2024-05-09T05:15:31.552 INFO:root:teuthology version: 0.0.1.dev271+g1ae7ad8 2024-05-09T05:15:31.552 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --name pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi --archive /home/teuthworker/archive/pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi/7699118 --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/no 5-quiesce/no 6-workunit/suites/dbench}} --owner scheduled_pdonnell@teuthology -- /home/teuthworker/archive/pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi/7699118/orig.config.yaml 2024-05-09T05:15:31.612 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-09T05:15:31.697 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi/7699118 branch: wip-pdonnell-testing-20240508.183908-debug description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/no 5-quiesce/no 6-workunit/suites/dbench}} email: pdonnell@redhat.com first_in_suite: false job_id: '7699118' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-pdonnell-testing-20240508.183908-debug ceph: cephfs: max_mds: 3 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_bal_replicate_threshold: 1 mds_export_ephemeral_random_max: 0.1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: c9da4049f638c0f84bdd9b4e33c42e86046ac554 subvols: create: 2 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt install: ceph: flavor: default sha1: c9da4049f638c0f84bdd9b4e33c42e86046ac554 kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=secure - wsync syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20240508.183908-debug sha1: c9da4049f638c0f84bdd9b4e33c42e86046ac554 owner: scheduled_pdonnell@teuthology priority: 90 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 1722 sha1: c9da4049f638c0f84bdd9b4e33c42e86046ac554 sleep_before_teardown: 0 subset: 67/512 suite: fs suite_branch: wip-pdonnell-testing-20240508.183908-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_c9da4049f638c0f84bdd9b4e33c42e86046ac554/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: c9da4049f638c0f84bdd9b4e33c42e86046ac554 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi039.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMfsWBMrefvZJKA35My6Vb0SYMlzkSWMU7qQjS9mI8QJ5nS8Y+Y4zIh8Pl/x8hOdRVtBjLQ3jreV11tlnPq7kAQ= smithi060.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIyMsQ+pXjy7SWIXEmTSaIamvGq1HdivvKGQGMmaLiaggLr0j8C8c1GgZolDRQBxUwAuTn6+bHYBioteyZipxlE= smithi100.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEboqiHBZGmBr9g+VKzcbRE2waQHs7YPjawDfcRnl5pMZ7l4WkRphIVLFIRQGd0c8UvNlc1aGA4Br5MRvjcPnEo= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate false - ceph fs subvolumegroup pin cephfs qa random 0.10 - check-counter: {} - workunit: clients: all: - suites/dbench.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 1ae7ad82388e92a475afff437d49054826c019a1 timestamp: 2024-05-08_22:06:20 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-05-09T05:15:31.697 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_c9da4049f638c0f84bdd9b4e33c42e86046ac554/qa; will attempt to use it 2024-05-09T05:15:31.698 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_c9da4049f638c0f84bdd9b4e33c42e86046ac554/qa/tasks 2024-05-09T05:15:31.698 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-05-09T05:15:31.700 INFO:teuthology.task.internal:Checking packages... 2024-05-09T05:15:31.723 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'c9da4049f638c0f84bdd9b4e33c42e86046ac554' 2024-05-09T05:15:31.723 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-09T05:15:31.723 INFO:teuthology.packaging:ref: None 2024-05-09T05:15:31.723 INFO:teuthology.packaging:tag: None 2024-05-09T05:15:31.723 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20240508.183908-debug 2024-05-09T05:15:31.723 INFO:teuthology.packaging:sha1: c9da4049f638c0f84bdd9b4e33c42e86046ac554 2024-05-09T05:15:31.723 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-pdonnell-testing-20240508.183908-debug 2024-05-09T05:15:31.955 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3594.gc9da4049 2024-05-09T05:15:31.956 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-05-09T05:15:31.963 INFO:teuthology.task.internal:no buildpackages task found 2024-05-09T05:15:31.963 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-05-09T05:15:31.969 INFO:teuthology.task.internal:Saving configuration 2024-05-09T05:15:31.991 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-05-09T05:15:31.997 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-09T05:15:32.024 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi039.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi/7699118', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-09 05:09:42.379897', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMfsWBMrefvZJKA35My6Vb0SYMlzkSWMU7qQjS9mI8QJ5nS8Y+Y4zIh8Pl/x8hOdRVtBjLQ3jreV11tlnPq7kAQ='} 2024-05-09T05:15:32.048 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi060.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi/7699118', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-09 05:09:42.382265', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIyMsQ+pXjy7SWIXEmTSaIamvGq1HdivvKGQGMmaLiaggLr0j8C8c1GgZolDRQBxUwAuTn6+bHYBioteyZipxlE='} 2024-05-09T05:15:32.073 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi100.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi/7699118', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-09 05:09:42.381219', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEboqiHBZGmBr9g+VKzcbRE2waQHs7YPjawDfcRnl5pMZ7l4WkRphIVLFIRQGd0c8UvNlc1aGA4Br5MRvjcPnEo='} 2024-05-09T05:15:32.073 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-05-09T05:15:32.080 INFO:teuthology.task.internal:roles: ubuntu@smithi039.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-05-09T05:15:32.080 INFO:teuthology.task.internal:roles: ubuntu@smithi060.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-05-09T05:15:32.080 INFO:teuthology.task.internal:roles: ubuntu@smithi100.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-05-09T05:15:32.080 INFO:teuthology.run_tasks:Running task console_log... 2024-05-09T05:15:32.187 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fc6f27c1f70>, signals=[15]) 2024-05-09T05:15:32.187 INFO:teuthology.run_tasks:Running task internal.connect... 2024-05-09T05:15:32.194 INFO:teuthology.task.internal:Opening connections... 2024-05-09T05:15:32.194 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi039.front.sepia.ceph.com 2024-05-09T05:15:32.196 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T05:15:32.274 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi060.front.sepia.ceph.com 2024-05-09T05:15:32.275 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T05:15:32.350 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi100.front.sepia.ceph.com 2024-05-09T05:15:32.351 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T05:15:32.424 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-05-09T05:15:32.431 DEBUG:teuthology.orchestra.run.smithi039:> uname -m 2024-05-09T05:15:32.450 INFO:teuthology.orchestra.run.smithi039.stdout:x86_64 2024-05-09T05:15:32.450 DEBUG:teuthology.orchestra.run.smithi039:> cat /etc/os-release 2024-05-09T05:15:32.508 INFO:teuthology.orchestra.run.smithi039.stdout:NAME="CentOS Stream" 2024-05-09T05:15:32.508 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION="9" 2024-05-09T05:15:32.508 INFO:teuthology.orchestra.run.smithi039.stdout:ID="centos" 2024-05-09T05:15:32.508 INFO:teuthology.orchestra.run.smithi039.stdout:ID_LIKE="rhel fedora" 2024-05-09T05:15:32.508 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION_ID="9" 2024-05-09T05:15:32.508 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM_ID="platform:el9" 2024-05-09T05:15:32.508 INFO:teuthology.orchestra.run.smithi039.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-09T05:15:32.508 INFO:teuthology.orchestra.run.smithi039.stdout:ANSI_COLOR="0;31" 2024-05-09T05:15:32.509 INFO:teuthology.orchestra.run.smithi039.stdout:LOGO="fedora-logo-icon" 2024-05-09T05:15:32.509 INFO:teuthology.orchestra.run.smithi039.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-09T05:15:32.509 INFO:teuthology.orchestra.run.smithi039.stdout:HOME_URL="https://centos.org/" 2024-05-09T05:15:32.509 INFO:teuthology.orchestra.run.smithi039.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-09T05:15:32.509 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-09T05:15:32.509 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-09T05:15:32.509 INFO:teuthology.lock.ops:Updating smithi039.front.sepia.ceph.com on lock server 2024-05-09T05:15:32.533 DEBUG:teuthology.orchestra.run.smithi060:> uname -m 2024-05-09T05:15:32.554 INFO:teuthology.orchestra.run.smithi060.stdout:x86_64 2024-05-09T05:15:32.554 DEBUG:teuthology.orchestra.run.smithi060:> cat /etc/os-release 2024-05-09T05:15:32.612 INFO:teuthology.orchestra.run.smithi060.stdout:NAME="CentOS Stream" 2024-05-09T05:15:32.612 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION="9" 2024-05-09T05:15:32.612 INFO:teuthology.orchestra.run.smithi060.stdout:ID="centos" 2024-05-09T05:15:32.612 INFO:teuthology.orchestra.run.smithi060.stdout:ID_LIKE="rhel fedora" 2024-05-09T05:15:32.613 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION_ID="9" 2024-05-09T05:15:32.613 INFO:teuthology.orchestra.run.smithi060.stdout:PLATFORM_ID="platform:el9" 2024-05-09T05:15:32.613 INFO:teuthology.orchestra.run.smithi060.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-09T05:15:32.613 INFO:teuthology.orchestra.run.smithi060.stdout:ANSI_COLOR="0;31" 2024-05-09T05:15:32.613 INFO:teuthology.orchestra.run.smithi060.stdout:LOGO="fedora-logo-icon" 2024-05-09T05:15:32.613 INFO:teuthology.orchestra.run.smithi060.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-09T05:15:32.613 INFO:teuthology.orchestra.run.smithi060.stdout:HOME_URL="https://centos.org/" 2024-05-09T05:15:32.613 INFO:teuthology.orchestra.run.smithi060.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-09T05:15:32.613 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-09T05:15:32.613 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-09T05:15:32.614 INFO:teuthology.lock.ops:Updating smithi060.front.sepia.ceph.com on lock server 2024-05-09T05:15:32.641 DEBUG:teuthology.orchestra.run.smithi100:> uname -m 2024-05-09T05:15:32.658 INFO:teuthology.orchestra.run.smithi100.stdout:x86_64 2024-05-09T05:15:32.658 DEBUG:teuthology.orchestra.run.smithi100:> cat /etc/os-release 2024-05-09T05:15:32.715 INFO:teuthology.orchestra.run.smithi100.stdout:NAME="CentOS Stream" 2024-05-09T05:15:32.716 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION="9" 2024-05-09T05:15:32.716 INFO:teuthology.orchestra.run.smithi100.stdout:ID="centos" 2024-05-09T05:15:32.716 INFO:teuthology.orchestra.run.smithi100.stdout:ID_LIKE="rhel fedora" 2024-05-09T05:15:32.716 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION_ID="9" 2024-05-09T05:15:32.716 INFO:teuthology.orchestra.run.smithi100.stdout:PLATFORM_ID="platform:el9" 2024-05-09T05:15:32.716 INFO:teuthology.orchestra.run.smithi100.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-09T05:15:32.716 INFO:teuthology.orchestra.run.smithi100.stdout:ANSI_COLOR="0;31" 2024-05-09T05:15:32.716 INFO:teuthology.orchestra.run.smithi100.stdout:LOGO="fedora-logo-icon" 2024-05-09T05:15:32.716 INFO:teuthology.orchestra.run.smithi100.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-09T05:15:32.716 INFO:teuthology.orchestra.run.smithi100.stdout:HOME_URL="https://centos.org/" 2024-05-09T05:15:32.716 INFO:teuthology.orchestra.run.smithi100.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-09T05:15:32.716 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-09T05:15:32.716 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-09T05:15:32.717 INFO:teuthology.lock.ops:Updating smithi100.front.sepia.ceph.com on lock server 2024-05-09T05:15:32.740 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-05-09T05:15:32.754 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-05-09T05:15:32.760 INFO:teuthology.task.internal:Checking for old test directory... 2024-05-09T05:15:32.760 DEBUG:teuthology.orchestra.run.smithi039:> test '!' -e /home/ubuntu/cephtest 2024-05-09T05:15:32.763 DEBUG:teuthology.orchestra.run.smithi060:> test '!' -e /home/ubuntu/cephtest 2024-05-09T05:15:32.765 DEBUG:teuthology.orchestra.run.smithi100:> test '!' -e /home/ubuntu/cephtest 2024-05-09T05:15:32.782 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-05-09T05:15:32.888 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-05-09T05:15:32.888 DEBUG:teuthology.orchestra.run.smithi039:> test -z $(ls -A /var/lib/ceph) 2024-05-09T05:15:32.890 DEBUG:teuthology.orchestra.run.smithi060:> test -z $(ls -A /var/lib/ceph) 2024-05-09T05:15:32.893 DEBUG:teuthology.orchestra.run.smithi100:> test -z $(ls -A /var/lib/ceph) 2024-05-09T05:15:32.924 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-05-09T05:15:33.006 INFO:teuthology.run_tasks:Running task kernel... 2024-05-09T05:15:33.021 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-05-09T05:15:33.021 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-05-09T05:15:33.021 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-05-09T05:15:33.022 DEBUG:teuthology.orchestra.run.smithi039:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-09T05:15:33.039 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T05:15:33.039 DEBUG:teuthology.orchestra.run.smithi039:> uname -r 2024-05-09T05:15:33.097 INFO:teuthology.orchestra.run.smithi039.stdout:5.14.0-437.el9.x86_64 2024-05-09T05:15:33.098 INFO:teuthology.task.kernel:Running kernel on smithi039: 5.14.0-437.el9.x86_64 2024-05-09T05:15:33.098 DEBUG:teuthology.orchestra.run.smithi039:> sudo yum install -y kernel 2024-05-09T05:15:35.689 INFO:teuthology.orchestra.run.smithi039.stdout:CentOS Stream 9 - BaseOS 8.1 MB/s | 8.1 MB 00:00 2024-05-09T05:15:38.924 INFO:teuthology.orchestra.run.smithi039.stdout:CentOS Stream 9 - AppStream 9.0 MB/s | 19 MB 00:02 2024-05-09T05:15:45.590 INFO:teuthology.orchestra.run.smithi039.stdout:CentOS Stream 9 - CRB 2.1 MB/s | 6.2 MB 00:02 2024-05-09T05:15:47.357 INFO:teuthology.orchestra.run.smithi039.stdout:CentOS Stream 9 - Extras packages 32 kB/s | 16 kB 00:00 2024-05-09T05:15:50.208 INFO:teuthology.orchestra.run.smithi039.stdout:Extra Packages for Enterprise Linux 7.8 MB/s | 21 MB 00:02 2024-05-09T05:15:55.583 INFO:teuthology.orchestra.run.smithi039.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-05-09T05:15:57.714 INFO:teuthology.orchestra.run.smithi039.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-05-09T05:15:57.714 INFO:teuthology.orchestra.run.smithi039.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-05-09T05:15:57.806 INFO:teuthology.orchestra.run.smithi039.stdout:Dependencies resolved. 2024-05-09T05:15:57.819 INFO:teuthology.orchestra.run.smithi039.stdout:================================================================================ 2024-05-09T05:15:57.819 INFO:teuthology.orchestra.run.smithi039.stdout: Package Architecture Version Repository Size 2024-05-09T05:15:57.819 INFO:teuthology.orchestra.run.smithi039.stdout:================================================================================ 2024-05-09T05:15:57.819 INFO:teuthology.orchestra.run.smithi039.stdout:Installing: 2024-05-09T05:15:57.820 INFO:teuthology.orchestra.run.smithi039.stdout: kernel x86_64 5.14.0-444.el9 baseos 484 k 2024-05-09T05:15:57.820 INFO:teuthology.orchestra.run.smithi039.stdout:Installing dependencies: 2024-05-09T05:15:57.820 INFO:teuthology.orchestra.run.smithi039.stdout: kernel-core x86_64 5.14.0-444.el9 baseos 15 M 2024-05-09T05:15:57.820 INFO:teuthology.orchestra.run.smithi039.stdout: kernel-modules x86_64 5.14.0-444.el9 baseos 34 M 2024-05-09T05:15:57.820 INFO:teuthology.orchestra.run.smithi039.stdout: kernel-modules-core x86_64 5.14.0-444.el9 baseos 28 M 2024-05-09T05:15:57.820 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-09T05:15:57.820 INFO:teuthology.orchestra.run.smithi039.stdout:Transaction Summary 2024-05-09T05:15:57.820 INFO:teuthology.orchestra.run.smithi039.stdout:================================================================================ 2024-05-09T05:15:57.820 INFO:teuthology.orchestra.run.smithi039.stdout:Install 4 Packages 2024-05-09T05:15:57.820 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-09T05:15:57.821 INFO:teuthology.orchestra.run.smithi039.stdout:Total download size: 78 M 2024-05-09T05:15:57.821 INFO:teuthology.orchestra.run.smithi039.stdout:Installed size: 123 M 2024-05-09T05:15:57.821 INFO:teuthology.orchestra.run.smithi039.stdout:Downloading Packages: 2024-05-09T05:15:58.126 INFO:teuthology.orchestra.run.smithi039.stdout:(1/4): kernel-5.14.0-444.el9.x86_64.rpm 2.7 MB/s | 484 kB 00:00 2024-05-09T05:15:58.693 INFO:teuthology.orchestra.run.smithi039.stdout:(2/4): kernel-core-5.14.0-444.el9.x86_64.rpm 21 MB/s | 15 MB 00:00 2024-05-09T05:15:59.518 INFO:teuthology.orchestra.run.smithi039.stdout:(3/4): kernel-modules-core-5.14.0-444.el9.x86_6 20 MB/s | 28 MB 00:01 2024-05-09T05:15:59.869 INFO:teuthology.orchestra.run.smithi039.stdout:(4/4): kernel-modules-5.14.0-444.el9.x86_64.rpm 18 MB/s | 34 MB 00:01 2024-05-09T05:15:59.869 INFO:teuthology.orchestra.run.smithi039.stdout:-------------------------------------------------------------------------------- 2024-05-09T05:15:59.869 INFO:teuthology.orchestra.run.smithi039.stdout:Total 38 MB/s | 78 MB 00:02 2024-05-09T05:16:00.577 INFO:teuthology.orchestra.run.smithi039.stdout:Running transaction check 2024-05-09T05:16:00.987 INFO:teuthology.orchestra.run.smithi039.stdout:Transaction check succeeded. 2024-05-09T05:16:00.987 INFO:teuthology.orchestra.run.smithi039.stdout:Running transaction test 2024-05-09T05:16:01.958 INFO:teuthology.orchestra.run.smithi039.stdout:Transaction test succeeded. 2024-05-09T05:16:02.013 INFO:teuthology.orchestra.run.smithi039.stdout:Running transaction 2024-05-09T05:16:04.499 INFO:teuthology.orchestra.run.smithi039.stdout: Preparing : 1/1 2024-05-09T05:16:05.126 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : kernel-modules-core-5.14.0-444.el9.x86_64 1/4 2024-05-09T05:16:05.218 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-09T05:16:08.018 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-09T05:16:08.162 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-09T05:16:13.236 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-09T05:16:13.281 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : kernel-5.14.0-444.el9.x86_64 4/4 2024-05-09T05:16:18.373 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: kernel-modules-core-5.14.0-444.el9.x86_64 4/4 2024-05-09T05:16:49.483 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: kernel-core-5.14.0-444.el9.x86_64 4/4 2024-05-09T05:16:49.525 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: kernel-modules-5.14.0-444.el9.x86_64 4/4 2024-05-09T05:16:49.804 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: kernel-5.14.0-444.el9.x86_64 4/4 2024-05-09T05:16:49.804 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : kernel-5.14.0-444.el9.x86_64 1/4 2024-05-09T05:16:49.804 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-09T05:16:49.804 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-09T05:16:50.587 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : kernel-modules-core-5.14.0-444.el9.x86_64 4/4 2024-05-09T05:16:50.587 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-09T05:16:50.587 INFO:teuthology.orchestra.run.smithi039.stdout:Installed: 2024-05-09T05:16:50.587 INFO:teuthology.orchestra.run.smithi039.stdout: kernel-5.14.0-444.el9.x86_64 2024-05-09T05:16:50.587 INFO:teuthology.orchestra.run.smithi039.stdout: kernel-core-5.14.0-444.el9.x86_64 2024-05-09T05:16:50.588 INFO:teuthology.orchestra.run.smithi039.stdout: kernel-modules-5.14.0-444.el9.x86_64 2024-05-09T05:16:50.588 INFO:teuthology.orchestra.run.smithi039.stdout: kernel-modules-core-5.14.0-444.el9.x86_64 2024-05-09T05:16:50.588 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-09T05:16:50.588 INFO:teuthology.orchestra.run.smithi039.stdout:Complete! 2024-05-09T05:16:50.934 DEBUG:teuthology.orchestra.run.smithi039:> rpm -q kernel | sort -rV | head -n 1 2024-05-09T05:16:51.025 INFO:teuthology.orchestra.run.smithi039.stdout:kernel-5.14.0-444.el9.x86_64 2024-05-09T05:16:51.025 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-444.el9.x86_64 2024-05-09T05:16:51.025 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-437.el9.x86_64 Expected: 5.14.0-444.el9.x86_64 2024-05-09T05:16:51.025 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-09T05:16:51.025 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-09T05:16:51.025 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-05-09T05:16:51.026 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi039.front.sepia.ceph.com, path=None, version=distro) 2024-05-09T05:16:51.026 DEBUG:teuthology.orchestra.run.smithi039:> rpm -q kernel | sort -rV | head -n 1 2024-05-09T05:16:51.075 INFO:teuthology.orchestra.run.smithi039.stdout:kernel-5.14.0-444.el9.x86_64 2024-05-09T05:16:51.076 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-444.el9.x86_64 2024-05-09T05:16:51.076 DEBUG:teuthology.orchestra.run.smithi039:> sudo rpm -qi grub2-tools 2024-05-09T05:16:51.118 INFO:teuthology.orchestra.run.smithi039.stdout:Name : grub2-tools 2024-05-09T05:16:51.118 INFO:teuthology.orchestra.run.smithi039.stdout:Epoch : 1 2024-05-09T05:16:51.118 INFO:teuthology.orchestra.run.smithi039.stdout:Version : 2.06 2024-05-09T05:16:51.118 INFO:teuthology.orchestra.run.smithi039.stdout:Release : 68.el9 2024-05-09T05:16:51.119 INFO:teuthology.orchestra.run.smithi039.stdout:Architecture: x86_64 2024-05-09T05:16:51.119 INFO:teuthology.orchestra.run.smithi039.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-09T05:16:51.119 INFO:teuthology.orchestra.run.smithi039.stdout:Group : Unspecified 2024-05-09T05:16:51.119 INFO:teuthology.orchestra.run.smithi039.stdout:Size : 8264254 2024-05-09T05:16:51.119 INFO:teuthology.orchestra.run.smithi039.stdout:License : GPLv3+ 2024-05-09T05:16:51.119 INFO:teuthology.orchestra.run.smithi039.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-09T05:16:51.119 INFO:teuthology.orchestra.run.smithi039.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-09T05:16:51.119 INFO:teuthology.orchestra.run.smithi039.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-09T05:16:51.119 INFO:teuthology.orchestra.run.smithi039.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-09T05:16:51.119 INFO:teuthology.orchestra.run.smithi039.stdout:Packager : builder@centos.org 2024-05-09T05:16:51.119 INFO:teuthology.orchestra.run.smithi039.stdout:Vendor : CentOS 2024-05-09T05:16:51.119 INFO:teuthology.orchestra.run.smithi039.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-09T05:16:51.119 INFO:teuthology.orchestra.run.smithi039.stdout:Summary : Support tools for GRUB. 2024-05-09T05:16:51.119 INFO:teuthology.orchestra.run.smithi039.stdout:Description : 2024-05-09T05:16:51.120 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-09T05:16:51.120 INFO:teuthology.orchestra.run.smithi039.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-09T05:16:51.120 INFO:teuthology.orchestra.run.smithi039.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-09T05:16:51.120 INFO:teuthology.orchestra.run.smithi039.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-09T05:16:51.120 INFO:teuthology.orchestra.run.smithi039.stdout:hardware devices. 2024-05-09T05:16:51.120 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-09T05:16:51.120 INFO:teuthology.orchestra.run.smithi039.stdout:This subpackage provides tools for support of all platforms. 2024-05-09T05:16:51.121 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-09T05:16:51.121 INFO:teuthology.task.kernel:Updating grub on smithi039 to boot 5.14.0-444.el9.x86_64 2024-05-09T05:16:51.121 DEBUG:teuthology.orchestra.run.smithi039:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-09T05:16:51.764 INFO:teuthology.orchestra.run.smithi039.stderr:Generating grub configuration file ... 2024-05-09T05:16:53.175 INFO:teuthology.orchestra.run.smithi039.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-09T05:16:53.197 INFO:teuthology.orchestra.run.smithi039.stderr:done 2024-05-09T05:16:53.199 DEBUG:teuthology.orchestra.run.smithi039:> mktemp 2024-05-09T05:16:53.214 INFO:teuthology.orchestra.run.smithi039.stdout:/tmp/tmp.QL1SLZGNIp 2024-05-09T05:16:53.215 DEBUG:teuthology.orchestra.run.smithi039:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.QL1SLZGNIp 2024-05-09T05:16:53.285 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod 0666 /tmp/tmp.QL1SLZGNIp 2024-05-09T05:16:53.422 DEBUG:teuthology.orchestra.remote:smithi039:/tmp/tmp.QL1SLZGNIp is 6KB 2024-05-09T05:16:53.470 DEBUG:teuthology.orchestra.run.smithi039:> rm -fr /tmp/tmp.QL1SLZGNIp 2024-05-09T05:16:53.485 DEBUG:teuthology.orchestra.run.smithi039:> sudo /bin/ls /boot/loader/entries || true 2024-05-09T05:16:53.556 INFO:teuthology.orchestra.run.smithi039.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-09T05:16:53.556 INFO:teuthology.orchestra.run.smithi039.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-09T05:16:53.556 INFO:teuthology.orchestra.run.smithi039.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-09T05:16:53.556 INFO:teuthology.orchestra.run.smithi039.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-444.el9.x86_64.conf 2024-05-09T05:16:53.557 DEBUG:teuthology.orchestra.run.smithi039:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-5.14.0-444.el9.x86_64 2024-05-09T05:16:53.709 DEBUG:teuthology.orchestra.run.smithi039:> sudo shutdown -r now 2024-05-09T05:17:23.712 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-05-09T05:17:23.712 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi039.front.sepia.ceph.com' 2024-05-09T05:17:23.713 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T05:17:42.046 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.39 2024-05-09T05:17:51.047 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi039.front.sepia.ceph.com' 2024-05-09T05:17:51.048 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T05:17:54.110 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.39 2024-05-09T05:18:06.111 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi039.front.sepia.ceph.com' 2024-05-09T05:18:06.112 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T05:18:09.182 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.39 2024-05-09T05:18:24.183 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi039.front.sepia.ceph.com' 2024-05-09T05:18:24.185 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T05:18:27.263 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.39 2024-05-09T05:18:45.265 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi039.front.sepia.ceph.com' 2024-05-09T05:18:45.266 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T05:19:00.969 DEBUG:teuthology.orchestra.run.smithi039:> true 2024-05-09T05:19:01.446 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi039.front.sepia.ceph.com' 2024-05-09T05:19:01.447 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-444.el9.x86_64"... 2024-05-09T05:19:01.447 DEBUG:teuthology.orchestra.run.smithi039:> uname -r 2024-05-09T05:19:01.464 INFO:teuthology.orchestra.run.smithi039.stdout:5.14.0-444.el9.x86_64 2024-05-09T05:19:01.464 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-444.el9.x86_64 vs 5.14.0-444.el9.x86_64 2024-05-09T05:19:01.464 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-09T05:19:01.464 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-09T05:19:02.465 DEBUG:teuthology.parallel:result is None 2024-05-09T05:19:02.466 INFO:teuthology.run_tasks:Running task internal.base... 2024-05-09T05:19:02.474 INFO:teuthology.task.internal:Creating test directory... 2024-05-09T05:19:02.474 DEBUG:teuthology.orchestra.run.smithi039:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-09T05:19:02.477 DEBUG:teuthology.orchestra.run.smithi060:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-09T05:19:02.480 DEBUG:teuthology.orchestra.run.smithi100:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-09T05:19:02.498 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-05-09T05:19:02.505 INFO:teuthology.run_tasks:Running task internal.archive... 2024-05-09T05:19:02.514 INFO:teuthology.task.internal:Creating archive directory... 2024-05-09T05:19:02.514 DEBUG:teuthology.orchestra.run.smithi039:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-09T05:19:02.535 DEBUG:teuthology.orchestra.run.smithi060:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-09T05:19:02.539 DEBUG:teuthology.orchestra.run.smithi100:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-09T05:19:02.632 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-05-09T05:19:02.640 INFO:teuthology.task.internal:Enabling coredump saving... 2024-05-09T05:19:02.640 DEBUG:teuthology.orchestra.run.smithi060:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-09T05:19:02.657 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T05:19:02.658 DEBUG:teuthology.orchestra.run.smithi100:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-09T05:19:02.674 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T05:19:02.675 DEBUG:teuthology.orchestra.run.smithi039:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-09T05:19:02.681 DEBUG:teuthology.orchestra.run.smithi060:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-09T05:19:02.701 DEBUG:teuthology.orchestra.run.smithi100:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-09T05:19:02.731 INFO:teuthology.orchestra.run.smithi060.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-09T05:19:02.747 INFO:teuthology.orchestra.run.smithi060.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-09T05:19:02.750 INFO:teuthology.orchestra.run.smithi039.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-09T05:19:02.762 INFO:teuthology.orchestra.run.smithi100.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-09T05:19:02.781 INFO:teuthology.orchestra.run.smithi100.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-09T05:19:02.810 INFO:teuthology.orchestra.run.smithi039.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-09T05:19:02.811 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-05-09T05:19:02.820 INFO:teuthology.task.internal:Configuring sudo... 2024-05-09T05:19:02.821 DEBUG:teuthology.orchestra.run.smithi039:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-09T05:19:02.823 DEBUG:teuthology.orchestra.run.smithi060:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-09T05:19:02.825 DEBUG:teuthology.orchestra.run.smithi100:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-09T05:19:02.853 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-05-09T05:19:02.863 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-05-09T05:19:02.864 DEBUG:teuthology.orchestra.run.smithi039:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-09T05:19:02.889 DEBUG:teuthology.orchestra.run.smithi060:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-09T05:19:02.893 DEBUG:teuthology.orchestra.run.smithi100:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-09T05:19:02.910 DEBUG:teuthology.orchestra.run.smithi039:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-09T05:19:02.985 DEBUG:teuthology.orchestra.run.smithi039:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-09T05:19:03.028 DEBUG:teuthology.orchestra.run.smithi039:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-09T05:19:03.112 DEBUG:teuthology.orchestra.run.smithi039:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-09T05:19:03.155 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-05-09T05:19:03.155 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-09T05:19:03.262 DEBUG:teuthology.orchestra.run.smithi060:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-09T05:19:03.312 DEBUG:teuthology.orchestra.run.smithi060:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-09T05:19:03.365 DEBUG:teuthology.orchestra.run.smithi060:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-09T05:19:03.451 DEBUG:teuthology.orchestra.run.smithi060:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-09T05:19:03.493 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-05-09T05:19:03.493 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-09T05:19:03.561 DEBUG:teuthology.orchestra.run.smithi100:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-09T05:19:03.606 DEBUG:teuthology.orchestra.run.smithi100:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-09T05:19:03.666 DEBUG:teuthology.orchestra.run.smithi100:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-09T05:19:03.712 DEBUG:teuthology.orchestra.run.smithi100:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-09T05:19:03.752 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-05-09T05:19:03.752 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-09T05:19:03.818 DEBUG:teuthology.orchestra.run.smithi039:> sudo service rsyslog restart 2024-05-09T05:19:03.821 DEBUG:teuthology.orchestra.run.smithi060:> sudo service rsyslog restart 2024-05-09T05:19:03.824 DEBUG:teuthology.orchestra.run.smithi100:> sudo service rsyslog restart 2024-05-09T05:19:03.856 INFO:teuthology.orchestra.run.smithi060.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-09T05:19:03.885 INFO:teuthology.orchestra.run.smithi039.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-09T05:19:03.899 INFO:teuthology.orchestra.run.smithi100.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-09T05:19:04.337 INFO:teuthology.run_tasks:Running task internal.timer... 2024-05-09T05:19:04.350 INFO:teuthology.task.internal:Starting timer... 2024-05-09T05:19:04.350 INFO:teuthology.run_tasks:Running task pcp... 2024-05-09T05:19:04.363 INFO:teuthology.run_tasks:Running task selinux... 2024-05-09T05:19:04.374 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-05-09T05:19:04.375 DEBUG:teuthology.orchestra.run.smithi039:> sudo service auditd rotate 2024-05-09T05:19:04.434 INFO:teuthology.orchestra.run.smithi039.stdout:Rotating logs: 2024-05-09T05:19:04.436 DEBUG:teuthology.orchestra.run.smithi060:> sudo service auditd rotate 2024-05-09T05:19:04.529 INFO:teuthology.orchestra.run.smithi060.stdout:Rotating logs: 2024-05-09T05:19:04.532 DEBUG:teuthology.orchestra.run.smithi100:> sudo service auditd rotate 2024-05-09T05:19:04.590 INFO:teuthology.orchestra.run.smithi100.stdout:Rotating logs: 2024-05-09T05:19:04.592 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-05-09T05:19:04.593 DEBUG:teuthology.orchestra.run.smithi039:> /usr/sbin/getenforce 2024-05-09T05:19:04.617 INFO:teuthology.orchestra.run.smithi039.stdout:Permissive 2024-05-09T05:19:04.617 DEBUG:teuthology.orchestra.run.smithi060:> /usr/sbin/getenforce 2024-05-09T05:19:04.669 INFO:teuthology.orchestra.run.smithi060.stdout:Permissive 2024-05-09T05:19:04.670 DEBUG:teuthology.orchestra.run.smithi100:> /usr/sbin/getenforce 2024-05-09T05:19:04.713 INFO:teuthology.orchestra.run.smithi100.stdout:Permissive 2024-05-09T05:19:04.713 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi039.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi060.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi100.front.sepia.ceph.com': 'permissive'} 2024-05-09T05:19:04.714 DEBUG:teuthology.orchestra.run.smithi039:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-09T05:19:04.741 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T05:19:04.742 DEBUG:teuthology.orchestra.run.smithi060:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-09T05:19:04.769 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T05:19:04.770 DEBUG:teuthology.orchestra.run.smithi100:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-09T05:19:04.794 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T05:19:04.795 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-05-09T05:19:04.795 DEBUG:teuthology.orchestra.run.smithi039:> sudo /usr/sbin/setenforce permissive 2024-05-09T05:19:04.824 DEBUG:teuthology.orchestra.run.smithi060:> sudo /usr/sbin/setenforce permissive 2024-05-09T05:19:04.854 DEBUG:teuthology.orchestra.run.smithi100:> sudo /usr/sbin/setenforce permissive 2024-05-09T05:19:04.878 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-05-09T05:19:04.888 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-05-09T05:19:04.907 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-05-09T05:19:04.908 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi039.front.sepia.ceph.com,smithi060.front.sepia.ceph.com,smithi100.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-05-09T05:23:29.020 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi039.front.sepia.ceph.com'), Remote(name='ubuntu@smithi060.front.sepia.ceph.com'), Remote(name='ubuntu@smithi100.front.sepia.ceph.com')] 2024-05-09T05:23:29.021 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi039.front.sepia.ceph.com' 2024-05-09T05:23:29.022 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T05:23:29.100 DEBUG:teuthology.orchestra.run.smithi039:> true 2024-05-09T05:23:29.137 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi039.front.sepia.ceph.com' 2024-05-09T05:23:29.138 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi060.front.sepia.ceph.com' 2024-05-09T05:23:29.138 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T05:23:29.213 DEBUG:teuthology.orchestra.run.smithi060:> true 2024-05-09T05:23:29.290 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi060.front.sepia.ceph.com' 2024-05-09T05:23:29.291 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi100.front.sepia.ceph.com' 2024-05-09T05:23:29.291 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-09T05:23:29.365 DEBUG:teuthology.orchestra.run.smithi100:> true 2024-05-09T05:23:29.455 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi100.front.sepia.ceph.com' 2024-05-09T05:23:29.455 INFO:teuthology.run_tasks:Running task clock... 2024-05-09T05:23:29.466 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-05-09T05:23:29.466 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-09T05:23:29.466 DEBUG:teuthology.orchestra.run.smithi039:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-09T05:23:29.468 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-09T05:23:29.468 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-09T05:23:29.471 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-09T05:23:29.471 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-09T05:23:29.498 INFO:teuthology.orchestra.run.smithi039.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-09T05:23:29.499 INFO:teuthology.orchestra.run.smithi060.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-09T05:23:29.513 INFO:teuthology.orchestra.run.smithi060.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-09T05:23:29.514 INFO:teuthology.orchestra.run.smithi039.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-09T05:23:29.526 INFO:teuthology.orchestra.run.smithi100.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-09T05:23:29.537 INFO:teuthology.orchestra.run.smithi060.stderr:sudo: ntpd: command not found 2024-05-09T05:23:29.539 INFO:teuthology.orchestra.run.smithi039.stderr:sudo: ntpd: command not found 2024-05-09T05:23:29.541 INFO:teuthology.orchestra.run.smithi100.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-09T05:23:29.548 INFO:teuthology.orchestra.run.smithi060.stdout:506 Cannot talk to daemon 2024-05-09T05:23:29.551 INFO:teuthology.orchestra.run.smithi039.stdout:506 Cannot talk to daemon 2024-05-09T05:23:29.562 INFO:teuthology.orchestra.run.smithi060.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-09T05:23:29.565 INFO:teuthology.orchestra.run.smithi100.stderr:sudo: ntpd: command not found 2024-05-09T05:23:29.565 INFO:teuthology.orchestra.run.smithi039.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-09T05:23:29.575 INFO:teuthology.orchestra.run.smithi100.stdout:506 Cannot talk to daemon 2024-05-09T05:23:29.576 INFO:teuthology.orchestra.run.smithi060.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-09T05:23:29.580 INFO:teuthology.orchestra.run.smithi039.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-09T05:23:29.589 INFO:teuthology.orchestra.run.smithi100.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-09T05:23:29.603 INFO:teuthology.orchestra.run.smithi100.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-09T05:23:29.633 INFO:teuthology.orchestra.run.smithi060.stderr:bash: line 1: ntpq: command not found 2024-05-09T05:23:29.636 INFO:teuthology.orchestra.run.smithi039.stderr:bash: line 1: ntpq: command not found 2024-05-09T05:23:29.637 INFO:teuthology.orchestra.run.smithi060.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-09T05:23:29.637 INFO:teuthology.orchestra.run.smithi060.stdout:=============================================================================== 2024-05-09T05:23:29.637 INFO:teuthology.orchestra.run.smithi060.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T05:23:29.637 INFO:teuthology.orchestra.run.smithi060.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T05:23:29.637 INFO:teuthology.orchestra.run.smithi060.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T05:23:29.637 INFO:teuthology.orchestra.run.smithi060.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T05:23:29.639 INFO:teuthology.orchestra.run.smithi039.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-09T05:23:29.639 INFO:teuthology.orchestra.run.smithi039.stdout:=============================================================================== 2024-05-09T05:23:29.639 INFO:teuthology.orchestra.run.smithi039.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T05:23:29.639 INFO:teuthology.orchestra.run.smithi039.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T05:23:29.639 INFO:teuthology.orchestra.run.smithi039.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T05:23:29.640 INFO:teuthology.orchestra.run.smithi039.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T05:23:29.654 INFO:teuthology.orchestra.run.smithi100.stderr:bash: line 1: ntpq: command not found 2024-05-09T05:23:29.658 INFO:teuthology.orchestra.run.smithi100.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-09T05:23:29.658 INFO:teuthology.orchestra.run.smithi100.stdout:=============================================================================== 2024-05-09T05:23:29.658 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T05:23:29.658 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T05:23:29.658 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T05:23:29.658 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T05:23:29.659 INFO:teuthology.run_tasks:Running task install... 2024-05-09T05:23:29.666 DEBUG:teuthology.task.install:project ceph 2024-05-09T05:23:29.667 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'c9da4049f638c0f84bdd9b4e33c42e86046ac554'}} 2024-05-09T05:23:29.667 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'c9da4049f638c0f84bdd9b4e33c42e86046ac554'} 2024-05-09T05:23:29.667 INFO:teuthology.task.install:Using flavor: default 2024-05-09T05:23:29.674 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-05-09T05:23:29.674 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-05-09T05:23:29.675 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'c9da4049f638c0f84bdd9b4e33c42e86046ac554', 'tag': None, 'wait_for_package': False} 2024-05-09T05:23:29.675 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=c9da4049f638c0f84bdd9b4e33c42e86046ac554 2024-05-09T05:23:29.677 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'c9da4049f638c0f84bdd9b4e33c42e86046ac554', 'tag': None, 'wait_for_package': False} 2024-05-09T05:23:29.677 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=c9da4049f638c0f84bdd9b4e33c42e86046ac554 2024-05-09T05:23:29.678 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'c9da4049f638c0f84bdd9b4e33c42e86046ac554', 'tag': None, 'wait_for_package': False} 2024-05-09T05:23:29.678 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=c9da4049f638c0f84bdd9b4e33c42e86046ac554 2024-05-09T05:23:29.835 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/centos/9/flavors/default/ 2024-05-09T05:23:29.835 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3594.gc9da4049 2024-05-09T05:23:29.902 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/centos/9/flavors/default/ 2024-05-09T05:23:29.903 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3594.gc9da4049 2024-05-09T05:23:29.906 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/centos/9/flavors/default/ 2024-05-09T05:23:29.906 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3594.gc9da4049 2024-05-09T05:23:30.008 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-09T05:23:30.008 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-05-09T05:23:30.008 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-09T05:23:30.035 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-09T05:23:30.035 DEBUG:teuthology.orchestra.run.smithi039:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/c9da4049f638c0f84bdd9b4e33c42e86046ac554/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-09T05:23:30.070 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-09T05:23:30.070 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-05-09T05:23:30.070 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-09T05:23:30.078 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-09T05:23:30.078 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-05-09T05:23:30.078 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-09T05:23:30.096 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-09T05:23:30.096 DEBUG:teuthology.orchestra.run.smithi060:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/c9da4049f638c0f84bdd9b4e33c42e86046ac554/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-09T05:23:30.103 DEBUG:teuthology.orchestra.run.smithi039:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-09T05:23:30.104 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-09T05:23:30.104 DEBUG:teuthology.orchestra.run.smithi100:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/c9da4049f638c0f84bdd9b4e33c42e86046ac554/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-09T05:23:30.162 DEBUG:teuthology.orchestra.run.smithi060:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-09T05:23:30.169 DEBUG:teuthology.orchestra.run.smithi100:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-09T05:23:30.180 DEBUG:teuthology.orchestra.run.smithi039:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-09T05:23:30.236 DEBUG:teuthology.orchestra.run.smithi060:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-09T05:23:30.242 DEBUG:teuthology.orchestra.run.smithi100:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-09T05:23:30.246 INFO:teuthology.orchestra.run.smithi039.stdout:check_obsoletes = 1 2024-05-09T05:23:30.248 DEBUG:teuthology.orchestra.run.smithi039:> sudo yum clean all 2024-05-09T05:23:30.299 INFO:teuthology.orchestra.run.smithi060.stdout:check_obsoletes = 1 2024-05-09T05:23:30.301 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum clean all 2024-05-09T05:23:30.305 INFO:teuthology.orchestra.run.smithi100.stdout:check_obsoletes = 1 2024-05-09T05:23:30.306 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum clean all 2024-05-09T05:23:30.493 INFO:teuthology.orchestra.run.smithi039.stdout:54 files removed 2024-05-09T05:23:30.521 DEBUG:teuthology.orchestra.run.smithi039:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-09T05:23:30.532 INFO:teuthology.orchestra.run.smithi100.stdout:54 files removed 2024-05-09T05:23:30.536 INFO:teuthology.orchestra.run.smithi060.stdout:54 files removed 2024-05-09T05:23:30.559 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-09T05:23:30.564 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-09T05:23:31.288 INFO:teuthology.orchestra.run.smithi039.stdout:ceph packages for x86_64 175 kB/s | 84 kB 00:00 2024-05-09T05:23:31.293 INFO:teuthology.orchestra.run.smithi100.stdout:ceph packages for x86_64 177 kB/s | 84 kB 00:00 2024-05-09T05:23:31.306 INFO:teuthology.orchestra.run.smithi060.stdout:ceph packages for x86_64 178 kB/s | 84 kB 00:00 2024-05-09T05:23:31.690 INFO:teuthology.orchestra.run.smithi060.stdout:ceph noarch packages 35 kB/s | 12 kB 00:00 2024-05-09T05:23:31.697 INFO:teuthology.orchestra.run.smithi039.stdout:ceph noarch packages 33 kB/s | 12 kB 00:00 2024-05-09T05:23:31.902 INFO:teuthology.orchestra.run.smithi100.stdout:ceph noarch packages 21 kB/s | 12 kB 00:00 2024-05-09T05:23:32.097 INFO:teuthology.orchestra.run.smithi039.stdout:ceph source packages 5.4 kB/s | 1.9 kB 00:00 2024-05-09T05:23:32.266 INFO:teuthology.orchestra.run.smithi060.stdout:ceph source packages 3.5 kB/s | 1.9 kB 00:00 2024-05-09T05:23:32.328 INFO:teuthology.orchestra.run.smithi100.stdout:ceph source packages 4.9 kB/s | 1.9 kB 00:00 2024-05-09T05:23:32.891 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.1 MB 00:00 2024-05-09T05:23:33.286 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - BaseOS 8.7 MB/s | 8.1 MB 00:00 2024-05-09T05:23:33.897 INFO:teuthology.orchestra.run.smithi039.stdout:CentOS Stream 9 - BaseOS 4.6 MB/s | 8.1 MB 00:01 2024-05-09T05:23:35.073 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - AppStream 28 MB/s | 19 MB 00:00 2024-05-09T05:23:36.223 INFO:teuthology.orchestra.run.smithi039.stdout:CentOS Stream 9 - AppStream 16 MB/s | 19 MB 00:01 2024-05-09T05:23:37.375 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 9 - AppStream 5.7 MB/s | 19 MB 00:03 2024-05-09T05:23:39.630 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - CRB 6.2 MB/s | 6.2 MB 00:00 2024-05-09T05:23:40.416 INFO:teuthology.orchestra.run.smithi039.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.2 MB 00:00 2024-05-09T05:23:41.074 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - Extras packages 58 kB/s | 16 kB 00:00 2024-05-09T05:23:41.810 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 9 - CRB 9.9 MB/s | 6.2 MB 00:00 2024-05-09T05:23:42.933 INFO:teuthology.orchestra.run.smithi039.stdout:CentOS Stream 9 - Extras packages 13 kB/s | 16 kB 00:01 2024-05-09T05:23:43.352 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 9 - Extras packages 55 kB/s | 16 kB 00:00 2024-05-09T05:23:44.593 INFO:teuthology.orchestra.run.smithi100.stdout:Extra Packages for Enterprise Linux 6.2 MB/s | 21 MB 00:03 2024-05-09T05:23:45.554 INFO:teuthology.orchestra.run.smithi039.stdout:Extra Packages for Enterprise Linux 8.5 MB/s | 21 MB 00:02 2024-05-09T05:23:46.338 INFO:teuthology.orchestra.run.smithi060.stdout:Extra Packages for Enterprise Linux 7.4 MB/s | 21 MB 00:02 2024-05-09T05:23:49.857 INFO:teuthology.orchestra.run.smithi100.stdout:lab-extras 16 kB/s | 1.7 kB 00:00 2024-05-09T05:23:50.910 INFO:teuthology.orchestra.run.smithi039.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-05-09T05:23:51.729 INFO:teuthology.orchestra.run.smithi060.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-05-09T05:23:52.134 INFO:teuthology.orchestra.run.smithi100.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-09T05:23:52.134 INFO:teuthology.orchestra.run.smithi100.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-09T05:23:52.145 INFO:teuthology.orchestra.run.smithi100.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-09T05:23:52.146 INFO:teuthology.orchestra.run.smithi100.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-09T05:23:52.147 INFO:teuthology.orchestra.run.smithi100.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-09T05:23:52.148 INFO:teuthology.orchestra.run.smithi100.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-09T05:23:52.149 INFO:teuthology.orchestra.run.smithi100.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-09T05:23:52.151 INFO:teuthology.orchestra.run.smithi100.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-09T05:23:52.152 INFO:teuthology.orchestra.run.smithi100.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-09T05:23:52.214 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-05-09T05:23:52.229 INFO:teuthology.orchestra.run.smithi100.stdout:======================================================================================= 2024-05-09T05:23:52.229 INFO:teuthology.orchestra.run.smithi100.stdout: Package Arch Version Repository Size 2024-05-09T05:23:52.229 INFO:teuthology.orchestra.run.smithi100.stdout:======================================================================================= 2024-05-09T05:23:52.229 INFO:teuthology.orchestra.run.smithi100.stdout:Installing: 2024-05-09T05:23:52.229 INFO:teuthology.orchestra.run.smithi100.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-09T05:23:52.229 INFO:teuthology.orchestra.run.smithi100.stdout: ceph x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 6.6 k 2024-05-09T05:23:52.229 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-base x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 5.4 M 2024-05-09T05:23:52.229 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-fuse x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 863 k 2024-05-09T05:23:52.230 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 147 k 2024-05-09T05:23:52.230 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 1.5 M 2024-05-09T05:23:52.230 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 142 k 2024-05-09T05:23:52.230 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 3.5 M 2024-05-09T05:23:52.230 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 7.4 M 2024-05-09T05:23:52.230 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-rook noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 49 k 2024-05-09T05:23:52.230 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-radosgw x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 10 M 2024-05-09T05:23:52.230 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-test x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 43 M 2024-05-09T05:23:52.230 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-volume noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 273 k 2024-05-09T05:23:52.230 INFO:teuthology.orchestra.run.smithi100.stdout: cephadm noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 763 k 2024-05-09T05:23:52.230 INFO:teuthology.orchestra.run.smithi100.stdout: cephfs-mirror x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 224 k 2024-05-09T05:23:52.230 INFO:teuthology.orchestra.run.smithi100.stdout: cephfs-shell x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 27 k 2024-05-09T05:23:52.230 INFO:teuthology.orchestra.run.smithi100.stdout: cephfs-top noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 18 k 2024-05-09T05:23:52.231 INFO:teuthology.orchestra.run.smithi100.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-05-09T05:23:52.231 INFO:teuthology.orchestra.run.smithi100.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-09T05:23:52.231 INFO:teuthology.orchestra.run.smithi100.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-09T05:23:52.231 INFO:teuthology.orchestra.run.smithi100.stdout: libcephfs-devel x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 32 k 2024-05-09T05:23:52.231 INFO:teuthology.orchestra.run.smithi100.stdout: libcephfs2 x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 756 k 2024-05-09T05:23:52.231 INFO:teuthology.orchestra.run.smithi100.stdout: librados-devel x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 127 k 2024-05-09T05:23:52.231 INFO:teuthology.orchestra.run.smithi100.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-09T05:23:52.231 INFO:teuthology.orchestra.run.smithi100.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-09T05:23:52.231 INFO:teuthology.orchestra.run.smithi100.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-09T05:23:52.231 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-09T05:23:52.231 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-09T05:23:52.231 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-09T05:23:52.231 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cephfs x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 162 k 2024-05-09T05:23:52.231 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rados x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 321 k 2024-05-09T05:23:52.232 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rbd x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 301 k 2024-05-09T05:23:52.232 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rgw x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 99 k 2024-05-09T05:23:52.232 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-fuse x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 86 k 2024-05-09T05:23:52.232 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-mirror x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 3.0 M 2024-05-09T05:23:52.232 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-nbd x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 169 k 2024-05-09T05:23:52.232 INFO:teuthology.orchestra.run.smithi100.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-09T05:23:52.232 INFO:teuthology.orchestra.run.smithi100.stdout:Upgrading: 2024-05-09T05:23:52.232 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager x86_64 1:1.47.5-1.el9 baseos 2.3 M 2024-05-09T05:23:52.232 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-libnm x86_64 1:1.47.5-1.el9 baseos 1.8 M 2024-05-09T05:23:52.232 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-team x86_64 1:1.47.5-1.el9 baseos 42 k 2024-05-09T05:23:52.232 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-tui x86_64 1:1.47.5-1.el9 baseos 248 k 2024-05-09T05:23:52.232 INFO:teuthology.orchestra.run.smithi100.stdout: librados2 x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 3.3 M 2024-05-09T05:23:52.232 INFO:teuthology.orchestra.run.smithi100.stdout: librbd1 x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 3.1 M 2024-05-09T05:23:52.232 INFO:teuthology.orchestra.run.smithi100.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-09T05:23:52.232 INFO:teuthology.orchestra.run.smithi100.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-09T05:23:52.233 INFO:teuthology.orchestra.run.smithi100.stdout:Installing dependencies: 2024-05-09T05:23:52.233 INFO:teuthology.orchestra.run.smithi100.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-09T05:23:52.233 INFO:teuthology.orchestra.run.smithi100.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-09T05:23:52.233 INFO:teuthology.orchestra.run.smithi100.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-09T05:23:52.233 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-common x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 20 M 2024-05-09T05:23:52.233 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 34 k 2024-05-09T05:23:52.233 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mds x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 2.3 M 2024-05-09T05:23:52.233 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 274 k 2024-05-09T05:23:52.233 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mon x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 4.9 M 2024-05-09T05:23:52.233 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-osd x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 18 M 2024-05-09T05:23:52.233 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 16 k 2024-05-09T05:23:52.233 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-selinux x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 25 k 2024-05-09T05:23:52.233 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-09T05:23:52.233 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-09T05:23:52.234 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-09T05:23:52.234 INFO:teuthology.orchestra.run.smithi100.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-09T05:23:52.234 INFO:teuthology.orchestra.run.smithi100.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-09T05:23:52.234 INFO:teuthology.orchestra.run.smithi100.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-09T05:23:52.234 INFO:teuthology.orchestra.run.smithi100.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-09T05:23:52.234 INFO:teuthology.orchestra.run.smithi100.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-09T05:23:52.234 INFO:teuthology.orchestra.run.smithi100.stdout: libcephsqlite x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 158 k 2024-05-09T05:23:52.234 INFO:teuthology.orchestra.run.smithi100.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-09T05:23:52.234 INFO:teuthology.orchestra.run.smithi100.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-09T05:23:52.234 INFO:teuthology.orchestra.run.smithi100.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-09T05:23:52.234 INFO:teuthology.orchestra.run.smithi100.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-09T05:23:52.234 INFO:teuthology.orchestra.run.smithi100.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-09T05:23:52.234 INFO:teuthology.orchestra.run.smithi100.stdout: libradosstriper1 x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 497 k 2024-05-09T05:23:52.235 INFO:teuthology.orchestra.run.smithi100.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-09T05:23:52.235 INFO:teuthology.orchestra.run.smithi100.stdout: librgw2 x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 5.2 M 2024-05-09T05:23:52.235 INFO:teuthology.orchestra.run.smithi100.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-09T05:23:52.235 INFO:teuthology.orchestra.run.smithi100.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-09T05:23:52.235 INFO:teuthology.orchestra.run.smithi100.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-09T05:23:52.235 INFO:teuthology.orchestra.run.smithi100.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-09T05:23:52.235 INFO:teuthology.orchestra.run.smithi100.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-09T05:23:52.235 INFO:teuthology.orchestra.run.smithi100.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-05-09T05:23:52.235 INFO:teuthology.orchestra.run.smithi100.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-09T05:23:52.235 INFO:teuthology.orchestra.run.smithi100.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-09T05:23:52.235 INFO:teuthology.orchestra.run.smithi100.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-09T05:23:52.235 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-09T05:23:52.235 INFO:teuthology.orchestra.run.smithi100.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-09T05:23:52.235 INFO:teuthology.orchestra.run.smithi100.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-09T05:23:52.235 INFO:teuthology.orchestra.run.smithi100.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-09T05:23:52.236 INFO:teuthology.orchestra.run.smithi100.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-09T05:23:52.236 INFO:teuthology.orchestra.run.smithi100.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-09T05:23:52.236 INFO:teuthology.orchestra.run.smithi100.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-09T05:23:52.236 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-09T05:23:52.236 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ceph-argparse x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 45 k 2024-05-09T05:23:52.236 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ceph-common x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 135 k 2024-05-09T05:23:52.236 INFO:teuthology.orchestra.run.smithi100.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-09T05:23:52.236 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-09T05:23:52.236 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-09T05:23:52.236 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-09T05:23:52.236 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-05-09T05:23:52.236 INFO:teuthology.orchestra.run.smithi100.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-05-09T05:23:52.236 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-09T05:23:52.236 INFO:teuthology.orchestra.run.smithi100.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-09T05:23:52.237 INFO:teuthology.orchestra.run.smithi100.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-09T05:23:52.237 INFO:teuthology.orchestra.run.smithi100.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-09T05:23:52.237 INFO:teuthology.orchestra.run.smithi100.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-09T05:23:52.237 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-09T05:23:52.237 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-09T05:23:52.237 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-09T05:23:52.237 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-09T05:23:52.237 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-09T05:23:52.237 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-09T05:23:52.237 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-09T05:23:52.237 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-09T05:23:52.237 INFO:teuthology.orchestra.run.smithi100.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-09T05:23:52.237 INFO:teuthology.orchestra.run.smithi100.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-09T05:23:52.237 INFO:teuthology.orchestra.run.smithi100.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-09T05:23:52.237 INFO:teuthology.orchestra.run.smithi100.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-09T05:23:52.238 INFO:teuthology.orchestra.run.smithi100.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-09T05:23:52.238 INFO:teuthology.orchestra.run.smithi100.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-09T05:23:52.238 INFO:teuthology.orchestra.run.smithi100.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-09T05:23:52.238 INFO:teuthology.orchestra.run.smithi100.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-09T05:23:52.238 INFO:teuthology.orchestra.run.smithi100.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-09T05:23:52.238 INFO:teuthology.orchestra.run.smithi100.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-09T05:23:52.238 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-09T05:23:52.238 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-09T05:23:52.238 INFO:teuthology.orchestra.run.smithi100.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-09T05:23:52.238 INFO:teuthology.orchestra.run.smithi100.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-09T05:23:52.238 INFO:teuthology.orchestra.run.smithi100.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-09T05:23:52.238 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-09T05:23:52.238 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-09T05:23:52.238 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-09T05:23:52.239 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-09T05:23:52.239 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-05-09T05:23:52.239 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-09T05:23:52.239 INFO:teuthology.orchestra.run.smithi100.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-09T05:23:52.239 INFO:teuthology.orchestra.run.smithi100.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-09T05:23:52.239 INFO:teuthology.orchestra.run.smithi100.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-09T05:23:52.239 INFO:teuthology.orchestra.run.smithi100.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-09T05:23:52.239 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-09T05:23:52.239 INFO:teuthology.orchestra.run.smithi100.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-09T05:23:52.239 INFO:teuthology.orchestra.run.smithi100.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-09T05:23:52.239 INFO:teuthology.orchestra.run.smithi100.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-09T05:23:52.239 INFO:teuthology.orchestra.run.smithi100.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-09T05:23:52.239 INFO:teuthology.orchestra.run.smithi100.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-09T05:23:52.239 INFO:teuthology.orchestra.run.smithi100.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-05-09T05:23:52.239 INFO:teuthology.orchestra.run.smithi100.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-09T05:23:52.240 INFO:teuthology.orchestra.run.smithi100.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-09T05:23:52.240 INFO:teuthology.orchestra.run.smithi100.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-09T05:23:52.240 INFO:teuthology.orchestra.run.smithi100.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-09T05:23:52.240 INFO:teuthology.orchestra.run.smithi100.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-09T05:23:52.240 INFO:teuthology.orchestra.run.smithi100.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-09T05:23:52.240 INFO:teuthology.orchestra.run.smithi100.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-09T05:23:52.240 INFO:teuthology.orchestra.run.smithi100.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-09T05:23:52.240 INFO:teuthology.orchestra.run.smithi100.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-09T05:23:52.240 INFO:teuthology.orchestra.run.smithi100.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-09T05:23:52.240 INFO:teuthology.orchestra.run.smithi100.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-09T05:23:52.240 INFO:teuthology.orchestra.run.smithi100.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-09T05:23:52.240 INFO:teuthology.orchestra.run.smithi100.stdout:Installing weak dependencies: 2024-05-09T05:23:52.240 INFO:teuthology.orchestra.run.smithi100.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-09T05:23:52.240 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:23:52.240 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2024-05-09T05:23:52.241 INFO:teuthology.orchestra.run.smithi100.stdout:======================================================================================= 2024-05-09T05:23:52.241 INFO:teuthology.orchestra.run.smithi100.stdout:Install 148 Packages 2024-05-09T05:23:52.241 INFO:teuthology.orchestra.run.smithi100.stdout:Upgrade 8 Packages 2024-05-09T05:23:52.241 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:23:52.241 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 219 M 2024-05-09T05:23:52.241 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2024-05-09T05:23:53.353 INFO:teuthology.orchestra.run.smithi039.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-09T05:23:53.354 INFO:teuthology.orchestra.run.smithi039.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-09T05:23:53.365 INFO:teuthology.orchestra.run.smithi039.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-09T05:23:53.366 INFO:teuthology.orchestra.run.smithi039.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-09T05:23:53.367 INFO:teuthology.orchestra.run.smithi039.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-09T05:23:53.368 INFO:teuthology.orchestra.run.smithi039.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-09T05:23:53.369 INFO:teuthology.orchestra.run.smithi039.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-09T05:23:53.372 INFO:teuthology.orchestra.run.smithi039.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-09T05:23:53.372 INFO:teuthology.orchestra.run.smithi039.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-09T05:23:53.437 INFO:teuthology.orchestra.run.smithi039.stdout:Dependencies resolved. 2024-05-09T05:23:53.451 INFO:teuthology.orchestra.run.smithi039.stdout:======================================================================================= 2024-05-09T05:23:53.451 INFO:teuthology.orchestra.run.smithi039.stdout: Package Arch Version Repository Size 2024-05-09T05:23:53.451 INFO:teuthology.orchestra.run.smithi039.stdout:======================================================================================= 2024-05-09T05:23:53.451 INFO:teuthology.orchestra.run.smithi039.stdout:Installing: 2024-05-09T05:23:53.451 INFO:teuthology.orchestra.run.smithi039.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-09T05:23:53.451 INFO:teuthology.orchestra.run.smithi039.stdout: ceph x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 6.6 k 2024-05-09T05:23:53.451 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-base x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 5.4 M 2024-05-09T05:23:53.451 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-fuse x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 863 k 2024-05-09T05:23:53.451 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 147 k 2024-05-09T05:23:53.451 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 1.5 M 2024-05-09T05:23:53.451 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 142 k 2024-05-09T05:23:53.452 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 3.5 M 2024-05-09T05:23:53.452 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 7.4 M 2024-05-09T05:23:53.452 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-rook noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 49 k 2024-05-09T05:23:53.452 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-radosgw x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 10 M 2024-05-09T05:23:53.452 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-test x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 43 M 2024-05-09T05:23:53.452 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-volume noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 273 k 2024-05-09T05:23:53.452 INFO:teuthology.orchestra.run.smithi039.stdout: cephadm noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 763 k 2024-05-09T05:23:53.452 INFO:teuthology.orchestra.run.smithi039.stdout: cephfs-mirror x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 224 k 2024-05-09T05:23:53.452 INFO:teuthology.orchestra.run.smithi039.stdout: cephfs-shell x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 27 k 2024-05-09T05:23:53.452 INFO:teuthology.orchestra.run.smithi039.stdout: cephfs-top noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 18 k 2024-05-09T05:23:53.452 INFO:teuthology.orchestra.run.smithi039.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-05-09T05:23:53.452 INFO:teuthology.orchestra.run.smithi039.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-09T05:23:53.452 INFO:teuthology.orchestra.run.smithi039.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-09T05:23:53.453 INFO:teuthology.orchestra.run.smithi039.stdout: libcephfs-devel x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 32 k 2024-05-09T05:23:53.453 INFO:teuthology.orchestra.run.smithi039.stdout: libcephfs2 x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 756 k 2024-05-09T05:23:53.453 INFO:teuthology.orchestra.run.smithi039.stdout: librados-devel x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 127 k 2024-05-09T05:23:53.453 INFO:teuthology.orchestra.run.smithi039.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-09T05:23:53.453 INFO:teuthology.orchestra.run.smithi039.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-09T05:23:53.453 INFO:teuthology.orchestra.run.smithi039.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-09T05:23:53.453 INFO:teuthology.orchestra.run.smithi039.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-09T05:23:53.453 INFO:teuthology.orchestra.run.smithi039.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-09T05:23:53.453 INFO:teuthology.orchestra.run.smithi039.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-09T05:23:53.453 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cephfs x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 162 k 2024-05-09T05:23:53.453 INFO:teuthology.orchestra.run.smithi039.stdout: python3-rados x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 321 k 2024-05-09T05:23:53.453 INFO:teuthology.orchestra.run.smithi039.stdout: python3-rbd x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 301 k 2024-05-09T05:23:53.453 INFO:teuthology.orchestra.run.smithi039.stdout: python3-rgw x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 99 k 2024-05-09T05:23:53.453 INFO:teuthology.orchestra.run.smithi039.stdout: rbd-fuse x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 86 k 2024-05-09T05:23:53.453 INFO:teuthology.orchestra.run.smithi039.stdout: rbd-mirror x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 3.0 M 2024-05-09T05:23:53.454 INFO:teuthology.orchestra.run.smithi039.stdout: rbd-nbd x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 169 k 2024-05-09T05:23:53.454 INFO:teuthology.orchestra.run.smithi039.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-09T05:23:53.454 INFO:teuthology.orchestra.run.smithi039.stdout:Upgrading: 2024-05-09T05:23:53.454 INFO:teuthology.orchestra.run.smithi039.stdout: NetworkManager x86_64 1:1.47.5-1.el9 baseos 2.3 M 2024-05-09T05:23:53.454 INFO:teuthology.orchestra.run.smithi039.stdout: NetworkManager-libnm x86_64 1:1.47.5-1.el9 baseos 1.8 M 2024-05-09T05:23:53.454 INFO:teuthology.orchestra.run.smithi039.stdout: NetworkManager-team x86_64 1:1.47.5-1.el9 baseos 42 k 2024-05-09T05:23:53.454 INFO:teuthology.orchestra.run.smithi039.stdout: NetworkManager-tui x86_64 1:1.47.5-1.el9 baseos 248 k 2024-05-09T05:23:53.454 INFO:teuthology.orchestra.run.smithi039.stdout: librados2 x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 3.3 M 2024-05-09T05:23:53.454 INFO:teuthology.orchestra.run.smithi039.stdout: librbd1 x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 3.1 M 2024-05-09T05:23:53.454 INFO:teuthology.orchestra.run.smithi039.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-09T05:23:53.454 INFO:teuthology.orchestra.run.smithi039.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-09T05:23:53.454 INFO:teuthology.orchestra.run.smithi039.stdout:Installing dependencies: 2024-05-09T05:23:53.454 INFO:teuthology.orchestra.run.smithi039.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-09T05:23:53.455 INFO:teuthology.orchestra.run.smithi039.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-09T05:23:53.455 INFO:teuthology.orchestra.run.smithi039.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-09T05:23:53.455 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-common x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 20 M 2024-05-09T05:23:53.455 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 34 k 2024-05-09T05:23:53.455 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mds x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 2.3 M 2024-05-09T05:23:53.455 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 274 k 2024-05-09T05:23:53.455 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mon x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 4.9 M 2024-05-09T05:23:53.455 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-osd x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 18 M 2024-05-09T05:23:53.455 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 16 k 2024-05-09T05:23:53.455 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-selinux x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 25 k 2024-05-09T05:23:53.455 INFO:teuthology.orchestra.run.smithi039.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-09T05:23:53.455 INFO:teuthology.orchestra.run.smithi039.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-09T05:23:53.455 INFO:teuthology.orchestra.run.smithi039.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-09T05:23:53.455 INFO:teuthology.orchestra.run.smithi039.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-09T05:23:53.455 INFO:teuthology.orchestra.run.smithi039.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-09T05:23:53.456 INFO:teuthology.orchestra.run.smithi039.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-09T05:23:53.456 INFO:teuthology.orchestra.run.smithi039.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-09T05:23:53.456 INFO:teuthology.orchestra.run.smithi039.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-09T05:23:53.456 INFO:teuthology.orchestra.run.smithi039.stdout: libcephsqlite x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 158 k 2024-05-09T05:23:53.456 INFO:teuthology.orchestra.run.smithi039.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-09T05:23:53.456 INFO:teuthology.orchestra.run.smithi039.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-09T05:23:53.456 INFO:teuthology.orchestra.run.smithi039.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-09T05:23:53.456 INFO:teuthology.orchestra.run.smithi039.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-09T05:23:53.456 INFO:teuthology.orchestra.run.smithi039.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-09T05:23:53.456 INFO:teuthology.orchestra.run.smithi039.stdout: libradosstriper1 x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 497 k 2024-05-09T05:23:53.456 INFO:teuthology.orchestra.run.smithi039.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-09T05:23:53.456 INFO:teuthology.orchestra.run.smithi039.stdout: librgw2 x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 5.2 M 2024-05-09T05:23:53.456 INFO:teuthology.orchestra.run.smithi039.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-09T05:23:53.456 INFO:teuthology.orchestra.run.smithi039.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-09T05:23:53.457 INFO:teuthology.orchestra.run.smithi039.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-09T05:23:53.457 INFO:teuthology.orchestra.run.smithi039.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-09T05:23:53.457 INFO:teuthology.orchestra.run.smithi039.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-09T05:23:53.457 INFO:teuthology.orchestra.run.smithi039.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-05-09T05:23:53.457 INFO:teuthology.orchestra.run.smithi039.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-09T05:23:53.457 INFO:teuthology.orchestra.run.smithi039.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-09T05:23:53.457 INFO:teuthology.orchestra.run.smithi039.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-09T05:23:53.457 INFO:teuthology.orchestra.run.smithi039.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-09T05:23:53.457 INFO:teuthology.orchestra.run.smithi039.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-09T05:23:53.457 INFO:teuthology.orchestra.run.smithi039.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-09T05:23:53.457 INFO:teuthology.orchestra.run.smithi039.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-09T05:23:53.457 INFO:teuthology.orchestra.run.smithi039.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-09T05:23:53.457 INFO:teuthology.orchestra.run.smithi039.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-09T05:23:53.457 INFO:teuthology.orchestra.run.smithi039.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-09T05:23:53.457 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-09T05:23:53.458 INFO:teuthology.orchestra.run.smithi039.stdout: python3-ceph-argparse x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 45 k 2024-05-09T05:23:53.458 INFO:teuthology.orchestra.run.smithi039.stdout: python3-ceph-common x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 135 k 2024-05-09T05:23:53.458 INFO:teuthology.orchestra.run.smithi039.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-09T05:23:53.458 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-09T05:23:53.458 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-09T05:23:53.458 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-09T05:23:53.458 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-05-09T05:23:53.458 INFO:teuthology.orchestra.run.smithi039.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-05-09T05:23:53.458 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-09T05:23:53.458 INFO:teuthology.orchestra.run.smithi039.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-09T05:23:53.458 INFO:teuthology.orchestra.run.smithi039.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-09T05:23:53.458 INFO:teuthology.orchestra.run.smithi039.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-09T05:23:53.458 INFO:teuthology.orchestra.run.smithi039.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-09T05:23:53.458 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-09T05:23:53.459 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-09T05:23:53.459 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-09T05:23:53.459 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-09T05:23:53.459 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-09T05:23:53.459 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-09T05:23:53.459 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-09T05:23:53.459 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-09T05:23:53.459 INFO:teuthology.orchestra.run.smithi039.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-09T05:23:53.459 INFO:teuthology.orchestra.run.smithi039.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-09T05:23:53.459 INFO:teuthology.orchestra.run.smithi039.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-09T05:23:53.459 INFO:teuthology.orchestra.run.smithi039.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-09T05:23:53.459 INFO:teuthology.orchestra.run.smithi039.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-09T05:23:53.459 INFO:teuthology.orchestra.run.smithi039.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-09T05:23:53.459 INFO:teuthology.orchestra.run.smithi039.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-09T05:23:53.460 INFO:teuthology.orchestra.run.smithi039.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-09T05:23:53.460 INFO:teuthology.orchestra.run.smithi039.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-09T05:23:53.460 INFO:teuthology.orchestra.run.smithi039.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-09T05:23:53.460 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-09T05:23:53.460 INFO:teuthology.orchestra.run.smithi039.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-09T05:23:53.460 INFO:teuthology.orchestra.run.smithi039.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-09T05:23:53.460 INFO:teuthology.orchestra.run.smithi039.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-09T05:23:53.460 INFO:teuthology.orchestra.run.smithi039.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-09T05:23:53.460 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-09T05:23:53.460 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-09T05:23:53.460 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-09T05:23:53.460 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-09T05:23:53.460 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-05-09T05:23:53.460 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-09T05:23:53.460 INFO:teuthology.orchestra.run.smithi039.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-09T05:23:53.461 INFO:teuthology.orchestra.run.smithi039.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-09T05:23:53.461 INFO:teuthology.orchestra.run.smithi039.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-09T05:23:53.461 INFO:teuthology.orchestra.run.smithi039.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-09T05:23:53.461 INFO:teuthology.orchestra.run.smithi039.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-09T05:23:53.461 INFO:teuthology.orchestra.run.smithi039.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-09T05:23:53.461 INFO:teuthology.orchestra.run.smithi039.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-09T05:23:53.461 INFO:teuthology.orchestra.run.smithi039.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-09T05:23:53.461 INFO:teuthology.orchestra.run.smithi039.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-09T05:23:53.461 INFO:teuthology.orchestra.run.smithi039.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-09T05:23:53.461 INFO:teuthology.orchestra.run.smithi039.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-05-09T05:23:53.461 INFO:teuthology.orchestra.run.smithi039.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-09T05:23:53.461 INFO:teuthology.orchestra.run.smithi039.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-09T05:23:53.461 INFO:teuthology.orchestra.run.smithi039.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-09T05:23:53.461 INFO:teuthology.orchestra.run.smithi039.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-09T05:23:53.461 INFO:teuthology.orchestra.run.smithi039.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-09T05:23:53.462 INFO:teuthology.orchestra.run.smithi039.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-09T05:23:53.462 INFO:teuthology.orchestra.run.smithi039.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-09T05:23:53.462 INFO:teuthology.orchestra.run.smithi039.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-09T05:23:53.462 INFO:teuthology.orchestra.run.smithi039.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-09T05:23:53.462 INFO:teuthology.orchestra.run.smithi039.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-09T05:23:53.462 INFO:teuthology.orchestra.run.smithi039.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-09T05:23:53.462 INFO:teuthology.orchestra.run.smithi039.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-09T05:23:53.462 INFO:teuthology.orchestra.run.smithi039.stdout:Installing weak dependencies: 2024-05-09T05:23:53.462 INFO:teuthology.orchestra.run.smithi039.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-09T05:23:53.462 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-09T05:23:53.462 INFO:teuthology.orchestra.run.smithi039.stdout:Transaction Summary 2024-05-09T05:23:53.462 INFO:teuthology.orchestra.run.smithi039.stdout:======================================================================================= 2024-05-09T05:23:53.462 INFO:teuthology.orchestra.run.smithi039.stdout:Install 148 Packages 2024-05-09T05:23:53.462 INFO:teuthology.orchestra.run.smithi039.stdout:Upgrade 8 Packages 2024-05-09T05:23:53.462 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-09T05:23:53.463 INFO:teuthology.orchestra.run.smithi039.stdout:Total download size: 219 M 2024-05-09T05:23:53.463 INFO:teuthology.orchestra.run.smithi039.stdout:Downloading Packages: 2024-05-09T05:23:53.608 INFO:teuthology.orchestra.run.smithi100.stdout:(1/156): ceph-19.0.0-3594.gc9da4049.el9.x86_64. 17 kB/s | 6.6 kB 00:00 2024-05-09T05:23:54.084 INFO:teuthology.orchestra.run.smithi100.stdout:(2/156): ceph-fuse-19.0.0-3594.gc9da4049.el9.x8 1.8 MB/s | 863 kB 00:00 2024-05-09T05:23:54.099 INFO:teuthology.orchestra.run.smithi060.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-09T05:23:54.099 INFO:teuthology.orchestra.run.smithi060.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-09T05:23:54.111 INFO:teuthology.orchestra.run.smithi060.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-09T05:23:54.112 INFO:teuthology.orchestra.run.smithi060.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-09T05:23:54.113 INFO:teuthology.orchestra.run.smithi060.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-09T05:23:54.113 INFO:teuthology.orchestra.run.smithi060.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-09T05:23:54.115 INFO:teuthology.orchestra.run.smithi060.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-09T05:23:54.117 INFO:teuthology.orchestra.run.smithi060.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-09T05:23:54.118 INFO:teuthology.orchestra.run.smithi060.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-09T05:23:54.176 INFO:teuthology.orchestra.run.smithi100.stdout:(3/156): ceph-immutable-object-cache-19.0.0-359 1.6 MB/s | 147 kB 00:00 2024-05-09T05:23:54.183 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2024-05-09T05:23:54.206 INFO:teuthology.orchestra.run.smithi060.stdout:======================================================================================= 2024-05-09T05:23:54.206 INFO:teuthology.orchestra.run.smithi060.stdout: Package Arch Version Repository Size 2024-05-09T05:23:54.207 INFO:teuthology.orchestra.run.smithi060.stdout:======================================================================================= 2024-05-09T05:23:54.207 INFO:teuthology.orchestra.run.smithi060.stdout:Installing: 2024-05-09T05:23:54.207 INFO:teuthology.orchestra.run.smithi060.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-09T05:23:54.207 INFO:teuthology.orchestra.run.smithi060.stdout: ceph x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 6.6 k 2024-05-09T05:23:54.207 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-base x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 5.4 M 2024-05-09T05:23:54.207 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-fuse x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 863 k 2024-05-09T05:23:54.207 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 147 k 2024-05-09T05:23:54.207 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 1.5 M 2024-05-09T05:23:54.207 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 142 k 2024-05-09T05:23:54.207 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 3.5 M 2024-05-09T05:23:54.207 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 7.4 M 2024-05-09T05:23:54.207 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-rook noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 49 k 2024-05-09T05:23:54.207 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-radosgw x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 10 M 2024-05-09T05:23:54.208 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-test x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 43 M 2024-05-09T05:23:54.208 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-volume noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 273 k 2024-05-09T05:23:54.208 INFO:teuthology.orchestra.run.smithi060.stdout: cephadm noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 763 k 2024-05-09T05:23:54.208 INFO:teuthology.orchestra.run.smithi060.stdout: cephfs-mirror x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 224 k 2024-05-09T05:23:54.208 INFO:teuthology.orchestra.run.smithi060.stdout: cephfs-shell x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 27 k 2024-05-09T05:23:54.208 INFO:teuthology.orchestra.run.smithi060.stdout: cephfs-top noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 18 k 2024-05-09T05:23:54.208 INFO:teuthology.orchestra.run.smithi060.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-05-09T05:23:54.208 INFO:teuthology.orchestra.run.smithi060.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-09T05:23:54.208 INFO:teuthology.orchestra.run.smithi060.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-09T05:23:54.208 INFO:teuthology.orchestra.run.smithi060.stdout: libcephfs-devel x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 32 k 2024-05-09T05:23:54.208 INFO:teuthology.orchestra.run.smithi060.stdout: libcephfs2 x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 756 k 2024-05-09T05:23:54.208 INFO:teuthology.orchestra.run.smithi060.stdout: librados-devel x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 127 k 2024-05-09T05:23:54.208 INFO:teuthology.orchestra.run.smithi060.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-09T05:23:54.209 INFO:teuthology.orchestra.run.smithi060.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-09T05:23:54.209 INFO:teuthology.orchestra.run.smithi060.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-09T05:23:54.209 INFO:teuthology.orchestra.run.smithi060.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-09T05:23:54.209 INFO:teuthology.orchestra.run.smithi060.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-09T05:23:54.209 INFO:teuthology.orchestra.run.smithi060.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-09T05:23:54.209 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cephfs x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 162 k 2024-05-09T05:23:54.209 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rados x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 321 k 2024-05-09T05:23:54.209 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rbd x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 301 k 2024-05-09T05:23:54.209 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rgw x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 99 k 2024-05-09T05:23:54.209 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-fuse x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 86 k 2024-05-09T05:23:54.209 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-mirror x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 3.0 M 2024-05-09T05:23:54.209 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-nbd x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 169 k 2024-05-09T05:23:54.210 INFO:teuthology.orchestra.run.smithi060.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-09T05:23:54.210 INFO:teuthology.orchestra.run.smithi060.stdout:Upgrading: 2024-05-09T05:23:54.210 INFO:teuthology.orchestra.run.smithi060.stdout: NetworkManager x86_64 1:1.47.5-1.el9 baseos 2.3 M 2024-05-09T05:23:54.210 INFO:teuthology.orchestra.run.smithi060.stdout: NetworkManager-libnm x86_64 1:1.47.5-1.el9 baseos 1.8 M 2024-05-09T05:23:54.210 INFO:teuthology.orchestra.run.smithi060.stdout: NetworkManager-team x86_64 1:1.47.5-1.el9 baseos 42 k 2024-05-09T05:23:54.210 INFO:teuthology.orchestra.run.smithi060.stdout: NetworkManager-tui x86_64 1:1.47.5-1.el9 baseos 248 k 2024-05-09T05:23:54.210 INFO:teuthology.orchestra.run.smithi060.stdout: librados2 x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 3.3 M 2024-05-09T05:23:54.210 INFO:teuthology.orchestra.run.smithi060.stdout: librbd1 x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 3.1 M 2024-05-09T05:23:54.210 INFO:teuthology.orchestra.run.smithi060.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-09T05:23:54.210 INFO:teuthology.orchestra.run.smithi060.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-09T05:23:54.210 INFO:teuthology.orchestra.run.smithi060.stdout:Installing dependencies: 2024-05-09T05:23:54.210 INFO:teuthology.orchestra.run.smithi060.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-09T05:23:54.211 INFO:teuthology.orchestra.run.smithi060.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-09T05:23:54.211 INFO:teuthology.orchestra.run.smithi060.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-09T05:23:54.211 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-common x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 20 M 2024-05-09T05:23:54.211 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 34 k 2024-05-09T05:23:54.211 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mds x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 2.3 M 2024-05-09T05:23:54.211 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 274 k 2024-05-09T05:23:54.211 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mon x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 4.9 M 2024-05-09T05:23:54.211 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-osd x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 18 M 2024-05-09T05:23:54.211 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3594.gc9da4049.el9 ceph-noarch 16 k 2024-05-09T05:23:54.211 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-selinux x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 25 k 2024-05-09T05:23:54.211 INFO:teuthology.orchestra.run.smithi060.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-09T05:23:54.211 INFO:teuthology.orchestra.run.smithi060.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-09T05:23:54.211 INFO:teuthology.orchestra.run.smithi060.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-09T05:23:54.212 INFO:teuthology.orchestra.run.smithi060.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-09T05:23:54.212 INFO:teuthology.orchestra.run.smithi060.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-09T05:23:54.212 INFO:teuthology.orchestra.run.smithi060.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-09T05:23:54.212 INFO:teuthology.orchestra.run.smithi060.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-09T05:23:54.212 INFO:teuthology.orchestra.run.smithi060.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-09T05:23:54.212 INFO:teuthology.orchestra.run.smithi060.stdout: libcephsqlite x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 158 k 2024-05-09T05:23:54.212 INFO:teuthology.orchestra.run.smithi060.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-09T05:23:54.212 INFO:teuthology.orchestra.run.smithi060.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-09T05:23:54.212 INFO:teuthology.orchestra.run.smithi060.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-09T05:23:54.212 INFO:teuthology.orchestra.run.smithi060.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-09T05:23:54.212 INFO:teuthology.orchestra.run.smithi060.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-09T05:23:54.212 INFO:teuthology.orchestra.run.smithi060.stdout: libradosstriper1 x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 497 k 2024-05-09T05:23:54.212 INFO:teuthology.orchestra.run.smithi060.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-09T05:23:54.212 INFO:teuthology.orchestra.run.smithi060.stdout: librgw2 x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 5.2 M 2024-05-09T05:23:54.213 INFO:teuthology.orchestra.run.smithi060.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-09T05:23:54.213 INFO:teuthology.orchestra.run.smithi060.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-09T05:23:54.213 INFO:teuthology.orchestra.run.smithi060.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-09T05:23:54.213 INFO:teuthology.orchestra.run.smithi060.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-09T05:23:54.213 INFO:teuthology.orchestra.run.smithi060.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-09T05:23:54.213 INFO:teuthology.orchestra.run.smithi060.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-05-09T05:23:54.213 INFO:teuthology.orchestra.run.smithi060.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-09T05:23:54.213 INFO:teuthology.orchestra.run.smithi060.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-09T05:23:54.213 INFO:teuthology.orchestra.run.smithi060.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-09T05:23:54.213 INFO:teuthology.orchestra.run.smithi060.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-09T05:23:54.213 INFO:teuthology.orchestra.run.smithi060.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-09T05:23:54.213 INFO:teuthology.orchestra.run.smithi060.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-09T05:23:54.214 INFO:teuthology.orchestra.run.smithi060.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-09T05:23:54.214 INFO:teuthology.orchestra.run.smithi060.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-09T05:23:54.214 INFO:teuthology.orchestra.run.smithi060.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-09T05:23:54.214 INFO:teuthology.orchestra.run.smithi060.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-09T05:23:54.214 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-09T05:23:54.214 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ceph-argparse x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 45 k 2024-05-09T05:23:54.214 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ceph-common x86_64 2:19.0.0-3594.gc9da4049.el9 ceph 135 k 2024-05-09T05:23:54.214 INFO:teuthology.orchestra.run.smithi060.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-09T05:23:54.214 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-09T05:23:54.214 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-09T05:23:54.214 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-09T05:23:54.214 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-05-09T05:23:54.215 INFO:teuthology.orchestra.run.smithi060.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-05-09T05:23:54.215 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-09T05:23:54.215 INFO:teuthology.orchestra.run.smithi060.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-09T05:23:54.215 INFO:teuthology.orchestra.run.smithi060.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-09T05:23:54.215 INFO:teuthology.orchestra.run.smithi060.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-09T05:23:54.215 INFO:teuthology.orchestra.run.smithi060.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-09T05:23:54.215 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-09T05:23:54.215 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-09T05:23:54.215 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-09T05:23:54.215 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-09T05:23:54.215 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-09T05:23:54.215 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-09T05:23:54.216 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-09T05:23:54.216 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-09T05:23:54.216 INFO:teuthology.orchestra.run.smithi060.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-09T05:23:54.216 INFO:teuthology.orchestra.run.smithi060.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-09T05:23:54.216 INFO:teuthology.orchestra.run.smithi060.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-09T05:23:54.216 INFO:teuthology.orchestra.run.smithi060.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-09T05:23:54.216 INFO:teuthology.orchestra.run.smithi060.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-09T05:23:54.216 INFO:teuthology.orchestra.run.smithi060.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-09T05:23:54.216 INFO:teuthology.orchestra.run.smithi060.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-09T05:23:54.216 INFO:teuthology.orchestra.run.smithi060.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-09T05:23:54.216 INFO:teuthology.orchestra.run.smithi060.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-09T05:23:54.216 INFO:teuthology.orchestra.run.smithi060.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-09T05:23:54.216 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-09T05:23:54.216 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-09T05:23:54.217 INFO:teuthology.orchestra.run.smithi060.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-09T05:23:54.217 INFO:teuthology.orchestra.run.smithi060.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-09T05:23:54.217 INFO:teuthology.orchestra.run.smithi060.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-09T05:23:54.217 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-09T05:23:54.217 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-09T05:23:54.217 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-09T05:23:54.217 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-09T05:23:54.217 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-05-09T05:23:54.217 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-09T05:23:54.217 INFO:teuthology.orchestra.run.smithi060.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-09T05:23:54.217 INFO:teuthology.orchestra.run.smithi060.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-09T05:23:54.217 INFO:teuthology.orchestra.run.smithi060.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-09T05:23:54.217 INFO:teuthology.orchestra.run.smithi060.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-09T05:23:54.217 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-09T05:23:54.218 INFO:teuthology.orchestra.run.smithi060.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-09T05:23:54.218 INFO:teuthology.orchestra.run.smithi060.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-09T05:23:54.218 INFO:teuthology.orchestra.run.smithi060.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-09T05:23:54.218 INFO:teuthology.orchestra.run.smithi060.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-09T05:23:54.218 INFO:teuthology.orchestra.run.smithi060.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-09T05:23:54.218 INFO:teuthology.orchestra.run.smithi060.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-05-09T05:23:54.218 INFO:teuthology.orchestra.run.smithi060.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-09T05:23:54.218 INFO:teuthology.orchestra.run.smithi060.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-09T05:23:54.218 INFO:teuthology.orchestra.run.smithi060.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-09T05:23:54.218 INFO:teuthology.orchestra.run.smithi060.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-09T05:23:54.218 INFO:teuthology.orchestra.run.smithi060.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-09T05:23:54.218 INFO:teuthology.orchestra.run.smithi060.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-09T05:23:54.218 INFO:teuthology.orchestra.run.smithi060.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-09T05:23:54.219 INFO:teuthology.orchestra.run.smithi060.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-09T05:23:54.219 INFO:teuthology.orchestra.run.smithi060.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-09T05:23:54.219 INFO:teuthology.orchestra.run.smithi060.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-09T05:23:54.219 INFO:teuthology.orchestra.run.smithi060.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-09T05:23:54.219 INFO:teuthology.orchestra.run.smithi060.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-09T05:23:54.219 INFO:teuthology.orchestra.run.smithi060.stdout:Installing weak dependencies: 2024-05-09T05:23:54.219 INFO:teuthology.orchestra.run.smithi060.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-09T05:23:54.219 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-05-09T05:23:54.219 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction Summary 2024-05-09T05:23:54.219 INFO:teuthology.orchestra.run.smithi060.stdout:======================================================================================= 2024-05-09T05:23:54.219 INFO:teuthology.orchestra.run.smithi060.stdout:Install 148 Packages 2024-05-09T05:23:54.219 INFO:teuthology.orchestra.run.smithi060.stdout:Upgrade 8 Packages 2024-05-09T05:23:54.219 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-05-09T05:23:54.220 INFO:teuthology.orchestra.run.smithi060.stdout:Total download size: 219 M 2024-05-09T05:23:54.220 INFO:teuthology.orchestra.run.smithi060.stdout:Downloading Packages: 2024-05-09T05:23:54.753 INFO:teuthology.orchestra.run.smithi039.stdout:(1/156): ceph-19.0.0-3594.gc9da4049.el9.x86_64. 15 kB/s | 6.6 kB 00:00 2024-05-09T05:23:54.884 INFO:teuthology.orchestra.run.smithi100.stdout:(4/156): ceph-common-19.0.0-3594.gc9da4049.el9. 12 MB/s | 20 MB 00:01 2024-05-09T05:23:54.934 INFO:teuthology.orchestra.run.smithi100.stdout:(5/156): ceph-mds-19.0.0-3594.gc9da4049.el9.x86 3.0 MB/s | 2.3 MB 00:00 2024-05-09T05:23:55.010 INFO:teuthology.orchestra.run.smithi100.stdout:(6/156): ceph-base-19.0.0-3594.gc9da4049.el9.x8 3.0 MB/s | 5.4 MB 00:01 2024-05-09T05:23:55.028 INFO:teuthology.orchestra.run.smithi039.stdout:(2/156): ceph-fuse-19.0.0-3594.gc9da4049.el9.x8 3.1 MB/s | 863 kB 00:00 2024-05-09T05:23:55.078 INFO:teuthology.orchestra.run.smithi100.stdout:(7/156): ceph-mgr-19.0.0-3594.gc9da4049.el9.x86 7.8 MB/s | 1.5 MB 00:00 2024-05-09T05:23:55.079 INFO:teuthology.orchestra.run.smithi039.stdout:(3/156): ceph-immutable-object-cache-19.0.0-359 2.9 MB/s | 147 kB 00:00 2024-05-09T05:23:55.306 INFO:teuthology.orchestra.run.smithi060.stdout:(1/156): ceph-19.0.0-3594.gc9da4049.el9.x86_64. 21 kB/s | 6.6 kB 00:00 2024-05-09T05:23:56.010 INFO:teuthology.orchestra.run.smithi100.stdout:(8/156): ceph-radosgw-19.0.0-3594.gc9da4049.el9 11 MB/s | 10 MB 00:00 2024-05-09T05:23:56.086 INFO:teuthology.orchestra.run.smithi100.stdout:(9/156): ceph-mon-19.0.0-3594.gc9da4049.el9.x86 4.2 MB/s | 4.9 MB 00:01 2024-05-09T05:23:56.111 INFO:teuthology.orchestra.run.smithi100.stdout:(10/156): ceph-selinux-19.0.0-3594.gc9da4049.el 251 kB/s | 25 kB 00:00 2024-05-09T05:23:56.178 INFO:teuthology.orchestra.run.smithi100.stdout:(11/156): cephfs-mirror-19.0.0-3594.gc9da4049.e 3.3 MB/s | 224 kB 00:00 2024-05-09T05:23:56.245 INFO:teuthology.orchestra.run.smithi100.stdout:(12/156): cephfs-shell-19.0.0-3594.gc9da4049.el 403 kB/s | 27 kB 00:00 2024-05-09T05:23:56.256 INFO:teuthology.orchestra.run.smithi060.stdout:(2/156): ceph-fuse-19.0.0-3594.gc9da4049.el9.x8 908 kB/s | 863 kB 00:00 2024-05-09T05:23:56.312 INFO:teuthology.orchestra.run.smithi100.stdout:(13/156): libcephfs-devel-19.0.0-3594.gc9da4049 477 kB/s | 32 kB 00:00 2024-05-09T05:23:56.439 INFO:teuthology.orchestra.run.smithi060.stdout:(3/156): ceph-immutable-object-cache-19.0.0-359 801 kB/s | 147 kB 00:00 2024-05-09T05:23:56.470 INFO:teuthology.orchestra.run.smithi100.stdout:(14/156): libcephfs2-19.0.0-3594.gc9da4049.el9. 4.7 MB/s | 756 kB 00:00 2024-05-09T05:23:56.554 INFO:teuthology.orchestra.run.smithi100.stdout:(15/156): libcephsqlite-19.0.0-3594.gc9da4049.e 1.9 MB/s | 158 kB 00:00 2024-05-09T05:23:56.638 INFO:teuthology.orchestra.run.smithi100.stdout:(16/156): librados-devel-19.0.0-3594.gc9da4049. 1.5 MB/s | 127 kB 00:00 2024-05-09T05:23:56.645 INFO:teuthology.orchestra.run.smithi039.stdout:(4/156): ceph-mds-19.0.0-3594.gc9da4049.el9.x86 1.4 MB/s | 2.3 MB 00:01 2024-05-09T05:23:56.746 INFO:teuthology.orchestra.run.smithi100.stdout:(17/156): libradosstriper1-19.0.0-3594.gc9da404 4.5 MB/s | 497 kB 00:00 2024-05-09T05:23:57.572 INFO:teuthology.orchestra.run.smithi100.stdout:(18/156): librgw2-19.0.0-3594.gc9da4049.el9.x86 6.3 MB/s | 5.2 MB 00:00 2024-05-09T05:23:57.596 INFO:teuthology.orchestra.run.smithi039.stdout:(5/156): ceph-base-19.0.0-3594.gc9da4049.el9.x8 1.6 MB/s | 5.4 MB 00:03 2024-05-09T05:23:57.622 INFO:teuthology.orchestra.run.smithi100.stdout:(19/156): python3-ceph-argparse-19.0.0-3594.gc9 907 kB/s | 45 kB 00:00 2024-05-09T05:23:57.648 INFO:teuthology.orchestra.run.smithi060.stdout:(4/156): ceph-base-19.0.0-3594.gc9da4049.el9.x8 2.0 MB/s | 5.4 MB 00:02 2024-05-09T05:23:57.697 INFO:teuthology.orchestra.run.smithi100.stdout:(20/156): python3-ceph-common-19.0.0-3594.gc9da 1.8 MB/s | 135 kB 00:00 2024-05-09T05:23:57.781 INFO:teuthology.orchestra.run.smithi100.stdout:(21/156): python3-cephfs-19.0.0-3594.gc9da4049. 1.9 MB/s | 162 kB 00:00 2024-05-09T05:23:57.864 INFO:teuthology.orchestra.run.smithi100.stdout:(22/156): python3-rados-19.0.0-3594.gc9da4049.e 3.8 MB/s | 321 kB 00:00 2024-05-09T05:23:58.012 INFO:teuthology.orchestra.run.smithi039.stdout:(6/156): ceph-mgr-19.0.0-3594.gc9da4049.el9.x86 1.1 MB/s | 1.5 MB 00:01 2024-05-09T05:23:58.048 INFO:teuthology.orchestra.run.smithi060.stdout:(5/156): ceph-mds-19.0.0-3594.gc9da4049.el9.x86 1.4 MB/s | 2.3 MB 00:01 2024-05-09T05:23:58.132 INFO:teuthology.orchestra.run.smithi060.stdout:(6/156): ceph-mgr-19.0.0-3594.gc9da4049.el9.x86 3.1 MB/s | 1.5 MB 00:00 2024-05-09T05:23:58.207 INFO:teuthology.orchestra.run.smithi100.stdout:(23/156): ceph-osd-19.0.0-3594.gc9da4049.el9.x8 5.6 MB/s | 18 MB 00:03 2024-05-09T05:23:58.232 INFO:teuthology.orchestra.run.smithi100.stdout:(24/156): python3-rbd-19.0.0-3594.gc9da4049.el9 819 kB/s | 301 kB 00:00 2024-05-09T05:23:58.290 INFO:teuthology.orchestra.run.smithi100.stdout:(25/156): python3-rgw-19.0.0-3594.gc9da4049.el9 1.2 MB/s | 99 kB 00:00 2024-05-09T05:23:58.557 INFO:teuthology.orchestra.run.smithi100.stdout:(26/156): rbd-fuse-19.0.0-3594.gc9da4049.el9.x8 263 kB/s | 86 kB 00:00 2024-05-09T05:23:58.641 INFO:teuthology.orchestra.run.smithi100.stdout:(27/156): rbd-nbd-19.0.0-3594.gc9da4049.el9.x86 2.0 MB/s | 169 kB 00:00 2024-05-09T05:23:58.724 INFO:teuthology.orchestra.run.smithi100.stdout:(28/156): ceph-grafana-dashboards-19.0.0-3594.g 412 kB/s | 34 kB 00:00 2024-05-09T05:23:58.808 INFO:teuthology.orchestra.run.smithi100.stdout:(29/156): ceph-mgr-cephadm-19.0.0-3594.gc9da404 1.7 MB/s | 142 kB 00:00 2024-05-09T05:23:58.950 INFO:teuthology.orchestra.run.smithi100.stdout:(30/156): rbd-mirror-19.0.0-3594.gc9da4049.el9. 4.6 MB/s | 3.0 MB 00:00 2024-05-09T05:23:59.500 INFO:teuthology.orchestra.run.smithi100.stdout:(31/156): ceph-mgr-dashboard-19.0.0-3594.gc9da4 5.1 MB/s | 3.5 MB 00:00 2024-05-09T05:23:59.601 INFO:teuthology.orchestra.run.smithi100.stdout:(32/156): ceph-mgr-modules-core-19.0.0-3594.gc9 2.7 MB/s | 274 kB 00:00 2024-05-09T05:23:59.668 INFO:teuthology.orchestra.run.smithi100.stdout:(33/156): ceph-mgr-rook-19.0.0-3594.gc9da4049.e 741 kB/s | 49 kB 00:00 2024-05-09T05:23:59.743 INFO:teuthology.orchestra.run.smithi100.stdout:(34/156): ceph-prometheus-alerts-19.0.0-3594.gc 219 kB/s | 16 kB 00:00 2024-05-09T05:23:59.826 INFO:teuthology.orchestra.run.smithi100.stdout:(35/156): ceph-volume-19.0.0-3594.gc9da4049.el9 3.2 MB/s | 273 kB 00:00 2024-05-09T05:24:00.046 INFO:teuthology.orchestra.run.smithi100.stdout:(36/156): cephadm-19.0.0-3594.gc9da4049.el9.noa 3.4 MB/s | 763 kB 00:00 2024-05-09T05:24:00.127 INFO:teuthology.orchestra.run.smithi100.stdout:(37/156): cephfs-top-19.0.0-3594.gc9da4049.el9. 227 kB/s | 18 kB 00:00 2024-05-09T05:24:00.236 INFO:teuthology.orchestra.run.smithi100.stdout:(38/156): fuse-2.9.9-15.el9.x86_64.rpm 743 kB/s | 80 kB 00:00 2024-05-09T05:24:00.403 INFO:teuthology.orchestra.run.smithi100.stdout:(39/156): ceph-mgr-diskprediction-local-19.0.0- 5.1 MB/s | 7.4 MB 00:01 2024-05-09T05:24:00.428 INFO:teuthology.orchestra.run.smithi100.stdout:(40/156): libgfortran-11.4.1-3.el9.x86_64.rpm 4.1 MB/s | 803 kB 00:00 2024-05-09T05:24:00.478 INFO:teuthology.orchestra.run.smithi100.stdout:(41/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.0 MB/s | 253 kB 00:00 2024-05-09T05:24:00.487 INFO:teuthology.orchestra.run.smithi039.stdout:(7/156): ceph-mon-19.0.0-3594.gc9da4049.el9.x86 1.7 MB/s | 4.9 MB 00:02 2024-05-09T05:24:00.524 INFO:teuthology.orchestra.run.smithi060.stdout:(7/156): ceph-mon-19.0.0-3594.gc9da4049.el9.x86 2.0 MB/s | 4.9 MB 00:02 2024-05-09T05:24:00.554 INFO:teuthology.orchestra.run.smithi100.stdout:(42/156): python3-cryptography-36.0.1-4.el9.x86 16 MB/s | 1.2 MB 00:00 2024-05-09T05:24:00.579 INFO:teuthology.orchestra.run.smithi100.stdout:(43/156): libquadmath-11.4.1-3.el9.x86_64.rpm 1.1 MB/s | 195 kB 00:00 2024-05-09T05:24:00.604 INFO:teuthology.orchestra.run.smithi100.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-05-09T05:24:00.980 INFO:teuthology.orchestra.run.smithi100.stdout:(45/156): ceph-test-19.0.0-3594.gc9da4049.el9.x 8.8 MB/s | 43 MB 00:04 2024-05-09T05:24:01.005 INFO:teuthology.orchestra.run.smithi100.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 312 kB/s | 125 kB 00:00 2024-05-09T05:24:01.030 INFO:teuthology.orchestra.run.smithi100.stdout:(47/156): python3-pycparser-2.20-6.el9.noarch.r 300 kB/s | 135 kB 00:00 2024-05-09T05:24:01.139 INFO:teuthology.orchestra.run.smithi100.stdout:(48/156): python3-urllib3-1.26.5-5.el9.noarch.r 1.3 MB/s | 215 kB 00:00 2024-05-09T05:24:01.847 INFO:teuthology.orchestra.run.smithi100.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 151 kB/s | 107 kB 00:00 2024-05-09T05:24:01.981 INFO:teuthology.orchestra.run.smithi100.stdout:(50/156): automake-1.16.2-8.el9.noarch.rpm 706 kB/s | 689 kB 00:00 2024-05-09T05:24:02.040 INFO:teuthology.orchestra.run.smithi100.stdout:(51/156): bison-3.7.4-5.el9.x86_64.rpm 934 kB/s | 943 kB 00:01 2024-05-09T05:24:02.221 INFO:teuthology.orchestra.run.smithi039.stdout:(8/156): ceph-common-19.0.0-3594.gc9da4049.el9. 2.5 MB/s | 20 MB 00:07 2024-05-09T05:24:02.271 INFO:teuthology.orchestra.run.smithi039.stdout:(9/156): ceph-selinux-19.0.0-3594.gc9da4049.el9 503 kB/s | 25 kB 00:00 2024-05-09T05:24:02.415 INFO:teuthology.orchestra.run.smithi100.stdout:(52/156): elfutils-libelf-devel-0.190-2.el9.x86 38 kB/s | 21 kB 00:00 2024-05-09T05:24:02.424 INFO:teuthology.orchestra.run.smithi060.stdout:(8/156): ceph-osd-19.0.0-3594.gc9da4049.el9.x86 4.1 MB/s | 18 MB 00:04 2024-05-09T05:24:02.482 INFO:teuthology.orchestra.run.smithi060.stdout:(9/156): ceph-selinux-19.0.0-3594.gc9da4049.el9 433 kB/s | 25 kB 00:00 2024-05-09T05:24:02.640 INFO:teuthology.orchestra.run.smithi100.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 54 kB/s | 33 kB 00:00 2024-05-09T05:24:02.824 INFO:teuthology.orchestra.run.smithi100.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 372 kB/s | 313 kB 00:00 2024-05-09T05:24:03.072 INFO:teuthology.orchestra.run.smithi039.stdout:(10/156): ceph-osd-19.0.0-3594.gc9da4049.el9.x8 3.5 MB/s | 18 MB 00:05 2024-05-09T05:24:03.139 INFO:teuthology.orchestra.run.smithi039.stdout:(11/156): cephfs-mirror-19.0.0-3594.gc9da4049.e 3.3 MB/s | 224 kB 00:00 2024-05-09T05:24:03.141 INFO:teuthology.orchestra.run.smithi060.stdout:(10/156): ceph-common-19.0.0-3594.gc9da4049.el9 2.4 MB/s | 20 MB 00:08 2024-05-09T05:24:03.181 INFO:teuthology.orchestra.run.smithi039.stdout:(12/156): cephfs-shell-19.0.0-3594.gc9da4049.el 649 kB/s | 27 kB 00:00 2024-05-09T05:24:03.199 INFO:teuthology.orchestra.run.smithi100.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 34 kB/s | 18 kB 00:00 2024-05-09T05:24:03.223 INFO:teuthology.orchestra.run.smithi039.stdout:(13/156): libcephfs-devel-19.0.0-3594.gc9da4049 763 kB/s | 32 kB 00:00 2024-05-09T05:24:03.224 INFO:teuthology.orchestra.run.smithi060.stdout:(11/156): cephfs-mirror-19.0.0-3594.gc9da4049.e 2.6 MB/s | 224 kB 00:00 2024-05-09T05:24:03.332 INFO:teuthology.orchestra.run.smithi100.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 22 kB/s | 11 kB 00:00 2024-05-09T05:24:03.333 INFO:teuthology.orchestra.run.smithi060.stdout:(12/156): ceph-radosgw-19.0.0-3594.gc9da4049.el 3.6 MB/s | 10 MB 00:02 2024-05-09T05:24:03.356 INFO:teuthology.orchestra.run.smithi039.stdout:(14/156): libcephfs2-19.0.0-3594.gc9da4049.el9. 5.5 MB/s | 756 kB 00:00 2024-05-09T05:24:03.392 INFO:teuthology.orchestra.run.smithi060.stdout:(13/156): libcephfs-devel-19.0.0-3594.gc9da4049 547 kB/s | 32 kB 00:00 2024-05-09T05:24:03.406 INFO:teuthology.orchestra.run.smithi039.stdout:(15/156): libcephsqlite-19.0.0-3594.gc9da4049.e 3.1 MB/s | 158 kB 00:00 2024-05-09T05:24:03.509 INFO:teuthology.orchestra.run.smithi060.stdout:(14/156): cephfs-shell-19.0.0-3594.gc9da4049.el 95 kB/s | 27 kB 00:00 2024-05-09T05:24:03.525 INFO:teuthology.orchestra.run.smithi100.stdout:(57/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.7 MB/s | 3.0 MB 00:01 2024-05-09T05:24:03.576 INFO:teuthology.orchestra.run.smithi060.stdout:(15/156): libcephsqlite-19.0.0-3594.gc9da4049.e 2.3 MB/s | 158 kB 00:00 2024-05-09T05:24:03.609 INFO:teuthology.orchestra.run.smithi060.stdout:(16/156): libcephfs2-19.0.0-3594.gc9da4049.el9. 3.4 MB/s | 756 kB 00:00 2024-05-09T05:24:03.635 INFO:teuthology.orchestra.run.smithi060.stdout:(17/156): librados-devel-19.0.0-3594.gc9da4049. 2.1 MB/s | 127 kB 00:00 2024-05-09T05:24:03.732 INFO:teuthology.orchestra.run.smithi039.stdout:(16/156): ceph-radosgw-19.0.0-3594.gc9da4049.el 3.1 MB/s | 10 MB 00:03 2024-05-09T05:24:03.743 INFO:teuthology.orchestra.run.smithi060.stdout:(18/156): libradosstriper1-19.0.0-3594.gc9da404 3.6 MB/s | 497 kB 00:00 2024-05-09T05:24:03.757 INFO:teuthology.orchestra.run.smithi039.stdout:(17/156): librados-devel-19.0.0-3594.gc9da4049. 361 kB/s | 127 kB 00:00 2024-05-09T05:24:03.802 INFO:teuthology.orchestra.run.smithi060.stdout:(19/156): python3-ceph-argparse-19.0.0-3594.gc9 772 kB/s | 45 kB 00:00 2024-05-09T05:24:03.869 INFO:teuthology.orchestra.run.smithi060.stdout:(20/156): python3-ceph-common-19.0.0-3594.gc9da 2.0 MB/s | 135 kB 00:00 2024-05-09T05:24:03.891 INFO:teuthology.orchestra.run.smithi039.stdout:(18/156): libradosstriper1-19.0.0-3594.gc9da404 3.1 MB/s | 497 kB 00:00 2024-05-09T05:24:03.944 INFO:teuthology.orchestra.run.smithi060.stdout:(21/156): python3-cephfs-19.0.0-3594.gc9da4049. 2.1 MB/s | 162 kB 00:00 2024-05-09T05:24:03.949 INFO:teuthology.orchestra.run.smithi039.stdout:(19/156): python3-ceph-argparse-19.0.0-3594.gc9 775 kB/s | 45 kB 00:00 2024-05-09T05:24:03.966 INFO:teuthology.orchestra.run.smithi100.stdout:(58/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 209 kB/s | 160 kB 00:00 2024-05-09T05:24:04.016 INFO:teuthology.orchestra.run.smithi039.stdout:(20/156): python3-ceph-common-19.0.0-3594.gc9da 2.0 MB/s | 135 kB 00:00 2024-05-09T05:24:04.042 INFO:teuthology.orchestra.run.smithi100.stdout:(59/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 65 kB/s | 45 kB 00:00 2024-05-09T05:24:04.053 INFO:teuthology.orchestra.run.smithi060.stdout:(22/156): python3-rados-19.0.0-3594.gc9da4049.e 2.9 MB/s | 321 kB 00:00 2024-05-09T05:24:04.091 INFO:teuthology.orchestra.run.smithi039.stdout:(21/156): python3-cephfs-19.0.0-3594.gc9da4049. 2.1 MB/s | 162 kB 00:00 2024-05-09T05:24:04.178 INFO:teuthology.orchestra.run.smithi060.stdout:(23/156): python3-rbd-19.0.0-3594.gc9da4049.el9 2.4 MB/s | 301 kB 00:00 2024-05-09T05:24:04.208 INFO:teuthology.orchestra.run.smithi039.stdout:(22/156): python3-rados-19.0.0-3594.gc9da4049.e 2.7 MB/s | 321 kB 00:00 2024-05-09T05:24:04.254 INFO:teuthology.orchestra.run.smithi060.stdout:(24/156): python3-rgw-19.0.0-3594.gc9da4049.el9 1.3 MB/s | 99 kB 00:00 2024-05-09T05:24:04.317 INFO:teuthology.orchestra.run.smithi039.stdout:(23/156): python3-rbd-19.0.0-3594.gc9da4049.el9 2.7 MB/s | 301 kB 00:00 2024-05-09T05:24:04.321 INFO:teuthology.orchestra.run.smithi060.stdout:(25/156): rbd-fuse-19.0.0-3594.gc9da4049.el9.x8 1.3 MB/s | 86 kB 00:00 2024-05-09T05:24:04.376 INFO:teuthology.orchestra.run.smithi039.stdout:(24/156): python3-rgw-19.0.0-3594.gc9da4049.el9 1.7 MB/s | 99 kB 00:00 2024-05-09T05:24:04.443 INFO:teuthology.orchestra.run.smithi039.stdout:(25/156): rbd-fuse-19.0.0-3594.gc9da4049.el9.x8 1.3 MB/s | 86 kB 00:00 2024-05-09T05:24:04.483 INFO:teuthology.orchestra.run.smithi100.stdout:(60/156): librdkafka-1.6.1-102.el9.x86_64.rpm 692 kB/s | 662 kB 00:00 2024-05-09T05:24:04.571 INFO:teuthology.orchestra.run.smithi060.stdout:(26/156): librgw2-19.0.0-3594.gc9da4049.el9.x86 5.5 MB/s | 5.2 MB 00:00 2024-05-09T05:24:04.600 INFO:teuthology.orchestra.run.smithi100.stdout:(61/156): libuuid-devel-2.37.4-18.el9.x86_64.rp 44 kB/s | 25 kB 00:00 2024-05-09T05:24:04.621 INFO:teuthology.orchestra.run.smithi060.stdout:(27/156): rbd-nbd-19.0.0-3594.gc9da4049.el9.x86 3.3 MB/s | 169 kB 00:00 2024-05-09T05:24:04.672 INFO:teuthology.orchestra.run.smithi060.stdout:(28/156): ceph-grafana-dashboards-19.0.0-3594.g 683 kB/s | 34 kB 00:00 2024-05-09T05:24:04.693 INFO:teuthology.orchestra.run.smithi039.stdout:(26/156): librgw2-19.0.0-3594.gc9da4049.el9.x86 5.5 MB/s | 5.2 MB 00:00 2024-05-09T05:24:04.730 INFO:teuthology.orchestra.run.smithi060.stdout:(29/156): ceph-mgr-cephadm-19.0.0-3594.gc9da404 2.4 MB/s | 142 kB 00:00 2024-05-09T05:24:04.743 INFO:teuthology.orchestra.run.smithi039.stdout:(27/156): rbd-nbd-19.0.0-3594.gc9da4049.el9.x86 3.3 MB/s | 169 kB 00:00 2024-05-09T05:24:04.802 INFO:teuthology.orchestra.run.smithi039.stdout:(28/156): ceph-grafana-dashboards-19.0.0-3594.g 586 kB/s | 34 kB 00:00 2024-05-09T05:24:04.860 INFO:teuthology.orchestra.run.smithi039.stdout:(29/156): ceph-mgr-cephadm-19.0.0-3594.gc9da404 2.4 MB/s | 142 kB 00:00 2024-05-09T05:24:04.875 INFO:teuthology.orchestra.run.smithi100.stdout:(62/156): libtool-2.4.6-45.el9.x86_64.rpm 641 kB/s | 582 kB 00:00 2024-05-09T05:24:05.118 INFO:teuthology.orchestra.run.smithi100.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 75 kB/s | 47 kB 00:00 2024-05-09T05:24:05.197 INFO:teuthology.orchestra.run.smithi060.stdout:(30/156): rbd-mirror-19.0.0-3594.gc9da4049.el9. 3.5 MB/s | 3.0 MB 00:00 2024-05-09T05:24:05.381 INFO:teuthology.orchestra.run.smithi060.stdout:(31/156): ceph-mgr-dashboard-19.0.0-3594.gc9da4 5.4 MB/s | 3.5 MB 00:00 2024-05-09T05:24:05.435 INFO:teuthology.orchestra.run.smithi100.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 350 kB/s | 292 kB 00:00 2024-05-09T05:24:05.469 INFO:teuthology.orchestra.run.smithi039.stdout:(30/156): ceph-mgr-dashboard-19.0.0-3594.gc9da4 5.8 MB/s | 3.5 MB 00:00 2024-05-09T05:24:05.473 INFO:teuthology.orchestra.run.smithi060.stdout:(32/156): ceph-mgr-modules-core-19.0.0-3594.gc9 2.9 MB/s | 274 kB 00:00 2024-05-09T05:24:05.531 INFO:teuthology.orchestra.run.smithi060.stdout:(33/156): ceph-mgr-rook-19.0.0-3594.gc9da4049.e 847 kB/s | 49 kB 00:00 2024-05-09T05:24:05.582 INFO:teuthology.orchestra.run.smithi060.stdout:(34/156): ceph-prometheus-alerts-19.0.0-3594.gc 330 kB/s | 16 kB 00:00 2024-05-09T05:24:05.611 INFO:teuthology.orchestra.run.smithi039.stdout:(31/156): rbd-mirror-19.0.0-3594.gc9da4049.el9. 2.6 MB/s | 3.0 MB 00:01 2024-05-09T05:24:05.657 INFO:teuthology.orchestra.run.smithi060.stdout:(35/156): ceph-volume-19.0.0-3594.gc9da4049.el9 3.6 MB/s | 273 kB 00:00 2024-05-09T05:24:05.660 INFO:teuthology.orchestra.run.smithi100.stdout:(65/156): lua-5.4.4-4.el9.x86_64.rpm 240 kB/s | 188 kB 00:00 2024-05-09T05:24:05.719 INFO:teuthology.orchestra.run.smithi039.stdout:(32/156): ceph-mgr-modules-core-19.0.0-3594.gc9 2.5 MB/s | 274 kB 00:00 2024-05-09T05:24:05.760 INFO:teuthology.orchestra.run.smithi100.stdout:(66/156): openblas-0.3.21-2.el9.x86_64.rpm 57 kB/s | 35 kB 00:00 2024-05-09T05:24:05.795 INFO:teuthology.orchestra.run.smithi039.stdout:(33/156): ceph-mgr-rook-19.0.0-3594.gc9da4049.e 658 kB/s | 49 kB 00:00 2024-05-09T05:24:05.824 INFO:teuthology.orchestra.run.smithi060.stdout:(36/156): cephadm-19.0.0-3594.gc9da4049.el9.noa 4.5 MB/s | 763 kB 00:00 2024-05-09T05:24:05.862 INFO:teuthology.orchestra.run.smithi039.stdout:(34/156): ceph-prometheus-alerts-19.0.0-3594.gc 247 kB/s | 16 kB 00:00 2024-05-09T05:24:05.866 INFO:teuthology.orchestra.run.smithi060.stdout:(37/156): cephfs-top-19.0.0-3594.gc9da4049.el9. 438 kB/s | 18 kB 00:00 2024-05-09T05:24:05.962 INFO:teuthology.orchestra.run.smithi039.stdout:(35/156): ceph-volume-19.0.0-3594.gc9da4049.el9 2.7 MB/s | 273 kB 00:00 2024-05-09T05:24:06.179 INFO:teuthology.orchestra.run.smithi039.stdout:(36/156): cephadm-19.0.0-3594.gc9da4049.el9.noa 3.4 MB/s | 763 kB 00:00 2024-05-09T05:24:06.208 INFO:teuthology.orchestra.run.smithi060.stdout:(38/156): fuse-2.9.9-15.el9.x86_64.rpm 235 kB/s | 80 kB 00:00 2024-05-09T05:24:06.496 INFO:teuthology.orchestra.run.smithi039.stdout:(37/156): cephfs-top-19.0.0-3594.gc9da4049.el9. 58 kB/s | 18 kB 00:00 2024-05-09T05:24:06.580 INFO:teuthology.orchestra.run.smithi039.stdout:(38/156): ceph-mgr-diskprediction-local-19.0.0- 6.7 MB/s | 7.4 MB 00:01 2024-05-09T05:24:06.661 INFO:teuthology.orchestra.run.smithi100.stdout:(67/156): openblas-openmp-0.3.21-2.el9.x86_64.r 3.9 MB/s | 4.7 MB 00:01 2024-05-09T05:24:06.708 INFO:teuthology.orchestra.run.smithi060.stdout:(39/156): libgfortran-11.4.1-3.el9.x86_64.rpm 1.6 MB/s | 803 kB 00:00 2024-05-09T05:24:06.730 INFO:teuthology.orchestra.run.smithi039.stdout:(39/156): fuse-2.9.9-15.el9.x86_64.rpm 344 kB/s | 80 kB 00:00 2024-05-09T05:24:06.817 INFO:teuthology.orchestra.run.smithi060.stdout:(40/156): libquadmath-11.4.1-3.el9.x86_64.rpm 1.8 MB/s | 195 kB 00:00 2024-05-09T05:24:06.822 INFO:teuthology.orchestra.run.smithi039.stdout:(40/156): libquadmath-11.4.1-3.el9.x86_64.rpm 2.1 MB/s | 195 kB 00:00 2024-05-09T05:24:06.855 INFO:teuthology.orchestra.run.smithi039.stdout:(41/156): libgfortran-11.4.1-3.el9.x86_64.rpm 2.8 MB/s | 803 kB 00:00 2024-05-09T05:24:06.881 INFO:teuthology.orchestra.run.smithi039.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.2 MB/s | 253 kB 00:00 2024-05-09T05:24:06.886 INFO:teuthology.orchestra.run.smithi100.stdout:(68/156): openssl-devel-3.2.1-1.el9.x86_64.rpm 3.7 MB/s | 4.4 MB 00:01 2024-05-09T05:24:06.909 INFO:teuthology.orchestra.run.smithi060.stdout:(41/156): ceph-mgr-diskprediction-local-19.0.0- 4.3 MB/s | 7.4 MB 00:01 2024-05-09T05:24:06.931 INFO:teuthology.orchestra.run.smithi039.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-05-09T05:24:06.953 INFO:teuthology.orchestra.run.smithi100.stdout:(69/156): postgresql-13.14-1.el9.x86_64.rpm 1.3 MB/s | 1.6 MB 00:01 2024-05-09T05:24:06.956 INFO:teuthology.orchestra.run.smithi060.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.8 MB/s | 253 kB 00:00 2024-05-09T05:24:07.050 INFO:teuthology.orchestra.run.smithi039.stdout:(44/156): python3-cryptography-36.0.1-4.el9.x86 6.3 MB/s | 1.2 MB 00:00 2024-05-09T05:24:07.051 INFO:teuthology.orchestra.run.smithi060.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 1.1 MB/s | 106 kB 00:00 2024-05-09T05:24:07.140 INFO:teuthology.orchestra.run.smithi039.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 647 kB/s | 135 kB 00:00 2024-05-09T05:24:07.160 INFO:teuthology.orchestra.run.smithi060.stdout:(44/156): python3-pycparser-2.20-6.el9.noarch.r 1.2 MB/s | 135 kB 00:00 2024-05-09T05:24:07.165 INFO:teuthology.orchestra.run.smithi039.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 1.1 MB/s | 125 kB 00:00 2024-05-09T05:24:07.208 INFO:teuthology.orchestra.run.smithi039.stdout:(47/156): python3-urllib3-1.26.5-5.el9.noarch.r 3.1 MB/s | 215 kB 00:00 2024-05-09T05:24:07.260 INFO:teuthology.orchestra.run.smithi060.stdout:(45/156): python3-requests-2.25.1-8.el9.noarch. 1.2 MB/s | 125 kB 00:00 2024-05-09T05:24:07.274 INFO:teuthology.orchestra.run.smithi039.stdout:(48/156): automake-1.16.2-8.el9.noarch.rpm 6.2 MB/s | 689 kB 00:00 2024-05-09T05:24:07.342 INFO:teuthology.orchestra.run.smithi039.stdout:(49/156): bison-3.7.4-5.el9.x86_64.rpm 6.9 MB/s | 943 kB 00:00 2024-05-09T05:24:07.369 INFO:teuthology.orchestra.run.smithi060.stdout:(46/156): python3-urllib3-1.26.5-5.el9.noarch.r 1.9 MB/s | 215 kB 00:00 2024-05-09T05:24:07.375 INFO:teuthology.orchestra.run.smithi039.stdout:(50/156): boost-program-options-1.75.0-8.el9.x8 1.0 MB/s | 107 kB 00:00 2024-05-09T05:24:07.417 INFO:teuthology.orchestra.run.smithi039.stdout:(51/156): elfutils-libelf-devel-0.190-2.el9.x86 286 kB/s | 21 kB 00:00 2024-05-09T05:24:07.469 INFO:teuthology.orchestra.run.smithi060.stdout:(47/156): automake-1.16.2-8.el9.noarch.rpm 6.7 MB/s | 689 kB 00:00 2024-05-09T05:24:07.476 INFO:teuthology.orchestra.run.smithi039.stdout:(52/156): flex-2.6.4-9.el9.x86_64.rpm 3.1 MB/s | 313 kB 00:00 2024-05-09T05:24:07.559 INFO:teuthology.orchestra.run.smithi039.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 231 kB/s | 33 kB 00:00 2024-05-09T05:24:07.561 INFO:teuthology.orchestra.run.smithi060.stdout:(48/156): bison-3.7.4-5.el9.x86_64.rpm 10 MB/s | 943 kB 00:00 2024-05-09T05:24:07.610 INFO:teuthology.orchestra.run.smithi039.stdout:(54/156): flexiblas-openblas-openmp-3.0.4-8.el9 365 kB/s | 18 kB 00:00 2024-05-09T05:24:07.628 INFO:teuthology.orchestra.run.smithi060.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 1.6 MB/s | 107 kB 00:00 2024-05-09T05:24:07.652 INFO:teuthology.orchestra.run.smithi039.stdout:(55/156): libaio-devel-0.3.111-13.el9.x86_64.rp 267 kB/s | 11 kB 00:00 2024-05-09T05:24:07.653 INFO:teuthology.orchestra.run.smithi100.stdout:(70/156): postgresql-contrib-13.14-1.el9.x86_64 919 kB/s | 911 kB 00:00 2024-05-09T05:24:07.678 INFO:teuthology.orchestra.run.smithi100.stdout:(71/156): postgresql-private-libs-13.14-1.el9.x 174 kB/s | 133 kB 00:00 2024-05-09T05:24:07.679 INFO:teuthology.orchestra.run.smithi060.stdout:(50/156): elfutils-libelf-devel-0.190-2.el9.x86 431 kB/s | 21 kB 00:00 2024-05-09T05:24:07.744 INFO:teuthology.orchestra.run.smithi039.stdout:(56/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 11 MB/s | 3.0 MB 00:00 2024-05-09T05:24:07.754 INFO:teuthology.orchestra.run.smithi060.stdout:(51/156): flex-2.6.4-9.el9.x86_64.rpm 4.1 MB/s | 313 kB 00:00 2024-05-09T05:24:07.769 INFO:teuthology.orchestra.run.smithi039.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.3 MB/s | 160 kB 00:00 2024-05-09T05:24:07.804 INFO:teuthology.orchestra.run.smithi060.stdout:(52/156): flexiblas-3.0.4-8.el9.x86_64.rpm 656 kB/s | 33 kB 00:00 2024-05-09T05:24:07.819 INFO:teuthology.orchestra.run.smithi039.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 601 kB/s | 45 kB 00:00 2024-05-09T05:24:07.847 INFO:teuthology.orchestra.run.smithi060.stdout:(53/156): python3-cryptography-36.0.1-4.el9.x86 1.3 MB/s | 1.2 MB 00:00 2024-05-09T05:24:07.878 INFO:teuthology.orchestra.run.smithi039.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 6.0 MB/s | 662 kB 00:00 2024-05-09T05:24:07.897 INFO:teuthology.orchestra.run.smithi060.stdout:(54/156): flexiblas-openblas-openmp-3.0.4-8.el9 364 kB/s | 18 kB 00:00 2024-05-09T05:24:07.911 INFO:teuthology.orchestra.run.smithi039.stdout:(60/156): libtool-2.4.6-45.el9.x86_64.rpm 6.2 MB/s | 582 kB 00:00 2024-05-09T05:24:07.937 INFO:teuthology.orchestra.run.smithi039.stdout:(61/156): libuuid-devel-2.37.4-18.el9.x86_64.rp 433 kB/s | 25 kB 00:00 2024-05-09T05:24:07.939 INFO:teuthology.orchestra.run.smithi060.stdout:(55/156): libaio-devel-0.3.111-13.el9.x86_64.rp 268 kB/s | 11 kB 00:00 2024-05-09T05:24:07.987 INFO:teuthology.orchestra.run.smithi039.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 631 kB/s | 47 kB 00:00 2024-05-09T05:24:08.037 INFO:teuthology.orchestra.run.smithi039.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.9 MB/s | 292 kB 00:00 2024-05-09T05:24:08.043 INFO:teuthology.orchestra.run.smithi060.stdout:(56/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 13 MB/s | 3.0 MB 00:00 2024-05-09T05:24:08.079 INFO:teuthology.orchestra.run.smithi039.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 2.0 MB/s | 188 kB 00:00 2024-05-09T05:24:08.113 INFO:teuthology.orchestra.run.smithi039.stdout:(65/156): openblas-0.3.21-2.el9.x86_64.rpm 466 kB/s | 35 kB 00:00 2024-05-09T05:24:08.179 INFO:teuthology.orchestra.run.smithi060.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 668 kB/s | 160 kB 00:00 2024-05-09T05:24:08.203 INFO:teuthology.orchestra.run.smithi100.stdout:(72/156): postgresql-server-13.14-1.el9.x86_64. 4.6 MB/s | 5.8 MB 00:01 2024-05-09T05:24:08.240 INFO:teuthology.orchestra.run.smithi060.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 231 kB/s | 45 kB 00:00 2024-05-09T05:24:08.297 INFO:teuthology.orchestra.run.smithi039.stdout:(66/156): openblas-openmp-0.3.21-2.el9.x86_64.r 22 MB/s | 4.7 MB 00:00 2024-05-09T05:24:08.298 INFO:teuthology.orchestra.run.smithi060.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 5.4 MB/s | 662 kB 00:00 2024-05-09T05:24:08.340 INFO:teuthology.orchestra.run.smithi060.stdout:(60/156): libtool-2.4.6-45.el9.x86_64.rpm 5.7 MB/s | 582 kB 00:00 2024-05-09T05:24:08.355 INFO:teuthology.orchestra.run.smithi039.stdout:(67/156): openssl-devel-3.2.1-1.el9.x86_64.rpm 18 MB/s | 4.4 MB 00:00 2024-05-09T05:24:08.357 INFO:teuthology.orchestra.run.smithi060.stdout:(61/156): libuuid-devel-2.37.4-18.el9.x86_64.rp 435 kB/s | 25 kB 00:00 2024-05-09T05:24:08.399 INFO:teuthology.orchestra.run.smithi060.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 811 kB/s | 47 kB 00:00 2024-05-09T05:24:08.404 INFO:teuthology.orchestra.run.smithi100.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 121 kB/s | 87 kB 00:00 2024-05-09T05:24:08.449 INFO:teuthology.orchestra.run.smithi060.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.1 MB/s | 292 kB 00:00 2024-05-09T05:24:08.464 INFO:teuthology.orchestra.run.smithi039.stdout:(68/156): postgresql-13.14-1.el9.x86_64.rpm 9.5 MB/s | 1.6 MB 00:00 2024-05-09T05:24:08.489 INFO:teuthology.orchestra.run.smithi039.stdout:(69/156): postgresql-contrib-13.14-1.el9.x86_64 6.7 MB/s | 911 kB 00:00 2024-05-09T05:24:08.491 INFO:teuthology.orchestra.run.smithi060.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 2.0 MB/s | 188 kB 00:00 2024-05-09T05:24:08.508 INFO:teuthology.orchestra.run.smithi060.stdout:(65/156): openblas-0.3.21-2.el9.x86_64.rpm 600 kB/s | 35 kB 00:00 2024-05-09T05:24:08.548 INFO:teuthology.orchestra.run.smithi039.stdout:(70/156): postgresql-private-libs-13.14-1.el9.x 1.6 MB/s | 133 kB 00:00 2024-05-09T05:24:08.687 INFO:teuthology.orchestra.run.smithi100.stdout:(74/156): protobuf-3.14.0-13.el9.x86_64.rpm 1.0 MB/s | 1.0 MB 00:01 2024-05-09T05:24:08.734 INFO:teuthology.orchestra.run.smithi060.stdout:(66/156): openblas-openmp-0.3.21-2.el9.x86_64.r 20 MB/s | 4.7 MB 00:00 2024-05-09T05:24:08.773 INFO:teuthology.orchestra.run.smithi039.stdout:(71/156): postgresql-server-13.14-1.el9.x86_64. 20 MB/s | 5.8 MB 00:00 2024-05-09T05:24:08.800 INFO:teuthology.orchestra.run.smithi060.stdout:(67/156): openssl-devel-3.2.1-1.el9.x86_64.rpm 15 MB/s | 4.4 MB 00:00 2024-05-09T05:24:08.806 INFO:teuthology.orchestra.run.smithi039.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 3.9 MB/s | 1.0 MB 00:00 2024-05-09T05:24:08.857 INFO:teuthology.orchestra.run.smithi039.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.0 MB/s | 87 kB 00:00 2024-05-09T05:24:08.926 INFO:teuthology.orchestra.run.smithi060.stdout:(68/156): postgresql-contrib-13.14-1.el9.x86_64 7.1 MB/s | 911 kB 00:00 2024-05-09T05:24:08.932 INFO:teuthology.orchestra.run.smithi039.stdout:(74/156): python3-devel-3.9.18-3.el9.x86_64.rpm 3.2 MB/s | 244 kB 00:00 2024-05-09T05:24:08.976 INFO:teuthology.orchestra.run.smithi060.stdout:(69/156): postgresql-13.14-1.el9.x86_64.rpm 6.6 MB/s | 1.6 MB 00:00 2024-05-09T05:24:09.007 INFO:teuthology.orchestra.run.smithi039.stdout:(75/156): python3-jinja2-2.11.3-5.el9.noarch.rp 3.2 MB/s | 248 kB 00:00 2024-05-09T05:24:09.018 INFO:teuthology.orchestra.run.smithi060.stdout:(70/156): postgresql-private-libs-13.14-1.el9.x 1.4 MB/s | 133 kB 00:00 2024-05-09T05:24:09.058 INFO:teuthology.orchestra.run.smithi039.stdout:(76/156): python3-jsonpatch-1.21-16.el9.noarch. 511 kB/s | 26 kB 00:00 2024-05-09T05:24:09.108 INFO:teuthology.orchestra.run.smithi039.stdout:(77/156): python3-jsonpointer-2.0-4.el9.noarch. 383 kB/s | 19 kB 00:00 2024-05-09T05:24:09.144 INFO:teuthology.orchestra.run.smithi060.stdout:(71/156): protobuf-3.14.0-13.el9.x86_64.rpm 8.1 MB/s | 1.0 MB 00:00 2024-05-09T05:24:09.183 INFO:teuthology.orchestra.run.smithi039.stdout:(78/156): python3-mako-1.1.4-6.el9.noarch.rpm 2.2 MB/s | 172 kB 00:00 2024-05-09T05:24:09.210 INFO:teuthology.orchestra.run.smithi060.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-05-09T05:24:09.238 INFO:teuthology.orchestra.run.smithi100.stdout:(75/156): python3-devel-3.9.18-3.el9.x86_64.rpm 293 kB/s | 244 kB 00:00 2024-05-09T05:24:09.259 INFO:teuthology.orchestra.run.smithi039.stdout:(79/156): python3-babel-2.9.1-2.el9.noarch.rpm 13 MB/s | 6.0 MB 00:00 2024-05-09T05:24:09.292 INFO:teuthology.orchestra.run.smithi039.stdout:(80/156): python3-markupsafe-1.1.1-12.el9.x86_6 319 kB/s | 35 kB 00:00 2024-05-09T05:24:09.361 INFO:teuthology.orchestra.run.smithi060.stdout:(73/156): postgresql-server-13.14-1.el9.x86_64. 15 MB/s | 5.8 MB 00:00 2024-05-09T05:24:09.367 INFO:teuthology.orchestra.run.smithi039.stdout:(81/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.3 MB/s | 250 kB 00:00 2024-05-09T05:24:09.430 INFO:teuthology.orchestra.run.smithi100.stdout:(76/156): python3-babel-2.9.1-2.el9.noarch.rpm 4.9 MB/s | 6.0 MB 00:01 2024-05-09T05:24:09.451 INFO:teuthology.orchestra.run.smithi039.stdout:(82/156): python3-oauthlib-3.1.1-5.el9.noarch.r 2.6 MB/s | 222 kB 00:00 2024-05-09T05:24:09.563 INFO:teuthology.orchestra.run.smithi100.stdout:(77/156): python3-jinja2-2.11.3-5.el9.noarch.rp 283 kB/s | 248 kB 00:00 2024-05-09T05:24:09.786 INFO:teuthology.orchestra.run.smithi060.stdout:(74/156): ceph-test-19.0.0-3594.gc9da4049.el9.x 5.9 MB/s | 43 MB 00:07 2024-05-09T05:24:09.812 INFO:teuthology.orchestra.run.smithi060.stdout:(75/156): python3-devel-3.9.18-3.el9.x86_64.rpm 542 kB/s | 244 kB 00:00 2024-05-09T05:24:09.843 INFO:teuthology.orchestra.run.smithi039.stdout:(83/156): ceph-test-19.0.0-3594.gc9da4049.el9.x 5.7 MB/s | 43 MB 00:07 2024-05-09T05:24:09.863 INFO:teuthology.orchestra.run.smithi100.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 41 kB/s | 26 kB 00:00 2024-05-09T05:24:09.904 INFO:teuthology.orchestra.run.smithi060.stdout:(76/156): python3-babel-2.9.1-2.el9.noarch.rpm 8.6 MB/s | 6.0 MB 00:00 2024-05-09T05:24:09.935 INFO:teuthology.orchestra.run.smithi039.stdout:(84/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 7.5 MB/s | 5.1 MB 00:00 2024-05-09T05:24:09.937 INFO:teuthology.orchestra.run.smithi060.stdout:(77/156): python3-jsonpatch-1.21-16.el9.noarch. 205 kB/s | 26 kB 00:00 2024-05-09T05:24:09.947 INFO:teuthology.orchestra.run.smithi100.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 37 kB/s | 19 kB 00:00 2024-05-09T05:24:09.960 INFO:teuthology.orchestra.run.smithi039.stdout:(85/156): python3-prettytable-0.7.2-27.el9.noar 363 kB/s | 42 kB 00:00 2024-05-09T05:24:09.962 INFO:teuthology.orchestra.run.smithi060.stdout:(78/156): python3-jinja2-2.11.3-5.el9.noarch.rp 1.4 MB/s | 248 kB 00:00 2024-05-09T05:24:09.986 INFO:teuthology.orchestra.run.smithi039.stdout:(86/156): python3-packaging-20.9-5.el9.noarch.r 144 kB/s | 77 kB 00:00 2024-05-09T05:24:09.987 INFO:teuthology.orchestra.run.smithi060.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 229 kB/s | 19 kB 00:00 2024-05-09T05:24:10.030 INFO:teuthology.orchestra.run.smithi060.stdout:(80/156): python3-markupsafe-1.1.1-12.el9.x86_6 520 kB/s | 35 kB 00:00 2024-05-09T05:24:10.036 INFO:teuthology.orchestra.run.smithi039.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 2.6 MB/s | 269 kB 00:00 2024-05-09T05:24:10.055 INFO:teuthology.orchestra.run.smithi060.stdout:(81/156): python3-mako-1.1.4-6.el9.noarch.rpm 1.4 MB/s | 172 kB 00:00 2024-05-09T05:24:10.061 INFO:teuthology.orchestra.run.smithi039.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.5 MB/s | 159 kB 00:00 2024-05-09T05:24:10.086 INFO:teuthology.orchestra.run.smithi039.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 2.7 MB/s | 279 kB 00:00 2024-05-09T05:24:10.120 INFO:teuthology.orchestra.run.smithi039.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 609 kB/s | 51 kB 00:00 2024-05-09T05:24:10.122 INFO:teuthology.orchestra.run.smithi060.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.7 MB/s | 250 kB 00:00 2024-05-09T05:24:10.145 INFO:teuthology.orchestra.run.smithi039.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 639 kB/s | 54 kB 00:00 2024-05-09T05:24:10.147 INFO:teuthology.orchestra.run.smithi060.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 2.4 MB/s | 222 kB 00:00 2024-05-09T05:24:10.195 INFO:teuthology.orchestra.run.smithi039.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 555 kB/s | 42 kB 00:00 2024-05-09T05:24:10.206 INFO:teuthology.orchestra.run.smithi060.stdout:(84/156): python3-packaging-20.9-5.el9.noarch.r 923 kB/s | 77 kB 00:00 2024-05-09T05:24:10.221 INFO:teuthology.orchestra.run.smithi039.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 589 kB/s | 44 kB 00:00 2024-05-09T05:24:10.231 INFO:teuthology.orchestra.run.smithi060.stdout:(85/156): python3-prettytable-0.7.2-27.el9.noar 507 kB/s | 42 kB 00:00 2024-05-09T05:24:10.280 INFO:teuthology.orchestra.run.smithi039.stdout:(94/156): qatlib-service-24.02.0-1.el9.x86_64.r 612 kB/s | 36 kB 00:00 2024-05-09T05:24:10.298 INFO:teuthology.orchestra.run.smithi060.stdout:(86/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.3 MB/s | 159 kB 00:00 2024-05-09T05:24:10.305 INFO:teuthology.orchestra.run.smithi039.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 2.0 MB/s | 221 kB 00:00 2024-05-09T05:24:10.323 INFO:teuthology.orchestra.run.smithi060.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 2.9 MB/s | 269 kB 00:00 2024-05-09T05:24:10.339 INFO:teuthology.orchestra.run.smithi100.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 222 kB/s | 172 kB 00:00 2024-05-09T05:24:10.355 INFO:teuthology.orchestra.run.smithi039.stdout:(96/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 630 kB/s | 47 kB 00:00 2024-05-09T05:24:10.398 INFO:teuthology.orchestra.run.smithi060.stdout:(88/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 5.1 MB 00:00 2024-05-09T05:24:10.405 INFO:teuthology.orchestra.run.smithi039.stdout:(97/156): socat-1.7.4.1-5.el9.x86_64.rpm 3.0 MB/s | 305 kB 00:00 2024-05-09T05:24:10.431 INFO:teuthology.orchestra.run.smithi039.stdout:(98/156): uuid-1.6.2-55.el9.x86_64.rpm 769 kB/s | 58 kB 00:00 2024-05-09T05:24:10.449 INFO:teuthology.orchestra.run.smithi060.stdout:(89/156): python3-pytz-2021.1-5.el9.noarch.rpm 407 kB/s | 51 kB 00:00 2024-05-09T05:24:10.474 INFO:teuthology.orchestra.run.smithi060.stdout:(90/156): python3-requests-oauthlib-1.3.0-12.el 713 kB/s | 54 kB 00:00 2024-05-09T05:24:10.490 INFO:teuthology.orchestra.run.smithi039.stdout:(99/156): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.1 MB/s | 94 kB 00:00 2024-05-09T05:24:10.499 INFO:teuthology.orchestra.run.smithi060.stdout:(91/156): python3-pyasn1-modules-0.4.8-6.el9.no 1.4 MB/s | 279 kB 00:00 2024-05-09T05:24:10.514 INFO:teuthology.orchestra.run.smithi039.stdout:(100/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 764 kB/s | 64 kB 00:00 2024-05-09T05:24:10.548 INFO:teuthology.orchestra.run.smithi100.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 51 kB/s | 35 kB 00:00 2024-05-09T05:24:10.549 INFO:teuthology.orchestra.run.smithi060.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 554 kB/s | 42 kB 00:00 2024-05-09T05:24:10.565 INFO:teuthology.orchestra.run.smithi039.stdout:(101/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 596 kB/s | 45 kB 00:00 2024-05-09T05:24:10.575 INFO:teuthology.orchestra.run.smithi060.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 587 kB/s | 44 kB 00:00 2024-05-09T05:24:10.598 INFO:teuthology.orchestra.run.smithi039.stdout:(102/156): lua-devel-5.4.4-4.el9.x86_64.rpm 267 kB/s | 22 kB 00:00 2024-05-09T05:24:10.633 INFO:teuthology.orchestra.run.smithi060.stdout:(94/156): qatlib-service-24.02.0-1.el9.x86_64.r 617 kB/s | 36 kB 00:00 2024-05-09T05:24:10.659 INFO:teuthology.orchestra.run.smithi060.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 2.0 MB/s | 221 kB 00:00 2024-05-09T05:24:10.725 INFO:teuthology.orchestra.run.smithi060.stdout:(96/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 518 kB/s | 47 kB 00:00 2024-05-09T05:24:10.776 INFO:teuthology.orchestra.run.smithi060.stdout:(97/156): socat-1.7.4.1-5.el9.x86_64.rpm 2.5 MB/s | 305 kB 00:00 2024-05-09T05:24:10.793 INFO:teuthology.orchestra.run.smithi060.stdout:(98/156): uuid-1.6.2-55.el9.x86_64.rpm 855 kB/s | 58 kB 00:00 2024-05-09T05:24:10.824 INFO:teuthology.orchestra.run.smithi039.stdout:(103/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 22 MB/s | 16 MB 00:00 2024-05-09T05:24:10.852 INFO:teuthology.orchestra.run.smithi060.stdout:(99/156): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.2 MB/s | 94 kB 00:00 2024-05-09T05:24:10.869 INFO:teuthology.orchestra.run.smithi060.stdout:(100/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 847 kB/s | 64 kB 00:00 2024-05-09T05:24:10.911 INFO:teuthology.orchestra.run.smithi060.stdout:(101/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 766 kB/s | 45 kB 00:00 2024-05-09T05:24:10.924 INFO:teuthology.orchestra.run.smithi039.stdout:(104/156): protobuf-compiler-3.14.0-13.el9.x86_ 2.3 MB/s | 863 kB 00:00 2024-05-09T05:24:10.950 INFO:teuthology.orchestra.run.smithi039.stdout:(105/156): abseil-cpp-20211102.0-3.el9.x86_64.r 1.5 MB/s | 548 kB 00:00 2024-05-09T05:24:10.991 INFO:teuthology.orchestra.run.smithi039.stdout:(106/156): gperftools-libs-2.9.1-2.el9.x86_64.r 1.8 MB/s | 309 kB 00:00 2024-05-09T05:24:11.016 INFO:teuthology.orchestra.run.smithi039.stdout:(107/156): grpc-data-1.46.7-10.el9.noarch.rpm 211 kB/s | 19 kB 00:00 2024-05-09T05:24:11.042 INFO:teuthology.orchestra.run.smithi039.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 518 kB/s | 26 kB 00:00 2024-05-09T05:24:11.084 INFO:teuthology.orchestra.run.smithi039.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 725 kB/s | 49 kB 00:00 2024-05-09T05:24:11.109 INFO:teuthology.orchestra.run.smithi039.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 1.0 MB/s | 67 kB 00:00 2024-05-09T05:24:11.159 INFO:teuthology.orchestra.run.smithi039.stdout:(111/156): luarocks-3.9.2-1.el9.noarch.rpm 2.0 MB/s | 151 kB 00:00 2024-05-09T05:24:11.165 INFO:teuthology.orchestra.run.smithi100.stdout:(82/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.2 MB/s | 5.1 MB 00:01 2024-05-09T05:24:11.170 INFO:teuthology.orchestra.run.smithi060.stdout:(102/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 23 MB/s | 16 MB 00:00 2024-05-09T05:24:11.209 INFO:teuthology.orchestra.run.smithi039.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.2 MB/s | 839 kB 00:00 2024-05-09T05:24:11.223 INFO:teuthology.orchestra.run.smithi100.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 283 kB/s | 250 kB 00:00 2024-05-09T05:24:11.260 INFO:teuthology.orchestra.run.smithi039.stdout:(113/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 868 kB/s | 43 kB 00:00 2024-05-09T05:24:11.335 INFO:teuthology.orchestra.run.smithi039.stdout:(114/156): libarrow-9.0.0-11.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-05-09T05:24:11.360 INFO:teuthology.orchestra.run.smithi039.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 321 kB/s | 32 kB 00:00 2024-05-09T05:24:11.386 INFO:teuthology.orchestra.run.smithi039.stdout:(116/156): python3-certifi-2021.10.8-2.el9.noar 298 kB/s | 15 kB 00:00 2024-05-09T05:24:11.390 INFO:teuthology.orchestra.run.smithi100.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 264 kB/s | 222 kB 00:00 2024-05-09T05:24:11.411 INFO:teuthology.orchestra.run.smithi039.stdout:(117/156): python3-asyncssh-2.13.2-5.el9.noarch 2.1 MB/s | 548 kB 00:00 2024-05-09T05:24:11.436 INFO:teuthology.orchestra.run.smithi039.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 2.2 MB/s | 172 kB 00:00 2024-05-09T05:24:11.462 INFO:teuthology.orchestra.run.smithi039.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 4.7 MB/s | 358 kB 00:00 2024-05-09T05:24:11.487 INFO:teuthology.orchestra.run.smithi039.stdout:(120/156): python3-colorama-0.4.4-12.el9.noarch 703 kB/s | 35 kB 00:00 2024-05-09T05:24:11.512 INFO:teuthology.orchestra.run.smithi039.stdout:(121/156): python3-google-auth-2.29.0-1.el9.noa 4.0 MB/s | 206 kB 00:00 2024-05-09T05:24:11.537 INFO:teuthology.orchestra.run.smithi039.stdout:(122/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.9 MB/s | 303 kB 00:00 2024-05-09T05:24:11.562 INFO:teuthology.orchestra.run.smithi039.stdout:(123/156): python3-grpcio-tools-1.46.7-10.el9.x 2.8 MB/s | 144 kB 00:00 2024-05-09T05:24:11.580 INFO:teuthology.orchestra.run.smithi039.stdout:(124/156): python3-jaraco-8.2.1-3.el9.noarch.rp 254 kB/s | 11 kB 00:00 2024-05-09T05:24:11.597 INFO:teuthology.orchestra.run.smithi039.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 522 kB/s | 18 kB 00:00 2024-05-09T05:24:11.614 INFO:teuthology.orchestra.run.smithi039.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 686 kB/s | 23 kB 00:00 2024-05-09T05:24:11.630 INFO:teuthology.orchestra.run.smithi039.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 582 kB/s | 19 kB 00:00 2024-05-09T05:24:11.656 INFO:teuthology.orchestra.run.smithi039.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 469 kB/s | 20 kB 00:00 2024-05-09T05:24:11.695 INFO:teuthology.orchestra.run.smithi060.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 27 kB/s | 22 kB 00:00 2024-05-09T05:24:11.698 INFO:teuthology.orchestra.run.smithi039.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.1 MB/s | 46 kB 00:00 2024-05-09T05:24:11.729 INFO:teuthology.orchestra.run.smithi060.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 981 kB/s | 548 kB 00:00 2024-05-09T05:24:11.740 INFO:teuthology.orchestra.run.smithi039.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 1.8 MB/s | 79 kB 00:00 2024-05-09T05:24:11.773 INFO:teuthology.orchestra.run.smithi039.stdout:(131/156): python3-kubernetes-26.1.0-2.el9.noar 7.2 MB/s | 1.0 MB 00:00 2024-05-09T05:24:11.799 INFO:teuthology.orchestra.run.smithi039.stdout:(132/156): python3-natsort-7.1.1-5.el9.noarch.r 985 kB/s | 58 kB 00:00 2024-05-09T05:24:11.824 INFO:teuthology.orchestra.run.smithi039.stdout:(133/156): python3-pecan-1.4.2-3.el9.noarch.rpm 5.3 MB/s | 272 kB 00:00 2024-05-09T05:24:11.849 INFO:teuthology.orchestra.run.smithi039.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 327 kB/s | 16 kB 00:00 2024-05-09T05:24:11.857 INFO:teuthology.orchestra.run.smithi100.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 112 kB/s | 77 kB 00:00 2024-05-09T05:24:11.875 INFO:teuthology.orchestra.run.smithi039.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.8 MB/s | 90 kB 00:00 2024-05-09T05:24:11.879 INFO:teuthology.orchestra.run.smithi060.stdout:(105/156): grpc-data-1.46.7-10.el9.noarch.rpm 130 kB/s | 19 kB 00:00 2024-05-09T05:24:11.882 INFO:teuthology.orchestra.run.smithi100.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 64 kB/s | 42 kB 00:00 2024-05-09T05:24:11.900 INFO:teuthology.orchestra.run.smithi039.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 563 kB/s | 28 kB 00:00 2024-05-09T05:24:11.925 INFO:teuthology.orchestra.run.smithi039.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 613 kB/s | 31 kB 00:00 2024-05-09T05:24:11.950 INFO:teuthology.orchestra.run.smithi039.stdout:(138/156): python3-routes-2.5.1-5.el9.noarch.rp 3.7 MB/s | 188 kB 00:00 2024-05-09T05:24:11.976 INFO:teuthology.orchestra.run.smithi039.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-05-09T05:24:12.001 INFO:teuthology.orchestra.run.smithi039.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 712 kB/s | 36 kB 00:00 2024-05-09T05:24:12.026 INFO:teuthology.orchestra.run.smithi039.stdout:(141/156): python3-typing-extensions-4.4.0-2.el 1.0 MB/s | 51 kB 00:00 2024-05-09T05:24:12.054 INFO:teuthology.orchestra.run.smithi060.stdout:(106/156): protobuf-compiler-3.14.0-13.el9.x86_ 755 kB/s | 863 kB 00:01 2024-05-09T05:24:12.077 INFO:teuthology.orchestra.run.smithi039.stdout:(142/156): python3-grpcio-1.46.7-10.el9.x86_64. 3.5 MB/s | 2.0 MB 00:00 2024-05-09T05:24:12.163 INFO:teuthology.orchestra.run.smithi060.stdout:(107/156): gperftools-libs-2.9.1-2.el9.x86_64.r 661 kB/s | 309 kB 00:00 2024-05-09T05:24:12.168 INFO:teuthology.orchestra.run.smithi039.stdout:(143/156): python3-webob-1.8.7-6.el9.noarch.rpm 1.3 MB/s | 230 kB 00:00 2024-05-09T05:24:12.255 INFO:teuthology.orchestra.run.smithi060.stdout:(108/156): liboath-2.6.7-2.el9.x86_64.rpm 530 kB/s | 49 kB 00:00 2024-05-09T05:24:12.269 INFO:teuthology.orchestra.run.smithi039.stdout:(144/156): python3-websocket-client-1.2.3-2.el9 370 kB/s | 90 kB 00:00 2024-05-09T05:24:12.274 INFO:teuthology.orchestra.run.smithi100.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 315 kB/s | 269 kB 00:00 2024-05-09T05:24:12.294 INFO:teuthology.orchestra.run.smithi039.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 159 kB/s | 20 kB 00:00 2024-05-09T05:24:12.320 INFO:teuthology.orchestra.run.smithi039.stdout:(146/156): re2-20211101-3.el9.x86_64.rpm 3.7 MB/s | 192 kB 00:00 2024-05-09T05:24:12.338 INFO:teuthology.orchestra.run.smithi060.stdout:(109/156): libarrow-9.0.0-11.el9.x86_64.rpm 9.6 MB/s | 4.4 MB 00:00 2024-05-09T05:24:12.344 INFO:teuthology.orchestra.run.smithi039.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 1.6 MB/s | 427 kB 00:00 2024-05-09T05:24:12.355 INFO:teuthology.orchestra.run.smithi060.stdout:(110/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 86 kB/s | 26 kB 00:00 2024-05-09T05:24:12.381 INFO:teuthology.orchestra.run.smithi060.stdout:(111/156): libunwind-1.6.2-1.el9.x86_64.rpm 536 kB/s | 67 kB 00:00 2024-05-09T05:24:12.439 INFO:teuthology.orchestra.run.smithi060.stdout:(112/156): luarocks-3.9.2-1.el9.noarch.rpm 1.5 MB/s | 151 kB 00:00 2024-05-09T05:24:12.445 INFO:teuthology.orchestra.run.smithi039.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-05-09T05:24:12.539 INFO:teuthology.orchestra.run.smithi060.stdout:(113/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 434 kB/s | 43 kB 00:00 2024-05-09T05:24:12.573 INFO:teuthology.orchestra.run.smithi060.stdout:(114/156): python3-asyncssh-2.13.2-5.el9.noarch 2.8 MB/s | 548 kB 00:00 2024-05-09T05:24:12.625 INFO:teuthology.orchestra.run.smithi100.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 207 kB/s | 159 kB 00:00 2024-05-09T05:24:12.631 INFO:teuthology.orchestra.run.smithi060.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 350 kB/s | 32 kB 00:00 2024-05-09T05:24:12.673 INFO:teuthology.orchestra.run.smithi060.stdout:(116/156): python3-certifi-2021.10.8-2.el9.noar 150 kB/s | 15 kB 00:00 2024-05-09T05:24:12.708 INFO:teuthology.orchestra.run.smithi100.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 338 kB/s | 279 kB 00:00 2024-05-09T05:24:12.741 INFO:teuthology.orchestra.run.smithi060.stdout:(117/156): python3-cheroot-8.6.0-4.el9.noarch.r 1.5 MB/s | 172 kB 00:00 2024-05-09T05:24:12.774 INFO:teuthology.orchestra.run.smithi060.stdout:(118/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 2.0 MB/s | 839 kB 00:00 2024-05-09T05:24:12.795 INFO:teuthology.orchestra.run.smithi039.stdout:(149/156): librados2-19.0.0-3594.gc9da4049.el9. 7.0 MB/s | 3.3 MB 00:00 2024-05-09T05:24:12.808 INFO:teuthology.orchestra.run.smithi060.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 2.6 MB/s | 358 kB 00:00 2024-05-09T05:24:12.837 INFO:teuthology.orchestra.run.smithi039.stdout:(150/156): NetworkManager-1.47.5-1.el9.x86_64.r 5.9 MB/s | 2.3 MB 00:00 2024-05-09T05:24:12.883 INFO:teuthology.orchestra.run.smithi060.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.1 MB/s | 303 kB 00:00 2024-05-09T05:24:12.896 INFO:teuthology.orchestra.run.smithi039.stdout:(151/156): NetworkManager-team-1.47.5-1.el9.x86 719 kB/s | 42 kB 00:00 2024-05-09T05:24:12.908 INFO:teuthology.orchestra.run.smithi060.stdout:(121/156): python3-colorama-0.4.4-12.el9.noarch 264 kB/s | 35 kB 00:00 2024-05-09T05:24:12.916 INFO:teuthology.orchestra.run.smithi100.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 79 kB/s | 51 kB 00:00 2024-05-09T05:24:12.934 INFO:teuthology.orchestra.run.smithi060.stdout:(122/156): python3-google-auth-2.29.0-1.el9.noa 1.6 MB/s | 206 kB 00:00 2024-05-09T05:24:12.954 INFO:teuthology.orchestra.run.smithi039.stdout:(152/156): NetworkManager-tui-1.47.5-1.el9.x86_ 4.2 MB/s | 248 kB 00:00 2024-05-09T05:24:13.063 INFO:teuthology.orchestra.run.smithi039.stdout:(153/156): openssl-3.2.1-1.el9.x86_64.rpm 12 MB/s | 1.3 MB 00:00 2024-05-09T05:24:13.076 INFO:teuthology.orchestra.run.smithi060.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 75 kB/s | 11 kB 00:00 2024-05-09T05:24:13.105 INFO:teuthology.orchestra.run.smithi039.stdout:(154/156): NetworkManager-libnm-1.47.5-1.el9.x8 5.9 MB/s | 1.8 MB 00:00 2024-05-09T05:24:13.193 INFO:teuthology.orchestra.run.smithi060.stdout:(124/156): python3-grpcio-1.46.7-10.el9.x86_64. 6.6 MB/s | 2.0 MB 00:00 2024-05-09T05:24:13.218 INFO:teuthology.orchestra.run.smithi060.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 124 kB/s | 18 kB 00:00 2024-05-09T05:24:13.235 INFO:teuthology.orchestra.run.smithi060.stdout:(126/156): python3-grpcio-tools-1.46.7-10.el9.x 443 kB/s | 144 kB 00:00 2024-05-09T05:24:13.239 INFO:teuthology.orchestra.run.smithi039.stdout:(155/156): librbd1-19.0.0-3594.gc9da4049.el9.x8 3.5 MB/s | 3.1 MB 00:00 2024-05-09T05:24:13.283 INFO:teuthology.orchestra.run.smithi100.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 81 kB/s | 54 kB 00:00 2024-05-09T05:24:13.285 INFO:teuthology.orchestra.run.smithi060.stdout:(127/156): python3-jaraco-collections-3.0.0-8.e 251 kB/s | 23 kB 00:00 2024-05-09T05:24:13.289 INFO:teuthology.orchestra.run.smithi039.stdout:(156/156): openssl-libs-3.2.1-1.el9.x86_64.rpm 11 MB/s | 2.4 MB 00:00 2024-05-09T05:24:13.292 INFO:teuthology.orchestra.run.smithi039.stdout:-------------------------------------------------------------------------------- 2024-05-09T05:24:13.292 INFO:teuthology.orchestra.run.smithi039.stdout:Total 11 MB/s | 219 MB 00:19 2024-05-09T05:24:13.311 INFO:teuthology.orchestra.run.smithi060.stdout:(128/156): python3-jaraco-functools-3.5.0-2.el9 210 kB/s | 19 kB 00:00 2024-05-09T05:24:13.336 INFO:teuthology.orchestra.run.smithi060.stdout:(129/156): python3-jaraco-text-3.2.0-6.el9.noar 195 kB/s | 20 kB 00:00 2024-05-09T05:24:13.403 INFO:teuthology.orchestra.run.smithi060.stdout:(130/156): python3-logutils-0.3.5-21.el9.noarch 504 kB/s | 46 kB 00:00 2024-05-09T05:24:13.445 INFO:teuthology.orchestra.run.smithi060.stdout:(131/156): python3-kubernetes-26.1.0-2.el9.noar 6.4 MB/s | 1.0 MB 00:00 2024-05-09T05:24:13.470 INFO:teuthology.orchestra.run.smithi060.stdout:(132/156): python3-more-itertools-8.12.0-2.el9. 589 kB/s | 79 kB 00:00 2024-05-09T05:24:13.495 INFO:teuthology.orchestra.run.smithi060.stdout:(133/156): python3-natsort-7.1.1-5.el9.noarch.r 625 kB/s | 58 kB 00:00 2024-05-09T05:24:13.562 INFO:teuthology.orchestra.run.smithi060.stdout:(134/156): python3-pecan-1.4.2-3.el9.noarch.rpm 2.3 MB/s | 272 kB 00:00 2024-05-09T05:24:13.567 INFO:teuthology.orchestra.run.smithi100.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 64 kB/s | 42 kB 00:00 2024-05-09T05:24:13.588 INFO:teuthology.orchestra.run.smithi060.stdout:(135/156): python3-portend-3.1.0-2.el9.noarch.r 140 kB/s | 16 kB 00:00 2024-05-09T05:24:13.613 INFO:teuthology.orchestra.run.smithi060.stdout:(136/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 767 kB/s | 90 kB 00:00 2024-05-09T05:24:13.655 INFO:teuthology.orchestra.run.smithi060.stdout:(137/156): python3-pyperclip-1.8.2-2.el9.noarch 306 kB/s | 28 kB 00:00 2024-05-09T05:24:13.680 INFO:teuthology.orchestra.run.smithi060.stdout:(138/156): python3-repoze-lru-0.7-16.el9.noarch 333 kB/s | 31 kB 00:00 2024-05-09T05:24:13.739 INFO:teuthology.orchestra.run.smithi060.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 1.5 MB/s | 188 kB 00:00 2024-05-09T05:24:13.764 INFO:teuthology.orchestra.run.smithi060.stdout:(140/156): python3-rsa-4.9-2.el9.noarch.rpm 543 kB/s | 59 kB 00:00 2024-05-09T05:24:13.789 INFO:teuthology.orchestra.run.smithi060.stdout:(141/156): python3-tempora-5.0.0-2.el9.noarch.r 329 kB/s | 36 kB 00:00 2024-05-09T05:24:13.831 INFO:teuthology.orchestra.run.smithi060.stdout:(142/156): python3-typing-extensions-4.4.0-2.el 553 kB/s | 51 kB 00:00 2024-05-09T05:24:13.873 INFO:teuthology.orchestra.run.smithi060.stdout:(143/156): python3-webob-1.8.7-6.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-05-09T05:24:13.899 INFO:teuthology.orchestra.run.smithi060.stdout:(144/156): python3-websocket-client-1.2.3-2.el9 822 kB/s | 90 kB 00:00 2024-05-09T05:24:13.901 INFO:teuthology.orchestra.run.smithi100.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 72 kB/s | 44 kB 00:00 2024-05-09T05:24:13.966 INFO:teuthology.orchestra.run.smithi060.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 217 kB/s | 20 kB 00:00 2024-05-09T05:24:13.999 INFO:teuthology.orchestra.run.smithi060.stdout:(146/156): python3-werkzeug-2.0.3-3.el9.1.noarc 2.5 MB/s | 427 kB 00:00 2024-05-09T05:24:14.041 INFO:teuthology.orchestra.run.smithi060.stdout:(147/156): re2-20211101-3.el9.x86_64.rpm 1.3 MB/s | 192 kB 00:00 2024-05-09T05:24:14.225 INFO:teuthology.orchestra.run.smithi060.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 6.1 MB/s | 1.6 MB 00:00 2024-05-09T05:24:14.251 INFO:teuthology.orchestra.run.smithi100.stdout:(94/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 11 MB/s | 16 MB 00:01 2024-05-09T05:24:14.460 INFO:teuthology.orchestra.run.smithi100.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 247 kB/s | 221 kB 00:00 2024-05-09T05:24:14.532 INFO:teuthology.orchestra.run.smithi039.stdout:Running transaction check 2024-05-09T05:24:14.617 INFO:teuthology.orchestra.run.smithi060.stdout:(149/156): librbd1-19.0.0-3594.gc9da4049.el9.x8 5.4 MB/s | 3.1 MB 00:00 2024-05-09T05:24:14.669 INFO:teuthology.orchestra.run.smithi100.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 47 kB/s | 36 kB 00:00 2024-05-09T05:24:14.700 INFO:teuthology.orchestra.run.smithi039.stdout:Transaction check succeeded. 2024-05-09T05:24:14.700 INFO:teuthology.orchestra.run.smithi039.stdout:Running transaction test 2024-05-09T05:24:14.784 INFO:teuthology.orchestra.run.smithi060.stdout:(150/156): librados2-19.0.0-3594.gc9da4049.el9. 4.2 MB/s | 3.3 MB 00:00 2024-05-09T05:24:14.952 INFO:teuthology.orchestra.run.smithi100.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 70 kB/s | 47 kB 00:00 2024-05-09T05:24:15.134 INFO:teuthology.orchestra.run.smithi060.stdout:(151/156): NetworkManager-team-1.47.5-1.el9.x86 119 kB/s | 42 kB 00:00 2024-05-09T05:24:15.327 INFO:teuthology.orchestra.run.smithi100.stdout:(98/156): uuid-1.6.2-55.el9.x86_64.rpm 88 kB/s | 58 kB 00:00 2024-05-09T05:24:15.369 INFO:teuthology.orchestra.run.smithi100.stdout:(99/156): socat-1.7.4.1-5.el9.x86_64.rpm 335 kB/s | 305 kB 00:00 2024-05-09T05:24:15.426 INFO:teuthology.orchestra.run.smithi060.stdout:(152/156): NetworkManager-1.47.5-1.el9.x86_64.r 1.9 MB/s | 2.3 MB 00:01 2024-05-09T05:24:15.485 INFO:teuthology.orchestra.run.smithi060.stdout:(153/156): NetworkManager-libnm-1.47.5-1.el9.x8 2.1 MB/s | 1.8 MB 00:00 2024-05-09T05:24:15.543 INFO:teuthology.orchestra.run.smithi060.stdout:(154/156): NetworkManager-tui-1.47.5-1.el9.x86_ 607 kB/s | 248 kB 00:00 2024-05-09T05:24:15.677 INFO:teuthology.orchestra.run.smithi060.stdout:(155/156): openssl-3.2.1-1.el9.x86_64.rpm 5.4 MB/s | 1.3 MB 00:00 2024-05-09T05:24:15.686 INFO:teuthology.orchestra.run.smithi100.stdout:(100/156): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 128 kB/s | 94 kB 00:00 2024-05-09T05:24:15.960 INFO:teuthology.orchestra.run.smithi060.stdout:(156/156): openssl-libs-3.2.1-1.el9.x86_64.rpm 5.0 MB/s | 2.4 MB 00:00 2024-05-09T05:24:15.963 INFO:teuthology.orchestra.run.smithi060.stdout:-------------------------------------------------------------------------------- 2024-05-09T05:24:15.964 INFO:teuthology.orchestra.run.smithi060.stdout:Total 10 MB/s | 219 MB 00:21 2024-05-09T05:24:16.037 INFO:teuthology.orchestra.run.smithi100.stdout:(101/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 67 kB/s | 45 kB 00:00 2024-05-09T05:24:16.062 INFO:teuthology.orchestra.run.smithi100.stdout:(102/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 87 kB/s | 64 kB 00:00 2024-05-09T05:24:16.295 INFO:teuthology.orchestra.run.smithi100.stdout:(103/156): abseil-cpp-20211102.0-3.el9.x86_64.r 2.3 MB/s | 548 kB 00:00 2024-05-09T05:24:16.345 INFO:teuthology.orchestra.run.smithi100.stdout:(104/156): lua-devel-5.4.4-4.el9.x86_64.rpm 34 kB/s | 22 kB 00:00 2024-05-09T05:24:16.371 INFO:teuthology.orchestra.run.smithi100.stdout:(105/156): gperftools-libs-2.9.1-2.el9.x86_64.r 6.3 MB/s | 309 kB 00:00 2024-05-09T05:24:16.479 INFO:teuthology.orchestra.run.smithi100.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 145 kB/s | 19 kB 00:00 2024-05-09T05:24:16.546 INFO:teuthology.orchestra.run.smithi100.stdout:(107/156): libarrow-9.0.0-11.el9.x86_64.rpm 30 MB/s | 4.4 MB 00:00 2024-05-09T05:24:16.563 INFO:teuthology.orchestra.run.smithi100.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 311 kB/s | 26 kB 00:00 2024-05-09T05:24:16.580 INFO:teuthology.orchestra.run.smithi100.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.4 MB/s | 49 kB 00:00 2024-05-09T05:24:16.622 INFO:teuthology.orchestra.run.smithi100.stdout:(110/156): luarocks-3.9.2-1.el9.noarch.rpm 3.6 MB/s | 151 kB 00:00 2024-05-09T05:24:16.647 INFO:teuthology.orchestra.run.smithi100.stdout:(111/156): libunwind-1.6.2-1.el9.x86_64.rpm 805 kB/s | 67 kB 00:00 2024-05-09T05:24:16.690 INFO:teuthology.orchestra.run.smithi100.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 12 MB/s | 839 kB 00:00 2024-05-09T05:24:16.748 INFO:teuthology.orchestra.run.smithi100.stdout:(113/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 745 kB/s | 43 kB 00:00 2024-05-09T05:24:16.807 INFO:teuthology.orchestra.run.smithi100.stdout:(114/156): python3-cachetools-4.2.4-1.el9.noarc 551 kB/s | 32 kB 00:00 2024-05-09T05:24:16.832 INFO:teuthology.orchestra.run.smithi100.stdout:(115/156): python3-asyncssh-2.13.2-5.el9.noarch 2.9 MB/s | 548 kB 00:00 2024-05-09T05:24:16.891 INFO:teuthology.orchestra.run.smithi100.stdout:(116/156): python3-certifi-2021.10.8-2.el9.noar 179 kB/s | 15 kB 00:00 2024-05-09T05:24:16.943 INFO:teuthology.orchestra.run.smithi039.stdout:Transaction test succeeded. 2024-05-09T05:24:16.945 INFO:teuthology.orchestra.run.smithi039.stdout:Running transaction 2024-05-09T05:24:16.958 INFO:teuthology.orchestra.run.smithi100.stdout:(117/156): python3-cheroot-8.6.0-4.el9.noarch.r 1.3 MB/s | 172 kB 00:00 2024-05-09T05:24:16.991 INFO:teuthology.orchestra.run.smithi100.stdout:(118/156): python3-cherrypy-18.6.1-2.el9.noarch 3.5 MB/s | 358 kB 00:00 2024-05-09T05:24:17.067 INFO:teuthology.orchestra.run.smithi100.stdout:(119/156): python3-colorama-0.4.4-12.el9.noarch 470 kB/s | 35 kB 00:00 2024-05-09T05:24:17.092 INFO:teuthology.orchestra.run.smithi100.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.2 MB/s | 303 kB 00:00 2024-05-09T05:24:17.159 INFO:teuthology.orchestra.run.smithi100.stdout:(121/156): python3-google-auth-2.29.0-1.el9.noa 2.2 MB/s | 206 kB 00:00 2024-05-09T05:24:17.190 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction check 2024-05-09T05:24:17.201 INFO:teuthology.orchestra.run.smithi100.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 3.4 MB/s | 144 kB 00:00 2024-05-09T05:24:17.243 INFO:teuthology.orchestra.run.smithi100.stdout:(123/156): protobuf-compiler-3.14.0-13.el9.x86_ 716 kB/s | 863 kB 00:01 2024-05-09T05:24:17.268 INFO:teuthology.orchestra.run.smithi100.stdout:(124/156): python3-jaraco-8.2.1-3.el9.noarch.rp 159 kB/s | 11 kB 00:00 2024-05-09T05:24:17.293 INFO:teuthology.orchestra.run.smithi100.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 355 kB/s | 18 kB 00:00 2024-05-09T05:24:17.358 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction check succeeded. 2024-05-09T05:24:17.358 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction test 2024-05-09T05:24:17.369 INFO:teuthology.orchestra.run.smithi100.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 410 kB/s | 19 kB 00:00 2024-05-09T05:24:17.411 INFO:teuthology.orchestra.run.smithi100.stdout:(127/156): python3-grpcio-1.46.7-10.el9.x86_64. 6.4 MB/s | 2.0 MB 00:00 2024-05-09T05:24:17.436 INFO:teuthology.orchestra.run.smithi100.stdout:(128/156): python3-jaraco-collections-3.0.0-8.e 138 kB/s | 23 kB 00:00 2024-05-09T05:24:17.461 INFO:teuthology.orchestra.run.smithi100.stdout:(129/156): python3-jaraco-text-3.2.0-6.el9.noar 213 kB/s | 20 kB 00:00 2024-05-09T05:24:17.503 INFO:teuthology.orchestra.run.smithi100.stdout:(130/156): python3-logutils-0.3.5-21.el9.noarch 1.1 MB/s | 46 kB 00:00 2024-05-09T05:24:17.537 INFO:teuthology.orchestra.run.smithi100.stdout:(131/156): python3-kubernetes-26.1.0-2.el9.noar 8.1 MB/s | 1.0 MB 00:00 2024-05-09T05:24:17.562 INFO:teuthology.orchestra.run.smithi100.stdout:(132/156): python3-more-itertools-8.12.0-2.el9. 785 kB/s | 79 kB 00:00 2024-05-09T05:24:17.587 INFO:teuthology.orchestra.run.smithi100.stdout:(133/156): python3-natsort-7.1.1-5.el9.noarch.r 687 kB/s | 58 kB 00:00 2024-05-09T05:24:17.613 INFO:teuthology.orchestra.run.smithi100.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 326 kB/s | 16 kB 00:00 2024-05-09T05:24:17.630 INFO:teuthology.orchestra.run.smithi100.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 2.1 MB/s | 90 kB 00:00 2024-05-09T05:24:17.655 INFO:teuthology.orchestra.run.smithi100.stdout:(136/156): python3-pecan-1.4.2-3.el9.noarch.rpm 2.3 MB/s | 272 kB 00:00 2024-05-09T05:24:17.680 INFO:teuthology.orchestra.run.smithi100.stdout:(137/156): python3-pyperclip-1.8.2-2.el9.noarch 420 kB/s | 28 kB 00:00 2024-05-09T05:24:17.726 INFO:teuthology.orchestra.run.smithi100.stdout:(138/156): python3-repoze-lru-0.7-16.el9.noarch 320 kB/s | 31 kB 00:00 2024-05-09T05:24:17.756 INFO:teuthology.orchestra.run.smithi100.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2024-05-09T05:24:17.781 INFO:teuthology.orchestra.run.smithi100.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 657 kB/s | 36 kB 00:00 2024-05-09T05:24:17.806 INFO:teuthology.orchestra.run.smithi100.stdout:(141/156): python3-rsa-4.9-2.el9.noarch.rpm 741 kB/s | 59 kB 00:00 2024-05-09T05:24:17.832 INFO:teuthology.orchestra.run.smithi100.stdout:(142/156): python3-typing-extensions-4.4.0-2.el 676 kB/s | 51 kB 00:00 2024-05-09T05:24:17.857 INFO:teuthology.orchestra.run.smithi100.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-05-09T05:24:17.882 INFO:teuthology.orchestra.run.smithi100.stdout:(144/156): python3-webob-1.8.7-6.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-05-09T05:24:17.908 INFO:teuthology.orchestra.run.smithi100.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-05-09T05:24:17.933 INFO:teuthology.orchestra.run.smithi100.stdout:(146/156): re2-20211101-3.el9.x86_64.rpm 3.7 MB/s | 192 kB 00:00 2024-05-09T05:24:17.958 INFO:teuthology.orchestra.run.smithi100.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-05-09T05:24:18.017 INFO:teuthology.orchestra.run.smithi100.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-05-09T05:24:18.225 INFO:teuthology.orchestra.run.smithi100.stdout:(149/156): NetworkManager-1.47.5-1.el9.x86_64.r 11 MB/s | 2.3 MB 00:00 2024-05-09T05:24:18.317 INFO:teuthology.orchestra.run.smithi100.stdout:(150/156): NetworkManager-libnm-1.47.5-1.el9.x8 20 MB/s | 1.8 MB 00:00 2024-05-09T05:24:18.359 INFO:teuthology.orchestra.run.smithi100.stdout:(151/156): NetworkManager-team-1.47.5-1.el9.x86 1.0 MB/s | 42 kB 00:00 2024-05-09T05:24:18.410 INFO:teuthology.orchestra.run.smithi100.stdout:(152/156): NetworkManager-tui-1.47.5-1.el9.x86_ 4.9 MB/s | 248 kB 00:00 2024-05-09T05:24:18.460 INFO:teuthology.orchestra.run.smithi100.stdout:(153/156): librados2-19.0.0-3594.gc9da4049.el9. 6.3 MB/s | 3.3 MB 00:00 2024-05-09T05:24:18.510 INFO:teuthology.orchestra.run.smithi100.stdout:(154/156): librbd1-19.0.0-3594.gc9da4049.el9.x8 5.6 MB/s | 3.1 MB 00:00 2024-05-09T05:24:18.544 INFO:teuthology.orchestra.run.smithi100.stdout:(155/156): openssl-3.2.1-1.el9.x86_64.rpm 10 MB/s | 1.3 MB 00:00 2024-05-09T05:24:18.661 INFO:teuthology.orchestra.run.smithi100.stdout:(156/156): openssl-libs-3.2.1-1.el9.x86_64.rpm 12 MB/s | 2.4 MB 00:00 2024-05-09T05:24:18.668 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2024-05-09T05:24:18.668 INFO:teuthology.orchestra.run.smithi100.stdout:Total 8.3 MB/s | 219 MB 00:26 2024-05-09T05:24:19.231 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction test succeeded. 2024-05-09T05:24:19.231 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction 2024-05-09T05:24:19.862 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2024-05-09T05:24:20.013 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2024-05-09T05:24:20.014 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2024-05-09T05:24:21.786 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2024-05-09T05:24:21.786 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2024-05-09T05:24:23.291 INFO:teuthology.orchestra.run.smithi039.stdout: Preparing : 1/1 2024-05-09T05:24:23.377 INFO:teuthology.orchestra.run.smithi039.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/164 2024-05-09T05:24:23.416 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-05-09T05:24:23.479 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-05-09T05:24:23.519 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-05-09T05:24:23.544 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-05-09T05:24:23.596 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-05-09T05:24:23.950 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-05-09T05:24:24.090 INFO:teuthology.orchestra.run.smithi039.stdout: Upgrading : librados2-2:19.0.0-3594.gc9da4049.el9.x86_64 8/164 2024-05-09T05:24:24.218 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: librados2-2:19.0.0-3594.gc9da4049.el9.x86_64 8/164 2024-05-09T05:24:24.254 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libcephfs2-2:19.0.0-3594.gc9da4049.el9.x86_64 9/164 2024-05-09T05:24:24.339 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: libcephfs2-2:19.0.0-3594.gc9da4049.el9.x86_64 9/164 2024-05-09T05:24:24.377 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-rados-2:19.0.0-3594.gc9da4049.el9.x86_64 10/164 2024-05-09T05:24:24.579 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/164 2024-05-09T05:24:24.648 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/164 2024-05-09T05:24:24.675 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libcephsqlite-2:19.0.0-3594.gc9da4049.el9.x86_64 13/164 2024-05-09T05:24:24.766 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3594.gc9da4049.el9.x86_64 13/164 2024-05-09T05:24:24.793 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libradosstriper1-2:19.0.0-3594.gc9da4049.el9.x86 14/164 2024-05-09T05:24:24.856 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3594.gc9da4049.el9.x86 14/164 2024-05-09T05:24:24.885 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-09T05:24:24.908 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-09T05:24:25.055 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-09T05:24:25.228 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-09T05:24:25.365 INFO:teuthology.orchestra.run.smithi039.stdout: Upgrading : NetworkManager-libnm-1:1.47.5-1.el9.x86_64 17/164 2024-05-09T05:24:25.426 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.5-1.el9.x86_64 17/164 2024-05-09T05:24:25.544 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-09T05:24:25.549 INFO:teuthology.orchestra.run.smithi060.stdout: Preparing : 1/1 2024-05-09T05:24:25.610 INFO:teuthology.orchestra.run.smithi039.stdout: Upgrading : NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-09T05:24:25.623 INFO:teuthology.orchestra.run.smithi060.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/164 2024-05-09T05:24:25.663 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-05-09T05:24:25.724 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-05-09T05:24:25.758 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-05-09T05:24:25.783 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-05-09T05:24:25.832 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-09T05:24:25.850 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-05-09T05:24:25.945 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : re2-1:20211101-3.el9.x86_64 19/164 2024-05-09T05:24:25.974 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-05-09T05:24:26.009 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : liboath-2.6.7-2.el9.x86_64 21/164 2024-05-09T05:24:26.086 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 22/164 2024-05-09T05:24:26.133 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 23/164 2024-05-09T05:24:26.176 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 24/164 2024-05-09T05:24:26.206 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-05-09T05:24:26.209 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 25/164 2024-05-09T05:24:26.236 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : lua-5.4.4-4.el9.x86_64 26/164 2024-05-09T05:24:26.309 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 27/164 2024-05-09T05:24:26.317 INFO:teuthology.orchestra.run.smithi060.stdout: Upgrading : librados2-2:19.0.0-3594.gc9da4049.el9.x86_64 8/164 2024-05-09T05:24:26.360 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 28/164 2024-05-09T05:24:26.389 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 29/164 2024-05-09T05:24:26.433 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 30/164 2024-05-09T05:24:26.445 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librados2-2:19.0.0-3594.gc9da4049.el9.x86_64 8/164 2024-05-09T05:24:26.468 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libcephfs2-2:19.0.0-3594.gc9da4049.el9.x86_64 9/164 2024-05-09T05:24:26.512 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 31/164 2024-05-09T05:24:26.543 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-ceph-common-2:19.0.0-3594.gc9da4049.el9. 32/164 2024-05-09T05:24:26.562 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: libcephfs2-2:19.0.0-3594.gc9da4049.el9.x86_64 9/164 2024-05-09T05:24:26.587 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-ceph-argparse-2:19.0.0-3594.gc9da4049.el 33/164 2024-05-09T05:24:26.589 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-rados-2:19.0.0-3594.gc9da4049.el9.x86_64 10/164 2024-05-09T05:24:26.615 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-cephfs-2:19.0.0-3594.gc9da4049.el9.x86_6 34/164 2024-05-09T05:24:26.691 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 35/164 2024-05-09T05:24:26.747 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : luarocks-3.9.2-1.el9.noarch 36/164 2024-05-09T05:24:26.750 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/164 2024-05-09T05:24:26.804 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/164 2024-05-09T05:24:26.831 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libcephsqlite-2:19.0.0-3594.gc9da4049.el9.x86_64 13/164 2024-05-09T05:24:26.833 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 37/164 2024-05-09T05:24:26.938 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3594.gc9da4049.el9.x86_64 13/164 2024-05-09T05:24:26.974 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libradosstriper1-2:19.0.0-3594.gc9da4049.el9.x86 14/164 2024-05-09T05:24:26.979 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 38/164 2024-05-09T05:24:27.037 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3594.gc9da4049.el9.x86 14/164 2024-05-09T05:24:27.042 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 39/164 2024-05-09T05:24:27.059 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-09T05:24:27.084 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-09T05:24:27.286 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-09T05:24:27.413 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-09T05:24:27.547 INFO:teuthology.orchestra.run.smithi060.stdout: Upgrading : NetworkManager-libnm-1:1.47.5-1.el9.x86_64 17/164 2024-05-09T05:24:27.608 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-rsa-4.9-2.el9.noarch 40/164 2024-05-09T05:24:27.609 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.5-1.el9.x86_64 17/164 2024-05-09T05:24:27.698 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 41/164 2024-05-09T05:24:27.720 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-09T05:24:27.732 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 42/164 2024-05-09T05:24:27.775 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 43/164 2024-05-09T05:24:27.785 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2024-05-09T05:24:27.801 INFO:teuthology.orchestra.run.smithi060.stdout: Upgrading : NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-09T05:24:27.813 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : librados-devel-2:19.0.0-3594.gc9da4049.el9.x86_6 44/164 2024-05-09T05:24:27.878 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 45/164 2024-05-09T05:24:27.882 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/164 2024-05-09T05:24:27.929 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-05-09T05:24:27.982 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-05-09T05:24:28.016 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-09T05:24:28.016 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-05-09T05:24:28.042 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-05-09T05:24:28.052 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 46/164 2024-05-09T05:24:28.084 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-05-09T05:24:28.116 INFO:teuthology.orchestra.run.smithi039.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 47/164 2024-05-09T05:24:28.129 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : re2-1:20211101-3.el9.x86_64 19/164 2024-05-09T05:24:28.164 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-05-09T05:24:28.200 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : liboath-2.6.7-2.el9.x86_64 21/164 2024-05-09T05:24:28.212 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 48/164 2024-05-09T05:24:28.273 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 49/164 2024-05-09T05:24:28.275 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 22/164 2024-05-09T05:24:28.316 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 23/164 2024-05-09T05:24:28.348 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 50/164 2024-05-09T05:24:28.359 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 24/164 2024-05-09T05:24:28.383 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 51/164 2024-05-09T05:24:28.391 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 25/164 2024-05-09T05:24:28.410 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-05-09T05:24:28.419 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : lua-5.4.4-4.el9.x86_64 26/164 2024-05-09T05:24:28.428 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 52/164 2024-05-09T05:24:28.477 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 53/164 2024-05-09T05:24:28.491 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 27/164 2024-05-09T05:24:28.511 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 54/164 2024-05-09T05:24:28.517 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : librados2-2:19.0.0-3594.gc9da4049.el9.x86_64 8/164 2024-05-09T05:24:28.554 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 55/164 2024-05-09T05:24:28.560 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 28/164 2024-05-09T05:24:28.589 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 29/164 2024-05-09T05:24:28.605 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 56/164 2024-05-09T05:24:28.626 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 30/164 2024-05-09T05:24:28.644 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librados2-2:19.0.0-3594.gc9da4049.el9.x86_64 8/164 2024-05-09T05:24:28.669 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libcephfs2-2:19.0.0-3594.gc9da4049.el9.x86_64 9/164 2024-05-09T05:24:28.704 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 31/164 2024-05-09T05:24:28.735 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-ceph-common-2:19.0.0-3594.gc9da4049.el9. 32/164 2024-05-09T05:24:28.751 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 57/164 2024-05-09T05:24:28.760 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libcephfs2-2:19.0.0-3594.gc9da4049.el9.x86_64 9/164 2024-05-09T05:24:28.780 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-ceph-argparse-2:19.0.0-3594.gc9da4049.el 33/164 2024-05-09T05:24:28.790 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-rados-2:19.0.0-3594.gc9da4049.el9.x86_64 10/164 2024-05-09T05:24:28.793 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 58/164 2024-05-09T05:24:28.807 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cephfs-2:19.0.0-3594.gc9da4049.el9.x86_6 34/164 2024-05-09T05:24:28.823 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 59/164 2024-05-09T05:24:28.866 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 60/164 2024-05-09T05:24:28.882 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 35/164 2024-05-09T05:24:28.931 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : luarocks-3.9.2-1.el9.noarch 36/164 2024-05-09T05:24:28.944 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/164 2024-05-09T05:24:28.965 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-05-09T05:24:28.998 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 62/164 2024-05-09T05:24:29.009 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 37/164 2024-05-09T05:24:29.023 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/164 2024-05-09T05:24:29.040 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-05-09T05:24:29.050 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libcephsqlite-2:19.0.0-3594.gc9da4049.el9.x86_64 13/164 2024-05-09T05:24:29.072 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-05-09T05:24:29.113 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-05-09T05:24:29.155 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 38/164 2024-05-09T05:24:29.156 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3594.gc9da4049.el9.x86_64 13/164 2024-05-09T05:24:29.186 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libradosstriper1-2:19.0.0-3594.gc9da4049.el9.x86 14/164 2024-05-09T05:24:29.209 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 39/164 2024-05-09T05:24:29.214 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-05-09T05:24:29.250 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3594.gc9da4049.el9.x86 14/164 2024-05-09T05:24:29.278 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-09T05:24:29.303 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-09T05:24:29.347 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-05-09T05:24:29.378 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-05-09T05:24:29.407 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-05-09T05:24:29.463 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-05-09T05:24:29.506 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-05-09T05:24:29.537 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-09T05:24:29.545 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-05-09T05:24:29.575 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-05-09T05:24:29.609 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-05-09T05:24:29.643 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-05-09T05:24:29.665 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-09T05:24:29.685 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-05-09T05:24:29.731 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-05-09T05:24:29.773 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-rsa-4.9-2.el9.noarch 40/164 2024-05-09T05:24:29.817 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-05-09T05:24:29.866 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 41/164 2024-05-09T05:24:29.875 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-05-09T05:24:29.892 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : NetworkManager-libnm-1:1.47.5-1.el9.x86_64 17/164 2024-05-09T05:24:29.905 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-05-09T05:24:29.908 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 42/164 2024-05-09T05:24:29.951 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 43/164 2024-05-09T05:24:29.952 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.5-1.el9.x86_64 17/164 2024-05-09T05:24:29.953 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-05-09T05:24:29.989 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : librados-devel-2:19.0.0-3594.gc9da4049.el9.x86_6 44/164 2024-05-09T05:24:30.031 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 45/164 2024-05-09T05:24:30.065 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-packaging-20.9-5.el9.noarch 82/164 2024-05-09T05:24:30.066 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-09T05:24:30.125 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/164 2024-05-09T05:24:30.154 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-09T05:24:30.190 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 46/164 2024-05-09T05:24:30.242 INFO:teuthology.orchestra.run.smithi060.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 47/164 2024-05-09T05:24:30.338 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 48/164 2024-05-09T05:24:30.353 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-09T05:24:30.399 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 49/164 2024-05-09T05:24:30.459 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : re2-1:20211101-3.el9.x86_64 19/164 2024-05-09T05:24:30.482 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 50/164 2024-05-09T05:24:30.483 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-05-09T05:24:30.509 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : liboath-2.6.7-2.el9.x86_64 21/164 2024-05-09T05:24:30.518 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 51/164 2024-05-09T05:24:30.555 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 52/164 2024-05-09T05:24:30.574 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 22/164 2024-05-09T05:24:30.603 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 53/164 2024-05-09T05:24:30.609 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 23/164 2024-05-09T05:24:30.638 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 54/164 2024-05-09T05:24:30.652 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 24/164 2024-05-09T05:24:30.681 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 55/164 2024-05-09T05:24:30.685 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 25/164 2024-05-09T05:24:30.713 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : lua-5.4.4-4.el9.x86_64 26/164 2024-05-09T05:24:30.723 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 56/164 2024-05-09T05:24:30.781 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 27/164 2024-05-09T05:24:30.835 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 28/164 2024-05-09T05:24:30.866 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 29/164 2024-05-09T05:24:30.869 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 57/164 2024-05-09T05:24:30.901 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 30/164 2024-05-09T05:24:30.902 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/164 2024-05-09T05:24:30.912 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 58/164 2024-05-09T05:24:30.942 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 59/164 2024-05-09T05:24:30.953 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/164 2024-05-09T05:24:30.977 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 31/164 2024-05-09T05:24:30.984 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 60/164 2024-05-09T05:24:30.987 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/164 2024-05-09T05:24:31.012 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-ceph-common-2:19.0.0-3594.gc9da4049.el9. 32/164 2024-05-09T05:24:31.055 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-ceph-argparse-2:19.0.0-3594.gc9da4049.el 33/164 2024-05-09T05:24:31.084 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-05-09T05:24:31.085 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cephfs-2:19.0.0-3594.gc9da4049.el9.x86_6 34/164 2024-05-09T05:24:31.091 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/164 2024-05-09T05:24:31.154 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 35/164 2024-05-09T05:24:31.155 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 88/164 2024-05-09T05:24:31.167 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 62/164 2024-05-09T05:24:31.207 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-05-09T05:24:31.224 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : luarocks-3.9.2-1.el9.noarch 36/164 2024-05-09T05:24:31.232 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-05-09T05:24:31.244 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-05-09T05:24:31.257 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-05-09T05:24:31.280 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-05-09T05:24:31.298 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 37/164 2024-05-09T05:24:31.335 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-05-09T05:24:31.434 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 38/164 2024-05-09T05:24:31.466 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-05-09T05:24:31.466 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : openblas-0.3.21-2.el9.x86_64 91/164 2024-05-09T05:24:31.493 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 39/164 2024-05-09T05:24:31.494 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 92/164 2024-05-09T05:24:31.506 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-05-09T05:24:31.534 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-05-09T05:24:31.568 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-05-09T05:24:31.575 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-05-09T05:24:31.608 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-05-09T05:24:31.648 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-05-09T05:24:31.677 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-05-09T05:24:31.712 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-05-09T05:24:31.745 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-05-09T05:24:31.788 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-05-09T05:24:31.821 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-05-09T05:24:31.913 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-05-09T05:24:31.961 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-05-09T05:24:31.992 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-05-09T05:24:32.024 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-rsa-4.9-2.el9.noarch 40/164 2024-05-09T05:24:32.040 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-05-09T05:24:32.106 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 41/164 2024-05-09T05:24:32.143 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 42/164 2024-05-09T05:24:32.151 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-packaging-20.9-5.el9.noarch 82/164 2024-05-09T05:24:32.186 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 43/164 2024-05-09T05:24:32.203 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/164 2024-05-09T05:24:32.223 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : librados-devel-2:19.0.0-3594.gc9da4049.el9.x86_6 44/164 2024-05-09T05:24:32.265 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 45/164 2024-05-09T05:24:32.293 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-05-09T05:24:32.405 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-05-09T05:24:32.429 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 46/164 2024-05-09T05:24:32.494 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 47/164 2024-05-09T05:24:32.585 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 48/164 2024-05-09T05:24:32.657 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 49/164 2024-05-09T05:24:32.731 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 50/164 2024-05-09T05:24:32.762 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 51/164 2024-05-09T05:24:32.798 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 52/164 2024-05-09T05:24:32.844 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 53/164 2024-05-09T05:24:32.881 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 54/164 2024-05-09T05:24:32.924 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 55/164 2024-05-09T05:24:32.966 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 56/164 2024-05-09T05:24:32.986 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/164 2024-05-09T05:24:33.032 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/164 2024-05-09T05:24:33.066 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/164 2024-05-09T05:24:33.111 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 57/164 2024-05-09T05:24:33.155 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 58/164 2024-05-09T05:24:33.272 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/164 2024-05-09T05:24:33.272 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 88/164 2024-05-09T05:24:33.272 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 59/164 2024-05-09T05:24:33.272 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 60/164 2024-05-09T05:24:33.316 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-05-09T05:24:33.322 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-05-09T05:24:33.351 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 62/164 2024-05-09T05:24:33.352 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-05-09T05:24:33.391 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-05-09T05:24:33.417 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-05-09T05:24:33.465 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-05-09T05:24:33.554 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : openblas-0.3.21-2.el9.x86_64 91/164 2024-05-09T05:24:33.583 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 92/164 2024-05-09T05:24:33.654 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-05-09T05:24:33.662 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-05-09T05:24:33.739 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-05-09T05:24:33.815 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-05-09T05:24:33.845 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-05-09T05:24:33.876 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 99/164 2024-05-09T05:24:33.928 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-05-09T05:24:33.975 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-05-09T05:24:34.011 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-05-09T05:24:34.045 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-05-09T05:24:34.084 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-05-09T05:24:34.116 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-05-09T05:24:34.145 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-05-09T05:24:34.180 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-05-09T05:24:34.213 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-05-09T05:24:34.213 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-05-09T05:24:34.255 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-05-09T05:24:34.255 INFO:teuthology.orchestra.run.smithi039.stdout: Upgrading : librbd1-2:19.0.0-3594.gc9da4049.el9.x86_64 101/164 2024-05-09T05:24:34.290 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-05-09T05:24:34.347 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: librbd1-2:19.0.0-3594.gc9da4049.el9.x86_64 101/164 2024-05-09T05:24:34.360 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-05-09T05:24:34.376 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-05-09T05:24:34.377 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-rbd-2:19.0.0-3594.gc9da4049.el9.x86_64 102/164 2024-05-09T05:24:34.420 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-05-09T05:24:34.420 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-05-09T05:24:34.451 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-05-09T05:24:34.486 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-05-09T05:24:34.498 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-05-09T05:24:34.596 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-packaging-20.9-5.el9.noarch 82/164 2024-05-09T05:24:34.644 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/164 2024-05-09T05:24:34.941 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-05-09T05:24:34.966 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : librgw2-2:19.0.0-3594.gc9da4049.el9.x86_64 105/164 2024-05-09T05:24:35.022 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: librgw2-2:19.0.0-3594.gc9da4049.el9.x86_64 105/164 2024-05-09T05:24:35.051 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-rgw-2:19.0.0-3594.gc9da4049.el9.x86_64 106/164 2024-05-09T05:24:35.381 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/164 2024-05-09T05:24:35.425 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/164 2024-05-09T05:24:35.459 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/164 2024-05-09T05:24:35.558 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/164 2024-05-09T05:24:35.617 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 88/164 2024-05-09T05:24:35.704 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-05-09T05:24:35.752 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-05-09T05:24:35.810 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-05-09T05:24:35.889 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-05-09T05:24:35.917 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-05-09T05:24:35.929 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : openblas-0.3.21-2.el9.x86_64 91/164 2024-05-09T05:24:35.950 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 99/164 2024-05-09T05:24:35.958 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 92/164 2024-05-09T05:24:36.038 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-05-09T05:24:36.286 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-05-09T05:24:36.330 INFO:teuthology.orchestra.run.smithi060.stdout: Upgrading : librbd1-2:19.0.0-3594.gc9da4049.el9.x86_64 101/164 2024-05-09T05:24:36.422 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librbd1-2:19.0.0-3594.gc9da4049.el9.x86_64 101/164 2024-05-09T05:24:36.451 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-rbd-2:19.0.0-3594.gc9da4049.el9.x86_64 102/164 2024-05-09T05:24:36.488 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-05-09T05:24:36.685 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-05-09T05:24:36.799 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-05-09T05:24:37.008 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-05-09T05:24:37.033 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : librgw2-2:19.0.0-3594.gc9da4049.el9.x86_64 105/164 2024-05-09T05:24:37.104 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librgw2-2:19.0.0-3594.gc9da4049.el9.x86_64 105/164 2024-05-09T05:24:37.164 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-rgw-2:19.0.0-3594.gc9da4049.el9.x86_64 106/164 2024-05-09T05:24:37.452 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-common-2:19.0.0-3594.gc9da4049.el9.x86_64 107/164 2024-05-09T05:24:37.474 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-common-2:19.0.0-3594.gc9da4049.el9.x86_64 107/164 2024-05-09T05:24:38.032 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-05-09T05:24:38.083 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-common-2:19.0.0-3594.gc9da4049.el9.x86_64 107/164 2024-05-09T05:24:38.120 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-base-2:19.0.0-3594.gc9da4049.el9.x86_64 108/164 2024-05-09T05:24:38.122 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-05-09T05:24:38.151 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-05-09T05:24:38.183 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 99/164 2024-05-09T05:24:38.198 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-base-2:19.0.0-3594.gc9da4049.el9.x86_64 108/164 2024-05-09T05:24:38.198 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-09T05:24:38.199 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-09T05:24:38.199 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-09T05:24:38.236 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-selinux-2:19.0.0-3594.gc9da4049.el9.x86_64 109/164 2024-05-09T05:24:38.500 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-05-09T05:24:38.546 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : librbd1-2:19.0.0-3594.gc9da4049.el9.x86_64 101/164 2024-05-09T05:24:38.628 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librbd1-2:19.0.0-3594.gc9da4049.el9.x86_64 101/164 2024-05-09T05:24:38.659 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-rbd-2:19.0.0-3594.gc9da4049.el9.x86_64 102/164 2024-05-09T05:24:38.694 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-05-09T05:24:39.183 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-05-09T05:24:39.473 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : librgw2-2:19.0.0-3594.gc9da4049.el9.x86_64 105/164 2024-05-09T05:24:39.492 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-common-2:19.0.0-3594.gc9da4049.el9.x86_64 107/164 2024-05-09T05:24:39.523 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-common-2:19.0.0-3594.gc9da4049.el9.x86_64 107/164 2024-05-09T05:24:39.540 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librgw2-2:19.0.0-3594.gc9da4049.el9.x86_64 105/164 2024-05-09T05:24:39.566 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-rgw-2:19.0.0-3594.gc9da4049.el9.x86_64 106/164 2024-05-09T05:24:40.113 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-common-2:19.0.0-3594.gc9da4049.el9.x86_64 107/164 2024-05-09T05:24:40.151 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-base-2:19.0.0-3594.gc9da4049.el9.x86_64 108/164 2024-05-09T05:24:40.252 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-base-2:19.0.0-3594.gc9da4049.el9.x86_64 108/164 2024-05-09T05:24:40.252 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-09T05:24:40.252 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-09T05:24:40.252 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-05-09T05:24:40.285 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-selinux-2:19.0.0-3594.gc9da4049.el9.x86_64 109/164 2024-05-09T05:24:41.828 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-common-2:19.0.0-3594.gc9da4049.el9.x86_64 107/164 2024-05-09T05:24:41.863 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-common-2:19.0.0-3594.gc9da4049.el9.x86_64 107/164 2024-05-09T05:24:42.422 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-common-2:19.0.0-3594.gc9da4049.el9.x86_64 107/164 2024-05-09T05:24:42.466 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-base-2:19.0.0-3594.gc9da4049.el9.x86_64 108/164 2024-05-09T05:24:42.559 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-base-2:19.0.0-3594.gc9da4049.el9.x86_64 108/164 2024-05-09T05:24:42.559 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-09T05:24:42.559 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-09T05:24:42.559 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:24:42.595 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-selinux-2:19.0.0-3594.gc9da4049.el9.x86_64 109/164 2024-05-09T05:24:50.011 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3594.gc9da4049.el9.x86_64 109/164 2024-05-09T05:24:50.011 INFO:teuthology.orchestra.run.smithi039.stdout:skipping the directory /sys 2024-05-09T05:24:50.011 INFO:teuthology.orchestra.run.smithi039.stdout:skipping the directory /proc 2024-05-09T05:24:50.011 INFO:teuthology.orchestra.run.smithi039.stdout:skipping the directory /mnt 2024-05-09T05:24:50.011 INFO:teuthology.orchestra.run.smithi039.stdout:skipping the directory /var/tmp 2024-05-09T05:24:50.011 INFO:teuthology.orchestra.run.smithi039.stdout:skipping the directory /home 2024-05-09T05:24:50.011 INFO:teuthology.orchestra.run.smithi039.stdout:skipping the directory /root 2024-05-09T05:24:50.011 INFO:teuthology.orchestra.run.smithi039.stdout:skipping the directory /tmp 2024-05-09T05:24:50.011 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-09T05:24:50.193 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-volume-2:19.0.0-3594.gc9da4049.el9.noarch 110/164 2024-05-09T05:24:50.210 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-volume-2:19.0.0-3594.gc9da4049.el9.noarch 110/164 2024-05-09T05:24:50.210 INFO:teuthology.orchestra.run.smithi039.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T05:24:50.210 INFO:teuthology.orchestra.run.smithi039.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-09T05:24:50.211 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-09T05:24:51.863 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-osd-2:19.0.0-3594.gc9da4049.el9.x86_64 111/164 2024-05-09T05:24:51.891 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-osd-2:19.0.0-3594.gc9da4049.el9.x86_64 111/164 2024-05-09T05:24:51.892 INFO:teuthology.orchestra.run.smithi039.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T05:24:51.892 INFO:teuthology.orchestra.run.smithi039.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-09T05:24:51.892 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-09T05:24:51.892 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-09T05:24:51.892 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-09T05:24:52.121 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-mds-2:19.0.0-3594.gc9da4049.el9.x86_64 112/164 2024-05-09T05:24:52.147 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-mds-2:19.0.0-3594.gc9da4049.el9.x86_64 112/164 2024-05-09T05:24:52.147 INFO:teuthology.orchestra.run.smithi039.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T05:24:52.147 INFO:teuthology.orchestra.run.smithi039.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-09T05:24:52.147 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-09T05:24:52.147 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-09T05:24:52.147 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-09T05:24:52.249 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3594.gc9da4049.el9.x86_64 109/164 2024-05-09T05:24:52.249 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /sys 2024-05-09T05:24:52.249 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /proc 2024-05-09T05:24:52.249 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /mnt 2024-05-09T05:24:52.249 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /var/tmp 2024-05-09T05:24:52.249 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /home 2024-05-09T05:24:52.250 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /root 2024-05-09T05:24:52.250 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /tmp 2024-05-09T05:24:52.250 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-05-09T05:24:52.425 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-volume-2:19.0.0-3594.gc9da4049.el9.noarch 110/164 2024-05-09T05:24:52.441 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-volume-2:19.0.0-3594.gc9da4049.el9.noarch 110/164 2024-05-09T05:24:52.442 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T05:24:52.442 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-09T05:24:52.442 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-05-09T05:24:52.639 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-mon-2:19.0.0-3594.gc9da4049.el9.x86_64 113/164 2024-05-09T05:24:52.665 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-mon-2:19.0.0-3594.gc9da4049.el9.x86_64 113/164 2024-05-09T05:24:52.665 INFO:teuthology.orchestra.run.smithi039.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T05:24:52.665 INFO:teuthology.orchestra.run.smithi039.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-09T05:24:52.665 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-09T05:24:52.665 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-09T05:24:52.665 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-09T05:24:52.778 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-05-09T05:24:52.836 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-05-09T05:24:52.900 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-05-09T05:24:53.096 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-05-09T05:24:53.149 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-05-09T05:24:53.230 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-05-09T05:24:53.319 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-05-09T05:24:53.461 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-05-09T05:24:53.519 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-05-09T05:24:53.556 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-05-09T05:24:53.583 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : fuse-2.9.9-15.el9.x86_64 124/164 2024-05-09T05:24:53.981 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: cephadm-2:19.0.0-3594.gc9da4049.el9.noarch 125/164 2024-05-09T05:24:54.007 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : cephadm-2:19.0.0-3594.gc9da4049.el9.noarch 125/164 2024-05-09T05:24:54.042 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3594.gc9da4049.e 126/164 2024-05-09T05:24:54.087 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-osd-2:19.0.0-3594.gc9da4049.el9.x86_64 111/164 2024-05-09T05:24:54.104 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3594.gc9da4049. 127/164 2024-05-09T05:24:54.115 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-osd-2:19.0.0-3594.gc9da4049.el9.x86_64 111/164 2024-05-09T05:24:54.115 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T05:24:54.115 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-09T05:24:54.115 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-09T05:24:54.115 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-09T05:24:54.115 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-05-09T05:24:54.130 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3594.gc9da4049.el9.noa 128/164 2024-05-09T05:24:54.215 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3594.gc9da4049.el9.x86_64 109/164 2024-05-09T05:24:54.215 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /sys 2024-05-09T05:24:54.215 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /proc 2024-05-09T05:24:54.215 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /mnt 2024-05-09T05:24:54.215 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /var/tmp 2024-05-09T05:24:54.215 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /home 2024-05-09T05:24:54.215 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /root 2024-05-09T05:24:54.215 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /tmp 2024-05-09T05:24:54.215 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:24:54.354 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mds-2:19.0.0-3594.gc9da4049.el9.x86_64 112/164 2024-05-09T05:24:54.378 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mds-2:19.0.0-3594.gc9da4049.el9.x86_64 112/164 2024-05-09T05:24:54.378 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T05:24:54.379 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-09T05:24:54.379 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-09T05:24:54.379 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-09T05:24:54.379 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-05-09T05:24:54.392 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-volume-2:19.0.0-3594.gc9da4049.el9.noarch 110/164 2024-05-09T05:24:54.408 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-volume-2:19.0.0-3594.gc9da4049.el9.noarch 110/164 2024-05-09T05:24:54.408 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T05:24:54.408 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-09T05:24:54.408 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:24:54.863 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mon-2:19.0.0-3594.gc9da4049.el9.x86_64 113/164 2024-05-09T05:24:54.888 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mon-2:19.0.0-3594.gc9da4049.el9.x86_64 113/164 2024-05-09T05:24:54.888 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T05:24:54.888 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-09T05:24:54.888 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-09T05:24:54.888 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-09T05:24:54.888 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-05-09T05:24:54.994 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-05-09T05:24:55.052 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-05-09T05:24:55.117 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-05-09T05:24:55.230 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3594.gc9da4049.el9.noa 128/164 2024-05-09T05:24:55.266 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3594.gc9da4049.el9.n 129/164 2024-05-09T05:24:55.313 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-05-09T05:24:55.365 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-05-09T05:24:55.446 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-05-09T05:24:55.536 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-05-09T05:24:55.679 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-05-09T05:24:55.732 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-05-09T05:24:55.763 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-05-09T05:24:55.791 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : fuse-2.9.9-15.el9.x86_64 124/164 2024-05-09T05:24:55.986 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-osd-2:19.0.0-3594.gc9da4049.el9.x86_64 111/164 2024-05-09T05:24:56.012 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-osd-2:19.0.0-3594.gc9da4049.el9.x86_64 111/164 2024-05-09T05:24:56.012 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T05:24:56.012 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-09T05:24:56.012 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-09T05:24:56.013 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-09T05:24:56.013 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:24:56.237 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mds-2:19.0.0-3594.gc9da4049.el9.x86_64 112/164 2024-05-09T05:24:56.260 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mds-2:19.0.0-3594.gc9da4049.el9.x86_64 112/164 2024-05-09T05:24:56.260 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T05:24:56.260 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-09T05:24:56.260 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-09T05:24:56.260 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-09T05:24:56.261 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:24:56.270 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: cephadm-2:19.0.0-3594.gc9da4049.el9.noarch 125/164 2024-05-09T05:24:56.283 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3594.gc9da4049.el9.n 129/164 2024-05-09T05:24:56.298 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : cephadm-2:19.0.0-3594.gc9da4049.el9.noarch 125/164 2024-05-09T05:24:56.308 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3594.gc9d 130/164 2024-05-09T05:24:56.339 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3594.gc9da4049.e 126/164 2024-05-09T05:24:56.403 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3594.gc9da4049. 127/164 2024-05-09T05:24:56.429 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3594.gc9d 130/164 2024-05-09T05:24:56.429 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3594.gc9da4049.el9.noa 128/164 2024-05-09T05:24:56.599 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3594.gc9da4049.el 131/164 2024-05-09T05:24:56.627 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-mgr-2:19.0.0-3594.gc9da4049.el9.x86_64 132/164 2024-05-09T05:24:56.653 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3594.gc9da4049.el9.x86_64 132/164 2024-05-09T05:24:56.653 INFO:teuthology.orchestra.run.smithi039.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T05:24:56.653 INFO:teuthology.orchestra.run.smithi039.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-09T05:24:56.653 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-09T05:24:56.653 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-09T05:24:56.653 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-09T05:24:56.703 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-mgr-rook-2:19.0.0-3594.gc9da4049.el9.noarch 133/164 2024-05-09T05:24:56.715 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3594.gc9da4049.el9.noarch 133/164 2024-05-09T05:24:56.729 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mon-2:19.0.0-3594.gc9da4049.el9.x86_64 113/164 2024-05-09T05:24:56.752 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mon-2:19.0.0-3594.gc9da4049.el9.x86_64 113/164 2024-05-09T05:24:56.752 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T05:24:56.752 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-09T05:24:56.753 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-09T05:24:56.753 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-09T05:24:56.753 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:24:56.816 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-2:19.0.0-3594.gc9da4049.el9.x86_64 134/164 2024-05-09T05:24:56.851 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-05-09T05:24:56.874 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-fuse-2:19.0.0-3594.gc9da4049.el9.x86_64 135/164 2024-05-09T05:24:56.900 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-05-09T05:24:56.955 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-05-09T05:24:57.141 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-05-09T05:24:57.188 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-05-09T05:24:57.259 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-05-09T05:24:57.347 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-05-09T05:24:57.487 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-05-09T05:24:57.533 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3594.gc9da4049.el9.noa 128/164 2024-05-09T05:24:57.538 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-05-09T05:24:57.564 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3594.gc9da4049.el9.n 129/164 2024-05-09T05:24:57.570 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-05-09T05:24:57.598 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : fuse-2.9.9-15.el9.x86_64 124/164 2024-05-09T05:24:57.857 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libtool-2.4.6-45.el9.x86_64 136/164 2024-05-09T05:24:57.889 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-radosgw-2:19.0.0-3594.gc9da4049.el9.x86_64 137/164 2024-05-09T05:24:57.914 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3594.gc9da4049.el9.x86_64 137/164 2024-05-09T05:24:57.914 INFO:teuthology.orchestra.run.smithi039.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T05:24:57.914 INFO:teuthology.orchestra.run.smithi039.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-09T05:24:57.914 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-09T05:24:57.914 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-09T05:24:57.914 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-09T05:24:57.956 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3594.gc9da4 138/164 2024-05-09T05:24:57.981 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3594.gc9da4 138/164 2024-05-09T05:24:57.981 INFO:teuthology.orchestra.run.smithi039.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T05:24:57.981 INFO:teuthology.orchestra.run.smithi039.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-09T05:24:57.981 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-09T05:24:58.032 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : cephfs-mirror-2:19.0.0-3594.gc9da4049.el9.x86_64 139/164 2024-05-09T05:24:58.049 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: cephadm-2:19.0.0-3594.gc9da4049.el9.noarch 125/164 2024-05-09T05:24:58.057 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3594.gc9da4049.el9.x86_64 139/164 2024-05-09T05:24:58.057 INFO:teuthology.orchestra.run.smithi039.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T05:24:58.057 INFO:teuthology.orchestra.run.smithi039.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-09T05:24:58.057 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-09T05:24:58.057 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-09T05:24:58.057 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-09T05:24:58.080 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : cephadm-2:19.0.0-3594.gc9da4049.el9.noarch 125/164 2024-05-09T05:24:58.112 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3594.gc9da4049.e 126/164 2024-05-09T05:24:58.181 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3594.gc9da4049. 127/164 2024-05-09T05:24:58.211 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3594.gc9da4049.el9.noa 128/164 2024-05-09T05:24:58.391 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : rbd-mirror-2:19.0.0-3594.gc9da4049.el9.x86_64 140/164 2024-05-09T05:24:58.416 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3594.gc9da4049.el9.x86_64 140/164 2024-05-09T05:24:58.416 INFO:teuthology.orchestra.run.smithi039.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T05:24:58.416 INFO:teuthology.orchestra.run.smithi039.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-09T05:24:58.416 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-09T05:24:58.416 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-09T05:24:58.416 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-09T05:24:58.587 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3594.gc9da4049.el9.n 129/164 2024-05-09T05:24:58.615 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3594.gc9d 130/164 2024-05-09T05:24:58.734 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3594.gc9d 130/164 2024-05-09T05:24:58.906 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3594.gc9da4049.el 131/164 2024-05-09T05:24:58.934 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-2:19.0.0-3594.gc9da4049.el9.x86_64 132/164 2024-05-09T05:24:58.959 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3594.gc9da4049.el9.x86_64 132/164 2024-05-09T05:24:58.959 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T05:24:58.959 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-09T05:24:58.959 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-09T05:24:58.959 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-09T05:24:58.959 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-05-09T05:24:59.009 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-rook-2:19.0.0-3594.gc9da4049.el9.noarch 133/164 2024-05-09T05:24:59.020 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3594.gc9da4049.el9.noarch 133/164 2024-05-09T05:24:59.131 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-2:19.0.0-3594.gc9da4049.el9.x86_64 134/164 2024-05-09T05:24:59.184 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-fuse-2:19.0.0-3594.gc9da4049.el9.x86_64 135/164 2024-05-09T05:24:59.253 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3594.gc9da4049.el9.noa 128/164 2024-05-09T05:24:59.296 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3594.gc9da4049.el9.n 129/164 2024-05-09T05:25:00.173 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libtool-2.4.6-45.el9.x86_64 136/164 2024-05-09T05:25:00.204 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-radosgw-2:19.0.0-3594.gc9da4049.el9.x86_64 137/164 2024-05-09T05:25:00.229 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3594.gc9da4049.el9.x86_64 137/164 2024-05-09T05:25:00.229 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T05:25:00.229 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-09T05:25:00.229 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-09T05:25:00.229 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-09T05:25:00.229 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-05-09T05:25:00.261 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3594.gc9da4049.el9.n 129/164 2024-05-09T05:25:00.271 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3594.gc9da4 138/164 2024-05-09T05:25:00.294 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3594.gc9da4 138/164 2024-05-09T05:25:00.295 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T05:25:00.295 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-09T05:25:00.295 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-05-09T05:25:00.297 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3594.gc9d 130/164 2024-05-09T05:25:00.347 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : cephfs-mirror-2:19.0.0-3594.gc9da4049.el9.x86_64 139/164 2024-05-09T05:25:00.371 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3594.gc9da4049.el9.x86_64 139/164 2024-05-09T05:25:00.371 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T05:25:00.371 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-09T05:25:00.371 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-09T05:25:00.371 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-09T05:25:00.371 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-05-09T05:25:00.410 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3594.gc9d 130/164 2024-05-09T05:25:00.599 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3594.gc9da4049.el 131/164 2024-05-09T05:25:00.632 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-2:19.0.0-3594.gc9da4049.el9.x86_64 132/164 2024-05-09T05:25:00.656 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3594.gc9da4049.el9.x86_64 132/164 2024-05-09T05:25:00.656 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T05:25:00.656 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-09T05:25:00.656 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-09T05:25:00.656 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-09T05:25:00.656 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:25:00.697 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : rbd-mirror-2:19.0.0-3594.gc9da4049.el9.x86_64 140/164 2024-05-09T05:25:00.699 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-rook-2:19.0.0-3594.gc9da4049.el9.noarch 133/164 2024-05-09T05:25:00.711 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3594.gc9da4049.el9.noarch 133/164 2024-05-09T05:25:00.721 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3594.gc9da4049.el9.x86_64 140/164 2024-05-09T05:25:00.721 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T05:25:00.722 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-09T05:25:00.722 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-09T05:25:00.722 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-09T05:25:00.722 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-05-09T05:25:00.809 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-2:19.0.0-3594.gc9da4049.el9.x86_64 134/164 2024-05-09T05:25:00.864 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-fuse-2:19.0.0-3594.gc9da4049.el9.x86_64 135/164 2024-05-09T05:25:01.797 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libtool-2.4.6-45.el9.x86_64 136/164 2024-05-09T05:25:01.827 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-radosgw-2:19.0.0-3594.gc9da4049.el9.x86_64 137/164 2024-05-09T05:25:01.850 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3594.gc9da4049.el9.x86_64 137/164 2024-05-09T05:25:01.850 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T05:25:01.850 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-09T05:25:01.850 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-09T05:25:01.850 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-09T05:25:01.851 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:25:01.903 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3594.gc9da4 138/164 2024-05-09T05:25:01.925 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3594.gc9da4 138/164 2024-05-09T05:25:01.925 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T05:25:01.925 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-09T05:25:01.925 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:25:01.970 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : cephfs-mirror-2:19.0.0-3594.gc9da4049.el9.x86_64 139/164 2024-05-09T05:25:01.992 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3594.gc9da4049.el9.x86_64 139/164 2024-05-09T05:25:01.993 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T05:25:01.993 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-09T05:25:01.993 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-09T05:25:01.993 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-09T05:25:01.993 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:25:02.325 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : rbd-mirror-2:19.0.0-3594.gc9da4049.el9.x86_64 140/164 2024-05-09T05:25:02.348 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3594.gc9da4049.el9.x86_64 140/164 2024-05-09T05:25:02.348 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-09T05:25:02.348 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-09T05:25:02.348 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-09T05:25:02.348 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-09T05:25:02.349 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:25:02.929 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-test-2:19.0.0-3594.gc9da4049.el9.x86_64 141/164 2024-05-09T05:25:02.971 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : rbd-fuse-2:19.0.0-3594.gc9da4049.el9.x86_64 142/164 2024-05-09T05:25:03.012 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : rbd-nbd-2:19.0.0-3594.gc9da4049.el9.x86_64 143/164 2024-05-09T05:25:03.043 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 144/164 2024-05-09T05:25:03.087 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 145/164 2024-05-09T05:25:03.277 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : cephfs-shell-2:19.0.0-3594.gc9da4049.el9.x86_64 146/164 2024-05-09T05:25:03.327 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 147/164 2024-05-09T05:25:03.356 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libcephfs-devel-2:19.0.0-3594.gc9da4049.el9.x86_ 148/164 2024-05-09T05:25:03.386 INFO:teuthology.orchestra.run.smithi039.stdout: Upgrading : NetworkManager-team-1:1.47.5-1.el9.x86_64 149/164 2024-05-09T05:25:03.424 INFO:teuthology.orchestra.run.smithi039.stdout: Upgrading : NetworkManager-tui-1:1.47.5-1.el9.x86_64 150/164 2024-05-09T05:25:03.996 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-09T05:25:04.038 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-09T05:25:04.060 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-09T05:25:04.976 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : cephfs-top-2:19.0.0-3594.gc9da4049.el9.noarch 152/164 2024-05-09T05:25:05.060 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 153/164 2024-05-09T05:25:05.113 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-05-09T05:25:05.206 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-05-09T05:25:05.239 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-05-09T05:25:05.251 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-test-2:19.0.0-3594.gc9da4049.el9.x86_64 141/164 2024-05-09T05:25:05.265 INFO:teuthology.orchestra.run.smithi039.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 157/164 2024-05-09T05:25:05.265 INFO:teuthology.orchestra.run.smithi039.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-09T05:25:05.293 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : rbd-fuse-2:19.0.0-3594.gc9da4049.el9.x86_64 142/164 2024-05-09T05:25:05.333 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-09T05:25:05.333 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : rbd-nbd-2:19.0.0-3594.gc9da4049.el9.x86_64 143/164 2024-05-09T05:25:05.365 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 144/164 2024-05-09T05:25:05.374 INFO:teuthology.orchestra.run.smithi039.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 159/164 2024-05-09T05:25:05.375 INFO:teuthology.orchestra.run.smithi039.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-09T05:25:05.393 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 145/164 2024-05-09T05:25:05.443 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-09T05:25:05.468 INFO:teuthology.orchestra.run.smithi039.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 161/164 2024-05-09T05:25:05.484 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-09T05:25:05.484 INFO:teuthology.orchestra.run.smithi039.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-09T05:25:05.586 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : cephfs-shell-2:19.0.0-3594.gc9da4049.el9.x86_64 146/164 2024-05-09T05:25:05.630 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 147/164 2024-05-09T05:25:05.652 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libcephfs-devel-2:19.0.0-3594.gc9da4049.el9.x86_ 148/164 2024-05-09T05:25:05.670 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-09T05:25:05.670 INFO:teuthology.orchestra.run.smithi039.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-09T05:25:05.682 INFO:teuthology.orchestra.run.smithi060.stdout: Upgrading : NetworkManager-team-1:1.47.5-1.el9.x86_64 149/164 2024-05-09T05:25:05.720 INFO:teuthology.orchestra.run.smithi060.stdout: Upgrading : NetworkManager-tui-1:1.47.5-1.el9.x86_64 150/164 2024-05-09T05:25:05.754 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-09T05:25:05.822 INFO:teuthology.orchestra.run.smithi039.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-09T05:25:06.375 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-09T05:25:06.418 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-09T05:25:06.439 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-09T05:25:06.616 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-test-2:19.0.0-3594.gc9da4049.el9.x86_64 141/164 2024-05-09T05:25:06.666 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : rbd-fuse-2:19.0.0-3594.gc9da4049.el9.x86_64 142/164 2024-05-09T05:25:06.707 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : rbd-nbd-2:19.0.0-3594.gc9da4049.el9.x86_64 143/164 2024-05-09T05:25:06.739 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 144/164 2024-05-09T05:25:06.766 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 145/164 2024-05-09T05:25:06.953 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : cephfs-shell-2:19.0.0-3594.gc9da4049.el9.x86_64 146/164 2024-05-09T05:25:06.995 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 147/164 2024-05-09T05:25:07.025 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libcephfs-devel-2:19.0.0-3594.gc9da4049.el9.x86_ 148/164 2024-05-09T05:25:07.055 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : NetworkManager-team-1:1.47.5-1.el9.x86_64 149/164 2024-05-09T05:25:07.101 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : NetworkManager-tui-1:1.47.5-1.el9.x86_64 150/164 2024-05-09T05:25:07.349 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : cephfs-top-2:19.0.0-3594.gc9da4049.el9.noarch 152/164 2024-05-09T05:25:07.470 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 153/164 2024-05-09T05:25:07.515 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-05-09T05:25:07.600 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-05-09T05:25:07.634 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-05-09T05:25:07.648 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-09T05:25:07.660 INFO:teuthology.orchestra.run.smithi060.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 157/164 2024-05-09T05:25:07.660 INFO:teuthology.orchestra.run.smithi060.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-09T05:25:07.690 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-09T05:25:07.710 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-09T05:25:07.753 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-09T05:25:07.786 INFO:teuthology.orchestra.run.smithi060.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 159/164 2024-05-09T05:25:07.786 INFO:teuthology.orchestra.run.smithi060.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-09T05:25:07.870 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-09T05:25:07.895 INFO:teuthology.orchestra.run.smithi060.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 161/164 2024-05-09T05:25:07.901 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-09T05:25:07.901 INFO:teuthology.orchestra.run.smithi060.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-09T05:25:08.089 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-09T05:25:08.089 INFO:teuthology.orchestra.run.smithi060.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-09T05:25:08.166 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-09T05:25:08.242 INFO:teuthology.orchestra.run.smithi060.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-09T05:25:08.540 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : cephfs-top-2:19.0.0-3594.gc9da4049.el9.noarch 152/164 2024-05-09T05:25:08.654 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 153/164 2024-05-09T05:25:08.703 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-05-09T05:25:08.794 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-05-09T05:25:08.831 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-05-09T05:25:08.857 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 157/164 2024-05-09T05:25:08.858 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-09T05:25:08.942 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-09T05:25:08.967 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 159/164 2024-05-09T05:25:08.967 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-09T05:25:09.051 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-09T05:25:09.077 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 161/164 2024-05-09T05:25:09.081 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-09T05:25:09.081 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-09T05:25:09.271 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-09T05:25:09.271 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-09T05:25:09.354 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-09T05:25:09.417 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-09T05:25:11.471 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-09T05:25:11.472 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-2:19.0.0-3594.gc9da4049.el9.x86_64 1/164 2024-05-09T05:25:11.472 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-base-2:19.0.0-3594.gc9da4049.el9.x86_64 2/164 2024-05-09T05:25:11.472 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-common-2:19.0.0-3594.gc9da4049.el9.x86_64 3/164 2024-05-09T05:25:11.472 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-fuse-2:19.0.0-3594.gc9da4049.el9.x86_64 4/164 2024-05-09T05:25:11.472 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3594.gc9da4 5/164 2024-05-09T05:25:11.472 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-mds-2:19.0.0-3594.gc9da4049.el9.x86_64 6/164 2024-05-09T05:25:11.472 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-mgr-2:19.0.0-3594.gc9da4049.el9.x86_64 7/164 2024-05-09T05:25:11.472 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-mon-2:19.0.0-3594.gc9da4049.el9.x86_64 8/164 2024-05-09T05:25:11.472 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-osd-2:19.0.0-3594.gc9da4049.el9.x86_64 9/164 2024-05-09T05:25:11.472 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-radosgw-2:19.0.0-3594.gc9da4049.el9.x86_64 10/164 2024-05-09T05:25:11.472 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-selinux-2:19.0.0-3594.gc9da4049.el9.x86_64 11/164 2024-05-09T05:25:11.472 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-test-2:19.0.0-3594.gc9da4049.el9.x86_64 12/164 2024-05-09T05:25:11.472 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : cephfs-mirror-2:19.0.0-3594.gc9da4049.el9.x86_64 13/164 2024-05-09T05:25:11.473 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : cephfs-shell-2:19.0.0-3594.gc9da4049.el9.x86_64 14/164 2024-05-09T05:25:11.473 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libcephfs-devel-2:19.0.0-3594.gc9da4049.el9.x86_ 15/164 2024-05-09T05:25:11.473 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libcephfs2-2:19.0.0-3594.gc9da4049.el9.x86_64 16/164 2024-05-09T05:25:11.473 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libcephsqlite-2:19.0.0-3594.gc9da4049.el9.x86_64 17/164 2024-05-09T05:25:11.473 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : librados-devel-2:19.0.0-3594.gc9da4049.el9.x86_6 18/164 2024-05-09T05:25:11.473 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libradosstriper1-2:19.0.0-3594.gc9da4049.el9.x86 19/164 2024-05-09T05:25:11.473 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : librgw2-2:19.0.0-3594.gc9da4049.el9.x86_64 20/164 2024-05-09T05:25:11.473 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3594.gc9da4049.el 21/164 2024-05-09T05:25:11.473 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-ceph-common-2:19.0.0-3594.gc9da4049.el9. 22/164 2024-05-09T05:25:11.473 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-cephfs-2:19.0.0-3594.gc9da4049.el9.x86_6 23/164 2024-05-09T05:25:11.473 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-rados-2:19.0.0-3594.gc9da4049.el9.x86_64 24/164 2024-05-09T05:25:11.473 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-rbd-2:19.0.0-3594.gc9da4049.el9.x86_64 25/164 2024-05-09T05:25:11.473 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-rgw-2:19.0.0-3594.gc9da4049.el9.x86_64 26/164 2024-05-09T05:25:11.473 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : rbd-fuse-2:19.0.0-3594.gc9da4049.el9.x86_64 27/164 2024-05-09T05:25:11.474 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : rbd-mirror-2:19.0.0-3594.gc9da4049.el9.x86_64 28/164 2024-05-09T05:25:11.474 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : rbd-nbd-2:19.0.0-3594.gc9da4049.el9.x86_64 29/164 2024-05-09T05:25:11.474 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3594.gc9da4049. 30/164 2024-05-09T05:25:11.474 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3594.gc9da4049.el9.noa 31/164 2024-05-09T05:25:11.474 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3594.gc9da4049.el9.n 32/164 2024-05-09T05:25:11.474 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3594.gc9d 33/164 2024-05-09T05:25:11.474 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3594.gc9da4049.el 34/164 2024-05-09T05:25:11.474 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3594.gc9da4049.el9.noarch 35/164 2024-05-09T05:25:11.474 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3594.gc9da4049.e 36/164 2024-05-09T05:25:11.474 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-volume-2:19.0.0-3594.gc9da4049.el9.noarch 37/164 2024-05-09T05:25:11.474 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : cephadm-2:19.0.0-3594.gc9da4049.el9.noarch 38/164 2024-05-09T05:25:11.474 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : cephfs-top-2:19.0.0-3594.gc9da4049.el9.noarch 39/164 2024-05-09T05:25:11.475 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/164 2024-05-09T05:25:11.475 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/164 2024-05-09T05:25:11.475 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/164 2024-05-09T05:25:11.475 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-05-09T05:25:11.475 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-05-09T05:25:11.475 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-05-09T05:25:11.475 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-05-09T05:25:11.475 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-05-09T05:25:11.475 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/164 2024-05-09T05:25:11.475 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-05-09T05:25:11.475 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-05-09T05:25:11.475 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-05-09T05:25:11.475 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/164 2024-05-09T05:25:11.475 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-05-09T05:25:11.476 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-05-09T05:25:11.476 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-05-09T05:25:11.476 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-05-09T05:25:11.476 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-05-09T05:25:11.476 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-05-09T05:25:11.476 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-05-09T05:25:11.476 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-05-09T05:25:11.476 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/164 2024-05-09T05:25:11.476 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/164 2024-05-09T05:25:11.476 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-05-09T05:25:11.476 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-05-09T05:25:11.476 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-05-09T05:25:11.476 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/164 2024-05-09T05:25:11.477 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/164 2024-05-09T05:25:11.477 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/164 2024-05-09T05:25:11.477 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/164 2024-05-09T05:25:11.477 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/164 2024-05-09T05:25:11.477 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/164 2024-05-09T05:25:11.477 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/164 2024-05-09T05:25:11.477 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-05-09T05:25:11.477 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-05-09T05:25:11.477 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-05-09T05:25:11.477 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/164 2024-05-09T05:25:11.477 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/164 2024-05-09T05:25:11.477 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/164 2024-05-09T05:25:11.477 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/164 2024-05-09T05:25:11.477 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/164 2024-05-09T05:25:11.478 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/164 2024-05-09T05:25:11.478 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/164 2024-05-09T05:25:11.478 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/164 2024-05-09T05:25:11.478 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/164 2024-05-09T05:25:11.478 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/164 2024-05-09T05:25:11.478 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/164 2024-05-09T05:25:11.478 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/164 2024-05-09T05:25:11.478 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/164 2024-05-09T05:25:11.478 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/164 2024-05-09T05:25:11.478 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/164 2024-05-09T05:25:11.478 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/164 2024-05-09T05:25:11.478 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/164 2024-05-09T05:25:11.478 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/164 2024-05-09T05:25:11.479 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/164 2024-05-09T05:25:11.479 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/164 2024-05-09T05:25:11.479 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/164 2024-05-09T05:25:11.479 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/164 2024-05-09T05:25:11.479 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/164 2024-05-09T05:25:11.479 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/164 2024-05-09T05:25:11.479 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/164 2024-05-09T05:25:11.479 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/164 2024-05-09T05:25:11.479 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/164 2024-05-09T05:25:11.479 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/164 2024-05-09T05:25:11.479 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/164 2024-05-09T05:25:11.479 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/164 2024-05-09T05:25:11.479 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/164 2024-05-09T05:25:11.479 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/164 2024-05-09T05:25:11.480 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/164 2024-05-09T05:25:11.480 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/164 2024-05-09T05:25:11.480 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/164 2024-05-09T05:25:11.480 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/164 2024-05-09T05:25:11.480 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/164 2024-05-09T05:25:11.480 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/164 2024-05-09T05:25:11.480 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/164 2024-05-09T05:25:11.480 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/164 2024-05-09T05:25:11.480 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/164 2024-05-09T05:25:11.480 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/164 2024-05-09T05:25:11.480 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/164 2024-05-09T05:25:11.480 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/164 2024-05-09T05:25:11.480 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/164 2024-05-09T05:25:11.481 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/164 2024-05-09T05:25:11.481 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/164 2024-05-09T05:25:11.481 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-05-09T05:25:11.481 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-05-09T05:25:11.481 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-05-09T05:25:11.481 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-05-09T05:25:11.481 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-05-09T05:25:11.481 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-05-09T05:25:11.481 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-05-09T05:25:11.481 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-05-09T05:25:11.481 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-05-09T05:25:11.481 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-05-09T05:25:11.481 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-05-09T05:25:11.481 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-05-09T05:25:11.482 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-05-09T05:25:11.482 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-05-09T05:25:11.482 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-05-09T05:25:11.482 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-05-09T05:25:11.482 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-05-09T05:25:11.482 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-05-09T05:25:11.482 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-05-09T05:25:11.482 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/164 2024-05-09T05:25:11.482 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/164 2024-05-09T05:25:11.482 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-05-09T05:25:11.482 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-05-09T05:25:11.482 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-05-09T05:25:11.482 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/164 2024-05-09T05:25:11.483 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-05-09T05:25:11.483 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : librados2-2:19.0.0-3594.gc9da4049.el9.x86_64 149/164 2024-05-09T05:25:11.483 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-05-09T05:25:11.483 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : librbd1-2:19.0.0-3594.gc9da4049.el9.x86_64 151/164 2024-05-09T05:25:11.483 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-05-09T05:25:11.483 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : NetworkManager-1:1.47.5-1.el9.x86_64 153/164 2024-05-09T05:25:11.483 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/164 2024-05-09T05:25:11.483 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : NetworkManager-libnm-1:1.47.5-1.el9.x86_64 155/164 2024-05-09T05:25:11.483 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/164 2024-05-09T05:25:11.483 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : NetworkManager-team-1:1.47.5-1.el9.x86_64 157/164 2024-05-09T05:25:11.483 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/164 2024-05-09T05:25:11.483 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : NetworkManager-tui-1:1.47.5-1.el9.x86_64 159/164 2024-05-09T05:25:11.483 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/164 2024-05-09T05:25:11.483 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 161/164 2024-05-09T05:25:11.483 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 162/164 2024-05-09T05:25:11.484 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 163/164 2024-05-09T05:25:13.940 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-09T05:25:13.940 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-2:19.0.0-3594.gc9da4049.el9.x86_64 1/164 2024-05-09T05:25:13.940 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-base-2:19.0.0-3594.gc9da4049.el9.x86_64 2/164 2024-05-09T05:25:13.940 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-common-2:19.0.0-3594.gc9da4049.el9.x86_64 3/164 2024-05-09T05:25:13.940 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-fuse-2:19.0.0-3594.gc9da4049.el9.x86_64 4/164 2024-05-09T05:25:13.941 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3594.gc9da4 5/164 2024-05-09T05:25:13.941 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mds-2:19.0.0-3594.gc9da4049.el9.x86_64 6/164 2024-05-09T05:25:13.941 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-2:19.0.0-3594.gc9da4049.el9.x86_64 7/164 2024-05-09T05:25:13.941 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mon-2:19.0.0-3594.gc9da4049.el9.x86_64 8/164 2024-05-09T05:25:13.941 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-osd-2:19.0.0-3594.gc9da4049.el9.x86_64 9/164 2024-05-09T05:25:13.941 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-radosgw-2:19.0.0-3594.gc9da4049.el9.x86_64 10/164 2024-05-09T05:25:13.941 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-selinux-2:19.0.0-3594.gc9da4049.el9.x86_64 11/164 2024-05-09T05:25:13.941 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-test-2:19.0.0-3594.gc9da4049.el9.x86_64 12/164 2024-05-09T05:25:13.941 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : cephfs-mirror-2:19.0.0-3594.gc9da4049.el9.x86_64 13/164 2024-05-09T05:25:13.941 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : cephfs-shell-2:19.0.0-3594.gc9da4049.el9.x86_64 14/164 2024-05-09T05:25:13.941 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libcephfs-devel-2:19.0.0-3594.gc9da4049.el9.x86_ 15/164 2024-05-09T05:25:13.941 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libcephfs2-2:19.0.0-3594.gc9da4049.el9.x86_64 16/164 2024-05-09T05:25:13.941 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libcephsqlite-2:19.0.0-3594.gc9da4049.el9.x86_64 17/164 2024-05-09T05:25:13.941 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librados-devel-2:19.0.0-3594.gc9da4049.el9.x86_6 18/164 2024-05-09T05:25:13.942 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libradosstriper1-2:19.0.0-3594.gc9da4049.el9.x86 19/164 2024-05-09T05:25:13.942 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librgw2-2:19.0.0-3594.gc9da4049.el9.x86_64 20/164 2024-05-09T05:25:13.942 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3594.gc9da4049.el 21/164 2024-05-09T05:25:13.942 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-ceph-common-2:19.0.0-3594.gc9da4049.el9. 22/164 2024-05-09T05:25:13.942 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cephfs-2:19.0.0-3594.gc9da4049.el9.x86_6 23/164 2024-05-09T05:25:13.942 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-rados-2:19.0.0-3594.gc9da4049.el9.x86_64 24/164 2024-05-09T05:25:13.942 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-rbd-2:19.0.0-3594.gc9da4049.el9.x86_64 25/164 2024-05-09T05:25:13.942 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-rgw-2:19.0.0-3594.gc9da4049.el9.x86_64 26/164 2024-05-09T05:25:13.942 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : rbd-fuse-2:19.0.0-3594.gc9da4049.el9.x86_64 27/164 2024-05-09T05:25:13.942 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : rbd-mirror-2:19.0.0-3594.gc9da4049.el9.x86_64 28/164 2024-05-09T05:25:13.942 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : rbd-nbd-2:19.0.0-3594.gc9da4049.el9.x86_64 29/164 2024-05-09T05:25:13.942 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3594.gc9da4049. 30/164 2024-05-09T05:25:13.942 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3594.gc9da4049.el9.noa 31/164 2024-05-09T05:25:13.943 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3594.gc9da4049.el9.n 32/164 2024-05-09T05:25:13.943 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3594.gc9d 33/164 2024-05-09T05:25:13.943 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3594.gc9da4049.el 34/164 2024-05-09T05:25:13.943 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3594.gc9da4049.el9.noarch 35/164 2024-05-09T05:25:13.943 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3594.gc9da4049.e 36/164 2024-05-09T05:25:13.943 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-volume-2:19.0.0-3594.gc9da4049.el9.noarch 37/164 2024-05-09T05:25:13.943 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : cephadm-2:19.0.0-3594.gc9da4049.el9.noarch 38/164 2024-05-09T05:25:13.943 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : cephfs-top-2:19.0.0-3594.gc9da4049.el9.noarch 39/164 2024-05-09T05:25:13.943 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/164 2024-05-09T05:25:13.943 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/164 2024-05-09T05:25:13.943 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/164 2024-05-09T05:25:13.943 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-05-09T05:25:13.943 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-05-09T05:25:13.944 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-05-09T05:25:13.944 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-05-09T05:25:13.944 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-05-09T05:25:13.944 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/164 2024-05-09T05:25:13.944 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-05-09T05:25:13.944 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-05-09T05:25:13.944 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-05-09T05:25:13.944 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/164 2024-05-09T05:25:13.944 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-05-09T05:25:13.944 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-05-09T05:25:13.945 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-05-09T05:25:13.945 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-05-09T05:25:13.945 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-05-09T05:25:13.945 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-05-09T05:25:13.945 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-05-09T05:25:13.945 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-05-09T05:25:13.946 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/164 2024-05-09T05:25:13.946 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/164 2024-05-09T05:25:13.946 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-05-09T05:25:13.946 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-05-09T05:25:13.946 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-05-09T05:25:13.946 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/164 2024-05-09T05:25:13.946 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/164 2024-05-09T05:25:13.946 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/164 2024-05-09T05:25:13.946 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/164 2024-05-09T05:25:13.946 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/164 2024-05-09T05:25:13.947 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/164 2024-05-09T05:25:13.947 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/164 2024-05-09T05:25:13.947 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-05-09T05:25:13.947 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-05-09T05:25:13.947 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-05-09T05:25:13.947 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/164 2024-05-09T05:25:13.947 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/164 2024-05-09T05:25:13.947 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/164 2024-05-09T05:25:13.947 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/164 2024-05-09T05:25:13.947 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/164 2024-05-09T05:25:13.947 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/164 2024-05-09T05:25:13.947 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/164 2024-05-09T05:25:13.947 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/164 2024-05-09T05:25:13.947 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/164 2024-05-09T05:25:13.948 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/164 2024-05-09T05:25:13.948 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/164 2024-05-09T05:25:13.948 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/164 2024-05-09T05:25:13.948 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/164 2024-05-09T05:25:13.948 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/164 2024-05-09T05:25:13.948 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/164 2024-05-09T05:25:13.948 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/164 2024-05-09T05:25:13.948 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/164 2024-05-09T05:25:13.948 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/164 2024-05-09T05:25:13.948 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/164 2024-05-09T05:25:13.948 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/164 2024-05-09T05:25:13.948 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/164 2024-05-09T05:25:13.948 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/164 2024-05-09T05:25:13.948 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/164 2024-05-09T05:25:13.949 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/164 2024-05-09T05:25:13.949 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/164 2024-05-09T05:25:13.949 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/164 2024-05-09T05:25:13.949 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/164 2024-05-09T05:25:13.949 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/164 2024-05-09T05:25:13.949 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/164 2024-05-09T05:25:13.949 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/164 2024-05-09T05:25:13.949 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/164 2024-05-09T05:25:13.949 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/164 2024-05-09T05:25:13.949 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/164 2024-05-09T05:25:13.949 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/164 2024-05-09T05:25:13.949 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/164 2024-05-09T05:25:13.949 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/164 2024-05-09T05:25:13.949 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/164 2024-05-09T05:25:13.950 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/164 2024-05-09T05:25:13.950 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/164 2024-05-09T05:25:13.950 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/164 2024-05-09T05:25:13.950 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/164 2024-05-09T05:25:13.950 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/164 2024-05-09T05:25:13.950 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/164 2024-05-09T05:25:13.950 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/164 2024-05-09T05:25:13.950 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/164 2024-05-09T05:25:13.950 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/164 2024-05-09T05:25:13.950 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/164 2024-05-09T05:25:13.950 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-05-09T05:25:13.950 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-05-09T05:25:13.950 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-05-09T05:25:13.951 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-05-09T05:25:13.951 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-05-09T05:25:13.951 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-05-09T05:25:13.951 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-05-09T05:25:13.951 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-05-09T05:25:13.951 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-05-09T05:25:13.951 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-05-09T05:25:13.951 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-05-09T05:25:13.951 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-05-09T05:25:13.951 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-05-09T05:25:13.951 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-05-09T05:25:13.951 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-05-09T05:25:13.951 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-05-09T05:25:13.951 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-05-09T05:25:13.952 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-05-09T05:25:13.952 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-05-09T05:25:13.952 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/164 2024-05-09T05:25:13.952 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/164 2024-05-09T05:25:13.952 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-05-09T05:25:13.952 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-05-09T05:25:13.952 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-05-09T05:25:13.952 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/164 2024-05-09T05:25:13.952 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-05-09T05:25:13.952 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librados2-2:19.0.0-3594.gc9da4049.el9.x86_64 149/164 2024-05-09T05:25:13.952 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-05-09T05:25:13.952 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librbd1-2:19.0.0-3594.gc9da4049.el9.x86_64 151/164 2024-05-09T05:25:13.952 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-05-09T05:25:13.952 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : NetworkManager-1:1.47.5-1.el9.x86_64 153/164 2024-05-09T05:25:13.953 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/164 2024-05-09T05:25:13.953 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : NetworkManager-libnm-1:1.47.5-1.el9.x86_64 155/164 2024-05-09T05:25:13.953 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/164 2024-05-09T05:25:13.953 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : NetworkManager-team-1:1.47.5-1.el9.x86_64 157/164 2024-05-09T05:25:13.953 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/164 2024-05-09T05:25:13.953 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : NetworkManager-tui-1:1.47.5-1.el9.x86_64 159/164 2024-05-09T05:25:13.953 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/164 2024-05-09T05:25:13.953 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 161/164 2024-05-09T05:25:13.953 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 162/164 2024-05-09T05:25:13.953 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 163/164 2024-05-09T05:25:14.103 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-09T05:25:14.103 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-09T05:25:14.103 INFO:teuthology.orchestra.run.smithi039.stdout:Upgraded: 2024-05-09T05:25:14.103 INFO:teuthology.orchestra.run.smithi039.stdout: NetworkManager-1:1.47.5-1.el9.x86_64 2024-05-09T05:25:14.103 INFO:teuthology.orchestra.run.smithi039.stdout: NetworkManager-libnm-1:1.47.5-1.el9.x86_64 2024-05-09T05:25:14.103 INFO:teuthology.orchestra.run.smithi039.stdout: NetworkManager-team-1:1.47.5-1.el9.x86_64 2024-05-09T05:25:14.103 INFO:teuthology.orchestra.run.smithi039.stdout: NetworkManager-tui-1:1.47.5-1.el9.x86_64 2024-05-09T05:25:14.103 INFO:teuthology.orchestra.run.smithi039.stdout: librados2-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T05:25:14.103 INFO:teuthology.orchestra.run.smithi039.stdout: librbd1-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T05:25:14.104 INFO:teuthology.orchestra.run.smithi039.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-09T05:25:14.104 INFO:teuthology.orchestra.run.smithi039.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-09T05:25:14.104 INFO:teuthology.orchestra.run.smithi039.stdout:Installed: 2024-05-09T05:25:14.104 INFO:teuthology.orchestra.run.smithi039.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-09T05:25:14.104 INFO:teuthology.orchestra.run.smithi039.stdout: automake-1.16.2-8.el9.noarch 2024-05-09T05:25:14.104 INFO:teuthology.orchestra.run.smithi039.stdout: bison-3.7.4-5.el9.x86_64 2024-05-09T05:25:14.104 INFO:teuthology.orchestra.run.smithi039.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-09T05:25:14.104 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T05:25:14.104 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-base-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T05:25:14.104 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-common-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T05:25:14.104 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-fuse-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T05:25:14.104 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-grafana-dashboards-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T05:25:14.105 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-immutable-object-cache-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T05:25:14.105 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mds-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T05:25:14.105 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T05:25:14.105 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-cephadm-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T05:25:14.105 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-dashboard-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T05:25:14.105 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T05:25:14.105 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-modules-core-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T05:25:14.105 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-rook-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T05:25:14.105 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mon-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T05:25:14.105 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-osd-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T05:25:14.105 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-prometheus-alerts-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T05:25:14.105 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-radosgw-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T05:25:14.105 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-selinux-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T05:25:14.106 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-test-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T05:25:14.106 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-volume-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T05:25:14.106 INFO:teuthology.orchestra.run.smithi039.stdout: cephadm-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T05:25:14.106 INFO:teuthology.orchestra.run.smithi039.stdout: cephfs-mirror-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T05:25:14.106 INFO:teuthology.orchestra.run.smithi039.stdout: cephfs-shell-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T05:25:14.106 INFO:teuthology.orchestra.run.smithi039.stdout: cephfs-top-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T05:25:14.106 INFO:teuthology.orchestra.run.smithi039.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-05-09T05:25:14.106 INFO:teuthology.orchestra.run.smithi039.stdout: flex-2.6.4-9.el9.x86_64 2024-05-09T05:25:14.106 INFO:teuthology.orchestra.run.smithi039.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-09T05:25:14.106 INFO:teuthology.orchestra.run.smithi039.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-09T05:25:14.106 INFO:teuthology.orchestra.run.smithi039.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-09T05:25:14.106 INFO:teuthology.orchestra.run.smithi039.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-09T05:25:14.107 INFO:teuthology.orchestra.run.smithi039.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-09T05:25:14.107 INFO:teuthology.orchestra.run.smithi039.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-09T05:25:14.107 INFO:teuthology.orchestra.run.smithi039.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-09T05:25:14.107 INFO:teuthology.orchestra.run.smithi039.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-09T05:25:14.107 INFO:teuthology.orchestra.run.smithi039.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-09T05:25:14.107 INFO:teuthology.orchestra.run.smithi039.stdout: libcephfs-devel-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T05:25:14.107 INFO:teuthology.orchestra.run.smithi039.stdout: libcephfs2-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T05:25:14.107 INFO:teuthology.orchestra.run.smithi039.stdout: libcephsqlite-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T05:25:14.107 INFO:teuthology.orchestra.run.smithi039.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-09T05:25:14.107 INFO:teuthology.orchestra.run.smithi039.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-09T05:25:14.107 INFO:teuthology.orchestra.run.smithi039.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-09T05:25:14.107 INFO:teuthology.orchestra.run.smithi039.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-09T05:25:14.107 INFO:teuthology.orchestra.run.smithi039.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-09T05:25:14.107 INFO:teuthology.orchestra.run.smithi039.stdout: librados-devel-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T05:25:14.108 INFO:teuthology.orchestra.run.smithi039.stdout: libradosstriper1-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T05:25:14.108 INFO:teuthology.orchestra.run.smithi039.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-09T05:25:14.108 INFO:teuthology.orchestra.run.smithi039.stdout: librgw2-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T05:25:14.108 INFO:teuthology.orchestra.run.smithi039.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-09T05:25:14.108 INFO:teuthology.orchestra.run.smithi039.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-09T05:25:14.108 INFO:teuthology.orchestra.run.smithi039.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-09T05:25:14.108 INFO:teuthology.orchestra.run.smithi039.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-09T05:25:14.108 INFO:teuthology.orchestra.run.smithi039.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-09T05:25:14.108 INFO:teuthology.orchestra.run.smithi039.stdout: lua-5.4.4-4.el9.x86_64 2024-05-09T05:25:14.108 INFO:teuthology.orchestra.run.smithi039.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-09T05:25:14.108 INFO:teuthology.orchestra.run.smithi039.stdout: luarocks-3.9.2-1.el9.noarch 2024-05-09T05:25:14.108 INFO:teuthology.orchestra.run.smithi039.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-09T05:25:14.108 INFO:teuthology.orchestra.run.smithi039.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-09T05:25:14.109 INFO:teuthology.orchestra.run.smithi039.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-09T05:25:14.109 INFO:teuthology.orchestra.run.smithi039.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-09T05:25:14.109 INFO:teuthology.orchestra.run.smithi039.stdout: postgresql-13.14-1.el9.x86_64 2024-05-09T05:25:14.109 INFO:teuthology.orchestra.run.smithi039.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-09T05:25:14.109 INFO:teuthology.orchestra.run.smithi039.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-09T05:25:14.109 INFO:teuthology.orchestra.run.smithi039.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-09T05:25:14.109 INFO:teuthology.orchestra.run.smithi039.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-09T05:25:14.109 INFO:teuthology.orchestra.run.smithi039.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-09T05:25:14.109 INFO:teuthology.orchestra.run.smithi039.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-09T05:25:14.109 INFO:teuthology.orchestra.run.smithi039.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-09T05:25:14.109 INFO:teuthology.orchestra.run.smithi039.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-09T05:25:14.109 INFO:teuthology.orchestra.run.smithi039.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-09T05:25:14.109 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-09T05:25:14.109 INFO:teuthology.orchestra.run.smithi039.stdout: python3-ceph-argparse-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T05:25:14.110 INFO:teuthology.orchestra.run.smithi039.stdout: python3-ceph-common-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T05:25:14.110 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cephfs-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T05:25:14.110 INFO:teuthology.orchestra.run.smithi039.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-09T05:25:14.110 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-09T05:25:14.110 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-09T05:25:14.110 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-09T05:25:14.110 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-05-09T05:25:14.110 INFO:teuthology.orchestra.run.smithi039.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-05-09T05:25:14.110 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-09T05:25:14.110 INFO:teuthology.orchestra.run.smithi039.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-09T05:25:14.110 INFO:teuthology.orchestra.run.smithi039.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-09T05:25:14.110 INFO:teuthology.orchestra.run.smithi039.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-09T05:25:14.110 INFO:teuthology.orchestra.run.smithi039.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-09T05:25:14.111 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-09T05:25:14.111 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-09T05:25:14.111 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-09T05:25:14.111 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-09T05:25:14.111 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-09T05:25:14.111 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-09T05:25:14.111 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-09T05:25:14.111 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-09T05:25:14.111 INFO:teuthology.orchestra.run.smithi039.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-09T05:25:14.111 INFO:teuthology.orchestra.run.smithi039.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-09T05:25:14.111 INFO:teuthology.orchestra.run.smithi039.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-09T05:25:14.111 INFO:teuthology.orchestra.run.smithi039.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-09T05:25:14.112 INFO:teuthology.orchestra.run.smithi039.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-09T05:25:14.112 INFO:teuthology.orchestra.run.smithi039.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-09T05:25:14.112 INFO:teuthology.orchestra.run.smithi039.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-09T05:25:14.112 INFO:teuthology.orchestra.run.smithi039.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-09T05:25:14.112 INFO:teuthology.orchestra.run.smithi039.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-09T05:25:14.112 INFO:teuthology.orchestra.run.smithi039.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-09T05:25:14.112 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-09T05:25:14.112 INFO:teuthology.orchestra.run.smithi039.stdout: python3-ply-3.11-14.el9.noarch 2024-05-09T05:25:14.112 INFO:teuthology.orchestra.run.smithi039.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-09T05:25:14.112 INFO:teuthology.orchestra.run.smithi039.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-09T05:25:14.112 INFO:teuthology.orchestra.run.smithi039.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-09T05:25:14.112 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-09T05:25:14.112 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-09T05:25:14.112 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-09T05:25:14.113 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-09T05:25:14.113 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-05-09T05:25:14.113 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-09T05:25:14.113 INFO:teuthology.orchestra.run.smithi039.stdout: python3-rados-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T05:25:14.113 INFO:teuthology.orchestra.run.smithi039.stdout: python3-rbd-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T05:25:14.113 INFO:teuthology.orchestra.run.smithi039.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-09T05:25:14.113 INFO:teuthology.orchestra.run.smithi039.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-09T05:25:14.113 INFO:teuthology.orchestra.run.smithi039.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-09T05:25:14.113 INFO:teuthology.orchestra.run.smithi039.stdout: python3-rgw-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T05:25:14.113 INFO:teuthology.orchestra.run.smithi039.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-09T05:25:14.113 INFO:teuthology.orchestra.run.smithi039.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-09T05:25:14.113 INFO:teuthology.orchestra.run.smithi039.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-09T05:25:14.113 INFO:teuthology.orchestra.run.smithi039.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-09T05:25:14.114 INFO:teuthology.orchestra.run.smithi039.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-09T05:25:14.114 INFO:teuthology.orchestra.run.smithi039.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-09T05:25:14.114 INFO:teuthology.orchestra.run.smithi039.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-09T05:25:14.114 INFO:teuthology.orchestra.run.smithi039.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-05-09T05:25:14.114 INFO:teuthology.orchestra.run.smithi039.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-09T05:25:14.114 INFO:teuthology.orchestra.run.smithi039.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-09T05:25:14.114 INFO:teuthology.orchestra.run.smithi039.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-09T05:25:14.114 INFO:teuthology.orchestra.run.smithi039.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-09T05:25:14.114 INFO:teuthology.orchestra.run.smithi039.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-09T05:25:14.114 INFO:teuthology.orchestra.run.smithi039.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-09T05:25:14.114 INFO:teuthology.orchestra.run.smithi039.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-09T05:25:14.114 INFO:teuthology.orchestra.run.smithi039.stdout: rbd-fuse-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T05:25:14.114 INFO:teuthology.orchestra.run.smithi039.stdout: rbd-mirror-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T05:25:14.115 INFO:teuthology.orchestra.run.smithi039.stdout: rbd-nbd-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T05:25:14.115 INFO:teuthology.orchestra.run.smithi039.stdout: re2-1:20211101-3.el9.x86_64 2024-05-09T05:25:14.115 INFO:teuthology.orchestra.run.smithi039.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-09T05:25:14.115 INFO:teuthology.orchestra.run.smithi039.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-09T05:25:14.115 INFO:teuthology.orchestra.run.smithi039.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-09T05:25:14.115 INFO:teuthology.orchestra.run.smithi039.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-09T05:25:14.115 INFO:teuthology.orchestra.run.smithi039.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-09T05:25:14.115 INFO:teuthology.orchestra.run.smithi039.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-09T05:25:14.115 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-09T05:25:14.116 INFO:teuthology.orchestra.run.smithi039.stdout:Complete! 2024-05-09T05:25:14.516 DEBUG:teuthology.parallel:result is None 2024-05-09T05:25:15.168 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-09T05:25:15.168 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-2:19.0.0-3594.gc9da4049.el9.x86_64 1/164 2024-05-09T05:25:15.168 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-base-2:19.0.0-3594.gc9da4049.el9.x86_64 2/164 2024-05-09T05:25:15.168 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-common-2:19.0.0-3594.gc9da4049.el9.x86_64 3/164 2024-05-09T05:25:15.168 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-fuse-2:19.0.0-3594.gc9da4049.el9.x86_64 4/164 2024-05-09T05:25:15.168 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3594.gc9da4 5/164 2024-05-09T05:25:15.169 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mds-2:19.0.0-3594.gc9da4049.el9.x86_64 6/164 2024-05-09T05:25:15.169 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-2:19.0.0-3594.gc9da4049.el9.x86_64 7/164 2024-05-09T05:25:15.169 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mon-2:19.0.0-3594.gc9da4049.el9.x86_64 8/164 2024-05-09T05:25:15.169 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-osd-2:19.0.0-3594.gc9da4049.el9.x86_64 9/164 2024-05-09T05:25:15.169 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-radosgw-2:19.0.0-3594.gc9da4049.el9.x86_64 10/164 2024-05-09T05:25:15.169 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-selinux-2:19.0.0-3594.gc9da4049.el9.x86_64 11/164 2024-05-09T05:25:15.169 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-test-2:19.0.0-3594.gc9da4049.el9.x86_64 12/164 2024-05-09T05:25:15.169 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : cephfs-mirror-2:19.0.0-3594.gc9da4049.el9.x86_64 13/164 2024-05-09T05:25:15.169 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : cephfs-shell-2:19.0.0-3594.gc9da4049.el9.x86_64 14/164 2024-05-09T05:25:15.169 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libcephfs-devel-2:19.0.0-3594.gc9da4049.el9.x86_ 15/164 2024-05-09T05:25:15.169 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libcephfs2-2:19.0.0-3594.gc9da4049.el9.x86_64 16/164 2024-05-09T05:25:15.169 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libcephsqlite-2:19.0.0-3594.gc9da4049.el9.x86_64 17/164 2024-05-09T05:25:15.169 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librados-devel-2:19.0.0-3594.gc9da4049.el9.x86_6 18/164 2024-05-09T05:25:15.169 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libradosstriper1-2:19.0.0-3594.gc9da4049.el9.x86 19/164 2024-05-09T05:25:15.170 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librgw2-2:19.0.0-3594.gc9da4049.el9.x86_64 20/164 2024-05-09T05:25:15.170 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3594.gc9da4049.el 21/164 2024-05-09T05:25:15.170 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-ceph-common-2:19.0.0-3594.gc9da4049.el9. 22/164 2024-05-09T05:25:15.170 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cephfs-2:19.0.0-3594.gc9da4049.el9.x86_6 23/164 2024-05-09T05:25:15.170 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-rados-2:19.0.0-3594.gc9da4049.el9.x86_64 24/164 2024-05-09T05:25:15.170 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-rbd-2:19.0.0-3594.gc9da4049.el9.x86_64 25/164 2024-05-09T05:25:15.170 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-rgw-2:19.0.0-3594.gc9da4049.el9.x86_64 26/164 2024-05-09T05:25:15.170 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : rbd-fuse-2:19.0.0-3594.gc9da4049.el9.x86_64 27/164 2024-05-09T05:25:15.170 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : rbd-mirror-2:19.0.0-3594.gc9da4049.el9.x86_64 28/164 2024-05-09T05:25:15.170 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : rbd-nbd-2:19.0.0-3594.gc9da4049.el9.x86_64 29/164 2024-05-09T05:25:15.183 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3594.gc9da4049. 30/164 2024-05-09T05:25:15.183 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3594.gc9da4049.el9.noa 31/164 2024-05-09T05:25:15.183 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3594.gc9da4049.el9.n 32/164 2024-05-09T05:25:15.183 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3594.gc9d 33/164 2024-05-09T05:25:15.183 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3594.gc9da4049.el 34/164 2024-05-09T05:25:15.183 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3594.gc9da4049.el9.noarch 35/164 2024-05-09T05:25:15.183 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3594.gc9da4049.e 36/164 2024-05-09T05:25:15.183 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-volume-2:19.0.0-3594.gc9da4049.el9.noarch 37/164 2024-05-09T05:25:15.183 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : cephadm-2:19.0.0-3594.gc9da4049.el9.noarch 38/164 2024-05-09T05:25:15.183 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : cephfs-top-2:19.0.0-3594.gc9da4049.el9.noarch 39/164 2024-05-09T05:25:15.183 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/164 2024-05-09T05:25:15.183 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/164 2024-05-09T05:25:15.184 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/164 2024-05-09T05:25:15.184 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-05-09T05:25:15.184 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-05-09T05:25:15.184 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-05-09T05:25:15.184 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-05-09T05:25:15.184 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-05-09T05:25:15.184 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/164 2024-05-09T05:25:15.184 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-05-09T05:25:15.184 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-05-09T05:25:15.184 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-05-09T05:25:15.184 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/164 2024-05-09T05:25:15.184 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-05-09T05:25:15.184 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-05-09T05:25:15.184 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-05-09T05:25:15.185 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-05-09T05:25:15.185 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-05-09T05:25:15.185 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-05-09T05:25:15.185 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-05-09T05:25:15.185 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-05-09T05:25:15.185 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/164 2024-05-09T05:25:15.185 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/164 2024-05-09T05:25:15.185 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-05-09T05:25:15.185 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-05-09T05:25:15.185 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-05-09T05:25:15.185 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/164 2024-05-09T05:25:15.185 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/164 2024-05-09T05:25:15.185 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/164 2024-05-09T05:25:15.186 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/164 2024-05-09T05:25:15.186 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/164 2024-05-09T05:25:15.186 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/164 2024-05-09T05:25:15.186 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/164 2024-05-09T05:25:15.186 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-05-09T05:25:15.186 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-05-09T05:25:15.186 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-05-09T05:25:15.186 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/164 2024-05-09T05:25:15.186 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/164 2024-05-09T05:25:15.186 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/164 2024-05-09T05:25:15.186 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/164 2024-05-09T05:25:15.186 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/164 2024-05-09T05:25:15.186 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/164 2024-05-09T05:25:15.187 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/164 2024-05-09T05:25:15.187 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/164 2024-05-09T05:25:15.187 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/164 2024-05-09T05:25:15.187 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/164 2024-05-09T05:25:15.187 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/164 2024-05-09T05:25:15.187 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/164 2024-05-09T05:25:15.187 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/164 2024-05-09T05:25:15.187 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/164 2024-05-09T05:25:15.187 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/164 2024-05-09T05:25:15.187 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/164 2024-05-09T05:25:15.187 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/164 2024-05-09T05:25:15.187 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/164 2024-05-09T05:25:15.187 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/164 2024-05-09T05:25:15.187 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/164 2024-05-09T05:25:15.188 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/164 2024-05-09T05:25:15.188 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/164 2024-05-09T05:25:15.188 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/164 2024-05-09T05:25:15.188 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/164 2024-05-09T05:25:15.188 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/164 2024-05-09T05:25:15.188 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/164 2024-05-09T05:25:15.188 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/164 2024-05-09T05:25:15.188 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/164 2024-05-09T05:25:15.188 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/164 2024-05-09T05:25:15.188 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/164 2024-05-09T05:25:15.188 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/164 2024-05-09T05:25:15.188 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/164 2024-05-09T05:25:15.188 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/164 2024-05-09T05:25:15.188 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/164 2024-05-09T05:25:15.189 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/164 2024-05-09T05:25:15.189 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/164 2024-05-09T05:25:15.189 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/164 2024-05-09T05:25:15.189 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/164 2024-05-09T05:25:15.189 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/164 2024-05-09T05:25:15.189 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/164 2024-05-09T05:25:15.189 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/164 2024-05-09T05:25:15.189 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/164 2024-05-09T05:25:15.189 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/164 2024-05-09T05:25:15.189 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/164 2024-05-09T05:25:15.189 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/164 2024-05-09T05:25:15.189 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/164 2024-05-09T05:25:15.189 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/164 2024-05-09T05:25:15.189 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-05-09T05:25:15.189 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-05-09T05:25:15.190 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-05-09T05:25:15.190 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-05-09T05:25:15.190 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-05-09T05:25:15.190 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-05-09T05:25:15.190 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-05-09T05:25:15.190 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-05-09T05:25:15.190 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-05-09T05:25:15.190 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-05-09T05:25:15.190 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-05-09T05:25:15.190 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-05-09T05:25:15.190 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-05-09T05:25:15.190 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-05-09T05:25:15.190 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-05-09T05:25:15.190 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-05-09T05:25:15.191 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-05-09T05:25:15.191 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-05-09T05:25:15.191 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-05-09T05:25:15.191 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/164 2024-05-09T05:25:15.191 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/164 2024-05-09T05:25:15.191 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-05-09T05:25:15.191 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-05-09T05:25:15.191 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-05-09T05:25:15.191 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/164 2024-05-09T05:25:15.191 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-05-09T05:25:15.191 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librados2-2:19.0.0-3594.gc9da4049.el9.x86_64 149/164 2024-05-09T05:25:15.191 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-05-09T05:25:15.191 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librbd1-2:19.0.0-3594.gc9da4049.el9.x86_64 151/164 2024-05-09T05:25:15.191 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-05-09T05:25:15.192 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-1:1.47.5-1.el9.x86_64 153/164 2024-05-09T05:25:15.192 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/164 2024-05-09T05:25:15.192 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-libnm-1:1.47.5-1.el9.x86_64 155/164 2024-05-09T05:25:15.192 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/164 2024-05-09T05:25:15.192 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-team-1:1.47.5-1.el9.x86_64 157/164 2024-05-09T05:25:15.192 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/164 2024-05-09T05:25:15.192 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-tui-1:1.47.5-1.el9.x86_64 159/164 2024-05-09T05:25:15.192 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/164 2024-05-09T05:25:15.192 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 161/164 2024-05-09T05:25:15.192 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 162/164 2024-05-09T05:25:15.192 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 163/164 2024-05-09T05:25:16.622 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-09T05:25:16.622 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-05-09T05:25:16.622 INFO:teuthology.orchestra.run.smithi060.stdout:Upgraded: 2024-05-09T05:25:16.622 INFO:teuthology.orchestra.run.smithi060.stdout: NetworkManager-1:1.47.5-1.el9.x86_64 2024-05-09T05:25:16.622 INFO:teuthology.orchestra.run.smithi060.stdout: NetworkManager-libnm-1:1.47.5-1.el9.x86_64 2024-05-09T05:25:16.622 INFO:teuthology.orchestra.run.smithi060.stdout: NetworkManager-team-1:1.47.5-1.el9.x86_64 2024-05-09T05:25:16.622 INFO:teuthology.orchestra.run.smithi060.stdout: NetworkManager-tui-1:1.47.5-1.el9.x86_64 2024-05-09T05:25:16.623 INFO:teuthology.orchestra.run.smithi060.stdout: librados2-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T05:25:16.623 INFO:teuthology.orchestra.run.smithi060.stdout: librbd1-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T05:25:16.623 INFO:teuthology.orchestra.run.smithi060.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-09T05:25:16.623 INFO:teuthology.orchestra.run.smithi060.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-09T05:25:16.623 INFO:teuthology.orchestra.run.smithi060.stdout:Installed: 2024-05-09T05:25:16.623 INFO:teuthology.orchestra.run.smithi060.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-09T05:25:16.623 INFO:teuthology.orchestra.run.smithi060.stdout: automake-1.16.2-8.el9.noarch 2024-05-09T05:25:16.623 INFO:teuthology.orchestra.run.smithi060.stdout: bison-3.7.4-5.el9.x86_64 2024-05-09T05:25:16.623 INFO:teuthology.orchestra.run.smithi060.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-09T05:25:16.623 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T05:25:16.623 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-base-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T05:25:16.624 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-common-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T05:25:16.624 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-fuse-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T05:25:16.624 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-grafana-dashboards-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T05:25:16.624 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-immutable-object-cache-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T05:25:16.624 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mds-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T05:25:16.624 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T05:25:16.624 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-cephadm-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T05:25:16.624 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-dashboard-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T05:25:16.624 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T05:25:16.624 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-modules-core-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T05:25:16.624 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-rook-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T05:25:16.624 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mon-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T05:25:16.624 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-osd-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T05:25:16.625 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-prometheus-alerts-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T05:25:16.625 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-radosgw-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T05:25:16.625 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-selinux-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T05:25:16.625 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-test-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T05:25:16.625 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-volume-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T05:25:16.625 INFO:teuthology.orchestra.run.smithi060.stdout: cephadm-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T05:25:16.625 INFO:teuthology.orchestra.run.smithi060.stdout: cephfs-mirror-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T05:25:16.625 INFO:teuthology.orchestra.run.smithi060.stdout: cephfs-shell-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T05:25:16.625 INFO:teuthology.orchestra.run.smithi060.stdout: cephfs-top-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T05:25:16.625 INFO:teuthology.orchestra.run.smithi060.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-05-09T05:25:16.625 INFO:teuthology.orchestra.run.smithi060.stdout: flex-2.6.4-9.el9.x86_64 2024-05-09T05:25:16.625 INFO:teuthology.orchestra.run.smithi060.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-09T05:25:16.626 INFO:teuthology.orchestra.run.smithi060.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-09T05:25:16.626 INFO:teuthology.orchestra.run.smithi060.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-09T05:25:16.626 INFO:teuthology.orchestra.run.smithi060.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-09T05:25:16.626 INFO:teuthology.orchestra.run.smithi060.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-09T05:25:16.626 INFO:teuthology.orchestra.run.smithi060.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-09T05:25:16.626 INFO:teuthology.orchestra.run.smithi060.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-09T05:25:16.626 INFO:teuthology.orchestra.run.smithi060.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-09T05:25:16.626 INFO:teuthology.orchestra.run.smithi060.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-09T05:25:16.626 INFO:teuthology.orchestra.run.smithi060.stdout: libcephfs-devel-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T05:25:16.626 INFO:teuthology.orchestra.run.smithi060.stdout: libcephfs2-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T05:25:16.626 INFO:teuthology.orchestra.run.smithi060.stdout: libcephsqlite-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T05:25:16.626 INFO:teuthology.orchestra.run.smithi060.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-09T05:25:16.626 INFO:teuthology.orchestra.run.smithi060.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-09T05:25:16.627 INFO:teuthology.orchestra.run.smithi060.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-09T05:25:16.627 INFO:teuthology.orchestra.run.smithi060.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-09T05:25:16.627 INFO:teuthology.orchestra.run.smithi060.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-09T05:25:16.627 INFO:teuthology.orchestra.run.smithi060.stdout: librados-devel-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T05:25:16.627 INFO:teuthology.orchestra.run.smithi060.stdout: libradosstriper1-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T05:25:16.627 INFO:teuthology.orchestra.run.smithi060.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-09T05:25:16.627 INFO:teuthology.orchestra.run.smithi060.stdout: librgw2-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T05:25:16.627 INFO:teuthology.orchestra.run.smithi060.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-09T05:25:16.627 INFO:teuthology.orchestra.run.smithi060.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-09T05:25:16.627 INFO:teuthology.orchestra.run.smithi060.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-09T05:25:16.627 INFO:teuthology.orchestra.run.smithi060.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-09T05:25:16.627 INFO:teuthology.orchestra.run.smithi060.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-09T05:25:16.627 INFO:teuthology.orchestra.run.smithi060.stdout: lua-5.4.4-4.el9.x86_64 2024-05-09T05:25:16.628 INFO:teuthology.orchestra.run.smithi060.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-09T05:25:16.628 INFO:teuthology.orchestra.run.smithi060.stdout: luarocks-3.9.2-1.el9.noarch 2024-05-09T05:25:16.628 INFO:teuthology.orchestra.run.smithi060.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-09T05:25:16.628 INFO:teuthology.orchestra.run.smithi060.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-09T05:25:16.628 INFO:teuthology.orchestra.run.smithi060.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-09T05:25:16.628 INFO:teuthology.orchestra.run.smithi060.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-09T05:25:16.628 INFO:teuthology.orchestra.run.smithi060.stdout: postgresql-13.14-1.el9.x86_64 2024-05-09T05:25:16.628 INFO:teuthology.orchestra.run.smithi060.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-09T05:25:16.628 INFO:teuthology.orchestra.run.smithi060.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-09T05:25:16.628 INFO:teuthology.orchestra.run.smithi060.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-09T05:25:16.628 INFO:teuthology.orchestra.run.smithi060.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-09T05:25:16.628 INFO:teuthology.orchestra.run.smithi060.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-09T05:25:16.628 INFO:teuthology.orchestra.run.smithi060.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-09T05:25:16.628 INFO:teuthology.orchestra.run.smithi060.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-09T05:25:16.629 INFO:teuthology.orchestra.run.smithi060.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-09T05:25:16.629 INFO:teuthology.orchestra.run.smithi060.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-09T05:25:16.629 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-09T05:25:16.629 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ceph-argparse-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T05:25:16.629 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ceph-common-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T05:25:16.629 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cephfs-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T05:25:16.629 INFO:teuthology.orchestra.run.smithi060.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-09T05:25:16.629 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-09T05:25:16.629 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-09T05:25:16.629 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-09T05:25:16.629 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-05-09T05:25:16.629 INFO:teuthology.orchestra.run.smithi060.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-05-09T05:25:16.629 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-09T05:25:16.630 INFO:teuthology.orchestra.run.smithi060.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-09T05:25:16.630 INFO:teuthology.orchestra.run.smithi060.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-09T05:25:16.630 INFO:teuthology.orchestra.run.smithi060.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-09T05:25:16.630 INFO:teuthology.orchestra.run.smithi060.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-09T05:25:16.630 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-09T05:25:16.630 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-09T05:25:16.630 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-09T05:25:16.630 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-09T05:25:16.630 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-09T05:25:16.630 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-09T05:25:16.630 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-09T05:25:16.630 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-09T05:25:16.631 INFO:teuthology.orchestra.run.smithi060.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-09T05:25:16.631 INFO:teuthology.orchestra.run.smithi060.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-09T05:25:16.631 INFO:teuthology.orchestra.run.smithi060.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-09T05:25:16.631 INFO:teuthology.orchestra.run.smithi060.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-09T05:25:16.631 INFO:teuthology.orchestra.run.smithi060.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-09T05:25:16.631 INFO:teuthology.orchestra.run.smithi060.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-09T05:25:16.631 INFO:teuthology.orchestra.run.smithi060.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-09T05:25:16.631 INFO:teuthology.orchestra.run.smithi060.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-09T05:25:16.631 INFO:teuthology.orchestra.run.smithi060.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-09T05:25:16.631 INFO:teuthology.orchestra.run.smithi060.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-09T05:25:16.631 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-09T05:25:16.631 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ply-3.11-14.el9.noarch 2024-05-09T05:25:16.631 INFO:teuthology.orchestra.run.smithi060.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-09T05:25:16.632 INFO:teuthology.orchestra.run.smithi060.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-09T05:25:16.632 INFO:teuthology.orchestra.run.smithi060.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-09T05:25:16.632 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-09T05:25:16.632 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-09T05:25:16.632 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-09T05:25:16.632 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-09T05:25:16.632 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-05-09T05:25:16.632 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-09T05:25:16.632 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rados-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T05:25:16.632 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rbd-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T05:25:16.632 INFO:teuthology.orchestra.run.smithi060.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-09T05:25:16.632 INFO:teuthology.orchestra.run.smithi060.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-09T05:25:16.632 INFO:teuthology.orchestra.run.smithi060.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-09T05:25:16.632 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rgw-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T05:25:16.633 INFO:teuthology.orchestra.run.smithi060.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-09T05:25:16.633 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-09T05:25:16.633 INFO:teuthology.orchestra.run.smithi060.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-09T05:25:16.633 INFO:teuthology.orchestra.run.smithi060.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-09T05:25:16.633 INFO:teuthology.orchestra.run.smithi060.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-09T05:25:16.633 INFO:teuthology.orchestra.run.smithi060.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-09T05:25:16.633 INFO:teuthology.orchestra.run.smithi060.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-09T05:25:16.633 INFO:teuthology.orchestra.run.smithi060.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-05-09T05:25:16.633 INFO:teuthology.orchestra.run.smithi060.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-09T05:25:16.633 INFO:teuthology.orchestra.run.smithi060.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-09T05:25:16.633 INFO:teuthology.orchestra.run.smithi060.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-09T05:25:16.633 INFO:teuthology.orchestra.run.smithi060.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-09T05:25:16.634 INFO:teuthology.orchestra.run.smithi060.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-09T05:25:16.634 INFO:teuthology.orchestra.run.smithi060.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-09T05:25:16.634 INFO:teuthology.orchestra.run.smithi060.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-09T05:25:16.634 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-fuse-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T05:25:16.634 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-mirror-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T05:25:16.634 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-nbd-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T05:25:16.634 INFO:teuthology.orchestra.run.smithi060.stdout: re2-1:20211101-3.el9.x86_64 2024-05-09T05:25:16.634 INFO:teuthology.orchestra.run.smithi060.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-09T05:25:16.634 INFO:teuthology.orchestra.run.smithi060.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-09T05:25:16.634 INFO:teuthology.orchestra.run.smithi060.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-09T05:25:16.634 INFO:teuthology.orchestra.run.smithi060.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-09T05:25:16.634 INFO:teuthology.orchestra.run.smithi060.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-09T05:25:16.635 INFO:teuthology.orchestra.run.smithi060.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-09T05:25:16.635 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-05-09T05:25:16.635 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2024-05-09T05:25:17.019 DEBUG:teuthology.parallel:result is None 2024-05-09T05:25:17.824 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-09T05:25:17.824 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:25:17.824 INFO:teuthology.orchestra.run.smithi100.stdout:Upgraded: 2024-05-09T05:25:17.824 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-1:1.47.5-1.el9.x86_64 2024-05-09T05:25:17.825 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-libnm-1:1.47.5-1.el9.x86_64 2024-05-09T05:25:17.825 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-team-1:1.47.5-1.el9.x86_64 2024-05-09T05:25:17.825 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-tui-1:1.47.5-1.el9.x86_64 2024-05-09T05:25:17.825 INFO:teuthology.orchestra.run.smithi100.stdout: librados2-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T05:25:17.825 INFO:teuthology.orchestra.run.smithi100.stdout: librbd1-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T05:25:17.825 INFO:teuthology.orchestra.run.smithi100.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-09T05:25:17.825 INFO:teuthology.orchestra.run.smithi100.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-09T05:25:17.825 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2024-05-09T05:25:17.825 INFO:teuthology.orchestra.run.smithi100.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-09T05:25:17.825 INFO:teuthology.orchestra.run.smithi100.stdout: automake-1.16.2-8.el9.noarch 2024-05-09T05:25:17.825 INFO:teuthology.orchestra.run.smithi100.stdout: bison-3.7.4-5.el9.x86_64 2024-05-09T05:25:17.825 INFO:teuthology.orchestra.run.smithi100.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-09T05:25:17.825 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T05:25:17.825 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-base-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T05:25:17.826 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-common-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T05:25:17.826 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-fuse-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T05:25:17.826 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-grafana-dashboards-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T05:25:17.826 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-immutable-object-cache-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T05:25:17.826 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mds-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T05:25:17.826 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T05:25:17.826 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-cephadm-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T05:25:17.826 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-dashboard-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T05:25:17.826 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T05:25:17.826 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-modules-core-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T05:25:17.826 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-rook-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T05:25:17.826 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mon-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T05:25:17.826 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-osd-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T05:25:17.827 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-prometheus-alerts-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T05:25:17.827 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-radosgw-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T05:25:17.827 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-selinux-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T05:25:17.827 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-test-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T05:25:17.827 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-volume-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T05:25:17.827 INFO:teuthology.orchestra.run.smithi100.stdout: cephadm-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T05:25:17.827 INFO:teuthology.orchestra.run.smithi100.stdout: cephfs-mirror-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T05:25:17.827 INFO:teuthology.orchestra.run.smithi100.stdout: cephfs-shell-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T05:25:17.827 INFO:teuthology.orchestra.run.smithi100.stdout: cephfs-top-2:19.0.0-3594.gc9da4049.el9.noarch 2024-05-09T05:25:17.827 INFO:teuthology.orchestra.run.smithi100.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-05-09T05:25:17.827 INFO:teuthology.orchestra.run.smithi100.stdout: flex-2.6.4-9.el9.x86_64 2024-05-09T05:25:17.827 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-09T05:25:17.827 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-09T05:25:17.827 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-09T05:25:17.828 INFO:teuthology.orchestra.run.smithi100.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-09T05:25:17.828 INFO:teuthology.orchestra.run.smithi100.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-09T05:25:17.828 INFO:teuthology.orchestra.run.smithi100.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-09T05:25:17.828 INFO:teuthology.orchestra.run.smithi100.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-09T05:25:17.828 INFO:teuthology.orchestra.run.smithi100.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-09T05:25:17.828 INFO:teuthology.orchestra.run.smithi100.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-09T05:25:17.828 INFO:teuthology.orchestra.run.smithi100.stdout: libcephfs-devel-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T05:25:17.828 INFO:teuthology.orchestra.run.smithi100.stdout: libcephfs2-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T05:25:17.828 INFO:teuthology.orchestra.run.smithi100.stdout: libcephsqlite-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T05:25:17.828 INFO:teuthology.orchestra.run.smithi100.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-09T05:25:17.828 INFO:teuthology.orchestra.run.smithi100.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-09T05:25:17.828 INFO:teuthology.orchestra.run.smithi100.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-09T05:25:17.828 INFO:teuthology.orchestra.run.smithi100.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-09T05:25:17.829 INFO:teuthology.orchestra.run.smithi100.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-09T05:25:17.829 INFO:teuthology.orchestra.run.smithi100.stdout: librados-devel-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T05:25:17.829 INFO:teuthology.orchestra.run.smithi100.stdout: libradosstriper1-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T05:25:17.829 INFO:teuthology.orchestra.run.smithi100.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-09T05:25:17.829 INFO:teuthology.orchestra.run.smithi100.stdout: librgw2-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T05:25:17.829 INFO:teuthology.orchestra.run.smithi100.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-09T05:25:17.829 INFO:teuthology.orchestra.run.smithi100.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-09T05:25:17.829 INFO:teuthology.orchestra.run.smithi100.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-09T05:25:17.829 INFO:teuthology.orchestra.run.smithi100.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-09T05:25:17.829 INFO:teuthology.orchestra.run.smithi100.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-09T05:25:17.829 INFO:teuthology.orchestra.run.smithi100.stdout: lua-5.4.4-4.el9.x86_64 2024-05-09T05:25:17.829 INFO:teuthology.orchestra.run.smithi100.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-09T05:25:17.829 INFO:teuthology.orchestra.run.smithi100.stdout: luarocks-3.9.2-1.el9.noarch 2024-05-09T05:25:17.830 INFO:teuthology.orchestra.run.smithi100.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-09T05:25:17.830 INFO:teuthology.orchestra.run.smithi100.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-09T05:25:17.830 INFO:teuthology.orchestra.run.smithi100.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-09T05:25:17.830 INFO:teuthology.orchestra.run.smithi100.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-09T05:25:17.830 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-13.14-1.el9.x86_64 2024-05-09T05:25:17.830 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-09T05:25:17.830 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-09T05:25:17.830 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-09T05:25:17.830 INFO:teuthology.orchestra.run.smithi100.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-09T05:25:17.830 INFO:teuthology.orchestra.run.smithi100.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-09T05:25:17.830 INFO:teuthology.orchestra.run.smithi100.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-09T05:25:17.830 INFO:teuthology.orchestra.run.smithi100.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-09T05:25:17.830 INFO:teuthology.orchestra.run.smithi100.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-09T05:25:17.830 INFO:teuthology.orchestra.run.smithi100.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-09T05:25:17.831 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-09T05:25:17.831 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ceph-argparse-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T05:25:17.831 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ceph-common-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T05:25:17.831 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cephfs-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T05:25:17.831 INFO:teuthology.orchestra.run.smithi100.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-09T05:25:17.831 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-09T05:25:17.831 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-09T05:25:17.831 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-09T05:25:17.831 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-05-09T05:25:17.831 INFO:teuthology.orchestra.run.smithi100.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-05-09T05:25:17.831 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-09T05:25:17.831 INFO:teuthology.orchestra.run.smithi100.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-09T05:25:17.831 INFO:teuthology.orchestra.run.smithi100.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-09T05:25:17.831 INFO:teuthology.orchestra.run.smithi100.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-09T05:25:17.832 INFO:teuthology.orchestra.run.smithi100.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-09T05:25:17.832 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-09T05:25:17.832 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-09T05:25:17.832 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-09T05:25:17.832 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-09T05:25:17.832 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-09T05:25:17.832 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-09T05:25:17.832 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-09T05:25:17.832 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-09T05:25:17.832 INFO:teuthology.orchestra.run.smithi100.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-09T05:25:17.832 INFO:teuthology.orchestra.run.smithi100.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-09T05:25:17.832 INFO:teuthology.orchestra.run.smithi100.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-09T05:25:17.832 INFO:teuthology.orchestra.run.smithi100.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-09T05:25:17.832 INFO:teuthology.orchestra.run.smithi100.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-09T05:25:17.833 INFO:teuthology.orchestra.run.smithi100.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-09T05:25:17.833 INFO:teuthology.orchestra.run.smithi100.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-09T05:25:17.833 INFO:teuthology.orchestra.run.smithi100.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-09T05:25:17.833 INFO:teuthology.orchestra.run.smithi100.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-09T05:25:17.833 INFO:teuthology.orchestra.run.smithi100.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-09T05:25:17.833 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-09T05:25:17.833 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ply-3.11-14.el9.noarch 2024-05-09T05:25:17.833 INFO:teuthology.orchestra.run.smithi100.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-09T05:25:17.833 INFO:teuthology.orchestra.run.smithi100.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-09T05:25:17.833 INFO:teuthology.orchestra.run.smithi100.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-09T05:25:17.833 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-09T05:25:17.833 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-09T05:25:17.833 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-09T05:25:17.834 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-09T05:25:17.834 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-05-09T05:25:17.834 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-09T05:25:17.834 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rados-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T05:25:17.834 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rbd-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T05:25:17.834 INFO:teuthology.orchestra.run.smithi100.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-09T05:25:17.834 INFO:teuthology.orchestra.run.smithi100.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-09T05:25:17.834 INFO:teuthology.orchestra.run.smithi100.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-09T05:25:17.834 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rgw-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T05:25:17.834 INFO:teuthology.orchestra.run.smithi100.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-09T05:25:17.834 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-09T05:25:17.834 INFO:teuthology.orchestra.run.smithi100.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-09T05:25:17.834 INFO:teuthology.orchestra.run.smithi100.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-09T05:25:17.834 INFO:teuthology.orchestra.run.smithi100.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-09T05:25:17.835 INFO:teuthology.orchestra.run.smithi100.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-09T05:25:17.835 INFO:teuthology.orchestra.run.smithi100.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-09T05:25:17.835 INFO:teuthology.orchestra.run.smithi100.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-05-09T05:25:17.835 INFO:teuthology.orchestra.run.smithi100.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-09T05:25:17.835 INFO:teuthology.orchestra.run.smithi100.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-09T05:25:17.835 INFO:teuthology.orchestra.run.smithi100.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-09T05:25:17.835 INFO:teuthology.orchestra.run.smithi100.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-09T05:25:17.835 INFO:teuthology.orchestra.run.smithi100.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-09T05:25:17.835 INFO:teuthology.orchestra.run.smithi100.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-09T05:25:17.835 INFO:teuthology.orchestra.run.smithi100.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-09T05:25:17.835 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-fuse-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T05:25:17.835 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-mirror-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T05:25:17.835 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-nbd-2:19.0.0-3594.gc9da4049.el9.x86_64 2024-05-09T05:25:17.835 INFO:teuthology.orchestra.run.smithi100.stdout: re2-1:20211101-3.el9.x86_64 2024-05-09T05:25:17.836 INFO:teuthology.orchestra.run.smithi100.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-09T05:25:17.836 INFO:teuthology.orchestra.run.smithi100.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-09T05:25:17.836 INFO:teuthology.orchestra.run.smithi100.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-09T05:25:17.836 INFO:teuthology.orchestra.run.smithi100.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-09T05:25:17.836 INFO:teuthology.orchestra.run.smithi100.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-09T05:25:17.836 INFO:teuthology.orchestra.run.smithi100.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-09T05:25:17.836 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:25:17.836 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-05-09T05:25:18.213 DEBUG:teuthology.parallel:result is None 2024-05-09T05:25:18.213 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=c9da4049f638c0f84bdd9b4e33c42e86046ac554 2024-05-09T05:25:18.359 DEBUG:teuthology.orchestra.run.smithi039:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-09T05:25:18.387 INFO:teuthology.orchestra.run.smithi039.stdout:19.0.0-3594.gc9da4049.el9 2024-05-09T05:25:18.387 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3594.gc9da4049.el9 2024-05-09T05:25:18.388 INFO:teuthology.task.install:The correct ceph version 19.0.0-3594.gc9da4049 is installed. 2024-05-09T05:25:18.389 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=c9da4049f638c0f84bdd9b4e33c42e86046ac554 2024-05-09T05:25:18.606 DEBUG:teuthology.orchestra.run.smithi060:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-09T05:25:18.633 INFO:teuthology.orchestra.run.smithi060.stdout:19.0.0-3594.gc9da4049.el9 2024-05-09T05:25:18.633 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3594.gc9da4049.el9 2024-05-09T05:25:18.633 INFO:teuthology.task.install:The correct ceph version 19.0.0-3594.gc9da4049 is installed. 2024-05-09T05:25:18.635 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=c9da4049f638c0f84bdd9b4e33c42e86046ac554 2024-05-09T05:25:18.776 DEBUG:teuthology.orchestra.run.smithi100:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-09T05:25:18.799 INFO:teuthology.orchestra.run.smithi100.stdout:19.0.0-3594.gc9da4049.el9 2024-05-09T05:25:18.799 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3594.gc9da4049.el9 2024-05-09T05:25:18.799 INFO:teuthology.task.install:The correct ceph version 19.0.0-3594.gc9da4049 is installed. 2024-05-09T05:25:18.801 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-05-09T05:25:18.801 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-05-09T05:25:18.801 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-09T05:25:18.836 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-05-09T05:25:18.836 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-09T05:25:18.868 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-05-09T05:25:18.868 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-09T05:25:18.895 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-05-09T05:25:18.895 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-05-09T05:25:18.895 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/usr/bin/daemon-helper 2024-05-09T05:25:18.926 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-09T05:25:18.997 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-05-09T05:25:18.997 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/usr/bin/daemon-helper 2024-05-09T05:25:19.027 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-09T05:25:19.095 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-05-09T05:25:19.095 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/usr/bin/daemon-helper 2024-05-09T05:25:19.119 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-09T05:25:19.183 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-05-09T05:25:19.183 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-05-09T05:25:19.184 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-09T05:25:19.213 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-09T05:25:19.282 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-05-09T05:25:19.282 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-09T05:25:19.311 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-09T05:25:19.381 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-05-09T05:25:19.381 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-09T05:25:19.405 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-09T05:25:19.469 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-05-09T05:25:19.469 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-05-09T05:25:19.469 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/usr/bin/stdin-killer 2024-05-09T05:25:19.498 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-09T05:25:19.567 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-05-09T05:25:19.567 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/usr/bin/stdin-killer 2024-05-09T05:25:19.596 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-09T05:25:19.665 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-05-09T05:25:19.666 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/usr/bin/stdin-killer 2024-05-09T05:25:19.689 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-09T05:25:19.753 INFO:teuthology.run_tasks:Running task cephadm... 2024-05-09T05:25:19.861 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_bal_replicate_threshold': 1, 'mds_export_ephemeral_random_max': 0.1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': 'c9da4049f638c0f84bdd9b4e33c42e86046ac554', 'subvols': {'create': 2}} 2024-05-09T05:25:19.861 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 2024-05-09T05:25:19.861 INFO:tasks.cephadm:Cluster fsid is 86d4cc60-0dc4-11ef-bc97-c7b262605968 2024-05-09T05:25:19.862 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-05-09T05:25:19.862 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.39', 'mon.b': '172.21.15.60', 'mon.c': '172.21.15.100'} 2024-05-09T05:25:19.862 INFO:tasks.cephadm:First mon is mon.a on smithi039 2024-05-09T05:25:19.862 INFO:tasks.cephadm:First mgr is x 2024-05-09T05:25:19.862 INFO:tasks.cephadm:Normalizing hostnames... 2024-05-09T05:25:19.862 DEBUG:teuthology.orchestra.run.smithi039:> sudo hostname $(hostname -s) 2024-05-09T05:25:19.890 DEBUG:teuthology.orchestra.run.smithi060:> sudo hostname $(hostname -s) 2024-05-09T05:25:19.920 DEBUG:teuthology.orchestra.run.smithi100:> sudo hostname $(hostname -s) 2024-05-09T05:25:19.944 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-05-09T05:25:19.944 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=c9da4049f638c0f84bdd9b4e33c42e86046ac554 2024-05-09T05:25:20.168 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'c9da4049f638c0f84bdd9b4e33c42e86046ac554', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/79226/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.0.0-3594-gc9da4049', 'node_name': '172.21.2.1+braggi01', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.0.0-3594.gc9da4049'}, 'url': 'https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-05-09 00:57:42.125322', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-pdonnell-testing-20240508.183908-debug', 'chacra_url': 'https://4.chacra.ceph.com/repos/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}, {'status': 'ready', 'sha1': 'c9da4049f638c0f84bdd9b4e33c42e86046ac554', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/79224/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.0.0-3594-gc9da4049', 'node_name': '172.21.5.39+adami09', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.0.0-3594.gc9da4049'}, 'url': 'https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-05-08 19:52:58.989794', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-pdonnell-testing-20240508.183908-debug', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-05-09T05:25:20.308 INFO:tasks.util.chacra:got chacra host 4.chacra.ceph.com, ref wip-pdonnell-testing-20240508.183908-debug, sha1 c9da4049f638c0f84bdd9b4e33c42e86046ac554 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=c9da4049f638c0f84bdd9b4e33c42e86046ac554 2024-05-09T05:25:20.310 INFO:tasks.cephadm:Discovered cachra url: https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/centos/9/x86_64/flavors/default/cephadm 2024-05-09T05:25:20.310 DEBUG:teuthology.orchestra.run.smithi039:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-05-09T05:25:20.898 INFO:teuthology.orchestra.run.smithi039.stdout:-rw-r--r--. 1 ubuntu ubuntu 782864 May 9 05:25 /home/ubuntu/cephtest/cephadm 2024-05-09T05:25:20.898 DEBUG:teuthology.orchestra.run.smithi060:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-05-09T05:25:21.411 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r--. 1 ubuntu ubuntu 782864 May 9 05:25 /home/ubuntu/cephtest/cephadm 2024-05-09T05:25:21.411 DEBUG:teuthology.orchestra.run.smithi100:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240508.183908-debug/c9da4049f638c0f84bdd9b4e33c42e86046ac554/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-05-09T05:25:22.125 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r--. 1 ubuntu ubuntu 782864 May 9 05:25 /home/ubuntu/cephtest/cephadm 2024-05-09T05:25:22.125 DEBUG:teuthology.orchestra.run.smithi039:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-05-09T05:25:22.146 DEBUG:teuthology.orchestra.run.smithi060:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-05-09T05:25:22.165 DEBUG:teuthology.orchestra.run.smithi100:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-05-09T05:25:22.201 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 on all hosts... 2024-05-09T05:25:22.201 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 pull 2024-05-09T05:25:22.204 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 pull 2024-05-09T05:25:22.207 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 pull 2024-05-09T05:25:23.686 INFO:teuthology.orchestra.run.smithi060.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554... 2024-05-09T05:25:23.717 INFO:teuthology.orchestra.run.smithi100.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554... 2024-05-09T05:25:23.890 INFO:teuthology.orchestra.run.smithi039.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554... 2024-05-09T05:25:53.703 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-05-09T05:25:53.703 INFO:teuthology.orchestra.run.smithi039.stdout: "ceph_version": "ceph version 19.0.0-3594-gc9da4049 (c9da4049f638c0f84bdd9b4e33c42e86046ac554) squid (dev)", 2024-05-09T05:25:53.703 INFO:teuthology.orchestra.run.smithi039.stdout: "image_id": "db794d706f492c144ccc8f2c5bbc1870e116f5c4f3309dfab4416b39d099f8d7", 2024-05-09T05:25:53.703 INFO:teuthology.orchestra.run.smithi039.stdout: "repo_digests": [ 2024-05-09T05:25:53.703 INFO:teuthology.orchestra.run.smithi039.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584" 2024-05-09T05:25:53.703 INFO:teuthology.orchestra.run.smithi039.stdout: ] 2024-05-09T05:25:53.703 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-05-09T05:26:02.975 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-05-09T05:26:02.975 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_version": "ceph version 19.0.0-3594-gc9da4049 (c9da4049f638c0f84bdd9b4e33c42e86046ac554) squid (dev)", 2024-05-09T05:26:02.975 INFO:teuthology.orchestra.run.smithi060.stdout: "image_id": "db794d706f492c144ccc8f2c5bbc1870e116f5c4f3309dfab4416b39d099f8d7", 2024-05-09T05:26:02.976 INFO:teuthology.orchestra.run.smithi060.stdout: "repo_digests": [ 2024-05-09T05:26:02.976 INFO:teuthology.orchestra.run.smithi060.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584" 2024-05-09T05:26:02.976 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-05-09T05:26:02.976 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-05-09T05:26:15.094 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-05-09T05:26:15.094 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_version": "ceph version 19.0.0-3594-gc9da4049 (c9da4049f638c0f84bdd9b4e33c42e86046ac554) squid (dev)", 2024-05-09T05:26:15.094 INFO:teuthology.orchestra.run.smithi100.stdout: "image_id": "db794d706f492c144ccc8f2c5bbc1870e116f5c4f3309dfab4416b39d099f8d7", 2024-05-09T05:26:15.094 INFO:teuthology.orchestra.run.smithi100.stdout: "repo_digests": [ 2024-05-09T05:26:15.094 INFO:teuthology.orchestra.run.smithi100.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584" 2024-05-09T05:26:15.095 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-05-09T05:26:15.095 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-05-09T05:26:15.120 DEBUG:teuthology.orchestra.run.smithi039:> sudo mkdir -p /etc/ceph 2024-05-09T05:26:15.156 DEBUG:teuthology.orchestra.run.smithi060:> sudo mkdir -p /etc/ceph 2024-05-09T05:26:15.189 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /etc/ceph 2024-05-09T05:26:15.217 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod 777 /etc/ceph 2024-05-09T05:26:15.248 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod 777 /etc/ceph 2024-05-09T05:26:15.278 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 777 /etc/ceph 2024-05-09T05:26:15.301 INFO:tasks.cephadm:Writing seed config... 2024-05-09T05:26:15.303 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-05-09T05:26:15.303 INFO:tasks.cephadm: override: [client] debug client = 20 2024-05-09T05:26:15.303 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-05-09T05:26:15.303 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-05-09T05:26:15.303 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-05-09T05:26:15.303 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-05-09T05:26:15.303 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-05-09T05:26:15.303 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-05-09T05:26:15.303 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-05-09T05:26:15.303 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-05-09T05:26:15.303 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-05-09T05:26:15.303 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-05-09T05:26:15.303 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-05-09T05:26:15.304 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-05-09T05:26:15.304 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-05-09T05:26:15.304 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-05-09T05:26:15.304 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-05-09T05:26:15.304 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2024-05-09T05:26:15.304 INFO:tasks.cephadm: override: [mds] mds_export_ephemeral_random_max = 0.1 2024-05-09T05:26:15.304 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-05-09T05:26:15.304 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-05-09T05:26:15.304 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-05-09T05:26:15.305 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-05-09T05:26:15.305 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-05-09T05:26:15.305 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-05-09T05:26:15.305 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-05-09T05:26:15.305 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-05-09T05:26:15.305 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-05-09T05:26:15.305 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-05-09T05:26:15.305 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-05-09T05:26:15.305 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-05-09T05:26:15.305 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-05-09T05:26:15.305 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-05-09T05:26:15.305 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-05-09T05:26:15.305 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-05-09T05:26:15.306 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-05-09T05:26:15.306 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-05-09T05:26:15.306 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-05-09T05:26:15.306 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-05-09T05:26:15.306 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-05-09T05:26:15.306 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-05-09T05:26:15.306 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-05-09T05:26:15.306 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-05-09T05:26:15.306 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-05-09T05:26:15.306 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-05-09T05:26:15.306 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-05-09T05:26:15.306 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-05-09T05:26:15.306 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-05-09T05:26:15.307 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2024-05-09T05:26:15.307 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-05-09T05:26:15.307 DEBUG:teuthology.orchestra.run.smithi039:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-05-09T05:26:15.327 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 86d4cc60-0dc4-11ef-bc97-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True mds_bal_replicate_threshold = 1 mds_export_ephemeral_random_max = 0.1 osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-05-09T05:26:15.327 DEBUG:teuthology.orchestra.run.smithi039:mon.a> sudo journalctl -f -n 0 -u ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@mon.a.service 2024-05-09T05:26:15.372 DEBUG:teuthology.orchestra.run.smithi039:mgr.x> sudo journalctl -f -n 0 -u ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@mgr.x.service 2024-05-09T05:26:15.416 INFO:tasks.cephadm:Bootstrapping... 2024-05-09T05:26:15.416 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 -v bootstrap --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.39 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-05-09T05:26:15.622 INFO:teuthology.orchestra.run.smithi039.stdout:-------------------------------------------------------------------------------- 2024-05-09T05:26:15.622 INFO:teuthology.orchestra.run.smithi039.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554', '-v', 'bootstrap', '--fsid', '86d4cc60-0dc4-11ef-bc97-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.39', '--skip-admin-label'] 2024-05-09T05:26:15.623 INFO:teuthology.orchestra.run.smithi039.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-05-09T05:26:15.623 INFO:teuthology.orchestra.run.smithi039.stdout:Verifying podman|docker is present... 2024-05-09T05:26:15.649 INFO:teuthology.orchestra.run.smithi039.stdout:/bin/podman: stdout 4.9.4-dev 2024-05-09T05:26:15.649 INFO:teuthology.orchestra.run.smithi039.stdout:Verifying lvm2 is present... 2024-05-09T05:26:15.650 INFO:teuthology.orchestra.run.smithi039.stdout:Verifying time synchronization is in place... 2024-05-09T05:26:15.657 INFO:teuthology.orchestra.run.smithi039.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-05-09T05:26:15.657 INFO:teuthology.orchestra.run.smithi039.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-05-09T05:26:15.664 INFO:teuthology.orchestra.run.smithi039.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-05-09T05:26:15.664 INFO:teuthology.orchestra.run.smithi039.stdout:systemctl: stdout inactive 2024-05-09T05:26:15.671 INFO:teuthology.orchestra.run.smithi039.stdout:systemctl: stdout enabled 2024-05-09T05:26:15.677 INFO:teuthology.orchestra.run.smithi039.stdout:systemctl: stdout active 2024-05-09T05:26:15.677 INFO:teuthology.orchestra.run.smithi039.stdout:Unit chronyd.service is enabled and running 2024-05-09T05:26:15.678 INFO:teuthology.orchestra.run.smithi039.stdout:Repeating the final host check... 2024-05-09T05:26:15.703 INFO:teuthology.orchestra.run.smithi039.stdout:/bin/podman: stdout 4.9.4-dev 2024-05-09T05:26:15.703 INFO:teuthology.orchestra.run.smithi039.stdout:podman (/bin/podman) version 4.9.4 is present 2024-05-09T05:26:15.703 INFO:teuthology.orchestra.run.smithi039.stdout:systemctl is present 2024-05-09T05:26:15.703 INFO:teuthology.orchestra.run.smithi039.stdout:lvcreate is present 2024-05-09T05:26:15.709 INFO:teuthology.orchestra.run.smithi039.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-05-09T05:26:15.709 INFO:teuthology.orchestra.run.smithi039.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-05-09T05:26:15.716 INFO:teuthology.orchestra.run.smithi039.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-05-09T05:26:15.716 INFO:teuthology.orchestra.run.smithi039.stdout:systemctl: stdout inactive 2024-05-09T05:26:15.723 INFO:teuthology.orchestra.run.smithi039.stdout:systemctl: stdout enabled 2024-05-09T05:26:15.729 INFO:teuthology.orchestra.run.smithi039.stdout:systemctl: stdout active 2024-05-09T05:26:15.730 INFO:teuthology.orchestra.run.smithi039.stdout:Unit chronyd.service is enabled and running 2024-05-09T05:26:15.730 INFO:teuthology.orchestra.run.smithi039.stdout:Host looks OK 2024-05-09T05:26:15.730 INFO:teuthology.orchestra.run.smithi039.stdout:Cluster fsid: 86d4cc60-0dc4-11ef-bc97-c7b262605968 2024-05-09T05:26:15.730 INFO:teuthology.orchestra.run.smithi039.stdout:Acquiring lock 140310346661312 on /run/cephadm/86d4cc60-0dc4-11ef-bc97-c7b262605968.lock 2024-05-09T05:26:15.730 INFO:teuthology.orchestra.run.smithi039.stdout:Lock 140310346661312 acquired on /run/cephadm/86d4cc60-0dc4-11ef-bc97-c7b262605968.lock 2024-05-09T05:26:15.731 INFO:teuthology.orchestra.run.smithi039.stdout:Verifying IP 172.21.15.39 port 3300 ... 2024-05-09T05:26:15.731 INFO:teuthology.orchestra.run.smithi039.stdout:Verifying IP 172.21.15.39 port 6789 ... 2024-05-09T05:26:15.731 INFO:teuthology.orchestra.run.smithi039.stdout:Base mon IP(s) is [172.21.15.39:3300, 172.21.15.39:6789], mon addrv is [v2:172.21.15.39:3300,v1:172.21.15.39:6789] 2024-05-09T05:26:15.734 INFO:teuthology.orchestra.run.smithi039.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.39 metric 100 2024-05-09T05:26:15.734 INFO:teuthology.orchestra.run.smithi039.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.39 metric 100 2024-05-09T05:26:15.737 INFO:teuthology.orchestra.run.smithi039.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-05-09T05:26:15.737 INFO:teuthology.orchestra.run.smithi039.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 1024 pref medium 2024-05-09T05:26:15.737 INFO:teuthology.orchestra.run.smithi039.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 100 pref medium 2024-05-09T05:26:15.740 INFO:teuthology.orchestra.run.smithi039.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-05-09T05:26:15.740 INFO:teuthology.orchestra.run.smithi039.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-05-09T05:26:15.740 INFO:teuthology.orchestra.run.smithi039.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-05-09T05:26:15.740 INFO:teuthology.orchestra.run.smithi039.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-05-09T05:26:15.740 INFO:teuthology.orchestra.run.smithi039.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:1370/64 scope link noprefixroute 2024-05-09T05:26:15.740 INFO:teuthology.orchestra.run.smithi039.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-05-09T05:26:15.740 INFO:teuthology.orchestra.run.smithi039.stdout:Mon IP `172.21.15.39` is in CIDR network `172.21.0.0/20` 2024-05-09T05:26:15.741 INFO:teuthology.orchestra.run.smithi039.stdout:Mon IP `172.21.15.39` is in CIDR network `172.21.0.0/20` 2024-05-09T05:26:15.741 INFO:teuthology.orchestra.run.smithi039.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-05-09T05:26:15.741 INFO:teuthology.orchestra.run.smithi039.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-05-09T05:26:15.742 INFO:teuthology.orchestra.run.smithi039.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554... 2024-05-09T05:26:18.910 INFO:teuthology.orchestra.run.smithi039.stdout:/bin/podman: stdout db794d706f492c144ccc8f2c5bbc1870e116f5c4f3309dfab4416b39d099f8d7 2024-05-09T05:26:18.910 INFO:teuthology.orchestra.run.smithi039.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554... 2024-05-09T05:26:18.910 INFO:teuthology.orchestra.run.smithi039.stdout:/bin/podman: stderr Getting image source signatures 2024-05-09T05:26:18.910 INFO:teuthology.orchestra.run.smithi039.stdout:/bin/podman: stderr Copying blob sha256:0411e0fd7a5d45f8ab31b23cec89f97c70494de39461f644c7cdc77de3b9cbca 2024-05-09T05:26:18.910 INFO:teuthology.orchestra.run.smithi039.stdout:/bin/podman: stderr Copying blob sha256:bf5b95bd68251da39c6cd2eb96c6ba4138bb37a62bdc39287908b25e92047d7e 2024-05-09T05:26:18.910 INFO:teuthology.orchestra.run.smithi039.stdout:/bin/podman: stderr Copying config sha256:db794d706f492c144ccc8f2c5bbc1870e116f5c4f3309dfab4416b39d099f8d7 2024-05-09T05:26:18.910 INFO:teuthology.orchestra.run.smithi039.stdout:/bin/podman: stderr Writing manifest to image destination 2024-05-09T05:26:25.364 INFO:teuthology.orchestra.run.smithi039.stdout:ceph: stdout ceph version 19.0.0-3594-gc9da4049 (c9da4049f638c0f84bdd9b4e33c42e86046ac554) squid (dev) 2024-05-09T05:26:25.364 INFO:teuthology.orchestra.run.smithi039.stdout:Ceph version: ceph version 19.0.0-3594-gc9da4049 (c9da4049f638c0f84bdd9b4e33c42e86046ac554) squid (dev) 2024-05-09T05:26:25.364 INFO:teuthology.orchestra.run.smithi039.stdout:Extracting ceph user uid/gid from container image... 2024-05-09T05:26:26.879 INFO:teuthology.orchestra.run.smithi039.stdout:stat: stdout 167 167 2024-05-09T05:26:26.879 INFO:teuthology.orchestra.run.smithi039.stdout:Creating initial keys... 2024-05-09T05:26:27.708 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph-authtool: stdout AQCDXjxm83LtDhAA4nLi/HzQmObZ96EkIUiPtg== 2024-05-09T05:26:28.631 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph-authtool: stdout AQCEXjxmYCDeARAAi/TabNqFi2J54qfk6FFYMQ== 2024-05-09T05:26:29.544 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph-authtool: stdout AQCEXjxmlRzYOhAAfrWzO0UZhg56GrwFYgc/3A== 2024-05-09T05:26:29.545 INFO:teuthology.orchestra.run.smithi039.stdout:Creating initial monmap... 2024-05-09T05:26:31.018 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-05-09T05:26:31.019 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-05-09T05:26:31.019 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 86d4cc60-0dc4-11ef-bc97-c7b262605968 2024-05-09T05:26:31.019 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-05-09T05:26:31.019 INFO:teuthology.orchestra.run.smithi039.stdout:monmaptool for a [v2:172.21.15.39:3300,v1:172.21.15.39:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-05-09T05:26:31.019 INFO:teuthology.orchestra.run.smithi039.stdout:setting min_mon_release = quincy 2024-05-09T05:26:31.019 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/monmaptool: set fsid to 86d4cc60-0dc4-11ef-bc97-c7b262605968 2024-05-09T05:26:31.019 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-05-09T05:26:31.019 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-09T05:26:31.019 INFO:teuthology.orchestra.run.smithi039.stdout:Creating mon... 2024-05-09T05:26:31.956 INFO:teuthology.orchestra.run.smithi039.stdout:create mon.a on 2024-05-09T05:26:32.173 INFO:teuthology.orchestra.run.smithi039.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-05-09T05:26:32.375 INFO:teuthology.orchestra.run.smithi039.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-05-09T05:26:32.565 INFO:teuthology.orchestra.run.smithi039.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968.target → /etc/systemd/system/ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968.target. 2024-05-09T05:26:32.565 INFO:teuthology.orchestra.run.smithi039.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968.target → /etc/systemd/system/ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968.target. 2024-05-09T05:26:32.810 INFO:teuthology.orchestra.run.smithi039.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@mon.a 2024-05-09T05:26:32.810 INFO:teuthology.orchestra.run.smithi039.stdout:systemctl: stderr Failed to reset failed state of unit ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@mon.a.service: Unit ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@mon.a.service not loaded. 2024-05-09T05:26:32.976 INFO:teuthology.orchestra.run.smithi039.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968.target.wants/ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@mon.a.service → /etc/systemd/system/ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@.service. 2024-05-09T05:26:33.531 INFO:teuthology.orchestra.run.smithi039.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-05-09T05:26:33.531 INFO:teuthology.orchestra.run.smithi039.stdout:systemctl: stdout disabled 2024-05-09T05:26:33.538 INFO:teuthology.orchestra.run.smithi039.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-05-09T05:26:33.539 INFO:teuthology.orchestra.run.smithi039.stdout:systemctl: stdout inactive 2024-05-09T05:26:33.539 INFO:teuthology.orchestra.run.smithi039.stdout:firewalld.service is not enabled 2024-05-09T05:26:33.539 INFO:teuthology.orchestra.run.smithi039.stdout:Not possible to enable service . firewalld.service is not available 2024-05-09T05:26:33.539 INFO:teuthology.orchestra.run.smithi039.stdout:Waiting for mon to start... 2024-05-09T05:26:33.539 INFO:teuthology.orchestra.run.smithi039.stdout:Waiting for mon... 2024-05-09T05:26:34.490 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout cluster: 2024-05-09T05:26:34.490 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout id: 86d4cc60-0dc4-11ef-bc97-c7b262605968 2024-05-09T05:26:34.490 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-05-09T05:26:34.490 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout 2024-05-09T05:26:34.490 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout services: 2024-05-09T05:26:34.490 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.506397s) 2024-05-09T05:26:34.490 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-05-09T05:26:34.490 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-05-09T05:26:34.491 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout 2024-05-09T05:26:34.491 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout data: 2024-05-09T05:26:34.491 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-05-09T05:26:34.491 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-05-09T05:26:34.491 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-05-09T05:26:34.491 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout pgs: 2024-05-09T05:26:34.491 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout 2024-05-09T05:26:34.491 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:33.937+0000 7f1d7452d700 1 Processor -- start 2024-05-09T05:26:34.491 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:33.937+0000 7f1d7452d700 1 -- start start 2024-05-09T05:26:34.491 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:33.938+0000 7f1d7452d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1d6c108c40 0x7f1d6c109050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:26:34.491 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:33.938+0000 7f1d7452d700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f1d6c109640 con 0x7f1d6c108c40 2024-05-09T05:26:34.491 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:33.938+0000 7f1d722c9700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1d6c108c40 0x7f1d6c109050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:26:34.491 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:33.938+0000 7f1d722c9700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1d6c108c40 0x7f1d6c109050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60172/0 (socket says 172.21.15.39:60172) 2024-05-09T05:26:34.492 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:33.938+0000 7f1d722c9700 1 -- 172.21.15.39:0/581842908 learned_addr learned my addr 172.21.15.39:0/581842908 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:26:34.492 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:33.938+0000 7f1d722c9700 1 -- 172.21.15.39:0/581842908 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d6c109d70 con 0x7f1d6c108c40 2024-05-09T05:26:34.492 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:33.939+0000 7f1d722c9700 1 --2- 172.21.15.39:0/581842908 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1d6c108c40 0x7f1d6c109050 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f1d5c0098a0 tx=0x7f1d5c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de48de0e8ab551d6 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:26:34.492 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:33.939+0000 7f1d712c7700 1 -- 172.21.15.39:0/581842908 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d5c004160 con 0x7f1d6c108c40 2024-05-09T05:26:34.492 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:33.939+0000 7f1d712c7700 1 -- 172.21.15.39:0/581842908 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d5c004300 con 0x7f1d6c108c40 2024-05-09T05:26:34.492 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:33.939+0000 7f1d712c7700 1 -- 172.21.15.39:0/581842908 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d5c0036a0 con 0x7f1d6c108c40 2024-05-09T05:26:34.492 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:33.939+0000 7f1d7452d700 1 -- 172.21.15.39:0/581842908 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1d6c108c40 msgr2=0x7f1d6c109050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:26:34.492 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:33.939+0000 7f1d7452d700 1 --2- 172.21.15.39:0/581842908 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1d6c108c40 0x7f1d6c109050 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f1d5c0098a0 tx=0x7f1d5c009bb0 comp rx=0 tx=0).stop 2024-05-09T05:26:34.492 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:33.940+0000 7f1d7452d700 1 -- 172.21.15.39:0/581842908 shutdown_connections 2024-05-09T05:26:34.492 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:33.940+0000 7f1d7452d700 1 --2- 172.21.15.39:0/581842908 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1d6c108c40 0x7f1d6c109050 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:26:34.492 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:33.940+0000 7f1d7452d700 1 -- 172.21.15.39:0/581842908 >> 172.21.15.39:0/581842908 conn(0x7f1d6c1042c0 msgr2=0x7f1d6c106730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:26:34.492 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:33.940+0000 7f1d7452d700 1 -- 172.21.15.39:0/581842908 shutdown_connections 2024-05-09T05:26:34.492 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:33.940+0000 7f1d7452d700 1 -- 172.21.15.39:0/581842908 wait complete. 2024-05-09T05:26:34.492 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:33.940+0000 7f1d7452d700 1 Processor -- start 2024-05-09T05:26:34.493 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:33.940+0000 7f1d7452d700 1 -- start start 2024-05-09T05:26:34.493 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:33.941+0000 7f1d7452d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1d6c108c40 0x7f1d6c191630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:26:34.493 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:33.941+0000 7f1d7452d700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f1d6c10a2a0 con 0x7f1d6c108c40 2024-05-09T05:26:34.493 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:33.941+0000 7f1d722c9700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1d6c108c40 0x7f1d6c191630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:26:34.493 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:33.941+0000 7f1d722c9700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1d6c108c40 0x7f1d6c191630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60182/0 (socket says 172.21.15.39:60182) 2024-05-09T05:26:34.493 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:33.941+0000 7f1d722c9700 1 -- 172.21.15.39:0/1357543049 learned_addr learned my addr 172.21.15.39:0/1357543049 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:26:34.493 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:33.941+0000 7f1d722c9700 1 -- 172.21.15.39:0/1357543049 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d6c191b70 con 0x7f1d6c108c40 2024-05-09T05:26:34.493 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:33.941+0000 7f1d722c9700 1 --2- 172.21.15.39:0/1357543049 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1d6c108c40 0x7f1d6c191630 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f1d5c000c00 tx=0x7f1d5c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:26:34.493 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:33.941+0000 7f1d637fe700 1 -- 172.21.15.39:0/1357543049 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d5c003db0 con 0x7f1d6c108c40 2024-05-09T05:26:34.493 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:33.941+0000 7f1d637fe700 1 -- 172.21.15.39:0/1357543049 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d5c011630 con 0x7f1d6c108c40 2024-05-09T05:26:34.493 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:33.941+0000 7f1d7452d700 1 -- 172.21.15.39:0/1357543049 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d6c18fdc0 con 0x7f1d6c108c40 2024-05-09T05:26:34.493 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:33.941+0000 7f1d637fe700 1 -- 172.21.15.39:0/1357543049 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d5c011950 con 0x7f1d6c108c40 2024-05-09T05:26:34.493 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:33.941+0000 7f1d7452d700 1 -- 172.21.15.39:0/1357543049 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d6c1902a0 con 0x7f1d6c108c40 2024-05-09T05:26:34.494 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:33.942+0000 7f1d637fe700 1 -- 172.21.15.39:0/1357543049 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1d5c011af0 con 0x7f1d6c108c40 2024-05-09T05:26:34.494 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:33.942+0000 7f1d637fe700 1 -- 172.21.15.39:0/1357543049 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f1d5c01c450 con 0x7f1d6c108c40 2024-05-09T05:26:34.494 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:33.942+0000 7f1d7452d700 1 -- 172.21.15.39:0/1357543049 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d6c064e20 con 0x7f1d6c108c40 2024-05-09T05:26:34.494 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:33.945+0000 7f1d637fe700 1 -- 172.21.15.39:0/1357543049 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f1d5c032020 con 0x7f1d6c108c40 2024-05-09T05:26:34.494 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:34.018+0000 7f1d7452d700 1 -- 172.21.15.39:0/1357543049 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7f1d6c196a00 con 0x7f1d6c108c40 2024-05-09T05:26:34.498 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:34.018+0000 7f1d637fe700 1 -- 172.21.15.39:0/1357543049 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7f1d5c004260 con 0x7f1d6c108c40 2024-05-09T05:26:34.498 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:34.019+0000 7f1d7452d700 1 -- 172.21.15.39:0/1357543049 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1d6c108c40 msgr2=0x7f1d6c191630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:26:34.498 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:34.019+0000 7f1d7452d700 1 --2- 172.21.15.39:0/1357543049 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1d6c108c40 0x7f1d6c191630 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f1d5c000c00 tx=0x7f1d5c004750 comp rx=0 tx=0).stop 2024-05-09T05:26:34.498 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:34.019+0000 7f1d7452d700 1 -- 172.21.15.39:0/1357543049 shutdown_connections 2024-05-09T05:26:34.498 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:34.019+0000 7f1d7452d700 1 --2- 172.21.15.39:0/1357543049 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1d6c108c40 0x7f1d6c191630 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:26:34.498 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:34.019+0000 7f1d7452d700 1 -- 172.21.15.39:0/1357543049 >> 172.21.15.39:0/1357543049 conn(0x7f1d6c1042c0 msgr2=0x7f1d6c193ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:26:34.498 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:34.019+0000 7f1d7452d700 1 -- 172.21.15.39:0/1357543049 shutdown_connections 2024-05-09T05:26:34.499 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:34.019+0000 7f1d7452d700 1 -- 172.21.15.39:0/1357543049 wait complete. 2024-05-09T05:26:34.499 INFO:teuthology.orchestra.run.smithi039.stdout:mon is available 2024-05-09T05:26:34.499 INFO:teuthology.orchestra.run.smithi039.stdout:Assimilating anything we can from ceph.conf... 2024-05-09T05:26:34.607 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:34 smithi039 ceph-mon[30069]: from='client.? 172.21.15.39:0/1357543049' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-05-09T05:26:35.596 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:35 smithi039 ceph-mon[30069]: from='client.? 172.21.15.39:0/1551571320' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-05-09T05:26:35.596 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:35 smithi039 ceph-mon[30069]: from='client.? 172.21.15.39:0/1551571320' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-05-09T05:26:35.605 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout 2024-05-09T05:26:35.605 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout [global] 2024-05-09T05:26:35.605 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout fsid = 86d4cc60-0dc4-11ef-bc97-c7b262605968 2024-05-09T05:26:35.606 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-05-09T05:26:35.606 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.39:3300,v1:172.21.15.39:6789] 2024-05-09T05:26:35.606 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-05-09T05:26:35.606 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-05-09T05:26:35.606 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-05-09T05:26:35.606 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-05-09T05:26:35.606 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout 2024-05-09T05:26:35.606 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout [mgr] 2024-05-09T05:26:35.606 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-05-09T05:26:35.606 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout 2024-05-09T05:26:35.606 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout [osd] 2024-05-09T05:26:35.606 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout bdev_async_discard = True 2024-05-09T05:26:35.607 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-05-09T05:26:35.607 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-05-09T05:26:35.607 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-05-09T05:26:35.607 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-05-09T05:26:35.607 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-05-09T05:26:35.607 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:34.953+0000 7fa14d729700 1 Processor -- start 2024-05-09T05:26:35.607 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:34.953+0000 7fa14d729700 1 -- start start 2024-05-09T05:26:35.607 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:34.953+0000 7fa14d729700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa148109db0 0x7fa14810a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:26:35.607 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:34.953+0000 7fa14d729700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fa14810a7b0 con 0x7fa148109db0 2024-05-09T05:26:35.607 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:34.953+0000 7fa146ffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa148109db0 0x7fa14810a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:26:35.607 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:34.953+0000 7fa146ffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa148109db0 0x7fa14810a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60188/0 (socket says 172.21.15.39:60188) 2024-05-09T05:26:35.607 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:34.953+0000 7fa146ffd700 1 -- 172.21.15.39:0/3084928910 learned_addr learned my addr 172.21.15.39:0/3084928910 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:26:35.607 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:34.954+0000 7fa146ffd700 1 -- 172.21.15.39:0/3084928910 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa14810ae90 con 0x7fa148109db0 2024-05-09T05:26:35.608 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:34.954+0000 7fa146ffd700 1 --2- 172.21.15.39:0/3084928910 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa148109db0 0x7fa14810a1c0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fa1380098a0 tx=0x7fa138009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95399368191538ac server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:26:35.608 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:34.954+0000 7fa145ffb700 1 -- 172.21.15.39:0/3084928910 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa138004160 con 0x7fa148109db0 2024-05-09T05:26:35.608 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:34.954+0000 7fa145ffb700 1 -- 172.21.15.39:0/3084928910 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa138004300 con 0x7fa148109db0 2024-05-09T05:26:35.608 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:34.954+0000 7fa145ffb700 1 -- 172.21.15.39:0/3084928910 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1380036a0 con 0x7fa148109db0 2024-05-09T05:26:35.608 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:34.955+0000 7fa14d729700 1 -- 172.21.15.39:0/3084928910 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa148109db0 msgr2=0x7fa14810a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:26:35.608 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:34.955+0000 7fa14d729700 1 --2- 172.21.15.39:0/3084928910 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa148109db0 0x7fa14810a1c0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fa1380098a0 tx=0x7fa138009bb0 comp rx=0 tx=0).stop 2024-05-09T05:26:35.608 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:34.955+0000 7fa14d729700 1 -- 172.21.15.39:0/3084928910 shutdown_connections 2024-05-09T05:26:35.608 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:34.955+0000 7fa14d729700 1 --2- 172.21.15.39:0/3084928910 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa148109db0 0x7fa14810a1c0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:26:35.608 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:34.955+0000 7fa14d729700 1 -- 172.21.15.39:0/3084928910 >> 172.21.15.39:0/3084928910 conn(0x7fa148105450 msgr2=0x7fa1481078a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:26:35.608 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:34.955+0000 7fa14d729700 1 -- 172.21.15.39:0/3084928910 shutdown_connections 2024-05-09T05:26:35.608 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:34.955+0000 7fa14d729700 1 -- 172.21.15.39:0/3084928910 wait complete. 2024-05-09T05:26:35.608 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:34.955+0000 7fa14d729700 1 Processor -- start 2024-05-09T05:26:35.608 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:34.956+0000 7fa14d729700 1 -- start start 2024-05-09T05:26:35.609 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:34.956+0000 7fa14d729700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa148109db0 0x7fa14807f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:26:35.609 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:34.956+0000 7fa14d729700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fa14810b3c0 con 0x7fa148109db0 2024-05-09T05:26:35.609 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:34.956+0000 7fa146ffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa148109db0 0x7fa14807f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:26:35.609 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:34.956+0000 7fa146ffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa148109db0 0x7fa14807f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60192/0 (socket says 172.21.15.39:60192) 2024-05-09T05:26:35.609 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:34.956+0000 7fa146ffd700 1 -- 172.21.15.39:0/1551571320 learned_addr learned my addr 172.21.15.39:0/1551571320 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:26:35.609 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:34.956+0000 7fa146ffd700 1 -- 172.21.15.39:0/1551571320 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa14807f820 con 0x7fa148109db0 2024-05-09T05:26:35.609 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:34.956+0000 7fa146ffd700 1 --2- 172.21.15.39:0/1551571320 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa148109db0 0x7fa14807f2e0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fa138000c00 tx=0x7fa138004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:26:35.609 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:34.957+0000 7fa12ffff700 1 -- 172.21.15.39:0/1551571320 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa138003db0 con 0x7fa148109db0 2024-05-09T05:26:35.609 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:34.957+0000 7fa12ffff700 1 -- 172.21.15.39:0/1551571320 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa138011630 con 0x7fa148109db0 2024-05-09T05:26:35.609 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:34.957+0000 7fa14d729700 1 -- 172.21.15.39:0/1551571320 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa14807da70 con 0x7fa148109db0 2024-05-09T05:26:35.609 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:34.957+0000 7fa12ffff700 1 -- 172.21.15.39:0/1551571320 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa138011950 con 0x7fa148109db0 2024-05-09T05:26:35.609 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:34.957+0000 7fa14d729700 1 -- 172.21.15.39:0/1551571320 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa14807df50 con 0x7fa148109db0 2024-05-09T05:26:35.609 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:34.957+0000 7fa12ffff700 1 -- 172.21.15.39:0/1551571320 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa138011af0 con 0x7fa148109db0 2024-05-09T05:26:35.610 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:34.957+0000 7fa12ffff700 1 -- 172.21.15.39:0/1551571320 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fa13801c450 con 0x7fa148109db0 2024-05-09T05:26:35.610 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:34.958+0000 7fa14d729700 1 -- 172.21.15.39:0/1551571320 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa148064e20 con 0x7fa148109db0 2024-05-09T05:26:35.610 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:34.960+0000 7fa12ffff700 1 -- 172.21.15.39:0/1551571320 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fa138032020 con 0x7fa148109db0 2024-05-09T05:26:35.610 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:35.031+0000 7fa14d729700 1 -- 172.21.15.39:0/1551571320 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7fa1481967c0 con 0x7fa148109db0 2024-05-09T05:26:35.610 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:35.040+0000 7fa12ffff700 1 -- 172.21.15.39:0/1551571320 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+492 (secure 0 0 0) 0x7fa1481967c0 con 0x7fa148109db0 2024-05-09T05:26:35.610 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:35.041+0000 7fa12ffff700 1 -- 172.21.15.39:0/1551571320 <== mon.0 v2:172.21.15.39:3300/0 8 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fa138004260 con 0x7fa148109db0 2024-05-09T05:26:35.610 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:35.041+0000 7fa14d729700 1 -- 172.21.15.39:0/1551571320 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa148109db0 msgr2=0x7fa14807f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:26:35.610 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:35.041+0000 7fa14d729700 1 --2- 172.21.15.39:0/1551571320 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa148109db0 0x7fa14807f2e0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fa138000c00 tx=0x7fa138004750 comp rx=0 tx=0).stop 2024-05-09T05:26:35.610 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:35.041+0000 7fa14d729700 1 -- 172.21.15.39:0/1551571320 shutdown_connections 2024-05-09T05:26:35.610 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:35.041+0000 7fa14d729700 1 --2- 172.21.15.39:0/1551571320 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa148109db0 0x7fa14807f2e0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:26:35.610 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:35.041+0000 7fa14d729700 1 -- 172.21.15.39:0/1551571320 >> 172.21.15.39:0/1551571320 conn(0x7fa148105450 msgr2=0x7fa148193f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:26:35.610 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:35.042+0000 7fa14d729700 1 -- 172.21.15.39:0/1551571320 shutdown_connections 2024-05-09T05:26:35.610 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:35.042+0000 7fa14d729700 1 -- 172.21.15.39:0/1551571320 wait complete. 2024-05-09T05:26:35.611 INFO:teuthology.orchestra.run.smithi039.stdout:Generating new minimal ceph.conf... 2024-05-09T05:26:36.652 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:36 smithi039 ceph-mon[30069]: from='client.? 172.21.15.39:0/3500168032' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf", "output-file": "/var/lib/ceph/mon/ceph-a/config"}]: dispatch 2024-05-09T05:26:36.659 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:36.064+0000 7f79cc7e3700 1 Processor -- start 2024-05-09T05:26:36.659 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:36.064+0000 7f79cc7e3700 1 -- start start 2024-05-09T05:26:36.659 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:36.064+0000 7f79cc7e3700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f79c4108c80 0x7f79c4109090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:26:36.659 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:36.064+0000 7f79cc7e3700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f79c4109680 con 0x7f79c4108c80 2024-05-09T05:26:36.660 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:36.064+0000 7f79ca57f700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f79c4108c80 0x7f79c4109090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:26:36.660 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:36.064+0000 7f79ca57f700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f79c4108c80 0x7f79c4109090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60196/0 (socket says 172.21.15.39:60196) 2024-05-09T05:26:36.660 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:36.064+0000 7f79ca57f700 1 -- 172.21.15.39:0/3106612704 learned_addr learned my addr 172.21.15.39:0/3106612704 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:26:36.660 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:36.065+0000 7f79ca57f700 1 -- 172.21.15.39:0/3106612704 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79c4109db0 con 0x7f79c4108c80 2024-05-09T05:26:36.660 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:36.065+0000 7f79ca57f700 1 --2- 172.21.15.39:0/3106612704 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f79c4108c80 0x7f79c4109090 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f79c00098a0 tx=0x7f79c0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1e0c5c930326edf server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:26:36.660 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:36.065+0000 7f79c957d700 1 -- 172.21.15.39:0/3106612704 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79c0004160 con 0x7f79c4108c80 2024-05-09T05:26:36.660 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:36.065+0000 7f79c957d700 1 -- 172.21.15.39:0/3106612704 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f79c0004300 con 0x7f79c4108c80 2024-05-09T05:26:36.660 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:36.065+0000 7f79c957d700 1 -- 172.21.15.39:0/3106612704 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79c0011af0 con 0x7f79c4108c80 2024-05-09T05:26:36.660 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:36.066+0000 7f79cc7e3700 1 -- 172.21.15.39:0/3106612704 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f79c4108c80 msgr2=0x7f79c4109090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:26:36.660 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:36.066+0000 7f79cc7e3700 1 --2- 172.21.15.39:0/3106612704 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f79c4108c80 0x7f79c4109090 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f79c00098a0 tx=0x7f79c0009bb0 comp rx=0 tx=0).stop 2024-05-09T05:26:36.660 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:36.066+0000 7f79cc7e3700 1 -- 172.21.15.39:0/3106612704 shutdown_connections 2024-05-09T05:26:36.660 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:36.066+0000 7f79cc7e3700 1 --2- 172.21.15.39:0/3106612704 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f79c4108c80 0x7f79c4109090 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:26:36.661 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:36.066+0000 7f79cc7e3700 1 -- 172.21.15.39:0/3106612704 >> 172.21.15.39:0/3106612704 conn(0x7f79c4104300 msgr2=0x7f79c4106770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:26:36.661 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:36.066+0000 7f79cc7e3700 1 -- 172.21.15.39:0/3106612704 shutdown_connections 2024-05-09T05:26:36.661 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:36.066+0000 7f79cc7e3700 1 -- 172.21.15.39:0/3106612704 wait complete. 2024-05-09T05:26:36.661 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:36.066+0000 7f79cc7e3700 1 Processor -- start 2024-05-09T05:26:36.661 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:36.067+0000 7f79cc7e3700 1 -- start start 2024-05-09T05:26:36.661 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:36.067+0000 7f79cc7e3700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f79c4108c80 0x7f79c407d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:26:36.661 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:36.067+0000 7f79cc7e3700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f79c410d160 con 0x7f79c4108c80 2024-05-09T05:26:36.661 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:36.067+0000 7f79ca57f700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f79c4108c80 0x7f79c407d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:26:36.661 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:36.067+0000 7f79ca57f700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f79c4108c80 0x7f79c407d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60206/0 (socket says 172.21.15.39:60206) 2024-05-09T05:26:36.661 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:36.067+0000 7f79ca57f700 1 -- 172.21.15.39:0/3500168032 learned_addr learned my addr 172.21.15.39:0/3500168032 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:26:36.661 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:36.067+0000 7f79ca57f700 1 -- 172.21.15.39:0/3500168032 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79c407d720 con 0x7f79c4108c80 2024-05-09T05:26:36.661 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:36.067+0000 7f79ca57f700 1 --2- 172.21.15.39:0/3500168032 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f79c4108c80 0x7f79c407d1e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f79c0009fb0 tx=0x7f79c0011890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:26:36.661 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:36.067+0000 7f79bb7fe700 1 -- 172.21.15.39:0/3500168032 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79c00036a0 con 0x7f79c4108c80 2024-05-09T05:26:36.661 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:36.067+0000 7f79bb7fe700 1 -- 172.21.15.39:0/3500168032 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f79c0003cd0 con 0x7f79c4108c80 2024-05-09T05:26:36.662 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:36.067+0000 7f79cc7e3700 1 -- 172.21.15.39:0/3500168032 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79c41a0ef0 con 0x7f79c4108c80 2024-05-09T05:26:36.662 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:36.067+0000 7f79bb7fe700 1 -- 172.21.15.39:0/3500168032 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79c001a430 con 0x7f79c4108c80 2024-05-09T05:26:36.662 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:36.068+0000 7f79cc7e3700 1 -- 172.21.15.39:0/3500168032 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79c41a1370 con 0x7f79c4108c80 2024-05-09T05:26:36.662 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:36.068+0000 7f79bb7fe700 1 -- 172.21.15.39:0/3500168032 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f79c001aa80 con 0x7f79c4108c80 2024-05-09T05:26:36.662 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:36.068+0000 7f79bb7fe700 1 -- 172.21.15.39:0/3500168032 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f79c0019700 con 0x7f79c4108c80 2024-05-09T05:26:36.662 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:36.068+0000 7f79cc7e3700 1 -- 172.21.15.39:0/3500168032 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79c4064e20 con 0x7f79c4108c80 2024-05-09T05:26:36.662 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:36.071+0000 7f79bb7fe700 1 -- 172.21.15.39:0/3500168032 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f79c0024440 con 0x7f79c4108c80 2024-05-09T05:26:36.662 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:36.142+0000 7f79cc7e3700 1 -- 172.21.15.39:0/3500168032 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "config generate-minimal-conf", "output-file": "/var/lib/ceph/mon/ceph-a/config"} v 0) -- 0x7f79c41a15f0 con 0x7f79c4108c80 2024-05-09T05:26:36.662 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:36.142+0000 7f79bb7fe700 1 -- 172.21.15.39:0/3500168032 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf", "output-file": "/var/lib/ceph/mon/ceph-a/config"}]=0 v2) ==== 126+0+175 (secure 0 0 0) 0x7f79c0024760 con 0x7f79c4108c80 2024-05-09T05:26:36.662 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:36.143+0000 7f79cc7e3700 1 -- 172.21.15.39:0/3500168032 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f79c4108c80 msgr2=0x7f79c407d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:26:36.662 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:36.143+0000 7f79cc7e3700 1 --2- 172.21.15.39:0/3500168032 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f79c4108c80 0x7f79c407d1e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f79c0009fb0 tx=0x7f79c0011890 comp rx=0 tx=0).stop 2024-05-09T05:26:36.662 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:36.143+0000 7f79cc7e3700 1 -- 172.21.15.39:0/3500168032 shutdown_connections 2024-05-09T05:26:36.662 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:36.143+0000 7f79cc7e3700 1 --2- 172.21.15.39:0/3500168032 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f79c4108c80 0x7f79c407d1e0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:26:36.663 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:36.143+0000 7f79cc7e3700 1 -- 172.21.15.39:0/3500168032 >> 172.21.15.39:0/3500168032 conn(0x7f79c4104300 msgr2=0x7f79c4104b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:26:36.663 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:36.143+0000 7f79cc7e3700 1 -- 172.21.15.39:0/3500168032 shutdown_connections 2024-05-09T05:26:36.663 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:36.143+0000 7f79cc7e3700 1 -- 172.21.15.39:0/3500168032 wait complete. 2024-05-09T05:26:36.663 INFO:teuthology.orchestra.run.smithi039.stdout:Restarting the monitor... 2024-05-09T05:26:36.931 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:36 smithi039 systemd[1]: Stopping Ceph mon.a for 86d4cc60-0dc4-11ef-bc97-c7b262605968... 2024-05-09T05:26:37.214 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:36 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mon-a[30065]: 2024-05-09T05:26:36.935+0000 7f77d630f700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T05:26:37.214 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:36 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mon-a[30065]: 2024-05-09T05:26:36.935+0000 7f77d630f700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-05-09T05:26:37.214 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:37 smithi039 podman[30314]: 2024-05-09 05:26:37.008419223 +0000 UTC m=+0.178668701 container died ef105e78114c5dea4045fb31f0c14b5f43676a473d76f6b1c124dfc256ae7962 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mon-a, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-05-09T05:26:37.522 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:37 smithi039 podman[30314]: 2024-05-09 05:26:37.285783641 +0000 UTC m=+0.456033119 container cleanup ef105e78114c5dea4045fb31f0c14b5f43676a473d76f6b1c124dfc256ae7962 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mon-a, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-05-09T05:26:37.522 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:37 smithi039 bash[30314]: ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mon-a 2024-05-09T05:26:37.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:37 smithi039 podman[30328]: 2024-05-09 05:26:37.528252639 +0000 UTC m=+0.516271995 container remove ef105e78114c5dea4045fb31f0c14b5f43676a473d76f6b1c124dfc256ae7962 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mon-a, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5) 2024-05-09T05:26:37.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:37 smithi039 systemd[1]: ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@mon.a.service: Deactivated successfully. 2024-05-09T05:26:37.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:37 smithi039 systemd[1]: Stopped Ceph mon.a for 86d4cc60-0dc4-11ef-bc97-c7b262605968. 2024-05-09T05:26:37.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:37 smithi039 systemd[1]: Starting Ceph mon.a for 86d4cc60-0dc4-11ef-bc97-c7b262605968... 2024-05-09T05:26:38.146 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:37 smithi039 podman[30420]: 2024-05-09 05:26:37.887683501 +0000 UTC m=+0.112775422 container create 002b60ced19b6c6879908e6e269f303837c19fb98a3ba0be01bf5c952f65f192 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mon-a, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux ) 2024-05-09T05:26:38.146 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:37 smithi039 podman[30420]: 2024-05-09 05:26:37.793240154 +0000 UTC m=+0.018332082 image pull db794d706f492c144ccc8f2c5bbc1870e116f5c4f3309dfab4416b39d099f8d7 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 2024-05-09T05:26:38.146 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 podman[30420]: 2024-05-09 05:26:38.114904244 +0000 UTC m=+0.339996167 container init 002b60ced19b6c6879908e6e269f303837c19fb98a3ba0be01bf5c952f65f192 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mon-a, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-05-09T05:26:38.146 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 podman[30420]: 2024-05-09 05:26:38.118252291 +0000 UTC m=+0.343344212 container start 002b60ced19b6c6879908e6e269f303837c19fb98a3ba0be01bf5c952f65f192 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mon-a, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, ceph=True) 2024-05-09T05:26:38.146 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: set uid:gid to 167:167 (ceph:ceph) 2024-05-09T05:26:38.197 INFO:teuthology.orchestra.run.smithi039.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-05-09T05:26:38.402 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: ceph version 19.0.0-3594-gc9da4049 (c9da4049f638c0f84bdd9b4e33c42e86046ac554) squid (dev), process ceph-mon, pid 2 2024-05-09T05:26:38.402 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: pidfile_write: ignore empty --pid-file 2024-05-09T05:26:38.403 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: load: jerasure load: lrc 2024-05-09T05:26:38.403 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: RocksDB version: 7.9.2 2024-05-09T05:26:38.403 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Git sha 0 2024-05-09T05:26:38.403 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Compile date 2024-05-08 19:33:14 2024-05-09T05:26:38.403 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: DB SUMMARY 2024-05-09T05:26:38.403 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: DB Session ID: FU8Q3PZVA7JJ3ATBWVAZ 2024-05-09T05:26:38.403 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: CURRENT file: CURRENT 2024-05-09T05:26:38.403 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: IDENTITY file: IDENTITY 2024-05-09T05:26:38.404 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-05-09T05:26:38.404 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-05-09T05:26:38.404 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 105764 ; 2024-05-09T05:26:38.404 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.error_if_exists: 0 2024-05-09T05:26:38.404 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.create_if_missing: 0 2024-05-09T05:26:38.404 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.paranoid_checks: 1 2024-05-09T05:26:38.404 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.flush_verify_memtable_count: 1 2024-05-09T05:26:38.404 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-05-09T05:26:38.404 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-05-09T05:26:38.404 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.env: 0x562617e63500 2024-05-09T05:26:38.404 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.fs: PosixFileSystem 2024-05-09T05:26:38.404 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.info_log: 0x5626189f4020 2024-05-09T05:26:38.404 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.max_file_opening_threads: 16 2024-05-09T05:26:38.405 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.statistics: (nil) 2024-05-09T05:26:38.405 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.use_fsync: 0 2024-05-09T05:26:38.405 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.max_log_file_size: 0 2024-05-09T05:26:38.405 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-05-09T05:26:38.405 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.log_file_time_to_roll: 0 2024-05-09T05:26:38.405 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.keep_log_file_num: 1000 2024-05-09T05:26:38.405 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.recycle_log_file_num: 0 2024-05-09T05:26:38.405 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.allow_fallocate: 1 2024-05-09T05:26:38.406 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.allow_mmap_reads: 0 2024-05-09T05:26:38.406 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.allow_mmap_writes: 0 2024-05-09T05:26:38.406 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.use_direct_reads: 0 2024-05-09T05:26:38.406 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-05-09T05:26:38.406 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.create_missing_column_families: 0 2024-05-09T05:26:38.406 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.db_log_dir: 2024-05-09T05:26:38.406 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.wal_dir: 2024-05-09T05:26:38.406 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.table_cache_numshardbits: 6 2024-05-09T05:26:38.407 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.WAL_ttl_seconds: 0 2024-05-09T05:26:38.407 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.WAL_size_limit_MB: 0 2024-05-09T05:26:38.407 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-05-09T05:26:38.407 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-05-09T05:26:38.407 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.is_fd_close_on_exec: 1 2024-05-09T05:26:38.408 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.advise_random_on_open: 1 2024-05-09T05:26:38.408 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.db_write_buffer_size: 0 2024-05-09T05:26:38.408 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.write_buffer_manager: 0x5626188be8c0 2024-05-09T05:26:38.408 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-05-09T05:26:38.408 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-05-09T05:26:38.408 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.use_adaptive_mutex: 0 2024-05-09T05:26:38.408 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.rate_limiter: (nil) 2024-05-09T05:26:38.408 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-05-09T05:26:38.409 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.wal_recovery_mode: 2 2024-05-09T05:26:38.409 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.enable_thread_tracking: 0 2024-05-09T05:26:38.409 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.enable_pipelined_write: 0 2024-05-09T05:26:38.409 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.unordered_write: 0 2024-05-09T05:26:38.409 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-05-09T05:26:38.409 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-05-09T05:26:38.409 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-05-09T05:26:38.409 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-05-09T05:26:38.409 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.row_cache: None 2024-05-09T05:26:38.409 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.wal_filter: None 2024-05-09T05:26:38.409 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-05-09T05:26:38.409 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.allow_ingest_behind: 0 2024-05-09T05:26:38.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.two_write_queues: 0 2024-05-09T05:26:38.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.manual_wal_flush: 0 2024-05-09T05:26:38.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.wal_compression: 0 2024-05-09T05:26:38.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.atomic_flush: 0 2024-05-09T05:26:38.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-05-09T05:26:38.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.persist_stats_to_disk: 0 2024-05-09T05:26:38.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.write_dbid_to_manifest: 0 2024-05-09T05:26:38.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.log_readahead_size: 0 2024-05-09T05:26:38.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-05-09T05:26:38.410 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.best_efforts_recovery: 0 2024-05-09T05:26:38.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-05-09T05:26:38.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-05-09T05:26:38.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.allow_data_in_errors: 0 2024-05-09T05:26:38.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.db_host_id: __hostname__ 2024-05-09T05:26:38.411 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.enforce_single_del_contracts: true 2024-05-09T05:26:38.413 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.max_background_jobs: 2 2024-05-09T05:26:38.413 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.max_background_compactions: -1 2024-05-09T05:26:38.413 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.max_subcompactions: 1 2024-05-09T05:26:38.413 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-05-09T05:26:38.413 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-05-09T05:26:38.413 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.delayed_write_rate : 16777216 2024-05-09T05:26:38.413 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.max_total_wal_size: 0 2024-05-09T05:26:38.413 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-05-09T05:26:38.413 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.stats_dump_period_sec: 600 2024-05-09T05:26:38.413 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.stats_persist_period_sec: 600 2024-05-09T05:26:38.414 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-05-09T05:26:38.414 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.max_open_files: -1 2024-05-09T05:26:38.414 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.bytes_per_sync: 0 2024-05-09T05:26:38.414 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.wal_bytes_per_sync: 0 2024-05-09T05:26:38.414 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.strict_bytes_per_sync: 0 2024-05-09T05:26:38.414 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.compaction_readahead_size: 0 2024-05-09T05:26:38.414 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.max_background_flushes: -1 2024-05-09T05:26:38.414 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Compression algorithms supported: 2024-05-09T05:26:38.414 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-05-09T05:26:38.414 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: kZSTD supported: 0 2024-05-09T05:26:38.414 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: kXpressCompression supported: 0 2024-05-09T05:26:38.414 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: kLZ4HCCompression supported: 1 2024-05-09T05:26:38.414 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: kZlibCompression supported: 1 2024-05-09T05:26:38.415 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: kSnappyCompression supported: 1 2024-05-09T05:26:38.415 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: kLZ4Compression supported: 1 2024-05-09T05:26:38.415 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: kBZip2Compression supported: 0 2024-05-09T05:26:38.415 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Fast CRC32 supported: Supported on x86 2024-05-09T05:26:38.415 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: DMutex implementation: pthread_mutex_t 2024-05-09T05:26:38.415 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-05-09T05:26:38.415 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-05-09T05:26:38.415 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-05-09T05:26:38.415 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.merge_operator: 2024-05-09T05:26:38.415 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.compaction_filter: None 2024-05-09T05:26:38.415 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.compaction_filter_factory: None 2024-05-09T05:26:38.415 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.sst_partitioner_factory: None 2024-05-09T05:26:38.415 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.memtable_factory: SkipListFactory 2024-05-09T05:26:38.415 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.table_factory: BlockBasedTable 2024-05-09T05:26:38.416 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5626189f41e0) 2024-05-09T05:26:38.416 INFO:journalctl@ceph.mon.a.smithi039.stdout: cache_index_and_filter_blocks: 1 2024-05-09T05:26:38.416 INFO:journalctl@ceph.mon.a.smithi039.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-05-09T05:26:38.416 INFO:journalctl@ceph.mon.a.smithi039.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-05-09T05:26:38.416 INFO:journalctl@ceph.mon.a.smithi039.stdout: pin_top_level_index_and_filter: 1 2024-05-09T05:26:38.416 INFO:journalctl@ceph.mon.a.smithi039.stdout: index_type: 0 2024-05-09T05:26:38.416 INFO:journalctl@ceph.mon.a.smithi039.stdout: data_block_index_type: 0 2024-05-09T05:26:38.416 INFO:journalctl@ceph.mon.a.smithi039.stdout: index_shortening: 1 2024-05-09T05:26:38.416 INFO:journalctl@ceph.mon.a.smithi039.stdout: data_block_hash_table_util_ratio: 0.750000 2024-05-09T05:26:38.416 INFO:journalctl@ceph.mon.a.smithi039.stdout: checksum: 4 2024-05-09T05:26:38.416 INFO:journalctl@ceph.mon.a.smithi039.stdout: no_block_cache: 0 2024-05-09T05:26:38.417 INFO:journalctl@ceph.mon.a.smithi039.stdout: block_cache: 0x5626188f11f0 2024-05-09T05:26:38.417 INFO:journalctl@ceph.mon.a.smithi039.stdout: block_cache_name: BinnedLRUCache 2024-05-09T05:26:38.417 INFO:journalctl@ceph.mon.a.smithi039.stdout: block_cache_options: 2024-05-09T05:26:38.417 INFO:journalctl@ceph.mon.a.smithi039.stdout: capacity : 536870912 2024-05-09T05:26:38.417 INFO:journalctl@ceph.mon.a.smithi039.stdout: num_shard_bits : 4 2024-05-09T05:26:38.417 INFO:journalctl@ceph.mon.a.smithi039.stdout: strict_capacity_limit : 0 2024-05-09T05:26:38.417 INFO:journalctl@ceph.mon.a.smithi039.stdout: high_pri_pool_ratio: 0.000 2024-05-09T05:26:38.418 INFO:journalctl@ceph.mon.a.smithi039.stdout: block_cache_compressed: (nil) 2024-05-09T05:26:38.418 INFO:journalctl@ceph.mon.a.smithi039.stdout: persistent_cache: (nil) 2024-05-09T05:26:38.418 INFO:journalctl@ceph.mon.a.smithi039.stdout: block_size: 4096 2024-05-09T05:26:38.418 INFO:journalctl@ceph.mon.a.smithi039.stdout: block_size_deviation: 10 2024-05-09T05:26:38.418 INFO:journalctl@ceph.mon.a.smithi039.stdout: block_restart_interval: 16 2024-05-09T05:26:38.418 INFO:journalctl@ceph.mon.a.smithi039.stdout: index_block_restart_interval: 1 2024-05-09T05:26:38.418 INFO:journalctl@ceph.mon.a.smithi039.stdout: metadata_block_size: 4096 2024-05-09T05:26:38.419 INFO:journalctl@ceph.mon.a.smithi039.stdout: partition_filters: 0 2024-05-09T05:26:38.419 INFO:journalctl@ceph.mon.a.smithi039.stdout: use_delta_encoding: 1 2024-05-09T05:26:38.419 INFO:journalctl@ceph.mon.a.smithi039.stdout: filter_policy: bloomfilter 2024-05-09T05:26:38.419 INFO:journalctl@ceph.mon.a.smithi039.stdout: whole_key_filtering: 1 2024-05-09T05:26:38.419 INFO:journalctl@ceph.mon.a.smithi039.stdout: verify_compression: 0 2024-05-09T05:26:38.419 INFO:journalctl@ceph.mon.a.smithi039.stdout: read_amp_bytes_per_bit: 0 2024-05-09T05:26:38.419 INFO:journalctl@ceph.mon.a.smithi039.stdout: format_version: 5 2024-05-09T05:26:38.419 INFO:journalctl@ceph.mon.a.smithi039.stdout: enable_index_compression: 1 2024-05-09T05:26:38.419 INFO:journalctl@ceph.mon.a.smithi039.stdout: block_align: 0 2024-05-09T05:26:38.419 INFO:journalctl@ceph.mon.a.smithi039.stdout: max_auto_readahead_size: 262144 2024-05-09T05:26:38.420 INFO:journalctl@ceph.mon.a.smithi039.stdout: prepopulate_block_cache: 0 2024-05-09T05:26:38.420 INFO:journalctl@ceph.mon.a.smithi039.stdout: initial_auto_readahead_size: 8192 2024-05-09T05:26:38.420 INFO:journalctl@ceph.mon.a.smithi039.stdout: num_file_reads_for_auto_readahead: 2 2024-05-09T05:26:38.420 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.write_buffer_size: 33554432 2024-05-09T05:26:38.420 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.max_write_buffer_number: 2 2024-05-09T05:26:38.420 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.compression: NoCompression 2024-05-09T05:26:38.420 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.bottommost_compression: Disabled 2024-05-09T05:26:38.420 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.prefix_extractor: nullptr 2024-05-09T05:26:38.420 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-05-09T05:26:38.420 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.num_levels: 7 2024-05-09T05:26:38.421 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-05-09T05:26:38.421 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-05-09T05:26:38.421 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-05-09T05:26:38.421 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-05-09T05:26:38.421 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-05-09T05:26:38.421 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-05-09T05:26:38.421 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-05-09T05:26:38.421 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-05-09T05:26:38.421 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-05-09T05:26:38.421 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-05-09T05:26:38.421 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-05-09T05:26:38.422 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-05-09T05:26:38.422 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.compression_opts.window_bits: -14 2024-05-09T05:26:38.422 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.compression_opts.level: 32767 2024-05-09T05:26:38.422 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.compression_opts.strategy: 0 2024-05-09T05:26:38.422 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-05-09T05:26:38.422 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-05-09T05:26:38.422 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-05-09T05:26:38.422 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-05-09T05:26:38.422 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.compression_opts.enabled: false 2024-05-09T05:26:38.422 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-05-09T05:26:38.422 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-05-09T05:26:38.422 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-05-09T05:26:38.422 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-05-09T05:26:38.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.target_file_size_base: 67108864 2024-05-09T05:26:38.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.target_file_size_multiplier: 1 2024-05-09T05:26:38.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-05-09T05:26:38.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-05-09T05:26:38.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-05-09T05:26:38.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-05-09T05:26:38.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-05-09T05:26:38.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-05-09T05:26:38.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-05-09T05:26:38.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-05-09T05:26:38.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-05-09T05:26:38.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-05-09T05:26:38.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-05-09T05:26:38.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-05-09T05:26:38.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-05-09T05:26:38.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.arena_block_size: 1048576 2024-05-09T05:26:38.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-05-09T05:26:38.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-05-09T05:26:38.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.disable_auto_compactions: 0 2024-05-09T05:26:38.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-05-09T05:26:38.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-05-09T05:26:38.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-05-09T05:26:38.424 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-05-09T05:26:38.425 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-05-09T05:26:38.425 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-05-09T05:26:38.425 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-05-09T05:26:38.425 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-05-09T05:26:38.425 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-05-09T05:26:38.425 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-05-09T05:26:38.425 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-05-09T05:26:38.425 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.inplace_update_support: 0 2024-05-09T05:26:38.425 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.inplace_update_num_locks: 10000 2024-05-09T05:26:38.425 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-05-09T05:26:38.425 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-05-09T05:26:38.425 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.memtable_huge_page_size: 0 2024-05-09T05:26:38.425 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.bloom_locality: 0 2024-05-09T05:26:38.425 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.max_successive_merges: 0 2024-05-09T05:26:38.426 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.optimize_filters_for_hits: 0 2024-05-09T05:26:38.426 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.paranoid_file_checks: 0 2024-05-09T05:26:38.426 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.force_consistency_checks: 1 2024-05-09T05:26:38.426 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.report_bg_io_stats: 0 2024-05-09T05:26:38.426 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.ttl: 2592000 2024-05-09T05:26:38.426 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.periodic_compaction_seconds: 0 2024-05-09T05:26:38.426 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-05-09T05:26:38.426 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-05-09T05:26:38.426 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.enable_blob_files: false 2024-05-09T05:26:38.426 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.min_blob_size: 0 2024-05-09T05:26:38.426 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.blob_file_size: 268435456 2024-05-09T05:26:38.426 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.blob_compression_type: NoCompression 2024-05-09T05:26:38.426 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.enable_blob_garbage_collection: false 2024-05-09T05:26:38.427 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-05-09T05:26:38.427 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-05-09T05:26:38.427 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-05-09T05:26:38.427 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.blob_file_starting_level: 0 2024-05-09T05:26:38.427 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-05-09T05:26:38.427 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-05-09T05:26:38.427 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-05-09T05:26:38.427 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: e0b24465-fd98-4e83-a670-a22c4255abe3 2024-05-09T05:26:38.427 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715232398159099, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-05-09T05:26:38.427 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-05-09T05:26:38.427 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715232398160294, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 100869, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 328, "table_properties": {"data_size": 98757, "index_size": 304, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 14294, "raw_average_key_size": 49, "raw_value_size": 90985, "raw_average_value_size": 317, "num_data_blocks": 12, "num_entries": 287, "num_filter_entries": 287, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1715232398, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "e0b24465-fd98-4e83-a670-a22c4255abe3", "db_session_id": "FU8Q3PZVA7JJ3ATBWVAZ", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-05-09T05:26:38.427 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715232398160378, "job": 1, "event": "recovery_finished"} 2024-05-09T05:26:38.427 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-05-09T05:26:38.427 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-05-09T05:26:38.427 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5626188d5c00 2024-05-09T05:26:38.428 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: DB pointer 0x56261d6c8000 2024-05-09T05:26:38.428 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-05-09T05:26:38.428 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-05-09T05:26:38.428 INFO:journalctl@ceph.mon.a.smithi039.stdout: ** DB Stats ** 2024-05-09T05:26:38.428 INFO:journalctl@ceph.mon.a.smithi039.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-09T05:26:38.428 INFO:journalctl@ceph.mon.a.smithi039.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-05-09T05:26:38.428 INFO:journalctl@ceph.mon.a.smithi039.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-09T05:26:38.428 INFO:journalctl@ceph.mon.a.smithi039.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-09T05:26:38.428 INFO:journalctl@ceph.mon.a.smithi039.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-05-09T05:26:38.428 INFO:journalctl@ceph.mon.a.smithi039.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-09T05:26:38.428 INFO:journalctl@ceph.mon.a.smithi039.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-09T05:26:38.428 INFO:journalctl@ceph.mon.a.smithi039.stdout: 2024-05-09T05:26:38.428 INFO:journalctl@ceph.mon.a.smithi039.stdout: ** Compaction Stats [default] ** 2024-05-09T05:26:38.428 INFO:journalctl@ceph.mon.a.smithi039.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-09T05:26:38.429 INFO:journalctl@ceph.mon.a.smithi039.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-05-09T05:26:38.429 INFO:journalctl@ceph.mon.a.smithi039.stdout: L0 2/0 100.37 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 155.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-09T05:26:38.429 INFO:journalctl@ceph.mon.a.smithi039.stdout: Sum 2/0 100.37 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 155.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-09T05:26:38.429 INFO:journalctl@ceph.mon.a.smithi039.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 155.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-09T05:26:38.429 INFO:journalctl@ceph.mon.a.smithi039.stdout: 2024-05-09T05:26:38.429 INFO:journalctl@ceph.mon.a.smithi039.stdout: ** Compaction Stats [default] ** 2024-05-09T05:26:38.429 INFO:journalctl@ceph.mon.a.smithi039.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-09T05:26:38.429 INFO:journalctl@ceph.mon.a.smithi039.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-05-09T05:26:38.429 INFO:journalctl@ceph.mon.a.smithi039.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 155.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-09T05:26:38.429 INFO:journalctl@ceph.mon.a.smithi039.stdout: 2024-05-09T05:26:38.429 INFO:journalctl@ceph.mon.a.smithi039.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-05-09T05:26:38.429 INFO:journalctl@ceph.mon.a.smithi039.stdout: 2024-05-09T05:26:38.429 INFO:journalctl@ceph.mon.a.smithi039.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-09T05:26:38.429 INFO:journalctl@ceph.mon.a.smithi039.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-05-09T05:26:38.429 INFO:journalctl@ceph.mon.a.smithi039.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-05-09T05:26:38.430 INFO:journalctl@ceph.mon.a.smithi039.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-05-09T05:26:38.430 INFO:journalctl@ceph.mon.a.smithi039.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-05-09T05:26:38.430 INFO:journalctl@ceph.mon.a.smithi039.stdout: AddFile(Keys): cumulative 0, interval 0 2024-05-09T05:26:38.430 INFO:journalctl@ceph.mon.a.smithi039.stdout: Cumulative compaction: 0.00 GB write, 26.44 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-09T05:26:38.430 INFO:journalctl@ceph.mon.a.smithi039.stdout: Interval compaction: 0.00 GB write, 26.44 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-09T05:26:38.430 INFO:journalctl@ceph.mon.a.smithi039.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-05-09T05:26:38.430 INFO:journalctl@ceph.mon.a.smithi039.stdout: Block cache BinnedLRUCache@0x5626188f11f0#2 capacity: 512.00 MB usage: 1.53 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-05-09T05:26:38.430 INFO:journalctl@ceph.mon.a.smithi039.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.03 KB,0.000196695%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-05-09T05:26:38.430 INFO:journalctl@ceph.mon.a.smithi039.stdout: 2024-05-09T05:26:38.430 INFO:journalctl@ceph.mon.a.smithi039.stdout: ** File Read Latency Histogram By Level [default] ** 2024-05-09T05:26:38.430 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: starting mon.a rank 0 at public addrs [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] at bind addrs [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 2024-05-09T05:26:38.430 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: mon.a@-1(???) e1 preinit fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 2024-05-09T05:26:38.430 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: mon.a@-1(???).mds e1 new map 2024-05-09T05:26:38.430 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: mon.a@-1(???).mds e1 print_map 2024-05-09T05:26:38.431 INFO:journalctl@ceph.mon.a.smithi039.stdout: e1 2024-05-09T05:26:38.431 INFO:journalctl@ceph.mon.a.smithi039.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-05-09T05:26:38.431 INFO:journalctl@ceph.mon.a.smithi039.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-05-09T05:26:38.431 INFO:journalctl@ceph.mon.a.smithi039.stdout: legacy client fscid: -1 2024-05-09T05:26:38.431 INFO:journalctl@ceph.mon.a.smithi039.stdout: 2024-05-09T05:26:38.431 INFO:journalctl@ceph.mon.a.smithi039.stdout: No filesystems configured 2024-05-09T05:26:38.431 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-05-09T05:26:38.431 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-05-09T05:26:38.431 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-05-09T05:26:38.431 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-05-09T05:26:38.431 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-05-09T05:26:38.431 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 bash[30420]: 002b60ced19b6c6879908e6e269f303837c19fb98a3ba0be01bf5c952f65f192 2024-05-09T05:26:38.431 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 systemd[1]: Started Ceph mon.a for 86d4cc60-0dc4-11ef-bc97-c7b262605968. 2024-05-09T05:26:38.431 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: mon.a is new leader, mons a in quorum (ranks 0) 2024-05-09T05:26:38.432 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: monmap epoch 1 2024-05-09T05:26:38.432 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 2024-05-09T05:26:38.432 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: last_changed 2024-05-09T05:26:29.940750+0000 2024-05-09T05:26:38.432 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: created 2024-05-09T05:26:29.940750+0000 2024-05-09T05:26:38.432 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: min_mon_release 19 (squid) 2024-05-09T05:26:38.432 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: election_strategy: 1 2024-05-09T05:26:38.432 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: 0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-05-09T05:26:38.432 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: fsmap 2024-05-09T05:26:38.432 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: osdmap e1: 0 total, 0 up, 0 in 2024-05-09T05:26:38.432 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:38 smithi039 ceph-mon[30439]: mgrmap e1: no daemons active 2024-05-09T05:26:39.222 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:38.619+0000 7f421c64c700 1 Processor -- start 2024-05-09T05:26:39.222 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:38.619+0000 7f421c64c700 1 -- start start 2024-05-09T05:26:39.222 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:38.620+0000 7f421c64c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4214108c80 0x7f4214109090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:26:39.223 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:38.620+0000 7f421c64c700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f4214109680 con 0x7f4214108c80 2024-05-09T05:26:39.223 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:38.620+0000 7f421a3e8700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4214108c80 0x7f4214109090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:26:39.223 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:38.620+0000 7f421a3e8700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4214108c80 0x7f4214109090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45938/0 (socket says 172.21.15.39:45938) 2024-05-09T05:26:39.223 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:38.620+0000 7f421a3e8700 1 -- 172.21.15.39:0/3348776092 learned_addr learned my addr 172.21.15.39:0/3348776092 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:26:39.223 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:38.620+0000 7f421a3e8700 1 -- 172.21.15.39:0/3348776092 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4214109db0 con 0x7f4214108c80 2024-05-09T05:26:39.223 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:38.621+0000 7f421a3e8700 1 --2- 172.21.15.39:0/3348776092 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4214108c80 0x7f4214109090 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f42100098a0 tx=0x7f4210009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65d1603e92c77e40 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:26:39.223 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:38.621+0000 7f42193e6700 1 -- 172.21.15.39:0/3348776092 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4210004160 con 0x7f4214108c80 2024-05-09T05:26:39.223 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:38.621+0000 7f42193e6700 1 -- 172.21.15.39:0/3348776092 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f4210004300 con 0x7f4214108c80 2024-05-09T05:26:39.223 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:38.621+0000 7f42193e6700 1 -- 172.21.15.39:0/3348776092 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4210011af0 con 0x7f4214108c80 2024-05-09T05:26:39.223 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:38.622+0000 7f421c64c700 1 -- 172.21.15.39:0/3348776092 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4214108c80 msgr2=0x7f4214109090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:26:39.223 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:38.622+0000 7f421c64c700 1 --2- 172.21.15.39:0/3348776092 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4214108c80 0x7f4214109090 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f42100098a0 tx=0x7f4210009bb0 comp rx=0 tx=0).stop 2024-05-09T05:26:39.223 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:38.622+0000 7f421c64c700 1 -- 172.21.15.39:0/3348776092 shutdown_connections 2024-05-09T05:26:39.223 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:38.622+0000 7f421c64c700 1 --2- 172.21.15.39:0/3348776092 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4214108c80 0x7f4214109090 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:26:39.224 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:38.622+0000 7f421c64c700 1 -- 172.21.15.39:0/3348776092 >> 172.21.15.39:0/3348776092 conn(0x7f4214104300 msgr2=0x7f4214106770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:26:39.224 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:38.622+0000 7f421c64c700 1 -- 172.21.15.39:0/3348776092 shutdown_connections 2024-05-09T05:26:39.224 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:38.622+0000 7f421c64c700 1 -- 172.21.15.39:0/3348776092 wait complete. 2024-05-09T05:26:39.224 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:38.623+0000 7f421c64c700 1 Processor -- start 2024-05-09T05:26:39.224 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:38.623+0000 7f421c64c700 1 -- start start 2024-05-09T05:26:39.224 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:38.623+0000 7f421c64c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4214108c80 0x7f421419e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:26:39.224 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:38.623+0000 7f421c64c700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f421410d160 con 0x7f4214108c80 2024-05-09T05:26:39.224 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:38.623+0000 7f421a3e8700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4214108c80 0x7f421419e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:26:39.224 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:38.623+0000 7f421a3e8700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4214108c80 0x7f421419e180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45952/0 (socket says 172.21.15.39:45952) 2024-05-09T05:26:39.224 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:38.623+0000 7f421a3e8700 1 -- 172.21.15.39:0/1905720739 learned_addr learned my addr 172.21.15.39:0/1905720739 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:26:39.224 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:38.623+0000 7f421a3e8700 1 -- 172.21.15.39:0/1905720739 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f421419e6c0 con 0x7f4214108c80 2024-05-09T05:26:39.224 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:38.624+0000 7f421a3e8700 1 --2- 172.21.15.39:0/1905720739 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4214108c80 0x7f421419e180 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f4210011890 tx=0x7f4210011970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:26:39.224 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:38.624+0000 7f420b7fe700 1 -- 172.21.15.39:0/1905720739 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42100039e0 con 0x7f4214108c80 2024-05-09T05:26:39.225 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:38.624+0000 7f420b7fe700 1 -- 172.21.15.39:0/1905720739 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f4210003b80 con 0x7f4214108c80 2024-05-09T05:26:39.225 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:38.624+0000 7f421c64c700 1 -- 172.21.15.39:0/1905720739 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f421419e950 con 0x7f4214108c80 2024-05-09T05:26:39.225 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:38.624+0000 7f420b7fe700 1 -- 172.21.15.39:0/1905720739 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42100246e0 con 0x7f4214108c80 2024-05-09T05:26:39.225 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:38.624+0000 7f421c64c700 1 -- 172.21.15.39:0/1905720739 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42141a1560 con 0x7f4214108c80 2024-05-09T05:26:39.225 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:38.624+0000 7f420b7fe700 1 -- 172.21.15.39:0/1905720739 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4210022020 con 0x7f4214108c80 2024-05-09T05:26:39.225 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:38.624+0000 7f420b7fe700 1 -- 172.21.15.39:0/1905720739 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f4210019400 con 0x7f4214108c80 2024-05-09T05:26:39.225 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:38.625+0000 7f421c64c700 1 -- 172.21.15.39:0/1905720739 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4214064e20 con 0x7f4214108c80 2024-05-09T05:26:39.225 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:38.627+0000 7f420b7fe700 1 -- 172.21.15.39:0/1905720739 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f421001aa70 con 0x7f4214108c80 2024-05-09T05:26:39.225 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:38.698+0000 7f421c64c700 1 -- 172.21.15.39:0/1905720739 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7f421402e960 con 0x7f4214108c80 2024-05-09T05:26:39.225 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:38.701+0000 7f420b7fe700 1 -- 172.21.15.39:0/1905720739 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7f4210024e20 con 0x7f4214108c80 2024-05-09T05:26:39.225 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:38.702+0000 7f421c64c700 1 -- 172.21.15.39:0/1905720739 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4214108c80 msgr2=0x7f421419e180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:26:39.225 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:38.702+0000 7f421c64c700 1 --2- 172.21.15.39:0/1905720739 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4214108c80 0x7f421419e180 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f4210011890 tx=0x7f4210011970 comp rx=0 tx=0).stop 2024-05-09T05:26:39.225 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:38.702+0000 7f421c64c700 1 -- 172.21.15.39:0/1905720739 shutdown_connections 2024-05-09T05:26:39.225 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:38.702+0000 7f421c64c700 1 --2- 172.21.15.39:0/1905720739 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4214108c80 0x7f421419e180 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:26:39.226 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:38.702+0000 7f421c64c700 1 -- 172.21.15.39:0/1905720739 >> 172.21.15.39:0/1905720739 conn(0x7f4214104300 msgr2=0x7f4214194710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:26:39.226 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:38.702+0000 7f421c64c700 1 -- 172.21.15.39:0/1905720739 shutdown_connections 2024-05-09T05:26:39.226 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:38.702+0000 7f421c64c700 1 -- 172.21.15.39:0/1905720739 wait complete. 2024-05-09T05:26:39.226 INFO:teuthology.orchestra.run.smithi039.stdout:Wrote config to /etc/ceph/ceph.conf 2024-05-09T05:26:39.240 INFO:teuthology.orchestra.run.smithi039.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-05-09T05:26:39.240 INFO:teuthology.orchestra.run.smithi039.stdout:Creating mgr... 2024-05-09T05:26:39.241 INFO:teuthology.orchestra.run.smithi039.stdout:Verifying port 0.0.0.0:9283 ... 2024-05-09T05:26:39.241 INFO:teuthology.orchestra.run.smithi039.stdout:Verifying port 0.0.0.0:8765 ... 2024-05-09T05:26:39.499 INFO:teuthology.orchestra.run.smithi039.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@mgr.x 2024-05-09T05:26:39.500 INFO:teuthology.orchestra.run.smithi039.stdout:systemctl: stderr Failed to reset failed state of unit ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@mgr.x.service: Unit ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@mgr.x.service not loaded. 2024-05-09T05:26:39.656 INFO:teuthology.orchestra.run.smithi039.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968.target.wants/ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@.service. 2024-05-09T05:26:39.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:39 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/1905720739' entity='client.admin' 2024-05-09T05:26:40.194 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:26:40 smithi039 podman[30652]: 2024-05-09 05:26:40.094915105 +0000 UTC m=+0.298853388 container start 07c07c8c5306c643b5732e7117e01ebe4a6f0a594c2ec46236eab9f0148ef1ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-09T05:26:40.195 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:26:40 smithi039 bash[30652]: 07c07c8c5306c643b5732e7117e01ebe4a6f0a594c2ec46236eab9f0148ef1ea 2024-05-09T05:26:40.209 INFO:teuthology.orchestra.run.smithi039.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-05-09T05:26:40.210 INFO:teuthology.orchestra.run.smithi039.stdout:systemctl: stdout disabled 2024-05-09T05:26:40.217 INFO:teuthology.orchestra.run.smithi039.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-05-09T05:26:40.217 INFO:teuthology.orchestra.run.smithi039.stdout:systemctl: stdout inactive 2024-05-09T05:26:40.217 INFO:teuthology.orchestra.run.smithi039.stdout:firewalld.service is not enabled 2024-05-09T05:26:40.217 INFO:teuthology.orchestra.run.smithi039.stdout:Not possible to enable service . firewalld.service is not available 2024-05-09T05:26:40.226 INFO:teuthology.orchestra.run.smithi039.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-05-09T05:26:40.227 INFO:teuthology.orchestra.run.smithi039.stdout:systemctl: stdout disabled 2024-05-09T05:26:40.234 INFO:teuthology.orchestra.run.smithi039.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-05-09T05:26:40.235 INFO:teuthology.orchestra.run.smithi039.stdout:systemctl: stdout inactive 2024-05-09T05:26:40.235 INFO:teuthology.orchestra.run.smithi039.stdout:firewalld.service is not enabled 2024-05-09T05:26:40.235 INFO:teuthology.orchestra.run.smithi039.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-05-09T05:26:40.235 INFO:teuthology.orchestra.run.smithi039.stdout:Waiting for mgr to start... 2024-05-09T05:26:40.235 INFO:teuthology.orchestra.run.smithi039.stdout:Waiting for mgr... 2024-05-09T05:26:40.457 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:26:40 smithi039 systemd[1]: Started Ceph mgr.x for 86d4cc60-0dc4-11ef-bc97-c7b262605968. 2024-05-09T05:26:40.457 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:26:40 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: 2024-05-09T05:26:40.263+0000 7fa97fb5e200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-09T05:26:40.457 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:26:40 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: 2024-05-09T05:26:40.462+0000 7fa97fb5e200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-09T05:26:40.780 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:26:40 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: 2024-05-09T05:26:40.570+0000 7fa97fb5e200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-09T05:26:41.114 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:40 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/2500501014' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-09T05:26:41.114 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:26:40 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: 2024-05-09T05:26:40.911+0000 7fa97fb5e200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-09T05:26:41.114 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:26:41 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: 2024-05-09T05:26:41.001+0000 7fa97fb5e200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-09T05:26:41.390 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout 2024-05-09T05:26:41.391 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout { 2024-05-09T05:26:41.391 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "fsid": "86d4cc60-0dc4-11ef-bc97-c7b262605968", 2024-05-09T05:26:41.391 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "health": { 2024-05-09T05:26:41.391 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-05-09T05:26:41.391 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-05-09T05:26:41.391 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-05-09T05:26:41.391 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout }, 2024-05-09T05:26:41.391 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-05-09T05:26:41.391 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-05-09T05:26:41.403 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout 0 2024-05-09T05:26:41.403 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout ], 2024-05-09T05:26:41.403 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-05-09T05:26:41.403 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "a" 2024-05-09T05:26:41.403 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout ], 2024-05-09T05:26:41.403 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-05-09T05:26:41.404 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "monmap": { 2024-05-09T05:26:41.404 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-09T05:26:41.404 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-05-09T05:26:41.404 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-05-09T05:26:41.404 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout }, 2024-05-09T05:26:41.404 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-05-09T05:26:41.404 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-09T05:26:41.404 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-05-09T05:26:41.404 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-05-09T05:26:41.404 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-05-09T05:26:41.404 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-05-09T05:26:41.405 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-05-09T05:26:41.405 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-05-09T05:26:41.405 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout }, 2024-05-09T05:26:41.405 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-05-09T05:26:41.405 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-05-09T05:26:41.405 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-05-09T05:26:41.405 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-05-09T05:26:41.405 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-05-09T05:26:41.405 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-05-09T05:26:41.405 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-05-09T05:26:41.406 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-05-09T05:26:41.406 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-05-09T05:26:41.406 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout }, 2024-05-09T05:26:41.406 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-05-09T05:26:41.406 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-09T05:26:41.406 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-05-09T05:26:41.406 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-05-09T05:26:41.406 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout }, 2024-05-09T05:26:41.406 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-05-09T05:26:41.406 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "available": false, 2024-05-09T05:26:41.406 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-05-09T05:26:41.406 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "modules": [ 2024-05-09T05:26:41.406 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "iostat", 2024-05-09T05:26:41.407 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "nfs", 2024-05-09T05:26:41.407 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "restful" 2024-05-09T05:26:41.407 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout ], 2024-05-09T05:26:41.407 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-09T05:26:41.407 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout }, 2024-05-09T05:26:41.407 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-05-09T05:26:41.407 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-09T05:26:41.407 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "modified": "2024-05-09T05:26:33.514821+0000", 2024-05-09T05:26:41.407 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-09T05:26:41.407 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout }, 2024-05-09T05:26:41.407 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-05-09T05:26:41.407 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout } 2024-05-09T05:26:41.408 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:40.701+0000 7f5c4f2f4700 1 Processor -- start 2024-05-09T05:26:41.408 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:40.701+0000 7f5c4f2f4700 1 -- start start 2024-05-09T05:26:41.408 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:40.702+0000 7f5c4f2f4700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5c48108c80 0x7f5c48109090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:26:41.408 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:40.702+0000 7f5c4f2f4700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f5c48109680 con 0x7f5c48108c80 2024-05-09T05:26:41.408 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:40.702+0000 7f5c4d090700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5c48108c80 0x7f5c48109090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:26:41.408 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:40.702+0000 7f5c4d090700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5c48108c80 0x7f5c48109090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45984/0 (socket says 172.21.15.39:45984) 2024-05-09T05:26:41.408 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:40.702+0000 7f5c4d090700 1 -- 172.21.15.39:0/2574907600 learned_addr learned my addr 172.21.15.39:0/2574907600 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:26:41.408 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:40.702+0000 7f5c4d090700 1 -- 172.21.15.39:0/2574907600 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c48109db0 con 0x7f5c48108c80 2024-05-09T05:26:41.408 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:40.702+0000 7f5c4d090700 1 --2- 172.21.15.39:0/2574907600 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5c48108c80 0x7f5c48109090 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f5c44009e80 tx=0x7f5c4400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f61580d42326c2f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:26:41.408 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:40.703+0000 7f5c3ffff700 1 -- 172.21.15.39:0/2574907600 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c44017070 con 0x7f5c48108c80 2024-05-09T05:26:41.408 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:40.703+0000 7f5c3ffff700 1 -- 172.21.15.39:0/2574907600 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f5c4400b8c0 con 0x7f5c48108c80 2024-05-09T05:26:41.408 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:40.703+0000 7f5c3ffff700 1 -- 172.21.15.39:0/2574907600 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c44004490 con 0x7f5c48108c80 2024-05-09T05:26:41.409 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:40.703+0000 7f5c4f2f4700 1 -- 172.21.15.39:0/2574907600 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5c48108c80 msgr2=0x7f5c48109090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:26:41.409 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:40.703+0000 7f5c4f2f4700 1 --2- 172.21.15.39:0/2574907600 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5c48108c80 0x7f5c48109090 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f5c44009e80 tx=0x7f5c4400b330 comp rx=0 tx=0).stop 2024-05-09T05:26:41.409 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:40.703+0000 7f5c4f2f4700 1 -- 172.21.15.39:0/2574907600 shutdown_connections 2024-05-09T05:26:41.409 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:40.703+0000 7f5c4f2f4700 1 --2- 172.21.15.39:0/2574907600 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5c48108c80 0x7f5c48109090 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:26:41.409 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:40.703+0000 7f5c4f2f4700 1 -- 172.21.15.39:0/2574907600 >> 172.21.15.39:0/2574907600 conn(0x7f5c48104300 msgr2=0x7f5c48106770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:26:41.409 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:40.704+0000 7f5c4f2f4700 1 -- 172.21.15.39:0/2574907600 shutdown_connections 2024-05-09T05:26:41.409 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:40.704+0000 7f5c4f2f4700 1 -- 172.21.15.39:0/2574907600 wait complete. 2024-05-09T05:26:41.409 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:40.704+0000 7f5c4f2f4700 1 Processor -- start 2024-05-09T05:26:41.409 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:40.704+0000 7f5c4f2f4700 1 -- start start 2024-05-09T05:26:41.409 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:40.705+0000 7f5c4f2f4700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5c48108c80 0x7f5c4819e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:26:41.409 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:40.705+0000 7f5c4f2f4700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f5c4810d160 con 0x7f5c48108c80 2024-05-09T05:26:41.409 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:40.705+0000 7f5c4d090700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5c48108c80 0x7f5c4819e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:26:41.410 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:40.705+0000 7f5c4d090700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5c48108c80 0x7f5c4819e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45990/0 (socket says 172.21.15.39:45990) 2024-05-09T05:26:41.410 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:40.705+0000 7f5c4d090700 1 -- 172.21.15.39:0/2500501014 learned_addr learned my addr 172.21.15.39:0/2500501014 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:26:41.410 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:40.705+0000 7f5c4d090700 1 -- 172.21.15.39:0/2500501014 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c4819e670 con 0x7f5c48108c80 2024-05-09T05:26:41.410 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:40.705+0000 7f5c4d090700 1 --2- 172.21.15.39:0/2500501014 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5c48108c80 0x7f5c4819e130 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f5c44009fd0 tx=0x7f5c4400bd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:26:41.410 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:40.705+0000 7f5c3e7fc700 1 -- 172.21.15.39:0/2500501014 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c44020020 con 0x7f5c48108c80 2024-05-09T05:26:41.410 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:40.705+0000 7f5c3e7fc700 1 -- 172.21.15.39:0/2500501014 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f5c44012430 con 0x7f5c48108c80 2024-05-09T05:26:41.410 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:40.705+0000 7f5c4f2f4700 1 -- 172.21.15.39:0/2500501014 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c4819e900 con 0x7f5c48108c80 2024-05-09T05:26:41.411 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:40.705+0000 7f5c3e7fc700 1 -- 172.21.15.39:0/2500501014 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c44017040 con 0x7f5c48108c80 2024-05-09T05:26:41.411 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:40.705+0000 7f5c4f2f4700 1 -- 172.21.15.39:0/2500501014 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c481a1510 con 0x7f5c48108c80 2024-05-09T05:26:41.411 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:40.706+0000 7f5c3e7fc700 1 -- 172.21.15.39:0/2500501014 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5c44023020 con 0x7f5c48108c80 2024-05-09T05:26:41.411 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:40.706+0000 7f5c3e7fc700 1 -- 172.21.15.39:0/2500501014 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f5c4400f050 con 0x7f5c48108c80 2024-05-09T05:26:41.411 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:40.706+0000 7f5c4f2f4700 1 -- 172.21.15.39:0/2500501014 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c48064e20 con 0x7f5c48108c80 2024-05-09T05:26:41.411 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:40.709+0000 7f5c3e7fc700 1 -- 172.21.15.39:0/2500501014 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f5c4402a020 con 0x7f5c48108c80 2024-05-09T05:26:41.411 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:40.784+0000 7f5c4f2f4700 1 -- 172.21.15.39:0/2500501014 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f5c481a16e0 con 0x7f5c48108c80 2024-05-09T05:26:41.411 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:40.784+0000 7f5c3e7fc700 1 -- 172.21.15.39:0/2500501014 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7f5c44025400 con 0x7f5c48108c80 2024-05-09T05:26:41.411 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:40.785+0000 7f5c4f2f4700 1 -- 172.21.15.39:0/2500501014 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5c48108c80 msgr2=0x7f5c4819e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:26:41.411 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:40.785+0000 7f5c4f2f4700 1 --2- 172.21.15.39:0/2500501014 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5c48108c80 0x7f5c4819e130 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f5c44009fd0 tx=0x7f5c4400bd50 comp rx=0 tx=0).stop 2024-05-09T05:26:41.411 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:40.785+0000 7f5c4f2f4700 1 -- 172.21.15.39:0/2500501014 shutdown_connections 2024-05-09T05:26:41.412 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:40.785+0000 7f5c4f2f4700 1 --2- 172.21.15.39:0/2500501014 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5c48108c80 0x7f5c4819e130 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:26:41.412 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:40.785+0000 7f5c4f2f4700 1 -- 172.21.15.39:0/2500501014 >> 172.21.15.39:0/2500501014 conn(0x7f5c48104300 msgr2=0x7f5c48104b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:26:41.412 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:40.786+0000 7f5c4f2f4700 1 -- 172.21.15.39:0/2500501014 shutdown_connections 2024-05-09T05:26:41.412 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:40.786+0000 7f5c4f2f4700 1 -- 172.21.15.39:0/2500501014 wait complete. 2024-05-09T05:26:41.412 INFO:teuthology.orchestra.run.smithi039.stdout:mgr not available, waiting (1/15)... 2024-05-09T05:26:42.612 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:26:42 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: 2024-05-09T05:26:42.290+0000 7fa97fb5e200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-09T05:26:42.612 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:26:42 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: 2024-05-09T05:26:42.467+0000 7fa97fb5e200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-09T05:26:42.941 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:26:42 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: 2024-05-09T05:26:42.645+0000 7fa97fb5e200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-09T05:26:42.941 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:26:42 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: 2024-05-09T05:26:42.945+0000 7fa97fb5e200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-09T05:26:43.255 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:26:43 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: 2024-05-09T05:26:43.043+0000 7fa97fb5e200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-09T05:26:43.256 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:26:43 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: 2024-05-09T05:26:43.260+0000 7fa97fb5e200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-09T05:26:43.519 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:26:43 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: 2024-05-09T05:26:43.464+0000 7fa97fb5e200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-09T05:26:44.111 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:43 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/143103070' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-09T05:26:44.481 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:26:44 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: 2024-05-09T05:26:44.117+0000 7fa97fb5e200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-09T05:26:44.482 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:26:44 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: 2024-05-09T05:26:44.353+0000 7fa97fb5e200 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-09T05:26:44.494 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout 2024-05-09T05:26:44.494 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout { 2024-05-09T05:26:44.494 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "fsid": "86d4cc60-0dc4-11ef-bc97-c7b262605968", 2024-05-09T05:26:44.494 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "health": { 2024-05-09T05:26:44.495 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-05-09T05:26:44.495 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-05-09T05:26:44.495 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-05-09T05:26:44.495 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout }, 2024-05-09T05:26:44.495 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-05-09T05:26:44.495 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-05-09T05:26:44.495 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout 0 2024-05-09T05:26:44.495 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout ], 2024-05-09T05:26:44.495 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-05-09T05:26:44.495 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "a" 2024-05-09T05:26:44.495 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout ], 2024-05-09T05:26:44.495 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-05-09T05:26:44.496 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "monmap": { 2024-05-09T05:26:44.496 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-09T05:26:44.496 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-05-09T05:26:44.496 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-05-09T05:26:44.496 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout }, 2024-05-09T05:26:44.496 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-05-09T05:26:44.496 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-09T05:26:44.496 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-05-09T05:26:44.496 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-05-09T05:26:44.496 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-05-09T05:26:44.496 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-05-09T05:26:44.496 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-05-09T05:26:44.496 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-05-09T05:26:44.496 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout }, 2024-05-09T05:26:44.497 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-05-09T05:26:44.497 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-05-09T05:26:44.497 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-05-09T05:26:44.497 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-05-09T05:26:44.497 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-05-09T05:26:44.497 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-05-09T05:26:44.497 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-05-09T05:26:44.497 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-05-09T05:26:44.497 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-05-09T05:26:44.497 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout }, 2024-05-09T05:26:44.497 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-05-09T05:26:44.497 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-09T05:26:44.497 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-05-09T05:26:44.497 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-05-09T05:26:44.498 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout }, 2024-05-09T05:26:44.498 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-05-09T05:26:44.498 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "available": false, 2024-05-09T05:26:44.498 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-05-09T05:26:44.498 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "modules": [ 2024-05-09T05:26:44.498 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "iostat", 2024-05-09T05:26:44.498 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "nfs", 2024-05-09T05:26:44.498 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "restful" 2024-05-09T05:26:44.498 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout ], 2024-05-09T05:26:44.498 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-09T05:26:44.498 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout }, 2024-05-09T05:26:44.498 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-05-09T05:26:44.498 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-09T05:26:44.498 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "modified": "2024-05-09T05:26:33.514821+0000", 2024-05-09T05:26:44.499 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-09T05:26:44.499 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout }, 2024-05-09T05:26:44.499 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-05-09T05:26:44.499 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout } 2024-05-09T05:26:44.499 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:43.854+0000 7f9090a6e700 1 Processor -- start 2024-05-09T05:26:44.499 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:43.854+0000 7f9090a6e700 1 -- start start 2024-05-09T05:26:44.499 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:43.854+0000 7f9090a6e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f908c109db0 0x7f908c10a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:26:44.499 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:43.854+0000 7f9090a6e700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f908c10a7b0 con 0x7f908c109db0 2024-05-09T05:26:44.499 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:43.855+0000 7f908a59c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f908c109db0 0x7f908c10a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:26:44.499 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:43.855+0000 7f908a59c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f908c109db0 0x7f908c10a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:46006/0 (socket says 172.21.15.39:46006) 2024-05-09T05:26:44.499 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:43.855+0000 7f908a59c700 1 -- 172.21.15.39:0/3274446979 learned_addr learned my addr 172.21.15.39:0/3274446979 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:26:44.499 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:43.855+0000 7f908a59c700 1 -- 172.21.15.39:0/3274446979 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f908c10aee0 con 0x7f908c109db0 2024-05-09T05:26:44.499 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:43.855+0000 7f908a59c700 1 --2- 172.21.15.39:0/3274446979 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f908c109db0 0x7f908c10a1c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f90740098a0 tx=0x7f9074009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=684550339c153c96 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:26:44.500 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:43.855+0000 7f908959a700 1 -- 172.21.15.39:0/3274446979 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9074004160 con 0x7f908c109db0 2024-05-09T05:26:44.500 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:43.856+0000 7f908959a700 1 -- 172.21.15.39:0/3274446979 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f9074004300 con 0x7f908c109db0 2024-05-09T05:26:44.500 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:43.856+0000 7f908959a700 1 -- 172.21.15.39:0/3274446979 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9074011af0 con 0x7f908c109db0 2024-05-09T05:26:44.500 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:43.856+0000 7f9090a6e700 1 -- 172.21.15.39:0/3274446979 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f908c109db0 msgr2=0x7f908c10a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:26:44.500 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:43.856+0000 7f9090a6e700 1 --2- 172.21.15.39:0/3274446979 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f908c109db0 0x7f908c10a1c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f90740098a0 tx=0x7f9074009bb0 comp rx=0 tx=0).stop 2024-05-09T05:26:44.500 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:43.857+0000 7f9090a6e700 1 -- 172.21.15.39:0/3274446979 shutdown_connections 2024-05-09T05:26:44.500 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:43.857+0000 7f9090a6e700 1 --2- 172.21.15.39:0/3274446979 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f908c109db0 0x7f908c10a1c0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:26:44.500 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:43.857+0000 7f9090a6e700 1 -- 172.21.15.39:0/3274446979 >> 172.21.15.39:0/3274446979 conn(0x7f908c105410 msgr2=0x7f908c1078a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:26:44.500 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:43.857+0000 7f9090a6e700 1 -- 172.21.15.39:0/3274446979 shutdown_connections 2024-05-09T05:26:44.500 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:43.857+0000 7f9090a6e700 1 -- 172.21.15.39:0/3274446979 wait complete. 2024-05-09T05:26:44.500 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:43.858+0000 7f9090a6e700 1 Processor -- start 2024-05-09T05:26:44.500 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:43.858+0000 7f9090a6e700 1 -- start start 2024-05-09T05:26:44.500 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:43.858+0000 7f9090a6e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f908c109db0 0x7f908c19e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:26:44.500 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:43.858+0000 7f9090a6e700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f908c10e290 con 0x7f908c109db0 2024-05-09T05:26:44.501 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:43.858+0000 7f908a59c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f908c109db0 0x7f908c19e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:26:44.501 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:43.858+0000 7f908a59c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f908c109db0 0x7f908c19e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:46012/0 (socket says 172.21.15.39:46012) 2024-05-09T05:26:44.501 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:43.858+0000 7f908a59c700 1 -- 172.21.15.39:0/143103070 learned_addr learned my addr 172.21.15.39:0/143103070 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:26:44.501 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:43.859+0000 7f908a59c700 1 -- 172.21.15.39:0/143103070 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f908c19e6b0 con 0x7f908c109db0 2024-05-09T05:26:44.501 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:43.859+0000 7f908a59c700 1 --2- 172.21.15.39:0/143103070 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f908c109db0 0x7f908c19e170 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9074009fb0 tx=0x7f9074011890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:26:44.501 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:43.859+0000 7f90837fe700 1 -- 172.21.15.39:0/143103070 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90740036a0 con 0x7f908c109db0 2024-05-09T05:26:44.501 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:43.859+0000 7f90837fe700 1 -- 172.21.15.39:0/143103070 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f9074003cd0 con 0x7f908c109db0 2024-05-09T05:26:44.501 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:43.859+0000 7f9090a6e700 1 -- 172.21.15.39:0/143103070 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f908c19e940 con 0x7f908c109db0 2024-05-09T05:26:44.501 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:43.859+0000 7f90837fe700 1 -- 172.21.15.39:0/143103070 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f907401a430 con 0x7f908c109db0 2024-05-09T05:26:44.501 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:43.859+0000 7f9090a6e700 1 -- 172.21.15.39:0/143103070 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f908c1a1550 con 0x7f908c109db0 2024-05-09T05:26:44.501 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:43.859+0000 7f90837fe700 1 -- 172.21.15.39:0/143103070 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f907401aa30 con 0x7f908c109db0 2024-05-09T05:26:44.501 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:43.859+0000 7f90837fe700 1 -- 172.21.15.39:0/143103070 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f90740193c0 con 0x7f908c109db0 2024-05-09T05:26:44.501 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:43.860+0000 7f9090a6e700 1 -- 172.21.15.39:0/143103070 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f908c064e20 con 0x7f908c109db0 2024-05-09T05:26:44.502 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:43.862+0000 7f90837fe700 1 -- 172.21.15.39:0/143103070 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f9074024440 con 0x7f908c109db0 2024-05-09T05:26:44.502 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:43.936+0000 7f9090a6e700 1 -- 172.21.15.39:0/143103070 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f908c1a1720 con 0x7f908c109db0 2024-05-09T05:26:44.502 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:43.937+0000 7f90837fe700 1 -- 172.21.15.39:0/143103070 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7f9074024760 con 0x7f908c109db0 2024-05-09T05:26:44.502 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:43.938+0000 7f9090a6e700 1 -- 172.21.15.39:0/143103070 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f908c109db0 msgr2=0x7f908c19e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:26:44.502 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:43.938+0000 7f9090a6e700 1 --2- 172.21.15.39:0/143103070 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f908c109db0 0x7f908c19e170 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9074009fb0 tx=0x7f9074011890 comp rx=0 tx=0).stop 2024-05-09T05:26:44.502 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:43.938+0000 7f9090a6e700 1 -- 172.21.15.39:0/143103070 shutdown_connections 2024-05-09T05:26:44.502 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:43.938+0000 7f9090a6e700 1 --2- 172.21.15.39:0/143103070 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f908c109db0 0x7f908c19e170 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:26:44.502 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:43.938+0000 7f9090a6e700 1 -- 172.21.15.39:0/143103070 >> 172.21.15.39:0/143103070 conn(0x7f908c105410 msgr2=0x7f908c105ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:26:44.502 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:43.938+0000 7f9090a6e700 1 -- 172.21.15.39:0/143103070 shutdown_connections 2024-05-09T05:26:44.502 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:43.938+0000 7f9090a6e700 1 -- 172.21.15.39:0/143103070 wait complete. 2024-05-09T05:26:44.502 INFO:teuthology.orchestra.run.smithi039.stdout:mgr not available, waiting (2/15)... 2024-05-09T05:26:45.111 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:26:44 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: 2024-05-09T05:26:44.800+0000 7fa97fb5e200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-09T05:26:45.111 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:26:44 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: 2024-05-09T05:26:44.901+0000 7fa97fb5e200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-09T05:26:45.611 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:26:45 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: 2024-05-09T05:26:45.285+0000 7fa97fb5e200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-09T05:26:46.007 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:26:45 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: 2024-05-09T05:26:45.659+0000 7fa97fb5e200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-09T05:26:46.007 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:26:45 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: 2024-05-09T05:26:45.756+0000 7fa97fb5e200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-09T05:26:46.361 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:26:46 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: 2024-05-09T05:26:46.011+0000 7fa97fb5e200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-09T05:26:46.361 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:26:46 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: 2024-05-09T05:26:46.153+0000 7fa97fb5e200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-09T05:26:46.361 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:26:46 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: 2024-05-09T05:26:46.253+0000 7fa97fb5e200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-09T05:26:46.861 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:26:46 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: 2024-05-09T05:26:46.599+0000 7fa97fb5e200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-09T05:26:46.861 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:26:46 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: 2024-05-09T05:26:46.699+0000 7fa97fb5e200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-09T05:26:47.354 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:47 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/964126716' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-09T05:26:47.611 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:26:47 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: 2024-05-09T05:26:47.359+0000 7fa97fb5e200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-09T05:26:47.611 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:26:47 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: 2024-05-09T05:26:47.589+0000 7fa97fb5e200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-09T05:26:47.723 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout 2024-05-09T05:26:47.723 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout { 2024-05-09T05:26:47.723 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "fsid": "86d4cc60-0dc4-11ef-bc97-c7b262605968", 2024-05-09T05:26:47.723 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "health": { 2024-05-09T05:26:47.723 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-05-09T05:26:47.723 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-05-09T05:26:47.723 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-05-09T05:26:47.723 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout }, 2024-05-09T05:26:47.723 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-05-09T05:26:47.723 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-05-09T05:26:47.724 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout 0 2024-05-09T05:26:47.724 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout ], 2024-05-09T05:26:47.724 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-05-09T05:26:47.724 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "a" 2024-05-09T05:26:47.724 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout ], 2024-05-09T05:26:47.724 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "quorum_age": 8, 2024-05-09T05:26:47.724 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "monmap": { 2024-05-09T05:26:47.724 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-09T05:26:47.724 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-05-09T05:26:47.724 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-05-09T05:26:47.724 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout }, 2024-05-09T05:26:47.724 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-05-09T05:26:47.724 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-09T05:26:47.724 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-05-09T05:26:47.725 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-05-09T05:26:47.725 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-05-09T05:26:47.725 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-05-09T05:26:47.725 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-05-09T05:26:47.725 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-05-09T05:26:47.725 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout }, 2024-05-09T05:26:47.725 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-05-09T05:26:47.725 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-05-09T05:26:47.725 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-05-09T05:26:47.725 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-05-09T05:26:47.725 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-05-09T05:26:47.725 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-05-09T05:26:47.725 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-05-09T05:26:47.725 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-05-09T05:26:47.726 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-05-09T05:26:47.726 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout }, 2024-05-09T05:26:47.726 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-05-09T05:26:47.726 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-09T05:26:47.726 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-05-09T05:26:47.726 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-05-09T05:26:47.726 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout }, 2024-05-09T05:26:47.726 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-05-09T05:26:47.726 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "available": false, 2024-05-09T05:26:47.726 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-05-09T05:26:47.726 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "modules": [ 2024-05-09T05:26:47.726 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "iostat", 2024-05-09T05:26:47.726 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "nfs", 2024-05-09T05:26:47.726 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "restful" 2024-05-09T05:26:47.727 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout ], 2024-05-09T05:26:47.727 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-09T05:26:47.727 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout }, 2024-05-09T05:26:47.727 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-05-09T05:26:47.727 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-09T05:26:47.727 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "modified": "2024-05-09T05:26:33.514821+0000", 2024-05-09T05:26:47.727 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-09T05:26:47.727 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout }, 2024-05-09T05:26:47.727 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-05-09T05:26:47.727 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout } 2024-05-09T05:26:47.727 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:46.927+0000 7fbe39851700 1 Processor -- start 2024-05-09T05:26:47.727 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:46.927+0000 7fbe39851700 1 -- start start 2024-05-09T05:26:47.727 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:46.927+0000 7fbe39851700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe3407f730 0x7fbe3407dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:26:47.727 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:46.928+0000 7fbe39851700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fbe3407e190 con 0x7fbe3407f730 2024-05-09T05:26:47.728 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:46.928+0000 7fbe32ffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe3407f730 0x7fbe3407dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:26:47.728 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:46.928+0000 7fbe32ffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe3407f730 0x7fbe3407dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47270/0 (socket says 172.21.15.39:47270) 2024-05-09T05:26:47.728 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:46.928+0000 7fbe32ffd700 1 -- 172.21.15.39:0/2204772898 learned_addr learned my addr 172.21.15.39:0/2204772898 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:26:47.728 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:46.928+0000 7fbe32ffd700 1 -- 172.21.15.39:0/2204772898 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe3407e310 con 0x7fbe3407f730 2024-05-09T05:26:47.728 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:46.928+0000 7fbe32ffd700 1 --2- 172.21.15.39:0/2204772898 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe3407f730 0x7fbe3407dc50 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fbe240098a0 tx=0x7fbe24009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb5eb9800251e291 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:26:47.728 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:46.928+0000 7fbe31ffb700 1 -- 172.21.15.39:0/2204772898 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe24004160 con 0x7fbe3407f730 2024-05-09T05:26:47.728 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:46.928+0000 7fbe31ffb700 1 -- 172.21.15.39:0/2204772898 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fbe24004300 con 0x7fbe3407f730 2024-05-09T05:26:47.728 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:46.928+0000 7fbe31ffb700 1 -- 172.21.15.39:0/2204772898 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe24011af0 con 0x7fbe3407f730 2024-05-09T05:26:47.728 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:46.929+0000 7fbe39851700 1 -- 172.21.15.39:0/2204772898 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe3407f730 msgr2=0x7fbe3407dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:26:47.728 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:46.929+0000 7fbe39851700 1 --2- 172.21.15.39:0/2204772898 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe3407f730 0x7fbe3407dc50 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fbe240098a0 tx=0x7fbe24009bb0 comp rx=0 tx=0).stop 2024-05-09T05:26:47.728 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:46.929+0000 7fbe39851700 1 -- 172.21.15.39:0/2204772898 shutdown_connections 2024-05-09T05:26:47.728 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:46.929+0000 7fbe39851700 1 --2- 172.21.15.39:0/2204772898 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe3407f730 0x7fbe3407dc50 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:26:47.728 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:46.929+0000 7fbe39851700 1 -- 172.21.15.39:0/2204772898 >> 172.21.15.39:0/2204772898 conn(0x7fbe34105450 msgr2=0x7fbe341078e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:26:47.728 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:46.929+0000 7fbe39851700 1 -- 172.21.15.39:0/2204772898 shutdown_connections 2024-05-09T05:26:47.729 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:46.930+0000 7fbe39851700 1 -- 172.21.15.39:0/2204772898 wait complete. 2024-05-09T05:26:47.729 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:46.930+0000 7fbe39851700 1 Processor -- start 2024-05-09T05:26:47.729 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:46.930+0000 7fbe39851700 1 -- start start 2024-05-09T05:26:47.729 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:46.931+0000 7fbe39851700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe3407f730 0x7fbe341a0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:26:47.729 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:46.931+0000 7fbe39851700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fbe34110310 con 0x7fbe3407f730 2024-05-09T05:26:47.729 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:46.931+0000 7fbe32ffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe3407f730 0x7fbe341a0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:26:47.729 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:46.931+0000 7fbe32ffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe3407f730 0x7fbe341a0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47282/0 (socket says 172.21.15.39:47282) 2024-05-09T05:26:47.729 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:46.931+0000 7fbe32ffd700 1 -- 172.21.15.39:0/964126716 learned_addr learned my addr 172.21.15.39:0/964126716 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:26:47.729 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:46.931+0000 7fbe32ffd700 1 -- 172.21.15.39:0/964126716 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe341a0840 con 0x7fbe3407f730 2024-05-09T05:26:47.729 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:46.931+0000 7fbe32ffd700 1 --2- 172.21.15.39:0/964126716 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe3407f730 0x7fbe341a0300 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fbe240117b0 tx=0x7fbe24011b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:26:47.729 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:46.931+0000 7fbe3884f700 1 -- 172.21.15.39:0/964126716 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe24003af0 con 0x7fbe3407f730 2024-05-09T05:26:47.729 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:46.931+0000 7fbe3884f700 1 -- 172.21.15.39:0/964126716 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fbe24020070 con 0x7fbe3407f730 2024-05-09T05:26:47.729 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:46.931+0000 7fbe39851700 1 -- 172.21.15.39:0/964126716 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe341a0ad0 con 0x7fbe3407f730 2024-05-09T05:26:47.729 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:46.932+0000 7fbe3884f700 1 -- 172.21.15.39:0/964126716 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe24019630 con 0x7fbe3407f730 2024-05-09T05:26:47.730 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:46.932+0000 7fbe39851700 1 -- 172.21.15.39:0/964126716 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe341a36e0 con 0x7fbe3407f730 2024-05-09T05:26:47.730 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:46.933+0000 7fbe3884f700 1 -- 172.21.15.39:0/964126716 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fbe24019c80 con 0x7fbe3407f730 2024-05-09T05:26:47.730 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:46.933+0000 7fbe3884f700 1 -- 172.21.15.39:0/964126716 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fbe2400bb30 con 0x7fbe3407f730 2024-05-09T05:26:47.730 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:46.933+0000 7fbe39851700 1 -- 172.21.15.39:0/964126716 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe34064e20 con 0x7fbe3407f730 2024-05-09T05:26:47.730 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:46.935+0000 7fbe3884f700 1 -- 172.21.15.39:0/964126716 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fbe240042a0 con 0x7fbe3407f730 2024-05-09T05:26:47.730 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:47.010+0000 7fbe39851700 1 -- 172.21.15.39:0/964126716 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fbe341a38e0 con 0x7fbe3407f730 2024-05-09T05:26:47.730 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:47.010+0000 7fbe3884f700 1 -- 172.21.15.39:0/964126716 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7fbe2400bd30 con 0x7fbe3407f730 2024-05-09T05:26:47.730 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:47.011+0000 7fbe39851700 1 -- 172.21.15.39:0/964126716 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe3407f730 msgr2=0x7fbe341a0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:26:47.730 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:47.011+0000 7fbe39851700 1 --2- 172.21.15.39:0/964126716 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe3407f730 0x7fbe341a0300 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fbe240117b0 tx=0x7fbe24011b70 comp rx=0 tx=0).stop 2024-05-09T05:26:47.730 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:47.011+0000 7fbe39851700 1 -- 172.21.15.39:0/964126716 shutdown_connections 2024-05-09T05:26:47.730 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:47.011+0000 7fbe39851700 1 --2- 172.21.15.39:0/964126716 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe3407f730 0x7fbe341a0300 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:26:47.730 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:47.011+0000 7fbe39851700 1 -- 172.21.15.39:0/964126716 >> 172.21.15.39:0/964126716 conn(0x7fbe34105450 msgr2=0x7fbe34105d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:26:47.730 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:47.011+0000 7fbe39851700 1 -- 172.21.15.39:0/964126716 shutdown_connections 2024-05-09T05:26:47.731 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:47.011+0000 7fbe39851700 1 -- 172.21.15.39:0/964126716 wait complete. 2024-05-09T05:26:47.731 INFO:teuthology.orchestra.run.smithi039.stdout:mgr not available, waiting (3/15)... 2024-05-09T05:26:48.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:48 smithi039 ceph-mon[30439]: Activating manager daemon x 2024-05-09T05:26:48.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:48 smithi039 ceph-mon[30439]: mgrmap e2: x(active, starting, since 0.00589501s) 2024-05-09T05:26:48.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:48 smithi039 ceph-mon[30439]: from='mgr.14100 172.21.15.39:0/1043371951' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-09T05:26:48.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:48 smithi039 ceph-mon[30439]: from='mgr.14100 172.21.15.39:0/1043371951' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-09T05:26:48.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:48 smithi039 ceph-mon[30439]: from='mgr.14100 172.21.15.39:0/1043371951' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-09T05:26:48.362 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:48 smithi039 ceph-mon[30439]: from='mgr.14100 172.21.15.39:0/1043371951' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-09T05:26:48.362 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:48 smithi039 ceph-mon[30439]: from='mgr.14100 172.21.15.39:0/1043371951' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-09T05:26:48.362 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:48 smithi039 ceph-mon[30439]: Manager daemon x is now available 2024-05-09T05:26:48.362 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:48 smithi039 ceph-mon[30439]: from='mgr.14100 172.21.15.39:0/1043371951' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-09T05:26:48.362 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:48 smithi039 ceph-mon[30439]: from='mgr.14100 172.21.15.39:0/1043371951' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-09T05:26:48.362 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:48 smithi039 ceph-mon[30439]: from='mgr.14100 172.21.15.39:0/1043371951' entity='mgr.x' 2024-05-09T05:26:48.362 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:48 smithi039 ceph-mon[30439]: from='mgr.14100 172.21.15.39:0/1043371951' entity='mgr.x' 2024-05-09T05:26:48.362 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:48 smithi039 ceph-mon[30439]: from='mgr.14100 172.21.15.39:0/1043371951' entity='mgr.x' 2024-05-09T05:26:49.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:49 smithi039 ceph-mon[30439]: mgrmap e3: x(active, since 1.01023s) 2024-05-09T05:26:50.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:50 smithi039 ceph-mon[30439]: mgrmap e4: x(active, since 2s) 2024-05-09T05:26:50.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:50 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/3723481532' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-09T05:26:51.141 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout 2024-05-09T05:26:51.141 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout { 2024-05-09T05:26:51.141 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "fsid": "86d4cc60-0dc4-11ef-bc97-c7b262605968", 2024-05-09T05:26:51.141 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "health": { 2024-05-09T05:26:51.141 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-05-09T05:26:51.141 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-05-09T05:26:51.141 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-05-09T05:26:51.141 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout }, 2024-05-09T05:26:51.141 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-05-09T05:26:51.141 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-05-09T05:26:51.141 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout 0 2024-05-09T05:26:51.142 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout ], 2024-05-09T05:26:51.142 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-05-09T05:26:51.142 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "a" 2024-05-09T05:26:51.142 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout ], 2024-05-09T05:26:51.142 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "quorum_age": 12, 2024-05-09T05:26:51.142 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "monmap": { 2024-05-09T05:26:51.142 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-09T05:26:51.142 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-05-09T05:26:51.142 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-05-09T05:26:51.142 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout }, 2024-05-09T05:26:51.142 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-05-09T05:26:51.142 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-09T05:26:51.142 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-05-09T05:26:51.143 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-05-09T05:26:51.143 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-05-09T05:26:51.143 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-05-09T05:26:51.143 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-05-09T05:26:51.143 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-05-09T05:26:51.143 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout }, 2024-05-09T05:26:51.143 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-05-09T05:26:51.143 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-05-09T05:26:51.143 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-05-09T05:26:51.143 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-05-09T05:26:51.143 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-05-09T05:26:51.143 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-05-09T05:26:51.143 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-05-09T05:26:51.144 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-05-09T05:26:51.144 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-05-09T05:26:51.144 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout }, 2024-05-09T05:26:51.144 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-05-09T05:26:51.144 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-09T05:26:51.144 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-05-09T05:26:51.144 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-05-09T05:26:51.144 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout }, 2024-05-09T05:26:51.144 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-05-09T05:26:51.144 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "available": true, 2024-05-09T05:26:51.144 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-05-09T05:26:51.144 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "modules": [ 2024-05-09T05:26:51.144 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "iostat", 2024-05-09T05:26:51.145 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "nfs", 2024-05-09T05:26:51.145 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "restful" 2024-05-09T05:26:51.145 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout ], 2024-05-09T05:26:51.145 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-09T05:26:51.145 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout }, 2024-05-09T05:26:51.145 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-05-09T05:26:51.145 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-09T05:26:51.145 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "modified": "2024-05-09T05:26:33.514821+0000", 2024-05-09T05:26:51.145 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-09T05:26:51.145 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout }, 2024-05-09T05:26:51.145 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-05-09T05:26:51.145 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout } 2024-05-09T05:26:51.145 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:50.172+0000 7fa0e1edb700 1 Processor -- start 2024-05-09T05:26:51.146 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:50.172+0000 7fa0e1edb700 1 -- start start 2024-05-09T05:26:51.146 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:50.172+0000 7fa0e1edb700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa0dc10a820 0x7fa0dc10cc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:26:51.146 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:50.172+0000 7fa0e1edb700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fa0dc07d7f0 con 0x7fa0dc10a820 2024-05-09T05:26:51.146 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:50.173+0000 7fa0db7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa0dc10a820 0x7fa0dc10cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:26:51.146 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:50.173+0000 7fa0db7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa0dc10a820 0x7fa0dc10cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47360/0 (socket says 172.21.15.39:47360) 2024-05-09T05:26:51.146 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:50.173+0000 7fa0db7fe700 1 -- 172.21.15.39:0/3710035089 learned_addr learned my addr 172.21.15.39:0/3710035089 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:26:51.146 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:50.173+0000 7fa0db7fe700 1 -- 172.21.15.39:0/3710035089 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0dc10d180 con 0x7fa0dc10a820 2024-05-09T05:26:51.146 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:50.173+0000 7fa0db7fe700 1 --2- 172.21.15.39:0/3710035089 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa0dc10a820 0x7fa0dc10cc40 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc009e80 tx=0x7fa0cc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8497a5966d93f2e8 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:26:51.146 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:50.173+0000 7fa0da7fc700 1 -- 172.21.15.39:0/3710035089 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0cc017070 con 0x7fa0dc10a820 2024-05-09T05:26:51.146 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:50.173+0000 7fa0da7fc700 1 -- 172.21.15.39:0/3710035089 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fa0cc00b8c0 con 0x7fa0dc10a820 2024-05-09T05:26:51.146 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:50.173+0000 7fa0da7fc700 1 -- 172.21.15.39:0/3710035089 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0cc004490 con 0x7fa0dc10a820 2024-05-09T05:26:51.146 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:50.174+0000 7fa0e1edb700 1 -- 172.21.15.39:0/3710035089 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa0dc10a820 msgr2=0x7fa0dc10cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:26:51.146 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:50.174+0000 7fa0e1edb700 1 --2- 172.21.15.39:0/3710035089 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa0dc10a820 0x7fa0dc10cc40 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc009e80 tx=0x7fa0cc00b330 comp rx=0 tx=0).stop 2024-05-09T05:26:51.147 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:50.174+0000 7fa0e1edb700 1 -- 172.21.15.39:0/3710035089 shutdown_connections 2024-05-09T05:26:51.147 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:50.174+0000 7fa0e1edb700 1 --2- 172.21.15.39:0/3710035089 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa0dc10a820 0x7fa0dc10cc40 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:26:51.147 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:50.174+0000 7fa0e1edb700 1 -- 172.21.15.39:0/3710035089 >> 172.21.15.39:0/3710035089 conn(0x7fa0dc1042c0 msgr2=0x7fa0dc106730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:26:51.147 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:50.174+0000 7fa0e1edb700 1 -- 172.21.15.39:0/3710035089 shutdown_connections 2024-05-09T05:26:51.147 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:50.174+0000 7fa0e1edb700 1 -- 172.21.15.39:0/3710035089 wait complete. 2024-05-09T05:26:51.147 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:50.175+0000 7fa0e1edb700 1 Processor -- start 2024-05-09T05:26:51.147 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:50.175+0000 7fa0e1edb700 1 -- start start 2024-05-09T05:26:51.147 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:50.175+0000 7fa0e1edb700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa0dc10a820 0x7fa0dc19e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:26:51.147 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:50.175+0000 7fa0e1edb700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fa0dc10e080 con 0x7fa0dc10a820 2024-05-09T05:26:51.147 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:50.175+0000 7fa0db7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa0dc10a820 0x7fa0dc19e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:26:51.147 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:50.175+0000 7fa0db7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa0dc10a820 0x7fa0dc19e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47364/0 (socket says 172.21.15.39:47364) 2024-05-09T05:26:51.147 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:50.175+0000 7fa0db7fe700 1 -- 172.21.15.39:0/3723481532 learned_addr learned my addr 172.21.15.39:0/3723481532 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:26:51.147 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:50.176+0000 7fa0db7fe700 1 -- 172.21.15.39:0/3723481532 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0dc19e5d0 con 0x7fa0dc10a820 2024-05-09T05:26:51.148 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:50.176+0000 7fa0db7fe700 1 --2- 172.21.15.39:0/3723481532 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa0dc10a820 0x7fa0dc19e090 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc004220 tx=0x7fa0cc00bd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:26:51.148 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:50.176+0000 7fa0d8ff9700 1 -- 172.21.15.39:0/3723481532 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0cc020020 con 0x7fa0dc10a820 2024-05-09T05:26:51.148 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:50.176+0000 7fa0d8ff9700 1 -- 172.21.15.39:0/3723481532 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fa0cc012430 con 0x7fa0dc10a820 2024-05-09T05:26:51.148 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:50.176+0000 7fa0e1edb700 1 -- 172.21.15.39:0/3723481532 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0dc19e860 con 0x7fa0dc10a820 2024-05-09T05:26:51.148 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:50.176+0000 7fa0d8ff9700 1 -- 172.21.15.39:0/3723481532 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0cc017040 con 0x7fa0dc10a820 2024-05-09T05:26:51.148 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:50.176+0000 7fa0e1edb700 1 -- 172.21.15.39:0/3723481532 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0dc1a1470 con 0x7fa0dc10a820 2024-05-09T05:26:51.148 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:50.177+0000 7fa0e1edb700 1 -- 172.21.15.39:0/3723481532 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0dc064e20 con 0x7fa0dc10a820 2024-05-09T05:26:51.148 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:50.177+0000 7fa0d8ff9700 1 -- 172.21.15.39:0/3723481532 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 4) ==== 50211+0+0 (secure 0 0 0) 0x7fa0cc023020 con 0x7fa0dc10a820 2024-05-09T05:26:51.148 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:50.177+0000 7fa0d8ff9700 1 --2- 172.21.15.39:0/3723481532 >> [v2:172.21.15.39:6800/499609328,v1:172.21.15.39:6801/499609328] conn(0x7fa0c803e420 0x7fa0c8040930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:26:51.148 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:50.177+0000 7fa0d8ff9700 1 -- 172.21.15.39:0/3723481532 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fa0cc00f050 con 0x7fa0dc10a820 2024-05-09T05:26:51.148 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:50.178+0000 7fa0daffd700 1 --2- 172.21.15.39:0/3723481532 >> [v2:172.21.15.39:6800/499609328,v1:172.21.15.39:6801/499609328] conn(0x7fa0c803e420 0x7fa0c8040930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:26:51.148 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:50.178+0000 7fa0daffd700 1 --2- 172.21.15.39:0/3723481532 >> [v2:172.21.15.39:6800/499609328,v1:172.21.15.39:6801/499609328] conn(0x7fa0c803e420 0x7fa0c8040930 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa0c4006fd0 tx=0x7fa0c4006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:26:51.148 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:50.183+0000 7fa0d8ff9700 1 -- 172.21.15.39:0/3723481532 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fa0cc02a020 con 0x7fa0dc10a820 2024-05-09T05:26:51.148 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:50.486+0000 7fa0e1edb700 1 -- 172.21.15.39:0/3723481532 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fa0dc1a1b40 con 0x7fa0dc10a820 2024-05-09T05:26:51.149 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:50.487+0000 7fa0d8ff9700 1 -- 172.21.15.39:0/3723481532 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7fa0cc02a200 con 0x7fa0dc10a820 2024-05-09T05:26:51.149 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:50.489+0000 7fa0e1edb700 1 -- 172.21.15.39:0/3723481532 >> [v2:172.21.15.39:6800/499609328,v1:172.21.15.39:6801/499609328] conn(0x7fa0c803e420 msgr2=0x7fa0c8040930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:26:51.149 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:50.489+0000 7fa0e1edb700 1 --2- 172.21.15.39:0/3723481532 >> [v2:172.21.15.39:6800/499609328,v1:172.21.15.39:6801/499609328] conn(0x7fa0c803e420 0x7fa0c8040930 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa0c4006fd0 tx=0x7fa0c4006e40 comp rx=0 tx=0).stop 2024-05-09T05:26:51.149 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:50.489+0000 7fa0e1edb700 1 -- 172.21.15.39:0/3723481532 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa0dc10a820 msgr2=0x7fa0dc19e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:26:51.149 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:50.489+0000 7fa0e1edb700 1 --2- 172.21.15.39:0/3723481532 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa0dc10a820 0x7fa0dc19e090 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc004220 tx=0x7fa0cc00bd50 comp rx=0 tx=0).stop 2024-05-09T05:26:51.149 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:50.489+0000 7fa0e1edb700 1 -- 172.21.15.39:0/3723481532 shutdown_connections 2024-05-09T05:26:51.149 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:50.489+0000 7fa0e1edb700 1 --2- 172.21.15.39:0/3723481532 >> [v2:172.21.15.39:6800/499609328,v1:172.21.15.39:6801/499609328] conn(0x7fa0c803e420 0x7fa0c8040930 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:26:51.149 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:50.489+0000 7fa0e1edb700 1 --2- 172.21.15.39:0/3723481532 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa0dc10a820 0x7fa0dc19e090 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:26:51.149 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:50.489+0000 7fa0e1edb700 1 -- 172.21.15.39:0/3723481532 >> 172.21.15.39:0/3723481532 conn(0x7fa0dc1042c0 msgr2=0x7fa0dc104ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:26:51.149 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:50.489+0000 7fa0e1edb700 1 -- 172.21.15.39:0/3723481532 shutdown_connections 2024-05-09T05:26:51.149 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:50.489+0000 7fa0e1edb700 1 -- 172.21.15.39:0/3723481532 wait complete. 2024-05-09T05:26:51.149 INFO:teuthology.orchestra.run.smithi039.stdout:mgr is available 2024-05-09T05:26:52.111 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:51 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/2391151826' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-05-09T05:26:52.363 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout 2024-05-09T05:26:52.363 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout [global] 2024-05-09T05:26:52.363 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout fsid = 86d4cc60-0dc4-11ef-bc97-c7b262605968 2024-05-09T05:26:52.363 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-05-09T05:26:52.363 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-05-09T05:26:52.363 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-05-09T05:26:52.363 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-05-09T05:26:52.363 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-05-09T05:26:52.364 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout 2024-05-09T05:26:52.364 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout [mgr] 2024-05-09T05:26:52.364 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-05-09T05:26:52.364 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout 2024-05-09T05:26:52.364 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout [osd] 2024-05-09T05:26:52.364 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout bdev_async_discard = True 2024-05-09T05:26:52.364 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-05-09T05:26:52.364 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-05-09T05:26:52.364 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-05-09T05:26:52.364 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-05-09T05:26:52.364 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-05-09T05:26:52.364 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:51.553+0000 7f2c7b34f700 1 Processor -- start 2024-05-09T05:26:52.364 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:51.553+0000 7f2c7b34f700 1 -- start start 2024-05-09T05:26:52.365 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:51.554+0000 7f2c7b34f700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2c74108cb0 0x7f2c741090c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:26:52.365 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:51.554+0000 7f2c7b34f700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f2c741096b0 con 0x7f2c74108cb0 2024-05-09T05:26:52.365 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:51.554+0000 7f2c790eb700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2c74108cb0 0x7f2c741090c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:26:52.365 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:51.554+0000 7f2c790eb700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2c74108cb0 0x7f2c741090c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47366/0 (socket says 172.21.15.39:47366) 2024-05-09T05:26:52.365 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:51.554+0000 7f2c790eb700 1 -- 172.21.15.39:0/3545733625 learned_addr learned my addr 172.21.15.39:0/3545733625 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:26:52.365 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:51.554+0000 7f2c790eb700 1 -- 172.21.15.39:0/3545733625 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c74109de0 con 0x7f2c74108cb0 2024-05-09T05:26:52.365 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:51.554+0000 7f2c790eb700 1 --2- 172.21.15.39:0/3545733625 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2c74108cb0 0x7f2c741090c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f2c700098a0 tx=0x7f2c70009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca7534547fabbe16 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:26:52.365 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:51.555+0000 7f2c6bfff700 1 -- 172.21.15.39:0/3545733625 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c70004160 con 0x7f2c74108cb0 2024-05-09T05:26:52.365 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:51.555+0000 7f2c6bfff700 1 -- 172.21.15.39:0/3545733625 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f2c70004300 con 0x7f2c74108cb0 2024-05-09T05:26:52.365 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:51.555+0000 7f2c6bfff700 1 -- 172.21.15.39:0/3545733625 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c70011af0 con 0x7f2c74108cb0 2024-05-09T05:26:52.365 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:51.555+0000 7f2c7b34f700 1 -- 172.21.15.39:0/3545733625 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2c74108cb0 msgr2=0x7f2c741090c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:26:52.365 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:51.555+0000 7f2c7b34f700 1 --2- 172.21.15.39:0/3545733625 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2c74108cb0 0x7f2c741090c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f2c700098a0 tx=0x7f2c70009bb0 comp rx=0 tx=0).stop 2024-05-09T05:26:52.365 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:51.555+0000 7f2c7b34f700 1 -- 172.21.15.39:0/3545733625 shutdown_connections 2024-05-09T05:26:52.366 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:51.555+0000 7f2c7b34f700 1 --2- 172.21.15.39:0/3545733625 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2c74108cb0 0x7f2c741090c0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:26:52.366 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:51.555+0000 7f2c7b34f700 1 -- 172.21.15.39:0/3545733625 >> 172.21.15.39:0/3545733625 conn(0x7f2c741043d0 msgr2=0x7f2c74106820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:26:52.366 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:51.555+0000 7f2c7b34f700 1 -- 172.21.15.39:0/3545733625 shutdown_connections 2024-05-09T05:26:52.366 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:51.556+0000 7f2c7b34f700 1 -- 172.21.15.39:0/3545733625 wait complete. 2024-05-09T05:26:52.366 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:51.556+0000 7f2c7b34f700 1 Processor -- start 2024-05-09T05:26:52.366 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:51.556+0000 7f2c7b34f700 1 -- start start 2024-05-09T05:26:52.366 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:51.556+0000 7f2c7b34f700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2c74108cb0 0x7f2c7407c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:26:52.366 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:51.556+0000 7f2c7b34f700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f2c7410d190 con 0x7f2c74108cb0 2024-05-09T05:26:52.366 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:51.556+0000 7f2c790eb700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2c74108cb0 0x7f2c7407c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:26:52.366 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:51.556+0000 7f2c790eb700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2c74108cb0 0x7f2c7407c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47382/0 (socket says 172.21.15.39:47382) 2024-05-09T05:26:52.366 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:51.557+0000 7f2c790eb700 1 -- 172.21.15.39:0/2391151826 learned_addr learned my addr 172.21.15.39:0/2391151826 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:26:52.366 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:51.557+0000 7f2c790eb700 1 -- 172.21.15.39:0/2391151826 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c7419ed50 con 0x7f2c74108cb0 2024-05-09T05:26:52.366 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:51.557+0000 7f2c790eb700 1 --2- 172.21.15.39:0/2391151826 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2c74108cb0 0x7f2c7407c930 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f2c70011670 tx=0x7f2c70004280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:26:52.367 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:51.557+0000 7f2c6a7fc700 1 -- 172.21.15.39:0/2391151826 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c700036a0 con 0x7f2c74108cb0 2024-05-09T05:26:52.367 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:51.557+0000 7f2c6a7fc700 1 -- 172.21.15.39:0/2391151826 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f2c70003cd0 con 0x7f2c74108cb0 2024-05-09T05:26:52.367 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:51.557+0000 7f2c7b34f700 1 -- 172.21.15.39:0/2391151826 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c7407ce70 con 0x7f2c74108cb0 2024-05-09T05:26:52.367 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:51.557+0000 7f2c6a7fc700 1 -- 172.21.15.39:0/2391151826 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c700193c0 con 0x7f2c74108cb0 2024-05-09T05:26:52.367 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:51.557+0000 7f2c7b34f700 1 -- 172.21.15.39:0/2391151826 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c741a3610 con 0x7f2c74108cb0 2024-05-09T05:26:52.367 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:51.558+0000 7f2c6a7fc700 1 -- 172.21.15.39:0/2391151826 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 4) ==== 50211+0+0 (secure 0 0 0) 0x7f2c70019630 con 0x7f2c74108cb0 2024-05-09T05:26:52.367 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:51.558+0000 7f2c7b34f700 1 -- 172.21.15.39:0/2391151826 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c74064e20 con 0x7f2c74108cb0 2024-05-09T05:26:52.367 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:51.558+0000 7f2c6a7fc700 1 --2- 172.21.15.39:0/2391151826 >> [v2:172.21.15.39:6800/499609328,v1:172.21.15.39:6801/499609328] conn(0x7f2c6003e420 0x7f2c60040930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:26:52.367 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:51.558+0000 7f2c6a7fc700 1 -- 172.21.15.39:0/2391151826 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f2c70053650 con 0x7f2c74108cb0 2024-05-09T05:26:52.367 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:51.559+0000 7f2c788ea700 1 --2- 172.21.15.39:0/2391151826 >> [v2:172.21.15.39:6800/499609328,v1:172.21.15.39:6801/499609328] conn(0x7f2c6003e420 0x7f2c60040930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:26:52.367 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:51.559+0000 7f2c788ea700 1 --2- 172.21.15.39:0/2391151826 >> [v2:172.21.15.39:6800/499609328,v1:172.21.15.39:6801/499609328] conn(0x7f2c6003e420 0x7f2c60040930 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2c64006fd0 tx=0x7f2c64006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:26:52.367 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:51.564+0000 7f2c6a7fc700 1 -- 172.21.15.39:0/2391151826 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f2c70016dd0 con 0x7f2c74108cb0 2024-05-09T05:26:52.367 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:51.778+0000 7f2c7b34f700 1 -- 172.21.15.39:0/2391151826 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f2c741a5070 con 0x7f2c74108cb0 2024-05-09T05:26:52.368 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:51.780+0000 7f2c6a7fc700 1 -- 172.21.15.39:0/2391151826 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+436 (secure 0 0 0) 0x7f2c700199d0 con 0x7f2c74108cb0 2024-05-09T05:26:52.368 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:51.783+0000 7f2c7b34f700 1 -- 172.21.15.39:0/2391151826 >> [v2:172.21.15.39:6800/499609328,v1:172.21.15.39:6801/499609328] conn(0x7f2c6003e420 msgr2=0x7f2c60040930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:26:52.368 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:51.783+0000 7f2c7b34f700 1 --2- 172.21.15.39:0/2391151826 >> [v2:172.21.15.39:6800/499609328,v1:172.21.15.39:6801/499609328] conn(0x7f2c6003e420 0x7f2c60040930 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2c64006fd0 tx=0x7f2c64006e40 comp rx=0 tx=0).stop 2024-05-09T05:26:52.368 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:51.783+0000 7f2c7b34f700 1 -- 172.21.15.39:0/2391151826 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2c74108cb0 msgr2=0x7f2c7407c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:26:52.368 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:51.783+0000 7f2c7b34f700 1 --2- 172.21.15.39:0/2391151826 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2c74108cb0 0x7f2c7407c930 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f2c70011670 tx=0x7f2c70004280 comp rx=0 tx=0).stop 2024-05-09T05:26:52.368 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:51.783+0000 7f2c7b34f700 1 -- 172.21.15.39:0/2391151826 shutdown_connections 2024-05-09T05:26:52.368 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:51.783+0000 7f2c7b34f700 1 --2- 172.21.15.39:0/2391151826 >> [v2:172.21.15.39:6800/499609328,v1:172.21.15.39:6801/499609328] conn(0x7f2c6003e420 0x7f2c60040930 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:26:52.368 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:51.783+0000 7f2c7b34f700 1 --2- 172.21.15.39:0/2391151826 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2c74108cb0 0x7f2c7407c930 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:26:52.368 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:51.783+0000 7f2c7b34f700 1 -- 172.21.15.39:0/2391151826 >> 172.21.15.39:0/2391151826 conn(0x7f2c741043d0 msgr2=0x7f2c74105d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:26:52.368 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:51.783+0000 7f2c7b34f700 1 -- 172.21.15.39:0/2391151826 shutdown_connections 2024-05-09T05:26:52.368 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:51.783+0000 7f2c7b34f700 1 -- 172.21.15.39:0/2391151826 wait complete. 2024-05-09T05:26:52.368 INFO:teuthology.orchestra.run.smithi039.stdout:Enabling cephadm module... 2024-05-09T05:26:53.314 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:53 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/2653575286' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-05-09T05:26:53.315 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:26:53 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: ignoring --setuser ceph since I am not root 2024-05-09T05:26:53.315 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:26:53 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: ignoring --setgroup ceph since I am not root 2024-05-09T05:26:53.315 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:26:53 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: 2024-05-09T05:26:53.319+0000 7f6193787200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-09T05:26:53.597 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:26:53 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: 2024-05-09T05:26:53.520+0000 7f6193787200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-09T05:26:53.748 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:52.756+0000 7f91b3340700 1 Processor -- start 2024-05-09T05:26:53.748 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:52.756+0000 7f91b3340700 1 -- start start 2024-05-09T05:26:53.749 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:52.757+0000 7f91b3340700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f91ac07f7e0 0x7f91ac07dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:26:53.749 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:52.757+0000 7f91b3340700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f91ac07e1f0 con 0x7f91ac07f7e0 2024-05-09T05:26:53.749 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:52.757+0000 7f91b10dc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f91ac07f7e0 0x7f91ac07dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:26:53.749 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:52.757+0000 7f91b10dc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f91ac07f7e0 0x7f91ac07dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47394/0 (socket says 172.21.15.39:47394) 2024-05-09T05:26:53.749 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:52.757+0000 7f91b10dc700 1 -- 172.21.15.39:0/2296941477 learned_addr learned my addr 172.21.15.39:0/2296941477 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:26:53.749 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:52.757+0000 7f91b10dc700 1 -- 172.21.15.39:0/2296941477 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91ac07e370 con 0x7f91ac07f7e0 2024-05-09T05:26:53.749 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:52.757+0000 7f91b10dc700 1 --2- 172.21.15.39:0/2296941477 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f91ac07f7e0 0x7f91ac07dcb0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f919c009e80 tx=0x7f919c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76f2aded91289168 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:26:53.749 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:52.757+0000 7f91abfff700 1 -- 172.21.15.39:0/2296941477 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f919c017070 con 0x7f91ac07f7e0 2024-05-09T05:26:53.749 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:52.758+0000 7f91abfff700 1 -- 172.21.15.39:0/2296941477 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f919c00b8c0 con 0x7f91ac07f7e0 2024-05-09T05:26:53.749 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:52.758+0000 7f91abfff700 1 -- 172.21.15.39:0/2296941477 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f919c004490 con 0x7f91ac07f7e0 2024-05-09T05:26:53.749 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:52.758+0000 7f91b3340700 1 -- 172.21.15.39:0/2296941477 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f91ac07f7e0 msgr2=0x7f91ac07dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:26:53.749 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:52.758+0000 7f91b3340700 1 --2- 172.21.15.39:0/2296941477 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f91ac07f7e0 0x7f91ac07dcb0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f919c009e80 tx=0x7f919c00b330 comp rx=0 tx=0).stop 2024-05-09T05:26:53.750 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:52.758+0000 7f91b3340700 1 -- 172.21.15.39:0/2296941477 shutdown_connections 2024-05-09T05:26:53.750 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:52.758+0000 7f91b3340700 1 --2- 172.21.15.39:0/2296941477 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f91ac07f7e0 0x7f91ac07dcb0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:26:53.750 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:52.758+0000 7f91b3340700 1 -- 172.21.15.39:0/2296941477 >> 172.21.15.39:0/2296941477 conn(0x7f91ac105470 msgr2=0x7f91ac1078c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:26:53.750 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:52.758+0000 7f91b3340700 1 -- 172.21.15.39:0/2296941477 shutdown_connections 2024-05-09T05:26:53.750 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:52.759+0000 7f91b3340700 1 -- 172.21.15.39:0/2296941477 wait complete. 2024-05-09T05:26:53.750 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:52.759+0000 7f91b3340700 1 Processor -- start 2024-05-09T05:26:53.750 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:52.759+0000 7f91b3340700 1 -- start start 2024-05-09T05:26:53.750 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:52.759+0000 7f91b3340700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f91ac07f7e0 0x7f91ac1a0270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:26:53.750 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:52.759+0000 7f91b3340700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f91ac1102b0 con 0x7f91ac07f7e0 2024-05-09T05:26:53.750 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:52.760+0000 7f91b10dc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f91ac07f7e0 0x7f91ac1a0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:26:53.750 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:52.760+0000 7f91b10dc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f91ac07f7e0 0x7f91ac1a0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47404/0 (socket says 172.21.15.39:47404) 2024-05-09T05:26:53.750 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:52.760+0000 7f91b10dc700 1 -- 172.21.15.39:0/2653575286 learned_addr learned my addr 172.21.15.39:0/2653575286 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:26:53.750 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:52.760+0000 7f91b10dc700 1 -- 172.21.15.39:0/2653575286 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91ac1a07b0 con 0x7f91ac07f7e0 2024-05-09T05:26:53.750 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:52.760+0000 7f91b10dc700 1 --2- 172.21.15.39:0/2653575286 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f91ac07f7e0 0x7f91ac1a0270 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f919c004220 tx=0x7f919c00bd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:26:53.751 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:52.760+0000 7f91aa7fc700 1 -- 172.21.15.39:0/2653575286 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f919c020020 con 0x7f91ac07f7e0 2024-05-09T05:26:53.751 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:52.760+0000 7f91aa7fc700 1 -- 172.21.15.39:0/2653575286 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f919c012430 con 0x7f91ac07f7e0 2024-05-09T05:26:53.751 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:52.760+0000 7f91b3340700 1 -- 172.21.15.39:0/2653575286 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91ac1a0a40 con 0x7f91ac07f7e0 2024-05-09T05:26:53.751 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:52.760+0000 7f91aa7fc700 1 -- 172.21.15.39:0/2653575286 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f919c017040 con 0x7f91ac07f7e0 2024-05-09T05:26:53.751 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:52.760+0000 7f91b3340700 1 -- 172.21.15.39:0/2653575286 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91ac1a3650 con 0x7f91ac07f7e0 2024-05-09T05:26:53.751 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:52.761+0000 7f91b3340700 1 -- 172.21.15.39:0/2653575286 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91ac064e20 con 0x7f91ac07f7e0 2024-05-09T05:26:53.751 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:52.761+0000 7f91aa7fc700 1 -- 172.21.15.39:0/2653575286 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 4) ==== 50211+0+0 (secure 0 0 0) 0x7f919c023020 con 0x7f91ac07f7e0 2024-05-09T05:26:53.751 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:52.762+0000 7f91aa7fc700 1 --2- 172.21.15.39:0/2653575286 >> [v2:172.21.15.39:6800/499609328,v1:172.21.15.39:6801/499609328] conn(0x7f919403e420 0x7f9194040930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:26:53.751 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:52.762+0000 7f91aa7fc700 1 -- 172.21.15.39:0/2653575286 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f919c00f050 con 0x7f91ac07f7e0 2024-05-09T05:26:53.751 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:52.762+0000 7f91b08db700 1 --2- 172.21.15.39:0/2653575286 >> [v2:172.21.15.39:6800/499609328,v1:172.21.15.39:6801/499609328] conn(0x7f919403e420 0x7f9194040930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:26:53.751 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:52.762+0000 7f91b08db700 1 --2- 172.21.15.39:0/2653575286 >> [v2:172.21.15.39:6800/499609328,v1:172.21.15.39:6801/499609328] conn(0x7f919403e420 0x7f9194040930 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f91a0006fd0 tx=0x7f91a0006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:26:53.751 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:52.767+0000 7f91aa7fc700 1 -- 172.21.15.39:0/2653575286 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f919c02a020 con 0x7f91ac07f7e0 2024-05-09T05:26:53.751 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:53.041+0000 7f91b3340700 1 -- 172.21.15.39:0/2653575286 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7f91ac1a3d20 con 0x7f91ac07f7e0 2024-05-09T05:26:53.752 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:53.097+0000 7f91aa7fc700 1 -- 172.21.15.39:0/2653575286 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7f919c02a200 con 0x7f91ac07f7e0 2024-05-09T05:26:53.752 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:53.099+0000 7f91aa7fc700 1 -- 172.21.15.39:0/2653575286 <== mon.0 v2:172.21.15.39:3300/0 8 ==== mgrmap(e 5) ==== 50222+0+0 (secure 0 0 0) 0x7f919c02da40 con 0x7f91ac07f7e0 2024-05-09T05:26:53.752 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:53.100+0000 7f91b3340700 1 -- 172.21.15.39:0/2653575286 >> [v2:172.21.15.39:6800/499609328,v1:172.21.15.39:6801/499609328] conn(0x7f919403e420 msgr2=0x7f9194040930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:26:53.752 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:53.100+0000 7f91b3340700 1 --2- 172.21.15.39:0/2653575286 >> [v2:172.21.15.39:6800/499609328,v1:172.21.15.39:6801/499609328] conn(0x7f919403e420 0x7f9194040930 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f91a0006fd0 tx=0x7f91a0006e40 comp rx=0 tx=0).stop 2024-05-09T05:26:53.752 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:53.100+0000 7f91b3340700 1 -- 172.21.15.39:0/2653575286 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f91ac07f7e0 msgr2=0x7f91ac1a0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:26:53.752 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:53.100+0000 7f91b3340700 1 --2- 172.21.15.39:0/2653575286 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f91ac07f7e0 0x7f91ac1a0270 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f919c004220 tx=0x7f919c00bd50 comp rx=0 tx=0).stop 2024-05-09T05:26:53.752 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:53.100+0000 7f91b3340700 1 -- 172.21.15.39:0/2653575286 shutdown_connections 2024-05-09T05:26:53.752 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:53.100+0000 7f91b3340700 1 --2- 172.21.15.39:0/2653575286 >> [v2:172.21.15.39:6800/499609328,v1:172.21.15.39:6801/499609328] conn(0x7f919403e420 0x7f9194040930 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:26:53.752 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:53.100+0000 7f91b3340700 1 --2- 172.21.15.39:0/2653575286 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f91ac07f7e0 0x7f91ac1a0270 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:26:53.752 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:53.100+0000 7f91b3340700 1 -- 172.21.15.39:0/2653575286 >> 172.21.15.39:0/2653575286 conn(0x7f91ac105470 msgr2=0x7f91ac106d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:26:53.752 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:53.100+0000 7f91b3340700 1 -- 172.21.15.39:0/2653575286 shutdown_connections 2024-05-09T05:26:53.752 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:53.100+0000 7f91b3340700 1 -- 172.21.15.39:0/2653575286 wait complete. 2024-05-09T05:26:53.861 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:26:53 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: 2024-05-09T05:26:53.633+0000 7f6193787200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-09T05:26:54.176 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:54 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/2653575286' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-05-09T05:26:54.177 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:54 smithi039 ceph-mon[30439]: mgrmap e5: x(active, since 5s) 2024-05-09T05:26:54.177 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:26:53 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: 2024-05-09T05:26:53.970+0000 7f6193787200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-09T05:26:54.177 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:26:54 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: 2024-05-09T05:26:54.063+0000 7f6193787200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-09T05:26:55.134 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout { 2024-05-09T05:26:55.140 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-05-09T05:26:55.140 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "available": true, 2024-05-09T05:26:55.140 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-05-09T05:26:55.140 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-05-09T05:26:55.140 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout } 2024-05-09T05:26:55.140 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:54.207+0000 7f1377d01700 1 Processor -- start 2024-05-09T05:26:55.141 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:54.207+0000 7f1377d01700 1 -- start start 2024-05-09T05:26:55.141 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:54.207+0000 7f1377d01700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f137007d6a0 0x7f137010c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:26:55.141 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:54.207+0000 7f1377d01700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f137010cef0 con 0x7f137007d6a0 2024-05-09T05:26:55.141 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:54.207+0000 7f1375a9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f137007d6a0 0x7f137010c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:26:55.141 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:54.207+0000 7f1375a9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f137007d6a0 0x7f137010c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47432/0 (socket says 172.21.15.39:47432) 2024-05-09T05:26:55.141 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:54.207+0000 7f1375a9d700 1 -- 172.21.15.39:0/2351496596 learned_addr learned my addr 172.21.15.39:0/2351496596 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:26:55.141 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:54.208+0000 7f1375a9d700 1 -- 172.21.15.39:0/2351496596 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f137010d070 con 0x7f137007d6a0 2024-05-09T05:26:55.141 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:54.208+0000 7f1375a9d700 1 --2- 172.21.15.39:0/2351496596 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f137007d6a0 0x7f137010c920 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f136c0098a0 tx=0x7f136c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a5becd388c5091a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:26:55.141 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:54.208+0000 7f1374a9b700 1 -- 172.21.15.39:0/2351496596 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f136c004160 con 0x7f137007d6a0 2024-05-09T05:26:55.141 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:54.208+0000 7f1374a9b700 1 -- 172.21.15.39:0/2351496596 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f136c004300 con 0x7f137007d6a0 2024-05-09T05:26:55.141 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:54.208+0000 7f1374a9b700 1 -- 172.21.15.39:0/2351496596 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f136c011af0 con 0x7f137007d6a0 2024-05-09T05:26:55.141 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:54.209+0000 7f1377d01700 1 -- 172.21.15.39:0/2351496596 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f137007d6a0 msgr2=0x7f137010c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:26:55.141 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:54.209+0000 7f1377d01700 1 --2- 172.21.15.39:0/2351496596 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f137007d6a0 0x7f137010c920 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f136c0098a0 tx=0x7f136c009bb0 comp rx=0 tx=0).stop 2024-05-09T05:26:55.142 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:54.209+0000 7f1377d01700 1 -- 172.21.15.39:0/2351496596 shutdown_connections 2024-05-09T05:26:55.142 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:54.209+0000 7f1377d01700 1 --2- 172.21.15.39:0/2351496596 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f137007d6a0 0x7f137010c920 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:26:55.142 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:54.209+0000 7f1377d01700 1 -- 172.21.15.39:0/2351496596 >> 172.21.15.39:0/2351496596 conn(0x7f1370104370 msgr2=0x7f13701067c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:26:55.142 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:54.209+0000 7f1377d01700 1 -- 172.21.15.39:0/2351496596 shutdown_connections 2024-05-09T05:26:55.142 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:54.209+0000 7f1377d01700 1 -- 172.21.15.39:0/2351496596 wait complete. 2024-05-09T05:26:55.142 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:54.210+0000 7f1377d01700 1 Processor -- start 2024-05-09T05:26:55.142 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:54.210+0000 7f1377d01700 1 -- start start 2024-05-09T05:26:55.142 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:54.210+0000 7f1377d01700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f137007d6a0 0x7f137010a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:26:55.142 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:54.210+0000 7f1377d01700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f137010e0f0 con 0x7f137007d6a0 2024-05-09T05:26:55.142 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:54.211+0000 7f1375a9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f137007d6a0 0x7f137010a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:26:55.142 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:54.211+0000 7f1375a9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f137007d6a0 0x7f137010a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47436/0 (socket says 172.21.15.39:47436) 2024-05-09T05:26:55.142 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:54.211+0000 7f1375a9d700 1 -- 172.21.15.39:0/2951931378 learned_addr learned my addr 172.21.15.39:0/2951931378 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:26:55.142 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:54.211+0000 7f1375a9d700 1 -- 172.21.15.39:0/2951931378 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f137010a5d0 con 0x7f137007d6a0 2024-05-09T05:26:55.143 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:54.211+0000 7f1375a9d700 1 --2- 172.21.15.39:0/2951931378 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f137007d6a0 0x7f137010a090 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f136c009fb0 tx=0x7f136c011890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:26:55.143 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:54.211+0000 7f1366ffd700 1 -- 172.21.15.39:0/2951931378 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f136c011bc0 con 0x7f137007d6a0 2024-05-09T05:26:55.143 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:54.211+0000 7f1366ffd700 1 -- 172.21.15.39:0/2951931378 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f136c024440 con 0x7f137007d6a0 2024-05-09T05:26:55.143 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:54.211+0000 7f1366ffd700 1 -- 172.21.15.39:0/2951931378 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f136c01a5c0 con 0x7f137007d6a0 2024-05-09T05:26:55.143 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:54.212+0000 7f1377d01700 1 -- 172.21.15.39:0/2951931378 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1370108820 con 0x7f137007d6a0 2024-05-09T05:26:55.143 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:54.212+0000 7f1377d01700 1 -- 172.21.15.39:0/2951931378 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1370108d00 con 0x7f137007d6a0 2024-05-09T05:26:55.143 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:54.213+0000 7f1366ffd700 1 -- 172.21.15.39:0/2951931378 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 50222+0+0 (secure 0 0 0) 0x7f136c0038b0 con 0x7f137007d6a0 2024-05-09T05:26:55.143 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:54.213+0000 7f1377d01700 1 -- 172.21.15.39:0/2951931378 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1370064e20 con 0x7f137007d6a0 2024-05-09T05:26:55.143 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:54.213+0000 7f1366ffd700 1 --2- 172.21.15.39:0/2951931378 >> [v2:172.21.15.39:6800/499609328,v1:172.21.15.39:6801/499609328] conn(0x7f135c03e420 0x7f135c040930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:26:55.143 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:54.213+0000 7f1366ffd700 1 -- 172.21.15.39:0/2951931378 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f136c053850 con 0x7f137007d6a0 2024-05-09T05:26:55.143 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:54.213+0000 7f137529c700 1 -- 172.21.15.39:0/2951931378 >> [v2:172.21.15.39:6800/499609328,v1:172.21.15.39:6801/499609328] conn(0x7f135c03e420 msgr2=0x7f135c040930 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.39:6800/499609328 2024-05-09T05:26:55.143 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:54.213+0000 7f137529c700 1 --2- 172.21.15.39:0/2951931378 >> [v2:172.21.15.39:6800/499609328,v1:172.21.15.39:6801/499609328] conn(0x7f135c03e420 0x7f135c040930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-09T05:26:55.143 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:54.219+0000 7f1366ffd700 1 -- 172.21.15.39:0/2951931378 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f136c0245f0 con 0x7f137007d6a0 2024-05-09T05:26:55.144 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:54.414+0000 7f137529c700 1 -- 172.21.15.39:0/2951931378 >> [v2:172.21.15.39:6800/499609328,v1:172.21.15.39:6801/499609328] conn(0x7f135c03e420 msgr2=0x7f135c040930 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.39:6800/499609328 2024-05-09T05:26:55.144 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:54.414+0000 7f137529c700 1 --2- 172.21.15.39:0/2951931378 >> [v2:172.21.15.39:6800/499609328,v1:172.21.15.39:6801/499609328] conn(0x7f135c03e420 0x7f135c040930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-09T05:26:55.144 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:54.545+0000 7f1377d01700 1 -- 172.21.15.39:0/2951931378 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f1370109440 con 0x7f137007d6a0 2024-05-09T05:26:55.144 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:54.546+0000 7f1366ffd700 1 -- 172.21.15.39:0/2951931378 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7f136c020d60 con 0x7f137007d6a0 2024-05-09T05:26:55.144 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:54.550+0000 7f1377d01700 1 -- 172.21.15.39:0/2951931378 >> [v2:172.21.15.39:6800/499609328,v1:172.21.15.39:6801/499609328] conn(0x7f135c03e420 msgr2=0x7f135c040930 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-09T05:26:55.144 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:54.550+0000 7f1377d01700 1 --2- 172.21.15.39:0/2951931378 >> [v2:172.21.15.39:6800/499609328,v1:172.21.15.39:6801/499609328] conn(0x7f135c03e420 0x7f135c040930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:26:55.144 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:54.550+0000 7f1377d01700 1 -- 172.21.15.39:0/2951931378 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f137007d6a0 msgr2=0x7f137010a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:26:55.144 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:54.550+0000 7f1377d01700 1 --2- 172.21.15.39:0/2951931378 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f137007d6a0 0x7f137010a090 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f136c009fb0 tx=0x7f136c011890 comp rx=0 tx=0).stop 2024-05-09T05:26:55.144 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:54.550+0000 7f1377d01700 1 -- 172.21.15.39:0/2951931378 shutdown_connections 2024-05-09T05:26:55.144 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:54.550+0000 7f1377d01700 1 --2- 172.21.15.39:0/2951931378 >> [v2:172.21.15.39:6800/499609328,v1:172.21.15.39:6801/499609328] conn(0x7f135c03e420 0x7f135c040930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:26:55.144 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:54.550+0000 7f1377d01700 1 --2- 172.21.15.39:0/2951931378 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f137007d6a0 0x7f137010a090 secure :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f136c009fb0 tx=0x7f136c011890 comp rx=0 tx=0).stop 2024-05-09T05:26:55.144 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:54.550+0000 7f1377d01700 1 -- 172.21.15.39:0/2951931378 >> 172.21.15.39:0/2951931378 conn(0x7f1370104370 msgr2=0x7f1370105c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:26:55.144 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:54.551+0000 7f1377d01700 1 -- 172.21.15.39:0/2951931378 shutdown_connections 2024-05-09T05:26:55.145 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:54.551+0000 7f1377d01700 1 -- 172.21.15.39:0/2951931378 wait complete. 2024-05-09T05:26:55.145 INFO:teuthology.orchestra.run.smithi039.stdout:Waiting for the mgr to restart... 2024-05-09T05:26:55.145 INFO:teuthology.orchestra.run.smithi039.stdout:Waiting for mgr epoch 5... 2024-05-09T05:26:55.360 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:26:55 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/2951931378' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-05-09T05:26:55.611 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:26:55 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: 2024-05-09T05:26:55.365+0000 7f6193787200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-09T05:26:55.611 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:26:55 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: 2024-05-09T05:26:55.549+0000 7f6193787200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-09T05:26:56.033 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:26:55 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: 2024-05-09T05:26:55.732+0000 7f6193787200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-09T05:26:56.034 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:26:56 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: 2024-05-09T05:26:56.038+0000 7f6193787200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-09T05:26:56.345 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:26:56 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: 2024-05-09T05:26:56.136+0000 7f6193787200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-09T05:26:56.345 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:26:56 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: 2024-05-09T05:26:56.350+0000 7f6193787200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-09T05:26:56.611 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:26:56 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: 2024-05-09T05:26:56.554+0000 7f6193787200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-09T05:26:57.361 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:26:57 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: 2024-05-09T05:26:57.190+0000 7f6193787200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-09T05:26:57.861 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:26:57 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: 2024-05-09T05:26:57.424+0000 7f6193787200 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-09T05:26:58.358 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:26:57 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: 2024-05-09T05:26:57.871+0000 7f6193787200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-09T05:26:58.358 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:26:57 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: 2024-05-09T05:26:57.974+0000 7f6193787200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-09T05:26:58.358 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:26:58 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: 2024-05-09T05:26:58.363+0000 7f6193787200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-09T05:26:59.092 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:26:58 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: 2024-05-09T05:26:58.741+0000 7f6193787200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-09T05:26:59.092 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:26:58 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: 2024-05-09T05:26:58.839+0000 7f6193787200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-09T05:26:59.361 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:26:59 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: 2024-05-09T05:26:59.096+0000 7f6193787200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-09T05:26:59.361 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:26:59 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: 2024-05-09T05:26:59.238+0000 7f6193787200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-09T05:26:59.361 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:26:59 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: 2024-05-09T05:26:59.339+0000 7f6193787200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-09T05:27:00.111 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:26:59 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: 2024-05-09T05:26:59.684+0000 7f6193787200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-09T05:27:00.111 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:26:59 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: 2024-05-09T05:26:59.782+0000 7f6193787200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-09T05:27:00.696 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:27:00 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: 2024-05-09T05:27:00.418+0000 7f6193787200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-09T05:27:00.696 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:27:00 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: 2024-05-09T05:27:00.647+0000 7f6193787200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-09T05:27:01.111 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:00 smithi039 ceph-mon[30439]: Active manager daemon x restarted 2024-05-09T05:27:01.111 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:00 smithi039 ceph-mon[30439]: Activating manager daemon x 2024-05-09T05:27:01.111 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:00 smithi039 ceph-mon[30439]: osdmap e2: 0 total, 0 up, 0 in 2024-05-09T05:27:01.111 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:00 smithi039 ceph-mon[30439]: mgrmap e6: x(active, starting, since 0.00574451s) 2024-05-09T05:27:01.111 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:00 smithi039 ceph-mon[30439]: from='mgr.14120 172.21.15.39:0/2177888564' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-09T05:27:01.111 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:00 smithi039 ceph-mon[30439]: from='mgr.14120 172.21.15.39:0/2177888564' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-09T05:27:01.111 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:00 smithi039 ceph-mon[30439]: from='mgr.14120 172.21.15.39:0/2177888564' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-09T05:27:01.112 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:00 smithi039 ceph-mon[30439]: from='mgr.14120 172.21.15.39:0/2177888564' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-09T05:27:01.112 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:00 smithi039 ceph-mon[30439]: from='mgr.14120 172.21.15.39:0/2177888564' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-09T05:27:01.112 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:00 smithi039 ceph-mon[30439]: Manager daemon x is now available 2024-05-09T05:27:01.112 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:00 smithi039 ceph-mon[30439]: from='mgr.14120 172.21.15.39:0/2177888564' entity='mgr.x' 2024-05-09T05:27:01.112 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:00 smithi039 ceph-mon[30439]: from='mgr.14120 172.21.15.39:0/2177888564' entity='mgr.x' 2024-05-09T05:27:01.112 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:00 smithi039 ceph-mon[30439]: from='mgr.14120 172.21.15.39:0/2177888564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:27:01.112 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:00 smithi039 ceph-mon[30439]: from='mgr.14120 172.21.15.39:0/2177888564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:27:01.977 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:01 smithi039 ceph-mon[30439]: Found migration_current of "None". Setting to last migration. 2024-05-09T05:27:01.977 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:01 smithi039 ceph-mon[30439]: from='mgr.14120 172.21.15.39:0/2177888564' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-09T05:27:01.977 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:01 smithi039 ceph-mon[30439]: from='mgr.14120 172.21.15.39:0/2177888564' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-09T05:27:01.977 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:01 smithi039 ceph-mon[30439]: from='mgr.14120 172.21.15.39:0/2177888564' entity='mgr.x' 2024-05-09T05:27:01.978 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:01 smithi039 ceph-mon[30439]: from='mgr.14120 172.21.15.39:0/2177888564' entity='mgr.x' 2024-05-09T05:27:01.978 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:01 smithi039 ceph-mon[30439]: mgrmap e7: x(active, since 1.00702s) 2024-05-09T05:27:02.195 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout { 2024-05-09T05:27:02.196 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-05-09T05:27:02.196 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "initialized": true 2024-05-09T05:27:02.196 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout } 2024-05-09T05:27:02.196 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:55.631+0000 7f229f3e2700 1 Processor -- start 2024-05-09T05:27:02.196 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:55.631+0000 7f229f3e2700 1 -- start start 2024-05-09T05:27:02.196 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:55.631+0000 7f229f3e2700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f229810a1d0 0x7f229810a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:27:02.196 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:55.631+0000 7f229f3e2700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f229810abd0 con 0x7f229810a1d0 2024-05-09T05:27:02.196 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:55.631+0000 7f229d17e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f229810a1d0 0x7f229810a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:27:02.196 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:55.631+0000 7f229d17e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f229810a1d0 0x7f229810a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47448/0 (socket says 172.21.15.39:47448) 2024-05-09T05:27:02.196 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:55.631+0000 7f229d17e700 1 -- 172.21.15.39:0/1257991960 learned_addr learned my addr 172.21.15.39:0/1257991960 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:27:02.196 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:55.632+0000 7f229d17e700 1 -- 172.21.15.39:0/1257991960 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2298108ef0 con 0x7f229810a1d0 2024-05-09T05:27:02.196 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:55.632+0000 7f229d17e700 1 --2- 172.21.15.39:0/1257991960 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f229810a1d0 0x7f229810a5e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f22940098a0 tx=0x7f2294009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=770a5bbcb5f23fb server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:27:02.196 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:55.632+0000 7f228ffff700 1 -- 172.21.15.39:0/1257991960 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2294004160 con 0x7f229810a1d0 2024-05-09T05:27:02.197 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:55.632+0000 7f228ffff700 1 -- 172.21.15.39:0/1257991960 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f2294004300 con 0x7f229810a1d0 2024-05-09T05:27:02.197 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:55.632+0000 7f228ffff700 1 -- 172.21.15.39:0/1257991960 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2294011af0 con 0x7f229810a1d0 2024-05-09T05:27:02.197 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:55.633+0000 7f229f3e2700 1 -- 172.21.15.39:0/1257991960 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f229810a1d0 msgr2=0x7f229810a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:27:02.197 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:55.633+0000 7f229f3e2700 1 --2- 172.21.15.39:0/1257991960 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f229810a1d0 0x7f229810a5e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f22940098a0 tx=0x7f2294009bb0 comp rx=0 tx=0).stop 2024-05-09T05:27:02.197 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:55.633+0000 7f229f3e2700 1 -- 172.21.15.39:0/1257991960 shutdown_connections 2024-05-09T05:27:02.197 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:55.633+0000 7f229f3e2700 1 --2- 172.21.15.39:0/1257991960 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f229810a1d0 0x7f229810a5e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:27:02.197 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:55.633+0000 7f229f3e2700 1 -- 172.21.15.39:0/1257991960 >> 172.21.15.39:0/1257991960 conn(0x7f2298103af0 msgr2=0x7f2298105f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:27:02.197 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:55.633+0000 7f229f3e2700 1 -- 172.21.15.39:0/1257991960 shutdown_connections 2024-05-09T05:27:02.197 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:55.633+0000 7f229f3e2700 1 -- 172.21.15.39:0/1257991960 wait complete. 2024-05-09T05:27:02.197 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:55.634+0000 7f229f3e2700 1 Processor -- start 2024-05-09T05:27:02.197 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:55.634+0000 7f229f3e2700 1 -- start start 2024-05-09T05:27:02.197 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:55.634+0000 7f229f3e2700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f229810a1d0 0x7f2298108760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:27:02.197 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:55.634+0000 7f229f3e2700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f229810d130 con 0x7f229810a1d0 2024-05-09T05:27:02.197 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:55.634+0000 7f229d17e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f229810a1d0 0x7f2298108760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:27:02.198 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:55.634+0000 7f229d17e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f229810a1d0 0x7f2298108760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47454/0 (socket says 172.21.15.39:47454) 2024-05-09T05:27:02.198 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:55.634+0000 7f229d17e700 1 -- 172.21.15.39:0/1976719020 learned_addr learned my addr 172.21.15.39:0/1976719020 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:27:02.198 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:55.635+0000 7f229d17e700 1 -- 172.21.15.39:0/1976719020 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2298108ca0 con 0x7f229810a1d0 2024-05-09T05:27:02.198 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:55.635+0000 7f229d17e700 1 --2- 172.21.15.39:0/1976719020 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f229810a1d0 0x7f2298108760 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f2294011670 tx=0x7f2294004280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:27:02.198 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:55.635+0000 7f228e7fc700 1 -- 172.21.15.39:0/1976719020 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22940036a0 con 0x7f229810a1d0 2024-05-09T05:27:02.198 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:55.635+0000 7f228e7fc700 1 -- 172.21.15.39:0/1976719020 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f229401a430 con 0x7f229810a1d0 2024-05-09T05:27:02.198 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:55.635+0000 7f229f3e2700 1 -- 172.21.15.39:0/1976719020 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22981a0fd0 con 0x7f229810a1d0 2024-05-09T05:27:02.198 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:55.635+0000 7f228e7fc700 1 -- 172.21.15.39:0/1976719020 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2294019550 con 0x7f229810a1d0 2024-05-09T05:27:02.198 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:55.635+0000 7f229f3e2700 1 -- 172.21.15.39:0/1976719020 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22981a1450 con 0x7f229810a1d0 2024-05-09T05:27:02.198 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:55.636+0000 7f228e7fc700 1 -- 172.21.15.39:0/1976719020 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 50222+0+0 (secure 0 0 0) 0x7f22940197c0 con 0x7f229810a1d0 2024-05-09T05:27:02.198 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:55.636+0000 7f228e7fc700 1 --2- 172.21.15.39:0/1976719020 >> [v2:172.21.15.39:6800/499609328,v1:172.21.15.39:6801/499609328] conn(0x7f228403e470 0x7f2284040980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:27:02.198 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:55.636+0000 7f229f3e2700 1 -- 172.21.15.39:0/1976719020 --> [v2:172.21.15.39:6800/499609328,v1:172.21.15.39:6801/499609328] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f2298064e20 con 0x7f228403e470 2024-05-09T05:27:02.198 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:55.637+0000 7f228e7fc700 1 -- 172.21.15.39:0/1976719020 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f22940537e0 con 0x7f229810a1d0 2024-05-09T05:27:02.198 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:55.637+0000 7f229c97d700 1 -- 172.21.15.39:0/1976719020 >> [v2:172.21.15.39:6800/499609328,v1:172.21.15.39:6801/499609328] conn(0x7f228403e470 msgr2=0x7f2284040980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.39:6800/499609328 2024-05-09T05:27:02.199 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:55.637+0000 7f229c97d700 1 --2- 172.21.15.39:0/1976719020 >> [v2:172.21.15.39:6800/499609328,v1:172.21.15.39:6801/499609328] conn(0x7f228403e470 0x7f2284040980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-09T05:27:02.199 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:55.838+0000 7f229c97d700 1 -- 172.21.15.39:0/1976719020 >> [v2:172.21.15.39:6800/499609328,v1:172.21.15.39:6801/499609328] conn(0x7f228403e470 msgr2=0x7f2284040980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.39:6800/499609328 2024-05-09T05:27:02.199 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:55.838+0000 7f229c97d700 1 --2- 172.21.15.39:0/1976719020 >> [v2:172.21.15.39:6800/499609328,v1:172.21.15.39:6801/499609328] conn(0x7f228403e470 0x7f2284040980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-09T05:27:02.199 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:56.239+0000 7f229c97d700 1 -- 172.21.15.39:0/1976719020 >> [v2:172.21.15.39:6800/499609328,v1:172.21.15.39:6801/499609328] conn(0x7f228403e470 msgr2=0x7f2284040980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.39:6800/499609328 2024-05-09T05:27:02.199 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:56.239+0000 7f229c97d700 1 --2- 172.21.15.39:0/1976719020 >> [v2:172.21.15.39:6800/499609328,v1:172.21.15.39:6801/499609328] conn(0x7f228403e470 0x7f2284040980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-09T05:27:02.199 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:57.040+0000 7f229c97d700 1 -- 172.21.15.39:0/1976719020 >> [v2:172.21.15.39:6800/499609328,v1:172.21.15.39:6801/499609328] conn(0x7f228403e470 msgr2=0x7f2284040980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.39:6800/499609328 2024-05-09T05:27:02.199 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:57.040+0000 7f229c97d700 1 --2- 172.21.15.39:0/1976719020 >> [v2:172.21.15.39:6800/499609328,v1:172.21.15.39:6801/499609328] conn(0x7f228403e470 0x7f2284040980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-09T05:27:02.199 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:58.641+0000 7f229c97d700 1 -- 172.21.15.39:0/1976719020 >> [v2:172.21.15.39:6800/499609328,v1:172.21.15.39:6801/499609328] conn(0x7f228403e470 msgr2=0x7f2284040980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.39:6800/499609328 2024-05-09T05:27:02.199 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:26:58.641+0000 7f229c97d700 1 --2- 172.21.15.39:0/1976719020 >> [v2:172.21.15.39:6800/499609328,v1:172.21.15.39:6801/499609328] conn(0x7f228403e470 0x7f2284040980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-05-09T05:27:02.199 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:00.653+0000 7f228e7fc700 1 -- 172.21.15.39:0/1976719020 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mgrmap(e 6) ==== 49989+0+0 (secure 0 0 0) 0x7f229400fd80 con 0x7f229810a1d0 2024-05-09T05:27:02.199 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:00.653+0000 7f228e7fc700 1 -- 172.21.15.39:0/1976719020 >> [v2:172.21.15.39:6800/499609328,v1:172.21.15.39:6801/499609328] conn(0x7f228403e470 msgr2=0x7f2284040980 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-09T05:27:02.199 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:00.653+0000 7f228e7fc700 1 --2- 172.21.15.39:0/1976719020 >> [v2:172.21.15.39:6800/499609328,v1:172.21.15.39:6801/499609328] conn(0x7f228403e470 0x7f2284040980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:27:02.199 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:01.653+0000 7f228e7fc700 1 -- 172.21.15.39:0/1976719020 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mgrmap(e 7) ==== 50116+0+0 (secure 0 0 0) 0x7f2294055430 con 0x7f229810a1d0 2024-05-09T05:27:02.199 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:01.653+0000 7f228e7fc700 1 --2- 172.21.15.39:0/1976719020 >> [v2:172.21.15.39:6800/4091500272,v1:172.21.15.39:6801/4091500272] conn(0x7f2284041bc0 0x7f2284043fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:27:02.200 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:01.653+0000 7f228e7fc700 1 -- 172.21.15.39:0/1976719020 --> [v2:172.21.15.39:6800/4091500272,v1:172.21.15.39:6801/4091500272] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f2298064e20 con 0x7f2284041bc0 2024-05-09T05:27:02.200 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:01.654+0000 7f229c97d700 1 --2- 172.21.15.39:0/1976719020 >> [v2:172.21.15.39:6800/4091500272,v1:172.21.15.39:6801/4091500272] conn(0x7f2284041bc0 0x7f2284043fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:27:02.200 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:01.654+0000 7f229c97d700 1 --2- 172.21.15.39:0/1976719020 >> [v2:172.21.15.39:6800/4091500272,v1:172.21.15.39:6801/4091500272] conn(0x7f2284041bc0 0x7f2284043fe0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f2288003a10 tx=0x7f22880092b0 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:27:02.200 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:01.655+0000 7f228e7fc700 1 -- 172.21.15.39:0/1976719020 <== mgr.14120 v2:172.21.15.39:6800/4091500272 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f2298064e20 con 0x7f2284041bc0 2024-05-09T05:27:02.200 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:01.669+0000 7f229f3e2700 1 -- 172.21.15.39:0/1976719020 --> [v2:172.21.15.39:6800/4091500272,v1:172.21.15.39:6801/4091500272] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f2298105d00 con 0x7f2284041bc0 2024-05-09T05:27:02.200 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:01.670+0000 7f228e7fc700 1 -- 172.21.15.39:0/1976719020 <== mgr.14120 v2:172.21.15.39:6800/4091500272 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7f2298105d00 con 0x7f2284041bc0 2024-05-09T05:27:02.200 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:01.670+0000 7f229f3e2700 1 -- 172.21.15.39:0/1976719020 >> [v2:172.21.15.39:6800/4091500272,v1:172.21.15.39:6801/4091500272] conn(0x7f2284041bc0 msgr2=0x7f2284043fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:27:02.200 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:01.670+0000 7f229f3e2700 1 --2- 172.21.15.39:0/1976719020 >> [v2:172.21.15.39:6800/4091500272,v1:172.21.15.39:6801/4091500272] conn(0x7f2284041bc0 0x7f2284043fe0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f2288003a10 tx=0x7f22880092b0 comp rx=0 tx=0).stop 2024-05-09T05:27:02.200 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:01.670+0000 7f229f3e2700 1 -- 172.21.15.39:0/1976719020 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f229810a1d0 msgr2=0x7f2298108760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:27:02.200 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:01.670+0000 7f229f3e2700 1 --2- 172.21.15.39:0/1976719020 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f229810a1d0 0x7f2298108760 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f2294011670 tx=0x7f2294004280 comp rx=0 tx=0).stop 2024-05-09T05:27:02.200 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:01.670+0000 7f229f3e2700 1 -- 172.21.15.39:0/1976719020 shutdown_connections 2024-05-09T05:27:02.200 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:01.670+0000 7f229f3e2700 1 --2- 172.21.15.39:0/1976719020 >> [v2:172.21.15.39:6800/4091500272,v1:172.21.15.39:6801/4091500272] conn(0x7f2284041bc0 0x7f2284043fe0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:27:02.200 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:01.670+0000 7f229f3e2700 1 --2- 172.21.15.39:0/1976719020 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f229810a1d0 0x7f2298108760 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:27:02.200 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:01.670+0000 7f229f3e2700 1 --2- 172.21.15.39:0/1976719020 >> [v2:172.21.15.39:6800/499609328,v1:172.21.15.39:6801/499609328] conn(0x7f228403e470 0x7f2284040980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:27:02.201 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:01.670+0000 7f229f3e2700 1 -- 172.21.15.39:0/1976719020 >> 172.21.15.39:0/1976719020 conn(0x7f2298103af0 msgr2=0x7f2298105570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:27:02.201 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:01.670+0000 7f229f3e2700 1 -- 172.21.15.39:0/1976719020 shutdown_connections 2024-05-09T05:27:02.201 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:01.670+0000 7f229f3e2700 1 -- 172.21.15.39:0/1976719020 wait complete. 2024-05-09T05:27:02.201 INFO:teuthology.orchestra.run.smithi039.stdout:mgr epoch 5 is available 2024-05-09T05:27:02.201 INFO:teuthology.orchestra.run.smithi039.stdout:Setting orchestrator backend to cephadm... 2024-05-09T05:27:02.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:02 smithi039 ceph-mon[30439]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-05-09T05:27:02.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:02 smithi039 ceph-mon[30439]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-05-09T05:27:03.475 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:02.634+0000 7f6d02fea700 1 Processor -- start 2024-05-09T05:27:03.475 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:02.634+0000 7f6d02fea700 1 -- start start 2024-05-09T05:27:03.475 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:02.635+0000 7f6d02fea700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6cfc108cb0 0x7f6cfc1090c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:27:03.475 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:02.635+0000 7f6d02fea700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f6cfc1096b0 con 0x7f6cfc108cb0 2024-05-09T05:27:03.475 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:02.635+0000 7f6d00d86700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6cfc108cb0 0x7f6cfc1090c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:27:03.475 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:02.635+0000 7f6d00d86700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6cfc108cb0 0x7f6cfc1090c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:48056/0 (socket says 172.21.15.39:48056) 2024-05-09T05:27:03.475 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:02.635+0000 7f6d00d86700 1 -- 172.21.15.39:0/4175896904 learned_addr learned my addr 172.21.15.39:0/4175896904 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:27:03.475 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:02.635+0000 7f6d00d86700 1 -- 172.21.15.39:0/4175896904 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cfc109de0 con 0x7f6cfc108cb0 2024-05-09T05:27:03.475 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:02.635+0000 7f6d00d86700 1 --2- 172.21.15.39:0/4175896904 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6cfc108cb0 0x7f6cfc1090c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6cf00098a0 tx=0x7f6cf0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59a1a37a1f625373 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:27:03.476 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:02.636+0000 7f6cfb7fe700 1 -- 172.21.15.39:0/4175896904 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6cf0004160 con 0x7f6cfc108cb0 2024-05-09T05:27:03.476 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:02.636+0000 7f6cfb7fe700 1 -- 172.21.15.39:0/4175896904 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f6cf0004300 con 0x7f6cfc108cb0 2024-05-09T05:27:03.476 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:02.636+0000 7f6cfb7fe700 1 -- 172.21.15.39:0/4175896904 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6cf0011af0 con 0x7f6cfc108cb0 2024-05-09T05:27:03.476 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:02.636+0000 7f6d02fea700 1 -- 172.21.15.39:0/4175896904 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6cfc108cb0 msgr2=0x7f6cfc1090c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:27:03.476 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:02.636+0000 7f6d02fea700 1 --2- 172.21.15.39:0/4175896904 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6cfc108cb0 0x7f6cfc1090c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6cf00098a0 tx=0x7f6cf0009bb0 comp rx=0 tx=0).stop 2024-05-09T05:27:03.476 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:02.636+0000 7f6d02fea700 1 -- 172.21.15.39:0/4175896904 shutdown_connections 2024-05-09T05:27:03.476 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:02.636+0000 7f6d02fea700 1 --2- 172.21.15.39:0/4175896904 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6cfc108cb0 0x7f6cfc1090c0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:27:03.476 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:02.636+0000 7f6d02fea700 1 -- 172.21.15.39:0/4175896904 >> 172.21.15.39:0/4175896904 conn(0x7f6cfc1043d0 msgr2=0x7f6cfc106820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:27:03.476 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:02.637+0000 7f6d02fea700 1 -- 172.21.15.39:0/4175896904 shutdown_connections 2024-05-09T05:27:03.476 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:02.637+0000 7f6d02fea700 1 -- 172.21.15.39:0/4175896904 wait complete. 2024-05-09T05:27:03.476 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:02.637+0000 7f6d02fea700 1 Processor -- start 2024-05-09T05:27:03.476 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:02.637+0000 7f6d02fea700 1 -- start start 2024-05-09T05:27:03.476 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:02.638+0000 7f6d02fea700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6cfc108cb0 0x7f6cfc07c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:27:03.476 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:02.638+0000 7f6d02fea700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f6cfc10d190 con 0x7f6cfc108cb0 2024-05-09T05:27:03.477 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:02.638+0000 7f6d00d86700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6cfc108cb0 0x7f6cfc07c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:27:03.477 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:02.638+0000 7f6d00d86700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6cfc108cb0 0x7f6cfc07c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:48068/0 (socket says 172.21.15.39:48068) 2024-05-09T05:27:03.477 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:02.638+0000 7f6d00d86700 1 -- 172.21.15.39:0/3243723775 learned_addr learned my addr 172.21.15.39:0/3243723775 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:27:03.477 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:02.638+0000 7f6d00d86700 1 -- 172.21.15.39:0/3243723775 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cfc19ed50 con 0x7f6cfc108cb0 2024-05-09T05:27:03.477 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:02.638+0000 7f6d00d86700 1 --2- 172.21.15.39:0/3243723775 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6cfc108cb0 0x7f6cfc07c930 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6cf0011670 tx=0x7f6cf0004280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:27:03.477 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:02.638+0000 7f6cf9ffb700 1 -- 172.21.15.39:0/3243723775 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6cf00036a0 con 0x7f6cfc108cb0 2024-05-09T05:27:03.477 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:02.638+0000 7f6cf9ffb700 1 -- 172.21.15.39:0/3243723775 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f6cf0003cd0 con 0x7f6cfc108cb0 2024-05-09T05:27:03.477 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:02.638+0000 7f6d02fea700 1 -- 172.21.15.39:0/3243723775 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cfc07ce70 con 0x7f6cfc108cb0 2024-05-09T05:27:03.477 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:02.638+0000 7f6cf9ffb700 1 -- 172.21.15.39:0/3243723775 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6cf00193c0 con 0x7f6cfc108cb0 2024-05-09T05:27:03.477 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:02.639+0000 7f6d02fea700 1 -- 172.21.15.39:0/3243723775 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cfc1a3610 con 0x7f6cfc108cb0 2024-05-09T05:27:03.477 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:02.640+0000 7f6cf9ffb700 1 -- 172.21.15.39:0/3243723775 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 7) ==== 50116+0+0 (secure 0 0 0) 0x7f6cf0019680 con 0x7f6cfc108cb0 2024-05-09T05:27:03.477 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:02.640+0000 7f6cf9ffb700 1 --2- 172.21.15.39:0/3243723775 >> [v2:172.21.15.39:6800/4091500272,v1:172.21.15.39:6801/4091500272] conn(0x7f6cec03e310 0x7f6cec040820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:27:03.477 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:02.640+0000 7f6d02fea700 1 -- 172.21.15.39:0/3243723775 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cfc064e20 con 0x7f6cfc108cb0 2024-05-09T05:27:03.478 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:02.640+0000 7f6cf9ffb700 1 -- 172.21.15.39:0/3243723775 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f6cf001a430 con 0x7f6cfc108cb0 2024-05-09T05:27:03.478 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:02.640+0000 7f6cfbfff700 1 --2- 172.21.15.39:0/3243723775 >> [v2:172.21.15.39:6800/4091500272,v1:172.21.15.39:6801/4091500272] conn(0x7f6cec03e310 0x7f6cec040820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:27:03.478 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:02.641+0000 7f6cfbfff700 1 --2- 172.21.15.39:0/3243723775 >> [v2:172.21.15.39:6800/4091500272,v1:172.21.15.39:6801/4091500272] conn(0x7f6cec03e310 0x7f6cec040820 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6ce8006fd0 tx=0x7f6ce8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:27:03.478 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:02.646+0000 7f6cf9ffb700 1 -- 172.21.15.39:0/3243723775 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f6cf00243f0 con 0x7f6cfc108cb0 2024-05-09T05:27:03.478 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:02.712+0000 7f6cf9ffb700 1 -- 172.21.15.39:0/3243723775 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7f6cf001a6c0 con 0x7f6cfc108cb0 2024-05-09T05:27:03.478 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:02.879+0000 7f6d02fea700 1 -- 172.21.15.39:0/3243723775 --> [v2:172.21.15.39:6800/4091500272,v1:172.21.15.39:6801/4091500272] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7f6cfc1064b0 con 0x7f6cec03e310 2024-05-09T05:27:03.478 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:02.884+0000 7f6cf9ffb700 1 -- 172.21.15.39:0/3243723775 <== mgr.14120 v2:172.21.15.39:6800/4091500272 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f6cfc1064b0 con 0x7f6cec03e310 2024-05-09T05:27:03.478 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:02.887+0000 7f6d02fea700 1 -- 172.21.15.39:0/3243723775 >> [v2:172.21.15.39:6800/4091500272,v1:172.21.15.39:6801/4091500272] conn(0x7f6cec03e310 msgr2=0x7f6cec040820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:27:03.478 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:02.887+0000 7f6d02fea700 1 --2- 172.21.15.39:0/3243723775 >> [v2:172.21.15.39:6800/4091500272,v1:172.21.15.39:6801/4091500272] conn(0x7f6cec03e310 0x7f6cec040820 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6ce8006fd0 tx=0x7f6ce8006e40 comp rx=0 tx=0).stop 2024-05-09T05:27:03.478 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:02.887+0000 7f6d02fea700 1 -- 172.21.15.39:0/3243723775 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6cfc108cb0 msgr2=0x7f6cfc07c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:27:03.478 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:02.887+0000 7f6d02fea700 1 --2- 172.21.15.39:0/3243723775 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6cfc108cb0 0x7f6cfc07c930 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6cf0011670 tx=0x7f6cf0004280 comp rx=0 tx=0).stop 2024-05-09T05:27:03.478 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:02.887+0000 7f6d02fea700 1 -- 172.21.15.39:0/3243723775 shutdown_connections 2024-05-09T05:27:03.478 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:02.887+0000 7f6d02fea700 1 --2- 172.21.15.39:0/3243723775 >> [v2:172.21.15.39:6800/4091500272,v1:172.21.15.39:6801/4091500272] conn(0x7f6cec03e310 0x7f6cec040820 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:27:03.479 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:02.887+0000 7f6d02fea700 1 --2- 172.21.15.39:0/3243723775 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6cfc108cb0 0x7f6cfc07c930 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:27:03.479 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:02.887+0000 7f6d02fea700 1 -- 172.21.15.39:0/3243723775 >> 172.21.15.39:0/3243723775 conn(0x7f6cfc1043d0 msgr2=0x7f6cfc105d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:27:03.479 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:02.887+0000 7f6d02fea700 1 -- 172.21.15.39:0/3243723775 shutdown_connections 2024-05-09T05:27:03.479 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:02.887+0000 7f6d02fea700 1 -- 172.21.15.39:0/3243723775 wait complete. 2024-05-09T05:27:03.795 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:03 smithi039 ceph-mon[30439]: mgrmap e8: x(active, since 2s) 2024-05-09T05:27:03.795 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:03 smithi039 ceph-mon[30439]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T05:27:03.795 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:03 smithi039 ceph-mon[30439]: from='mgr.14120 172.21.15.39:0/2177888564' entity='mgr.x' 2024-05-09T05:27:03.795 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:03 smithi039 ceph-mon[30439]: from='mgr.14120 172.21.15.39:0/2177888564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:27:03.795 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:03 smithi039 ceph-mon[30439]: [09/May/2024:05:27:02] ENGINE Bus STARTING 2024-05-09T05:27:03.795 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:03 smithi039 ceph-mon[30439]: [09/May/2024:05:27:03] ENGINE Serving on http://172.21.15.39:8765 2024-05-09T05:27:03.795 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:03 smithi039 ceph-mon[30439]: [09/May/2024:05:27:03] ENGINE Serving on https://172.21.15.39:7150 2024-05-09T05:27:03.796 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:03 smithi039 ceph-mon[30439]: [09/May/2024:05:27:03] ENGINE Bus STARTED 2024-05-09T05:27:03.796 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:03 smithi039 ceph-mon[30439]: from='mgr.14120 172.21.15.39:0/2177888564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:27:04.766 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout value unchanged 2024-05-09T05:27:04.766 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:03.928+0000 7fd135b69700 1 Processor -- start 2024-05-09T05:27:04.766 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:03.928+0000 7fd135b69700 1 -- start start 2024-05-09T05:27:04.766 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:03.928+0000 7fd135b69700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd13010a890 0x7fd13010ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:27:04.766 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:03.929+0000 7fd135b69700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fd13007cdc0 con 0x7fd13010a890 2024-05-09T05:27:04.766 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:03.929+0000 7fd12f7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd13010a890 0x7fd13010ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:27:04.766 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:03.929+0000 7fd12f7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd13010a890 0x7fd13010ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:48080/0 (socket says 172.21.15.39:48080) 2024-05-09T05:27:04.766 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:03.929+0000 7fd12f7fe700 1 -- 172.21.15.39:0/805851800 learned_addr learned my addr 172.21.15.39:0/805851800 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:27:04.766 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:03.929+0000 7fd12f7fe700 1 -- 172.21.15.39:0/805851800 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd13010d1f0 con 0x7fd13010a890 2024-05-09T05:27:04.766 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:03.929+0000 7fd12f7fe700 1 --2- 172.21.15.39:0/805851800 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd13010a890 0x7fd13010ccb0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd1200098a0 tx=0x7fd120009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4c0ffa0829cd316 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:27:04.766 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:03.929+0000 7fd12effd700 1 -- 172.21.15.39:0/805851800 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd120004160 con 0x7fd13010a890 2024-05-09T05:27:04.767 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:03.929+0000 7fd12effd700 1 -- 172.21.15.39:0/805851800 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fd120004300 con 0x7fd13010a890 2024-05-09T05:27:04.767 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:03.929+0000 7fd12effd700 1 -- 172.21.15.39:0/805851800 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd120011af0 con 0x7fd13010a890 2024-05-09T05:27:04.767 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:03.930+0000 7fd135b69700 1 -- 172.21.15.39:0/805851800 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd13010a890 msgr2=0x7fd13010ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:27:04.767 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:03.930+0000 7fd135b69700 1 --2- 172.21.15.39:0/805851800 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd13010a890 0x7fd13010ccb0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd1200098a0 tx=0x7fd120009bb0 comp rx=0 tx=0).stop 2024-05-09T05:27:04.767 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:03.930+0000 7fd135b69700 1 -- 172.21.15.39:0/805851800 shutdown_connections 2024-05-09T05:27:04.767 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:03.930+0000 7fd135b69700 1 --2- 172.21.15.39:0/805851800 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd13010a890 0x7fd13010ccb0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:27:04.767 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:03.930+0000 7fd135b69700 1 -- 172.21.15.39:0/805851800 >> 172.21.15.39:0/805851800 conn(0x7fd1301043d0 msgr2=0x7fd130106820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:27:04.767 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:03.930+0000 7fd135b69700 1 -- 172.21.15.39:0/805851800 shutdown_connections 2024-05-09T05:27:04.767 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:03.930+0000 7fd135b69700 1 -- 172.21.15.39:0/805851800 wait complete. 2024-05-09T05:27:04.767 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:03.931+0000 7fd135b69700 1 Processor -- start 2024-05-09T05:27:04.767 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:03.931+0000 7fd135b69700 1 -- start start 2024-05-09T05:27:04.767 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:03.931+0000 7fd135b69700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd13010a890 0x7fd13019e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:27:04.768 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:03.931+0000 7fd135b69700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fd13010e0f0 con 0x7fd13010a890 2024-05-09T05:27:04.768 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:03.932+0000 7fd12f7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd13010a890 0x7fd13019e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:27:04.768 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:03.932+0000 7fd12f7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd13010a890 0x7fd13019e140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:48086/0 (socket says 172.21.15.39:48086) 2024-05-09T05:27:04.768 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:03.932+0000 7fd12f7fe700 1 -- 172.21.15.39:0/1698407419 learned_addr learned my addr 172.21.15.39:0/1698407419 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:27:04.768 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:03.932+0000 7fd12f7fe700 1 -- 172.21.15.39:0/1698407419 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd13019e680 con 0x7fd13010a890 2024-05-09T05:27:04.768 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:03.932+0000 7fd12f7fe700 1 --2- 172.21.15.39:0/1698407419 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd13010a890 0x7fd13019e140 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd1200117b0 tx=0x7fd120011b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:27:04.768 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:03.932+0000 7fd12d7fa700 1 -- 172.21.15.39:0/1698407419 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1200039c0 con 0x7fd13010a890 2024-05-09T05:27:04.768 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:03.932+0000 7fd135b69700 1 -- 172.21.15.39:0/1698407419 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd13019e910 con 0x7fd13010a890 2024-05-09T05:27:04.768 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:03.932+0000 7fd12d7fa700 1 -- 172.21.15.39:0/1698407419 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fd120003b60 con 0x7fd13010a890 2024-05-09T05:27:04.768 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:03.932+0000 7fd12d7fa700 1 -- 172.21.15.39:0/1698407419 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1200196a0 con 0x7fd13010a890 2024-05-09T05:27:04.768 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:03.932+0000 7fd135b69700 1 -- 172.21.15.39:0/1698407419 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1301a1520 con 0x7fd13010a890 2024-05-09T05:27:04.768 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:03.933+0000 7fd12d7fa700 1 -- 172.21.15.39:0/1698407419 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7fd120019960 con 0x7fd13010a890 2024-05-09T05:27:04.769 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:03.933+0000 7fd135b69700 1 -- 172.21.15.39:0/1698407419 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd130064e20 con 0x7fd13010a890 2024-05-09T05:27:04.769 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:03.933+0000 7fd12d7fa700 1 --2- 172.21.15.39:0/1698407419 >> [v2:172.21.15.39:6800/4091500272,v1:172.21.15.39:6801/4091500272] conn(0x7fd11c03e470 0x7fd11c040980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:27:04.769 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:03.934+0000 7fd12d7fa700 1 -- 172.21.15.39:0/1698407419 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fd120054a40 con 0x7fd13010a890 2024-05-09T05:27:04.769 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:03.934+0000 7fd126ffd700 1 --2- 172.21.15.39:0/1698407419 >> [v2:172.21.15.39:6800/4091500272,v1:172.21.15.39:6801/4091500272] conn(0x7fd11c03e470 0x7fd11c040980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:27:04.769 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:03.934+0000 7fd126ffd700 1 --2- 172.21.15.39:0/1698407419 >> [v2:172.21.15.39:6800/4091500272,v1:172.21.15.39:6801/4091500272] conn(0x7fd11c03e470 0x7fd11c040980 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd118006fd0 tx=0x7fd118006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:27:04.769 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:03.939+0000 7fd12d7fa700 1 -- 172.21.15.39:0/1698407419 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fd120017e90 con 0x7fd13010a890 2024-05-09T05:27:04.769 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:04.155+0000 7fd135b69700 1 -- 172.21.15.39:0/1698407419 --> [v2:172.21.15.39:6800/4091500272,v1:172.21.15.39:6801/4091500272] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7fd130106560 con 0x7fd11c03e470 2024-05-09T05:27:04.769 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:04.155+0000 7fd12d7fa700 1 -- 172.21.15.39:0/1698407419 <== mgr.14120 v2:172.21.15.39:6800/4091500272 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7fd130106560 con 0x7fd11c03e470 2024-05-09T05:27:04.769 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:04.158+0000 7fd135b69700 1 -- 172.21.15.39:0/1698407419 >> [v2:172.21.15.39:6800/4091500272,v1:172.21.15.39:6801/4091500272] conn(0x7fd11c03e470 msgr2=0x7fd11c040980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:27:04.769 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:04.158+0000 7fd135b69700 1 --2- 172.21.15.39:0/1698407419 >> [v2:172.21.15.39:6800/4091500272,v1:172.21.15.39:6801/4091500272] conn(0x7fd11c03e470 0x7fd11c040980 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd118006fd0 tx=0x7fd118006e40 comp rx=0 tx=0).stop 2024-05-09T05:27:04.769 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:04.158+0000 7fd135b69700 1 -- 172.21.15.39:0/1698407419 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd13010a890 msgr2=0x7fd13019e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:27:04.770 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:04.158+0000 7fd135b69700 1 --2- 172.21.15.39:0/1698407419 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd13010a890 0x7fd13019e140 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd1200117b0 tx=0x7fd120011b70 comp rx=0 tx=0).stop 2024-05-09T05:27:04.770 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:04.158+0000 7fd135b69700 1 -- 172.21.15.39:0/1698407419 shutdown_connections 2024-05-09T05:27:04.770 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:04.158+0000 7fd135b69700 1 --2- 172.21.15.39:0/1698407419 >> [v2:172.21.15.39:6800/4091500272,v1:172.21.15.39:6801/4091500272] conn(0x7fd11c03e470 0x7fd11c040980 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:27:04.770 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:04.158+0000 7fd135b69700 1 --2- 172.21.15.39:0/1698407419 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd13010a890 0x7fd13019e140 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:27:04.770 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:04.158+0000 7fd135b69700 1 -- 172.21.15.39:0/1698407419 >> 172.21.15.39:0/1698407419 conn(0x7fd1301043d0 msgr2=0x7fd130105dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:27:04.770 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:04.158+0000 7fd135b69700 1 -- 172.21.15.39:0/1698407419 shutdown_connections 2024-05-09T05:27:04.770 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:04.158+0000 7fd135b69700 1 -- 172.21.15.39:0/1698407419 wait complete. 2024-05-09T05:27:04.770 INFO:teuthology.orchestra.run.smithi039.stdout:Generating ssh key... 2024-05-09T05:27:04.978 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:04 smithi039 ceph-mon[30439]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T05:27:06.202 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:27:05 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: Generating public/private rsa key pair. 2024-05-09T05:27:06.202 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:27:05 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: Your identification has been saved in /tmp/tmpxfoyl35y/key. 2024-05-09T05:27:06.202 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:27:05 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: Your public key has been saved in /tmp/tmpxfoyl35y/key.pub. 2024-05-09T05:27:06.202 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:27:05 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: The key fingerprint is: 2024-05-09T05:27:06.202 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:27:05 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: SHA256:PzPZcZ6W6E8RqE4bKx9IoD/xaoOQmnATjoNbwiLLWoY ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968 2024-05-09T05:27:06.203 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:27:05 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: The key's randomart image is: 2024-05-09T05:27:06.203 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:27:05 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: +---[RSA 3072]----+ 2024-05-09T05:27:06.203 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:27:05 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: | | 2024-05-09T05:27:06.203 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:27:05 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: | . | 2024-05-09T05:27:06.203 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:27:05 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: | . . . | 2024-05-09T05:27:06.203 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:27:05 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: | . . . . . | 2024-05-09T05:27:06.203 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:27:05 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: |oo o. . S + . o | 2024-05-09T05:27:06.203 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:27:05 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: |OoB . + = * = + | 2024-05-09T05:27:06.203 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:27:05 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: |EXoo .o + @ o * | 2024-05-09T05:27:06.203 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:27:05 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: |=+ . oo o * o | 2024-05-09T05:27:06.203 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:27:05 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: |o ... . ... | 2024-05-09T05:27:06.203 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:27:05 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: +----[SHA256]-----+ 2024-05-09T05:27:06.471 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:05.179+0000 7f7afdea8700 1 Processor -- start 2024-05-09T05:27:06.471 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:05.179+0000 7f7afdea8700 1 -- start start 2024-05-09T05:27:06.471 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:05.179+0000 7f7afdea8700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7af807d540 0x7f7af810c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:27:06.471 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:05.179+0000 7f7afdea8700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f7af810cec0 con 0x7f7af807d540 2024-05-09T05:27:06.471 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:05.179+0000 7f7af77fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7af807d540 0x7f7af810c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:27:06.472 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:05.179+0000 7f7af77fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7af807d540 0x7f7af810c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:48098/0 (socket says 172.21.15.39:48098) 2024-05-09T05:27:06.472 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:05.179+0000 7f7af77fe700 1 -- 172.21.15.39:0/1570212380 learned_addr learned my addr 172.21.15.39:0/1570212380 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:27:06.472 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:05.180+0000 7f7af77fe700 1 -- 172.21.15.39:0/1570212380 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7af810d040 con 0x7f7af807d540 2024-05-09T05:27:06.472 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:05.180+0000 7f7af77fe700 1 --2- 172.21.15.39:0/1570212380 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7af807d540 0x7f7af810c8b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7ae80098a0 tx=0x7f7ae8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77b69f1d0e37986c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:27:06.472 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:05.180+0000 7f7af67fc700 1 -- 172.21.15.39:0/1570212380 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ae8004160 con 0x7f7af807d540 2024-05-09T05:27:06.472 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:05.180+0000 7f7af67fc700 1 -- 172.21.15.39:0/1570212380 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f7ae8004300 con 0x7f7af807d540 2024-05-09T05:27:06.472 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:05.180+0000 7f7af67fc700 1 -- 172.21.15.39:0/1570212380 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ae8011af0 con 0x7f7af807d540 2024-05-09T05:27:06.472 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:05.181+0000 7f7afdea8700 1 -- 172.21.15.39:0/1570212380 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7af807d540 msgr2=0x7f7af810c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:27:06.472 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:05.181+0000 7f7afdea8700 1 --2- 172.21.15.39:0/1570212380 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7af807d540 0x7f7af810c8b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7ae80098a0 tx=0x7f7ae8009bb0 comp rx=0 tx=0).stop 2024-05-09T05:27:06.472 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:05.181+0000 7f7afdea8700 1 -- 172.21.15.39:0/1570212380 shutdown_connections 2024-05-09T05:27:06.472 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:05.181+0000 7f7afdea8700 1 --2- 172.21.15.39:0/1570212380 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7af807d540 0x7f7af810c8b0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:27:06.472 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:05.181+0000 7f7afdea8700 1 -- 172.21.15.39:0/1570212380 >> 172.21.15.39:0/1570212380 conn(0x7f7af8104300 msgr2=0x7f7af8106770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:27:06.472 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:05.181+0000 7f7afdea8700 1 -- 172.21.15.39:0/1570212380 shutdown_connections 2024-05-09T05:27:06.473 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:05.181+0000 7f7afdea8700 1 -- 172.21.15.39:0/1570212380 wait complete. 2024-05-09T05:27:06.473 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:05.182+0000 7f7afdea8700 1 Processor -- start 2024-05-09T05:27:06.473 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:05.182+0000 7f7afdea8700 1 -- start start 2024-05-09T05:27:06.473 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:05.182+0000 7f7afdea8700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7af819e140 0x7f7af819e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:27:06.473 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:05.182+0000 7f7afdea8700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f7af810e0c0 con 0x7f7af819e140 2024-05-09T05:27:06.473 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:05.182+0000 7f7af77fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7af819e140 0x7f7af819e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:27:06.473 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:05.182+0000 7f7af77fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7af819e140 0x7f7af819e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:48102/0 (socket says 172.21.15.39:48102) 2024-05-09T05:27:06.473 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:05.182+0000 7f7af77fe700 1 -- 172.21.15.39:0/3802974541 learned_addr learned my addr 172.21.15.39:0/3802974541 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:27:06.473 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:05.182+0000 7f7af77fe700 1 -- 172.21.15.39:0/3802974541 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7af819eaf0 con 0x7f7af819e140 2024-05-09T05:27:06.473 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:05.183+0000 7f7af77fe700 1 --2- 172.21.15.39:0/3802974541 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7af819e140 0x7f7af819e570 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7ae8000c00 tx=0x7f7ae8004260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:27:06.473 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:05.183+0000 7f7af4ff9700 1 -- 172.21.15.39:0/3802974541 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ae80037d0 con 0x7f7af819e140 2024-05-09T05:27:06.473 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:05.183+0000 7f7af4ff9700 1 -- 172.21.15.39:0/3802974541 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f7ae8003970 con 0x7f7af819e140 2024-05-09T05:27:06.473 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:05.183+0000 7f7afdea8700 1 -- 172.21.15.39:0/3802974541 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7af819ed80 con 0x7f7af819e140 2024-05-09T05:27:06.473 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:05.183+0000 7f7af4ff9700 1 -- 172.21.15.39:0/3802974541 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ae801b440 con 0x7f7af819e140 2024-05-09T05:27:06.474 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:05.183+0000 7f7afdea8700 1 -- 172.21.15.39:0/3802974541 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7af81a1850 con 0x7f7af819e140 2024-05-09T05:27:06.474 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:05.184+0000 7f7afdea8700 1 -- 172.21.15.39:0/3802974541 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7af8064e20 con 0x7f7af819e140 2024-05-09T05:27:06.474 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:05.184+0000 7f7af4ff9700 1 -- 172.21.15.39:0/3802974541 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7f7ae801b5e0 con 0x7f7af819e140 2024-05-09T05:27:06.474 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:05.184+0000 7f7af4ff9700 1 --2- 172.21.15.39:0/3802974541 >> [v2:172.21.15.39:6800/4091500272,v1:172.21.15.39:6801/4091500272] conn(0x7f7ae003e4c0 0x7f7ae00409d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:27:06.474 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:05.184+0000 7f7af4ff9700 1 -- 172.21.15.39:0/3802974541 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f7ae80536d0 con 0x7f7af819e140 2024-05-09T05:27:06.474 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:05.184+0000 7f7af6ffd700 1 --2- 172.21.15.39:0/3802974541 >> [v2:172.21.15.39:6800/4091500272,v1:172.21.15.39:6801/4091500272] conn(0x7f7ae003e4c0 0x7f7ae00409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:27:06.474 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:05.185+0000 7f7af6ffd700 1 --2- 172.21.15.39:0/3802974541 >> [v2:172.21.15.39:6800/4091500272,v1:172.21.15.39:6801/4091500272] conn(0x7f7ae003e4c0 0x7f7ae00409d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7aec006fd0 tx=0x7f7aec006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:27:06.474 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:05.190+0000 7f7af4ff9700 1 -- 172.21.15.39:0/3802974541 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f7ae80172b0 con 0x7f7af819e140 2024-05-09T05:27:06.474 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:05.407+0000 7f7afdea8700 1 -- 172.21.15.39:0/3802974541 --> [v2:172.21.15.39:6800/4091500272,v1:172.21.15.39:6801/4091500272] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7f7af8105430 con 0x7f7ae003e4c0 2024-05-09T05:27:06.474 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:05.898+0000 7f7af4ff9700 1 -- 172.21.15.39:0/3802974541 <== mgr.14120 v2:172.21.15.39:6800/4091500272 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f7af8105430 con 0x7f7ae003e4c0 2024-05-09T05:27:06.474 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:05.901+0000 7f7afdea8700 1 -- 172.21.15.39:0/3802974541 >> [v2:172.21.15.39:6800/4091500272,v1:172.21.15.39:6801/4091500272] conn(0x7f7ae003e4c0 msgr2=0x7f7ae00409d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:27:06.474 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:05.901+0000 7f7afdea8700 1 --2- 172.21.15.39:0/3802974541 >> [v2:172.21.15.39:6800/4091500272,v1:172.21.15.39:6801/4091500272] conn(0x7f7ae003e4c0 0x7f7ae00409d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7aec006fd0 tx=0x7f7aec006e40 comp rx=0 tx=0).stop 2024-05-09T05:27:06.474 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:05.901+0000 7f7afdea8700 1 -- 172.21.15.39:0/3802974541 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7af819e140 msgr2=0x7f7af819e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:27:06.475 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:05.901+0000 7f7afdea8700 1 --2- 172.21.15.39:0/3802974541 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7af819e140 0x7f7af819e570 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7ae8000c00 tx=0x7f7ae8004260 comp rx=0 tx=0).stop 2024-05-09T05:27:06.475 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:05.901+0000 7f7afdea8700 1 -- 172.21.15.39:0/3802974541 shutdown_connections 2024-05-09T05:27:06.475 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:05.901+0000 7f7afdea8700 1 --2- 172.21.15.39:0/3802974541 >> [v2:172.21.15.39:6800/4091500272,v1:172.21.15.39:6801/4091500272] conn(0x7f7ae003e4c0 0x7f7ae00409d0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:27:06.475 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:05.901+0000 7f7afdea8700 1 --2- 172.21.15.39:0/3802974541 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7af819e140 0x7f7af819e570 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:27:06.475 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:05.901+0000 7f7afdea8700 1 -- 172.21.15.39:0/3802974541 >> 172.21.15.39:0/3802974541 conn(0x7f7af8104300 msgr2=0x7f7af8104d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:27:06.475 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:05.901+0000 7f7afdea8700 1 -- 172.21.15.39:0/3802974541 shutdown_connections 2024-05-09T05:27:06.475 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:05.901+0000 7f7afdea8700 1 -- 172.21.15.39:0/3802974541 wait complete. 2024-05-09T05:27:07.111 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:06 smithi039 ceph-mon[30439]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T05:27:07.111 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:06 smithi039 ceph-mon[30439]: Generating ssh key... 2024-05-09T05:27:07.111 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:06 smithi039 ceph-mon[30439]: from='mgr.14120 172.21.15.39:0/2177888564' entity='mgr.x' 2024-05-09T05:27:07.111 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:06 smithi039 ceph-mon[30439]: from='mgr.14120 172.21.15.39:0/2177888564' entity='mgr.x' 2024-05-09T05:27:07.664 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC5cAw5nNw3w8j10PeIBbyqRaxdHF1dwKvSJh++B46vwQeQKPUH+qIjrvpCMBN6mIb1h/t8KGic9kLjBlIotyCYlTfjIlRGqxzZI9ChAEEVN/6XaQRvfqIWft0d/5YCkFisaeym2YNFC81NZXcmPiuCcocc4R3ibNeI+2HCLovwPf2ZuCbtKyETC115RPDoSz0S0qpshdgFL8sFY7LkiZuGhRahdIXJH7ZMWwfo2d4q+/y4CVshdtBGnpnz17OJiZDlInzBOC+ghXcOGVulyJiLY730EATJUYztgZrtWA6BwsgNO6EHbyZeFtQL9S4rznmFWxa1PPKDtR1XW9HiL9jkHxGpag4OpKrW/0nmTUEYKISFTN6eZYN5R217/eqQpLUUmHBRtUObYEzyyU+VI3ixDC756yl3gd8W0lv3z1nor8yLL436ZAiNxkgut3f84NsQDWpazMkPdx4wVSgnJd/YRfPd15WzDvAN44KqvPf3WPJsl8fRy6eLB0W1IDw6IYE= ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968 2024-05-09T05:27:07.665 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:06.909+0000 7fb63fe1e700 1 Processor -- start 2024-05-09T05:27:07.665 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:06.909+0000 7fb63fe1e700 1 -- start start 2024-05-09T05:27:07.665 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:06.909+0000 7fb63fe1e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb63807f5d0 0x7fb63807daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:27:07.665 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:06.909+0000 7fb63fe1e700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fb63807e030 con 0x7fb63807f5d0 2024-05-09T05:27:07.665 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:06.909+0000 7fb63dbba700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb63807f5d0 0x7fb63807daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:27:07.665 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:06.909+0000 7fb63dbba700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb63807f5d0 0x7fb63807daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60298/0 (socket says 172.21.15.39:60298) 2024-05-09T05:27:07.665 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:06.910+0000 7fb63dbba700 1 -- 172.21.15.39:0/3940422434 learned_addr learned my addr 172.21.15.39:0/3940422434 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:27:07.665 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:06.910+0000 7fb63dbba700 1 -- 172.21.15.39:0/3940422434 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb63807e1b0 con 0x7fb63807f5d0 2024-05-09T05:27:07.665 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:06.910+0000 7fb63dbba700 1 --2- 172.21.15.39:0/3940422434 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb63807f5d0 0x7fb63807daf0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb6340098a0 tx=0x7fb634009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2337ed7eccb3097d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:27:07.665 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:06.910+0000 7fb63cbb8700 1 -- 172.21.15.39:0/3940422434 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb634004160 con 0x7fb63807f5d0 2024-05-09T05:27:07.665 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:06.910+0000 7fb63cbb8700 1 -- 172.21.15.39:0/3940422434 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fb634004300 con 0x7fb63807f5d0 2024-05-09T05:27:07.665 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:06.910+0000 7fb63cbb8700 1 -- 172.21.15.39:0/3940422434 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb634011af0 con 0x7fb63807f5d0 2024-05-09T05:27:07.666 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:06.911+0000 7fb63fe1e700 1 -- 172.21.15.39:0/3940422434 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb63807f5d0 msgr2=0x7fb63807daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:27:07.666 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:06.911+0000 7fb63fe1e700 1 --2- 172.21.15.39:0/3940422434 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb63807f5d0 0x7fb63807daf0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb6340098a0 tx=0x7fb634009bb0 comp rx=0 tx=0).stop 2024-05-09T05:27:07.666 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:06.911+0000 7fb63fe1e700 1 -- 172.21.15.39:0/3940422434 shutdown_connections 2024-05-09T05:27:07.666 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:06.911+0000 7fb63fe1e700 1 --2- 172.21.15.39:0/3940422434 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb63807f5d0 0x7fb63807daf0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:27:07.666 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:06.911+0000 7fb63fe1e700 1 -- 172.21.15.39:0/3940422434 >> 172.21.15.39:0/3940422434 conn(0x7fb638105450 msgr2=0x7fb6381078a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:27:07.666 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:06.911+0000 7fb63fe1e700 1 -- 172.21.15.39:0/3940422434 shutdown_connections 2024-05-09T05:27:07.666 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:06.911+0000 7fb63fe1e700 1 -- 172.21.15.39:0/3940422434 wait complete. 2024-05-09T05:27:07.666 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:06.912+0000 7fb63fe1e700 1 Processor -- start 2024-05-09T05:27:07.666 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:06.912+0000 7fb63fe1e700 1 -- start start 2024-05-09T05:27:07.666 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:06.912+0000 7fb63fe1e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb63807f5d0 0x7fb6381a02d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:27:07.666 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:06.912+0000 7fb63fe1e700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fb6381102f0 con 0x7fb63807f5d0 2024-05-09T05:27:07.666 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:06.912+0000 7fb63dbba700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb63807f5d0 0x7fb6381a02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:27:07.666 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:06.912+0000 7fb63dbba700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb63807f5d0 0x7fb6381a02d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60300/0 (socket says 172.21.15.39:60300) 2024-05-09T05:27:07.667 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:06.912+0000 7fb63dbba700 1 -- 172.21.15.39:0/3206251548 learned_addr learned my addr 172.21.15.39:0/3206251548 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:27:07.667 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:06.912+0000 7fb63dbba700 1 -- 172.21.15.39:0/3206251548 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6381a0810 con 0x7fb63807f5d0 2024-05-09T05:27:07.667 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:06.912+0000 7fb63dbba700 1 --2- 172.21.15.39:0/3206251548 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb63807f5d0 0x7fb6381a02d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb634009fb0 tx=0x7fb634011940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:27:07.667 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:06.913+0000 7fb62effd700 1 -- 172.21.15.39:0/3206251548 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6340036a0 con 0x7fb63807f5d0 2024-05-09T05:27:07.667 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:06.913+0000 7fb62effd700 1 -- 172.21.15.39:0/3206251548 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fb63401a430 con 0x7fb63807f5d0 2024-05-09T05:27:07.667 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:06.913+0000 7fb63fe1e700 1 -- 172.21.15.39:0/3206251548 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6381a0aa0 con 0x7fb63807f5d0 2024-05-09T05:27:07.667 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:06.913+0000 7fb62effd700 1 -- 172.21.15.39:0/3206251548 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb634019550 con 0x7fb63807f5d0 2024-05-09T05:27:07.667 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:06.913+0000 7fb63fe1e700 1 -- 172.21.15.39:0/3206251548 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6381a36b0 con 0x7fb63807f5d0 2024-05-09T05:27:07.667 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:06.914+0000 7fb62effd700 1 -- 172.21.15.39:0/3206251548 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7fb634019800 con 0x7fb63807f5d0 2024-05-09T05:27:07.667 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:06.914+0000 7fb63fe1e700 1 -- 172.21.15.39:0/3206251548 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb638064e20 con 0x7fb63807f5d0 2024-05-09T05:27:07.667 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:06.914+0000 7fb62effd700 1 --2- 172.21.15.39:0/3206251548 >> [v2:172.21.15.39:6800/4091500272,v1:172.21.15.39:6801/4091500272] conn(0x7fb62403e470 0x7fb624040980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:27:07.667 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:06.914+0000 7fb62effd700 1 -- 172.21.15.39:0/3206251548 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fb634053a70 con 0x7fb63807f5d0 2024-05-09T05:27:07.667 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:06.914+0000 7fb63d3b9700 1 --2- 172.21.15.39:0/3206251548 >> [v2:172.21.15.39:6800/4091500272,v1:172.21.15.39:6801/4091500272] conn(0x7fb62403e470 0x7fb624040980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:27:07.668 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:06.915+0000 7fb63d3b9700 1 --2- 172.21.15.39:0/3206251548 >> [v2:172.21.15.39:6800/4091500272,v1:172.21.15.39:6801/4091500272] conn(0x7fb62403e470 0x7fb624040980 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb628006fd0 tx=0x7fb628006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:27:07.668 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:06.919+0000 7fb62effd700 1 -- 172.21.15.39:0/3206251548 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fb634023390 con 0x7fb63807f5d0 2024-05-09T05:27:07.668 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:07.134+0000 7fb63fe1e700 1 -- 172.21.15.39:0/3206251548 --> [v2:172.21.15.39:6800/4091500272,v1:172.21.15.39:6801/4091500272] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7fb638106450 con 0x7fb62403e470 2024-05-09T05:27:07.668 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:07.135+0000 7fb62effd700 1 -- 172.21.15.39:0/3206251548 <== mgr.14120 v2:172.21.15.39:6800/4091500272 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7fb638106450 con 0x7fb62403e470 2024-05-09T05:27:07.668 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:07.138+0000 7fb63fe1e700 1 -- 172.21.15.39:0/3206251548 >> [v2:172.21.15.39:6800/4091500272,v1:172.21.15.39:6801/4091500272] conn(0x7fb62403e470 msgr2=0x7fb624040980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:27:07.668 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:07.138+0000 7fb63fe1e700 1 --2- 172.21.15.39:0/3206251548 >> [v2:172.21.15.39:6800/4091500272,v1:172.21.15.39:6801/4091500272] conn(0x7fb62403e470 0x7fb624040980 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb628006fd0 tx=0x7fb628006e40 comp rx=0 tx=0).stop 2024-05-09T05:27:07.668 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:07.138+0000 7fb63fe1e700 1 -- 172.21.15.39:0/3206251548 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb63807f5d0 msgr2=0x7fb6381a02d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:27:07.668 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:07.138+0000 7fb63fe1e700 1 --2- 172.21.15.39:0/3206251548 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb63807f5d0 0x7fb6381a02d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb634009fb0 tx=0x7fb634011940 comp rx=0 tx=0).stop 2024-05-09T05:27:07.668 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:07.138+0000 7fb63fe1e700 1 -- 172.21.15.39:0/3206251548 shutdown_connections 2024-05-09T05:27:07.668 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:07.138+0000 7fb63fe1e700 1 --2- 172.21.15.39:0/3206251548 >> [v2:172.21.15.39:6800/4091500272,v1:172.21.15.39:6801/4091500272] conn(0x7fb62403e470 0x7fb624040980 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:27:07.668 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:07.138+0000 7fb63fe1e700 1 --2- 172.21.15.39:0/3206251548 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb63807f5d0 0x7fb6381a02d0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:27:07.668 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:07.138+0000 7fb63fe1e700 1 -- 172.21.15.39:0/3206251548 >> 172.21.15.39:0/3206251548 conn(0x7fb638105450 msgr2=0x7fb638105d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:27:07.668 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:07.138+0000 7fb63fe1e700 1 -- 172.21.15.39:0/3206251548 shutdown_connections 2024-05-09T05:27:07.668 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:07.138+0000 7fb63fe1e700 1 -- 172.21.15.39:0/3206251548 wait complete. 2024-05-09T05:27:07.669 INFO:teuthology.orchestra.run.smithi039.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-05-09T05:27:07.669 INFO:teuthology.orchestra.run.smithi039.stdout:Adding key to root@localhost authorized_keys... 2024-05-09T05:27:07.669 INFO:teuthology.orchestra.run.smithi039.stdout:Adding host smithi039... 2024-05-09T05:27:08.080 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:07 smithi039 ceph-mon[30439]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T05:27:09.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:09 smithi039 ceph-mon[30439]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi039", "addr": "172.21.15.39", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T05:27:09.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:09 smithi039 ceph-mon[30439]: Deploying cephadm binary to smithi039 2024-05-09T05:27:13.122 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout Added host 'smithi039' with addr '172.21.15.39' 2024-05-09T05:27:13.122 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:08.121+0000 7f6e51f02700 1 Processor -- start 2024-05-09T05:27:13.122 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:08.122+0000 7f6e51f02700 1 -- start start 2024-05-09T05:27:13.122 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:08.122+0000 7f6e51f02700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6e4c10b300 0x7f6e4c10b710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:27:13.122 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:08.122+0000 7f6e51f02700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f6e4c10bce0 con 0x7f6e4c10b300 2024-05-09T05:27:13.124 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:08.122+0000 7f6e4b7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6e4c10b300 0x7f6e4c10b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:27:13.124 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:08.122+0000 7f6e4b7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6e4c10b300 0x7f6e4c10b710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60316/0 (socket says 172.21.15.39:60316) 2024-05-09T05:27:13.124 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:08.122+0000 7f6e4b7fe700 1 -- 172.21.15.39:0/1145321983 learned_addr learned my addr 172.21.15.39:0/1145321983 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:27:13.124 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:08.122+0000 7f6e4b7fe700 1 -- 172.21.15.39:0/1145321983 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e4c10be60 con 0x7f6e4c10b300 2024-05-09T05:27:13.125 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:08.123+0000 7f6e4b7fe700 1 --2- 172.21.15.39:0/1145321983 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6e4c10b300 0x7f6e4c10b710 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c009e80 tx=0x7f6e3c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3c7ae1405d04990 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:27:13.125 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:08.123+0000 7f6e4a7fc700 1 -- 172.21.15.39:0/1145321983 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e3c017070 con 0x7f6e4c10b300 2024-05-09T05:27:13.125 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:08.123+0000 7f6e4a7fc700 1 -- 172.21.15.39:0/1145321983 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f6e3c00b8c0 con 0x7f6e4c10b300 2024-05-09T05:27:13.125 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:08.123+0000 7f6e4a7fc700 1 -- 172.21.15.39:0/1145321983 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e3c004490 con 0x7f6e4c10b300 2024-05-09T05:27:13.125 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:08.123+0000 7f6e51f02700 1 -- 172.21.15.39:0/1145321983 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6e4c10b300 msgr2=0x7f6e4c10b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:27:13.125 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:08.123+0000 7f6e51f02700 1 --2- 172.21.15.39:0/1145321983 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6e4c10b300 0x7f6e4c10b710 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c009e80 tx=0x7f6e3c00b330 comp rx=0 tx=0).stop 2024-05-09T05:27:13.125 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:08.124+0000 7f6e51f02700 1 -- 172.21.15.39:0/1145321983 shutdown_connections 2024-05-09T05:27:13.125 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:08.124+0000 7f6e51f02700 1 --2- 172.21.15.39:0/1145321983 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6e4c10b300 0x7f6e4c10b710 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:27:13.125 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:08.124+0000 7f6e51f02700 1 -- 172.21.15.39:0/1145321983 >> 172.21.15.39:0/1145321983 conn(0x7f6e4c103b00 msgr2=0x7f6e4c105f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:27:13.125 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:08.124+0000 7f6e51f02700 1 -- 172.21.15.39:0/1145321983 shutdown_connections 2024-05-09T05:27:13.125 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:08.124+0000 7f6e51f02700 1 -- 172.21.15.39:0/1145321983 wait complete. 2024-05-09T05:27:13.125 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:08.124+0000 7f6e51f02700 1 Processor -- start 2024-05-09T05:27:13.125 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:08.124+0000 7f6e51f02700 1 -- start start 2024-05-09T05:27:13.125 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:08.125+0000 7f6e51f02700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6e4c10b300 0x7f6e4c10a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:27:13.126 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:08.125+0000 7f6e51f02700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f6e4c108bb0 con 0x7f6e4c10b300 2024-05-09T05:27:13.126 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:08.125+0000 7f6e4b7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6e4c10b300 0x7f6e4c10a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:27:13.129 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:08.125+0000 7f6e4b7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6e4c10b300 0x7f6e4c10a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60320/0 (socket says 172.21.15.39:60320) 2024-05-09T05:27:13.129 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:08.125+0000 7f6e4b7fe700 1 -- 172.21.15.39:0/3158000819 learned_addr learned my addr 172.21.15.39:0/3158000819 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:27:13.129 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:08.125+0000 7f6e4b7fe700 1 -- 172.21.15.39:0/3158000819 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e4c10ad30 con 0x7f6e4c10b300 2024-05-09T05:27:13.129 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:08.125+0000 7f6e4b7fe700 1 --2- 172.21.15.39:0/3158000819 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6e4c10b300 0x7f6e4c10a7f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c009fd0 tx=0x7f6e3c00bd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:27:13.129 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:08.125+0000 7f6e48ff9700 1 -- 172.21.15.39:0/3158000819 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e3c020020 con 0x7f6e4c10b300 2024-05-09T05:27:13.129 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:08.125+0000 7f6e48ff9700 1 -- 172.21.15.39:0/3158000819 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f6e3c012430 con 0x7f6e4c10b300 2024-05-09T05:27:13.129 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:08.125+0000 7f6e51f02700 1 -- 172.21.15.39:0/3158000819 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e4c108f80 con 0x7f6e4c10b300 2024-05-09T05:27:13.129 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:08.125+0000 7f6e48ff9700 1 -- 172.21.15.39:0/3158000819 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e3c017040 con 0x7f6e4c10b300 2024-05-09T05:27:13.129 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:08.126+0000 7f6e51f02700 1 -- 172.21.15.39:0/3158000819 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e4c1094c0 con 0x7f6e4c10b300 2024-05-09T05:27:13.129 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:08.126+0000 7f6e48ff9700 1 -- 172.21.15.39:0/3158000819 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7f6e3c023020 con 0x7f6e4c10b300 2024-05-09T05:27:13.129 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:08.127+0000 7f6e48ff9700 1 --2- 172.21.15.39:0/3158000819 >> [v2:172.21.15.39:6800/4091500272,v1:172.21.15.39:6801/4091500272] conn(0x7f6e3803e4c0 0x7f6e380409d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:27:13.129 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:08.127+0000 7f6e48ff9700 1 -- 172.21.15.39:0/3158000819 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f6e3c00f050 con 0x7f6e4c10b300 2024-05-09T05:27:13.130 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:08.127+0000 7f6e4affd700 1 --2- 172.21.15.39:0/3158000819 >> [v2:172.21.15.39:6800/4091500272,v1:172.21.15.39:6801/4091500272] conn(0x7f6e3803e4c0 0x7f6e380409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:27:13.130 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:08.127+0000 7f6e51f02700 1 -- 172.21.15.39:0/3158000819 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e4c064e20 con 0x7f6e4c10b300 2024-05-09T05:27:13.130 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:08.127+0000 7f6e4affd700 1 --2- 172.21.15.39:0/3158000819 >> [v2:172.21.15.39:6800/4091500272,v1:172.21.15.39:6801/4091500272] conn(0x7f6e3803e4c0 0x7f6e380409d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6e34006fd0 tx=0x7f6e34006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:27:13.130 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:08.132+0000 7f6e48ff9700 1 -- 172.21.15.39:0/3158000819 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f6e3c02a020 con 0x7f6e4c10b300 2024-05-09T05:27:13.130 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:08.350+0000 7f6e51f02700 1 -- 172.21.15.39:0/3158000819 --> [v2:172.21.15.39:6800/4091500272,v1:172.21.15.39:6801/4091500272] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi039", "addr": "172.21.15.39", "target": ["mon-mgr", ""]}) -- 0x7f6e4c109ad0 con 0x7f6e3803e4c0 2024-05-09T05:27:13.130 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:12.550+0000 7f6e48ff9700 1 -- 172.21.15.39:0/3158000819 <== mgr.14120 v2:172.21.15.39:6800/4091500272 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7f6e4c109ad0 con 0x7f6e3803e4c0 2024-05-09T05:27:13.130 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:12.553+0000 7f6e51f02700 1 -- 172.21.15.39:0/3158000819 >> [v2:172.21.15.39:6800/4091500272,v1:172.21.15.39:6801/4091500272] conn(0x7f6e3803e4c0 msgr2=0x7f6e380409d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:27:13.130 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:12.553+0000 7f6e51f02700 1 --2- 172.21.15.39:0/3158000819 >> [v2:172.21.15.39:6800/4091500272,v1:172.21.15.39:6801/4091500272] conn(0x7f6e3803e4c0 0x7f6e380409d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6e34006fd0 tx=0x7f6e34006e40 comp rx=0 tx=0).stop 2024-05-09T05:27:13.130 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:12.553+0000 7f6e51f02700 1 -- 172.21.15.39:0/3158000819 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6e4c10b300 msgr2=0x7f6e4c10a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:27:13.130 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:12.553+0000 7f6e51f02700 1 --2- 172.21.15.39:0/3158000819 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6e4c10b300 0x7f6e4c10a7f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c009fd0 tx=0x7f6e3c00bd50 comp rx=0 tx=0).stop 2024-05-09T05:27:13.130 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:12.553+0000 7f6e51f02700 1 -- 172.21.15.39:0/3158000819 shutdown_connections 2024-05-09T05:27:13.130 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:12.553+0000 7f6e51f02700 1 --2- 172.21.15.39:0/3158000819 >> [v2:172.21.15.39:6800/4091500272,v1:172.21.15.39:6801/4091500272] conn(0x7f6e3803e4c0 0x7f6e380409d0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:27:13.130 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:12.553+0000 7f6e51f02700 1 --2- 172.21.15.39:0/3158000819 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6e4c10b300 0x7f6e4c10a7f0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:27:13.130 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:12.553+0000 7f6e51f02700 1 -- 172.21.15.39:0/3158000819 >> 172.21.15.39:0/3158000819 conn(0x7f6e4c103b00 msgr2=0x7f6e4c105480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:27:13.131 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:12.554+0000 7f6e51f02700 1 -- 172.21.15.39:0/3158000819 shutdown_connections 2024-05-09T05:27:13.131 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:12.554+0000 7f6e51f02700 1 -- 172.21.15.39:0/3158000819 wait complete. 2024-05-09T05:27:13.131 INFO:teuthology.orchestra.run.smithi039.stdout:Deploying unmanaged mon service... 2024-05-09T05:27:13.635 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:13 smithi039 ceph-mon[30439]: from='mgr.14120 172.21.15.39:0/2177888564' entity='mgr.x' 2024-05-09T05:27:13.636 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:13 smithi039 ceph-mon[30439]: Added host smithi039 2024-05-09T05:27:13.636 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:13 smithi039 ceph-mon[30439]: from='mgr.14120 172.21.15.39:0/2177888564' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:27:14.490 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-05-09T05:27:14.491 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:13.630+0000 7f0663f7c700 1 Processor -- start 2024-05-09T05:27:14.491 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:13.630+0000 7f0663f7c700 1 -- start start 2024-05-09T05:27:14.491 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:13.630+0000 7f0663f7c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f065c109db0 0x7f065c10a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:27:14.491 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:13.630+0000 7f0663f7c700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f065c10a7b0 con 0x7f065c109db0 2024-05-09T05:27:14.491 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:13.630+0000 7f0661d18700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f065c109db0 0x7f065c10a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:27:14.491 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:13.630+0000 7f0661d18700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f065c109db0 0x7f065c10a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60330/0 (socket says 172.21.15.39:60330) 2024-05-09T05:27:14.491 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:13.630+0000 7f0661d18700 1 -- 172.21.15.39:0/2143337809 learned_addr learned my addr 172.21.15.39:0/2143337809 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:27:14.491 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:13.631+0000 7f0661d18700 1 -- 172.21.15.39:0/2143337809 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f065c10ae90 con 0x7f065c109db0 2024-05-09T05:27:14.491 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:13.631+0000 7f0661d18700 1 --2- 172.21.15.39:0/2143337809 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f065c109db0 0x7f065c10a1c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f06580098a0 tx=0x7f0658009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3967e569c26e4cd3 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:27:14.492 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:13.631+0000 7f0660d16700 1 -- 172.21.15.39:0/2143337809 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0658004160 con 0x7f065c109db0 2024-05-09T05:27:14.498 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:13.631+0000 7f0660d16700 1 -- 172.21.15.39:0/2143337809 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f0658004300 con 0x7f065c109db0 2024-05-09T05:27:14.498 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:13.631+0000 7f0660d16700 1 -- 172.21.15.39:0/2143337809 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0658011af0 con 0x7f065c109db0 2024-05-09T05:27:14.498 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:13.632+0000 7f0663f7c700 1 -- 172.21.15.39:0/2143337809 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f065c109db0 msgr2=0x7f065c10a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:27:14.498 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:13.632+0000 7f0663f7c700 1 --2- 172.21.15.39:0/2143337809 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f065c109db0 0x7f065c10a1c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f06580098a0 tx=0x7f0658009bb0 comp rx=0 tx=0).stop 2024-05-09T05:27:14.498 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:13.632+0000 7f0663f7c700 1 -- 172.21.15.39:0/2143337809 shutdown_connections 2024-05-09T05:27:14.498 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:13.632+0000 7f0663f7c700 1 --2- 172.21.15.39:0/2143337809 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f065c109db0 0x7f065c10a1c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:27:14.499 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:13.632+0000 7f0663f7c700 1 -- 172.21.15.39:0/2143337809 >> 172.21.15.39:0/2143337809 conn(0x7f065c105450 msgr2=0x7f065c1078a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:27:14.499 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:13.632+0000 7f0663f7c700 1 -- 172.21.15.39:0/2143337809 shutdown_connections 2024-05-09T05:27:14.499 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:13.632+0000 7f0663f7c700 1 -- 172.21.15.39:0/2143337809 wait complete. 2024-05-09T05:27:14.499 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:13.633+0000 7f0663f7c700 1 Processor -- start 2024-05-09T05:27:14.499 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:13.633+0000 7f0663f7c700 1 -- start start 2024-05-09T05:27:14.499 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:13.633+0000 7f0663f7c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f065c109db0 0x7f065c07f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:27:14.499 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:13.633+0000 7f0663f7c700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f065c10e240 con 0x7f065c109db0 2024-05-09T05:27:14.499 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:13.633+0000 7f0661d18700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f065c109db0 0x7f065c07f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:27:14.499 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:13.633+0000 7f0661d18700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f065c109db0 0x7f065c07f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60342/0 (socket says 172.21.15.39:60342) 2024-05-09T05:27:14.499 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:13.633+0000 7f0661d18700 1 -- 172.21.15.39:0/3072153702 learned_addr learned my addr 172.21.15.39:0/3072153702 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:27:14.499 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:13.633+0000 7f0661d18700 1 -- 172.21.15.39:0/3072153702 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f065c07f820 con 0x7f065c109db0 2024-05-09T05:27:14.500 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:13.633+0000 7f0661d18700 1 --2- 172.21.15.39:0/3072153702 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f065c109db0 0x7f065c07f2e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0658011890 tx=0x7f0658011970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:27:14.500 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:13.634+0000 7f064effd700 1 -- 172.21.15.39:0/3072153702 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06580039e0 con 0x7f065c109db0 2024-05-09T05:27:14.500 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:13.634+0000 7f064effd700 1 -- 172.21.15.39:0/3072153702 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f0658003b80 con 0x7f065c109db0 2024-05-09T05:27:14.500 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:13.634+0000 7f0663f7c700 1 -- 172.21.15.39:0/3072153702 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f065c07da70 con 0x7f065c109db0 2024-05-09T05:27:14.500 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:13.634+0000 7f064effd700 1 -- 172.21.15.39:0/3072153702 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06580246e0 con 0x7f065c109db0 2024-05-09T05:27:14.500 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:13.634+0000 7f0663f7c700 1 -- 172.21.15.39:0/3072153702 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f065c07df50 con 0x7f065c109db0 2024-05-09T05:27:14.500 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:13.635+0000 7f0663f7c700 1 -- 172.21.15.39:0/3072153702 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f065c064e20 con 0x7f065c109db0 2024-05-09T05:27:14.500 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:13.635+0000 7f064effd700 1 -- 172.21.15.39:0/3072153702 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7f0658022020 con 0x7f065c109db0 2024-05-09T05:27:14.500 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:13.635+0000 7f064effd700 1 --2- 172.21.15.39:0/3072153702 >> [v2:172.21.15.39:6800/4091500272,v1:172.21.15.39:6801/4091500272] conn(0x7f064803e470 0x7f0648040980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:27:14.500 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:13.635+0000 7f064effd700 1 -- 172.21.15.39:0/3072153702 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f0658053950 con 0x7f065c109db0 2024-05-09T05:27:14.501 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:13.635+0000 7f0661517700 1 --2- 172.21.15.39:0/3072153702 >> [v2:172.21.15.39:6800/4091500272,v1:172.21.15.39:6801/4091500272] conn(0x7f064803e470 0x7f0648040980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:27:14.501 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:13.636+0000 7f0661517700 1 --2- 172.21.15.39:0/3072153702 >> [v2:172.21.15.39:6800/4091500272,v1:172.21.15.39:6801/4091500272] conn(0x7f064803e470 0x7f0648040980 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0650006fd0 tx=0x7f0650006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:27:14.501 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:13.641+0000 7f064effd700 1 -- 172.21.15.39:0/3072153702 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f065800bce0 con 0x7f065c109db0 2024-05-09T05:27:14.501 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:13.869+0000 7f0663f7c700 1 -- 172.21.15.39:0/3072153702 --> [v2:172.21.15.39:6800/4091500272,v1:172.21.15.39:6801/4091500272] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f065c07e700 con 0x7f064803e470 2024-05-09T05:27:14.501 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:13.874+0000 7f064effd700 1 -- 172.21.15.39:0/3072153702 <== mgr.14120 v2:172.21.15.39:6800/4091500272 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f065c07e700 con 0x7f064803e470 2024-05-09T05:27:14.501 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:13.877+0000 7f0663f7c700 1 -- 172.21.15.39:0/3072153702 >> [v2:172.21.15.39:6800/4091500272,v1:172.21.15.39:6801/4091500272] conn(0x7f064803e470 msgr2=0x7f0648040980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:27:14.501 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:13.877+0000 7f0663f7c700 1 --2- 172.21.15.39:0/3072153702 >> [v2:172.21.15.39:6800/4091500272,v1:172.21.15.39:6801/4091500272] conn(0x7f064803e470 0x7f0648040980 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0650006fd0 tx=0x7f0650006e40 comp rx=0 tx=0).stop 2024-05-09T05:27:14.501 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:13.877+0000 7f0663f7c700 1 -- 172.21.15.39:0/3072153702 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f065c109db0 msgr2=0x7f065c07f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:27:14.501 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:13.877+0000 7f0663f7c700 1 --2- 172.21.15.39:0/3072153702 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f065c109db0 0x7f065c07f2e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0658011890 tx=0x7f0658011970 comp rx=0 tx=0).stop 2024-05-09T05:27:14.501 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:13.877+0000 7f0663f7c700 1 -- 172.21.15.39:0/3072153702 shutdown_connections 2024-05-09T05:27:14.501 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:13.877+0000 7f0663f7c700 1 --2- 172.21.15.39:0/3072153702 >> [v2:172.21.15.39:6800/4091500272,v1:172.21.15.39:6801/4091500272] conn(0x7f064803e470 0x7f0648040980 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:27:14.502 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:13.877+0000 7f0663f7c700 1 --2- 172.21.15.39:0/3072153702 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f065c109db0 0x7f065c07f2e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:27:14.502 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:13.877+0000 7f0663f7c700 1 -- 172.21.15.39:0/3072153702 >> 172.21.15.39:0/3072153702 conn(0x7f065c105450 msgr2=0x7f065c105d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:27:14.502 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:13.877+0000 7f0663f7c700 1 -- 172.21.15.39:0/3072153702 shutdown_connections 2024-05-09T05:27:14.502 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:13.877+0000 7f0663f7c700 1 -- 172.21.15.39:0/3072153702 wait complete. 2024-05-09T05:27:14.502 INFO:teuthology.orchestra.run.smithi039.stdout:Deploying unmanaged mgr service... 2024-05-09T05:27:15.111 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:14 smithi039 ceph-mon[30439]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T05:27:15.111 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:14 smithi039 ceph-mon[30439]: Saving service mon spec with placement count:5 2024-05-09T05:27:15.111 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:14 smithi039 ceph-mon[30439]: from='mgr.14120 172.21.15.39:0/2177888564' entity='mgr.x' 2024-05-09T05:27:16.432 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:16 smithi039 ceph-mon[30439]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T05:27:16.432 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:16 smithi039 ceph-mon[30439]: Saving service mgr spec with placement count:2 2024-05-09T05:27:16.432 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:16 smithi039 ceph-mon[30439]: from='mgr.14120 172.21.15.39:0/2177888564' entity='mgr.x' 2024-05-09T05:27:16.432 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:16 smithi039 ceph-mon[30439]: from='mgr.14120 172.21.15.39:0/2177888564' entity='mgr.x' 2024-05-09T05:27:16.440 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-05-09T05:27:16.440 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:14.953+0000 7f3968e73700 1 Processor -- start 2024-05-09T05:27:16.440 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:14.953+0000 7f3968e73700 1 -- start start 2024-05-09T05:27:16.440 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:14.953+0000 7f3968e73700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3964108cb0 0x7f39641090c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:27:16.440 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:14.953+0000 7f3968e73700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f39641096b0 con 0x7f3964108cb0 2024-05-09T05:27:16.440 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:14.954+0000 7f396259c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3964108cb0 0x7f39641090c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:27:16.440 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:14.954+0000 7f396259c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3964108cb0 0x7f39641090c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60344/0 (socket says 172.21.15.39:60344) 2024-05-09T05:27:16.441 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:14.954+0000 7f396259c700 1 -- 172.21.15.39:0/1419082608 learned_addr learned my addr 172.21.15.39:0/1419082608 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:27:16.441 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:14.954+0000 7f396259c700 1 -- 172.21.15.39:0/1419082608 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3964109de0 con 0x7f3964108cb0 2024-05-09T05:27:16.441 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:14.954+0000 7f396259c700 1 --2- 172.21.15.39:0/1419082608 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3964108cb0 0x7f39641090c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f39540098a0 tx=0x7f3954009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dbc21ecfdbec7b8 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:27:16.441 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:14.954+0000 7f3961d9b700 1 -- 172.21.15.39:0/1419082608 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3954004160 con 0x7f3964108cb0 2024-05-09T05:27:16.441 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:14.954+0000 7f3961d9b700 1 -- 172.21.15.39:0/1419082608 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f3954004300 con 0x7f3964108cb0 2024-05-09T05:27:16.441 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:14.954+0000 7f3961d9b700 1 -- 172.21.15.39:0/1419082608 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3954011af0 con 0x7f3964108cb0 2024-05-09T05:27:16.441 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:14.955+0000 7f3968e73700 1 -- 172.21.15.39:0/1419082608 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3964108cb0 msgr2=0x7f39641090c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:27:16.441 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:14.955+0000 7f3968e73700 1 --2- 172.21.15.39:0/1419082608 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3964108cb0 0x7f39641090c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f39540098a0 tx=0x7f3954009bb0 comp rx=0 tx=0).stop 2024-05-09T05:27:16.441 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:14.955+0000 7f3968e73700 1 -- 172.21.15.39:0/1419082608 shutdown_connections 2024-05-09T05:27:16.441 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:14.955+0000 7f3968e73700 1 --2- 172.21.15.39:0/1419082608 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3964108cb0 0x7f39641090c0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:27:16.441 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:14.955+0000 7f3968e73700 1 -- 172.21.15.39:0/1419082608 >> 172.21.15.39:0/1419082608 conn(0x7f3964104370 msgr2=0x7f39641067c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:27:16.441 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:14.955+0000 7f3968e73700 1 -- 172.21.15.39:0/1419082608 shutdown_connections 2024-05-09T05:27:16.441 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:14.955+0000 7f3968e73700 1 -- 172.21.15.39:0/1419082608 wait complete. 2024-05-09T05:27:16.441 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:14.956+0000 7f3968e73700 1 Processor -- start 2024-05-09T05:27:16.442 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:14.956+0000 7f3968e73700 1 -- start start 2024-05-09T05:27:16.442 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:14.956+0000 7f3968e73700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3964108cb0 0x7f396419d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:27:16.442 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:14.956+0000 7f3968e73700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f396410d190 con 0x7f3964108cb0 2024-05-09T05:27:16.442 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:14.957+0000 7f396259c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3964108cb0 0x7f396419d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:27:16.442 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:14.957+0000 7f396259c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3964108cb0 0x7f396419d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60350/0 (socket says 172.21.15.39:60350) 2024-05-09T05:27:16.442 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:14.957+0000 7f396259c700 1 -- 172.21.15.39:0/2716727763 learned_addr learned my addr 172.21.15.39:0/2716727763 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:27:16.442 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:14.957+0000 7f396259c700 1 -- 172.21.15.39:0/2716727763 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f396419d610 con 0x7f3964108cb0 2024-05-09T05:27:16.442 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:14.957+0000 7f396259c700 1 --2- 172.21.15.39:0/2716727763 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3964108cb0 0x7f396419d0d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3954011670 tx=0x7f3954004280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:27:16.442 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:14.957+0000 7f395bfff700 1 -- 172.21.15.39:0/2716727763 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39540036a0 con 0x7f3964108cb0 2024-05-09T05:27:16.442 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:14.957+0000 7f395bfff700 1 -- 172.21.15.39:0/2716727763 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f3954003cd0 con 0x7f3964108cb0 2024-05-09T05:27:16.442 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:14.957+0000 7f3968e73700 1 -- 172.21.15.39:0/2716727763 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f396419d8a0 con 0x7f3964108cb0 2024-05-09T05:27:16.442 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:14.957+0000 7f395bfff700 1 -- 172.21.15.39:0/2716727763 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39540193c0 con 0x7f3964108cb0 2024-05-09T05:27:16.442 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:14.957+0000 7f3968e73700 1 -- 172.21.15.39:0/2716727763 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39641a04b0 con 0x7f3964108cb0 2024-05-09T05:27:16.443 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:14.958+0000 7f395bfff700 1 -- 172.21.15.39:0/2716727763 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7f3954019630 con 0x7f3964108cb0 2024-05-09T05:27:16.443 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:14.958+0000 7f3968e73700 1 -- 172.21.15.39:0/2716727763 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3964064e20 con 0x7f3964108cb0 2024-05-09T05:27:16.443 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:14.959+0000 7f395bfff700 1 --2- 172.21.15.39:0/2716727763 >> [v2:172.21.15.39:6800/4091500272,v1:172.21.15.39:6801/4091500272] conn(0x7f395003e470 0x7f3950040980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:27:16.443 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:14.959+0000 7f395bfff700 1 -- 172.21.15.39:0/2716727763 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f3954053710 con 0x7f3964108cb0 2024-05-09T05:27:16.443 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:14.959+0000 7f3959d9b700 1 --2- 172.21.15.39:0/2716727763 >> [v2:172.21.15.39:6800/4091500272,v1:172.21.15.39:6801/4091500272] conn(0x7f395003e470 0x7f3950040980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:27:16.443 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:14.959+0000 7f3959d9b700 1 --2- 172.21.15.39:0/2716727763 >> [v2:172.21.15.39:6800/4091500272,v1:172.21.15.39:6801/4091500272] conn(0x7f395003e470 0x7f3950040980 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f394c006fd0 tx=0x7f394c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:27:16.443 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:14.964+0000 7f395bfff700 1 -- 172.21.15.39:0/2716727763 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f3954017e90 con 0x7f3964108cb0 2024-05-09T05:27:16.443 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:15.195+0000 7f3968e73700 1 -- 172.21.15.39:0/2716727763 --> [v2:172.21.15.39:6800/4091500272,v1:172.21.15.39:6801/4091500272] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f39641a0680 con 0x7f395003e470 2024-05-09T05:27:16.443 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:15.200+0000 7f395bfff700 1 -- 172.21.15.39:0/2716727763 <== mgr.14120 v2:172.21.15.39:6800/4091500272 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f39641a0680 con 0x7f395003e470 2024-05-09T05:27:16.443 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:15.202+0000 7f3968e73700 1 -- 172.21.15.39:0/2716727763 >> [v2:172.21.15.39:6800/4091500272,v1:172.21.15.39:6801/4091500272] conn(0x7f395003e470 msgr2=0x7f3950040980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:27:16.443 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:15.202+0000 7f3968e73700 1 --2- 172.21.15.39:0/2716727763 >> [v2:172.21.15.39:6800/4091500272,v1:172.21.15.39:6801/4091500272] conn(0x7f395003e470 0x7f3950040980 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f394c006fd0 tx=0x7f394c006e40 comp rx=0 tx=0).stop 2024-05-09T05:27:16.443 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:15.202+0000 7f3968e73700 1 -- 172.21.15.39:0/2716727763 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3964108cb0 msgr2=0x7f396419d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:27:16.443 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:15.202+0000 7f3968e73700 1 --2- 172.21.15.39:0/2716727763 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3964108cb0 0x7f396419d0d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3954011670 tx=0x7f3954004280 comp rx=0 tx=0).stop 2024-05-09T05:27:16.443 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:15.203+0000 7f3968e73700 1 -- 172.21.15.39:0/2716727763 shutdown_connections 2024-05-09T05:27:16.444 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:15.203+0000 7f3968e73700 1 --2- 172.21.15.39:0/2716727763 >> [v2:172.21.15.39:6800/4091500272,v1:172.21.15.39:6801/4091500272] conn(0x7f395003e470 0x7f3950040980 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:27:16.444 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:15.203+0000 7f3968e73700 1 --2- 172.21.15.39:0/2716727763 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3964108cb0 0x7f396419d0d0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:27:16.444 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:15.203+0000 7f3968e73700 1 -- 172.21.15.39:0/2716727763 >> 172.21.15.39:0/2716727763 conn(0x7f3964104370 msgr2=0x7f3964105c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:27:16.444 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:15.203+0000 7f3968e73700 1 -- 172.21.15.39:0/2716727763 shutdown_connections 2024-05-09T05:27:16.444 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:15.203+0000 7f3968e73700 1 -- 172.21.15.39:0/2716727763 wait complete. 2024-05-09T05:27:17.707 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:16.868+0000 7f1ace032700 1 Processor -- start 2024-05-09T05:27:17.707 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:16.868+0000 7f1ace032700 1 -- start start 2024-05-09T05:27:17.707 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:16.868+0000 7f1ace032700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1ac8108cb0 0x7f1ac81090c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:27:17.707 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:16.868+0000 7f1ace032700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f1ac81096b0 con 0x7f1ac8108cb0 2024-05-09T05:27:17.707 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:16.868+0000 7f1ac77fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1ac8108cb0 0x7f1ac81090c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:27:17.707 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:16.868+0000 7f1ac77fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1ac8108cb0 0x7f1ac81090c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53110/0 (socket says 172.21.15.39:53110) 2024-05-09T05:27:17.708 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:16.868+0000 7f1ac77fe700 1 -- 172.21.15.39:0/3589551279 learned_addr learned my addr 172.21.15.39:0/3589551279 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:27:17.708 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:16.869+0000 7f1ac77fe700 1 -- 172.21.15.39:0/3589551279 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ac8109de0 con 0x7f1ac8108cb0 2024-05-09T05:27:17.708 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:16.869+0000 7f1ac77fe700 1 --2- 172.21.15.39:0/3589551279 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1ac8108cb0 0x7f1ac81090c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1ab80098a0 tx=0x7f1ab8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4adfed1fbb12fd01 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:27:17.708 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:16.869+0000 7f1ac67fc700 1 -- 172.21.15.39:0/3589551279 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ab8004160 con 0x7f1ac8108cb0 2024-05-09T05:27:17.708 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:16.869+0000 7f1ac67fc700 1 -- 172.21.15.39:0/3589551279 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ab8004300 con 0x7f1ac8108cb0 2024-05-09T05:27:17.708 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:16.869+0000 7f1ac67fc700 1 -- 172.21.15.39:0/3589551279 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ab8011a20 con 0x7f1ac8108cb0 2024-05-09T05:27:17.708 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:16.870+0000 7f1ace032700 1 -- 172.21.15.39:0/3589551279 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1ac8108cb0 msgr2=0x7f1ac81090c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:27:17.708 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:16.870+0000 7f1ace032700 1 --2- 172.21.15.39:0/3589551279 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1ac8108cb0 0x7f1ac81090c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1ab80098a0 tx=0x7f1ab8009bb0 comp rx=0 tx=0).stop 2024-05-09T05:27:17.708 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:16.870+0000 7f1ace032700 1 -- 172.21.15.39:0/3589551279 shutdown_connections 2024-05-09T05:27:17.708 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:16.870+0000 7f1ace032700 1 --2- 172.21.15.39:0/3589551279 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1ac8108cb0 0x7f1ac81090c0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:27:17.708 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:16.870+0000 7f1ace032700 1 -- 172.21.15.39:0/3589551279 >> 172.21.15.39:0/3589551279 conn(0x7f1ac81043d0 msgr2=0x7f1ac8106820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:27:17.708 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:16.870+0000 7f1ace032700 1 -- 172.21.15.39:0/3589551279 shutdown_connections 2024-05-09T05:27:17.709 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:16.870+0000 7f1ace032700 1 -- 172.21.15.39:0/3589551279 wait complete. 2024-05-09T05:27:17.709 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:16.871+0000 7f1ace032700 1 Processor -- start 2024-05-09T05:27:17.709 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:16.871+0000 7f1ace032700 1 -- start start 2024-05-09T05:27:17.709 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:16.872+0000 7f1ace032700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1ac8108cb0 0x7f1ac8107620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:27:17.709 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:16.872+0000 7f1ace032700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f1ac810d190 con 0x7f1ac8108cb0 2024-05-09T05:27:17.709 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:16.872+0000 7f1ac77fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1ac8108cb0 0x7f1ac8107620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:27:17.709 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:16.872+0000 7f1ac77fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1ac8108cb0 0x7f1ac8107620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53122/0 (socket says 172.21.15.39:53122) 2024-05-09T05:27:17.709 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:16.872+0000 7f1ac77fe700 1 -- 172.21.15.39:0/1416364318 learned_addr learned my addr 172.21.15.39:0/1416364318 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:27:17.709 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:16.872+0000 7f1ac77fe700 1 -- 172.21.15.39:0/1416364318 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ac8107b60 con 0x7f1ac8108cb0 2024-05-09T05:27:17.709 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:16.872+0000 7f1ac77fe700 1 --2- 172.21.15.39:0/1416364318 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1ac8108cb0 0x7f1ac8107620 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1ab8011a20 tx=0x7f1ab8011b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:27:17.709 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:16.872+0000 7f1ac4ff9700 1 -- 172.21.15.39:0/1416364318 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ab80039c0 con 0x7f1ac8108cb0 2024-05-09T05:27:17.709 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:16.872+0000 7f1ac4ff9700 1 -- 172.21.15.39:0/1416364318 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ab8003b60 con 0x7f1ac8108cb0 2024-05-09T05:27:17.710 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:16.872+0000 7f1ace032700 1 -- 172.21.15.39:0/1416364318 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ac8105db0 con 0x7f1ac8108cb0 2024-05-09T05:27:17.710 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:16.873+0000 7f1ac4ff9700 1 -- 172.21.15.39:0/1416364318 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ab8019700 con 0x7f1ac8108cb0 2024-05-09T05:27:17.710 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:16.873+0000 7f1ace032700 1 -- 172.21.15.39:0/1416364318 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ac8106290 con 0x7f1ac8108cb0 2024-05-09T05:27:17.710 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:16.874+0000 7f1ac4ff9700 1 -- 172.21.15.39:0/1416364318 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7f1ab80199d0 con 0x7f1ac8108cb0 2024-05-09T05:27:17.710 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:16.874+0000 7f1ace032700 1 -- 172.21.15.39:0/1416364318 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ac8064e20 con 0x7f1ac8108cb0 2024-05-09T05:27:17.710 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:16.874+0000 7f1ac4ff9700 1 --2- 172.21.15.39:0/1416364318 >> [v2:172.21.15.39:6800/4091500272,v1:172.21.15.39:6801/4091500272] conn(0x7f1ab003e470 0x7f1ab0040980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:27:17.710 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:16.874+0000 7f1ac4ff9700 1 -- 172.21.15.39:0/1416364318 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f1ab80539b0 con 0x7f1ac8108cb0 2024-05-09T05:27:17.710 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:16.874+0000 7f1ac6ffd700 1 --2- 172.21.15.39:0/1416364318 >> [v2:172.21.15.39:6800/4091500272,v1:172.21.15.39:6801/4091500272] conn(0x7f1ab003e470 0x7f1ab0040980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:27:17.711 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:16.874+0000 7f1ac6ffd700 1 --2- 172.21.15.39:0/1416364318 >> [v2:172.21.15.39:6800/4091500272,v1:172.21.15.39:6801/4091500272] conn(0x7f1ab003e470 0x7f1ab0040980 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1abc006fd0 tx=0x7f1abc006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:27:17.711 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:16.879+0000 7f1ac4ff9700 1 -- 172.21.15.39:0/1416364318 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f1ab8053710 con 0x7f1ac8108cb0 2024-05-09T05:27:17.711 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:17.093+0000 7f1ace032700 1 -- 172.21.15.39:0/1416364318 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7f1ac8197320 con 0x7f1ac8108cb0 2024-05-09T05:27:17.711 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:17.101+0000 7f1ac4ff9700 1 -- 172.21.15.39:0/1416364318 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) ==== 142+0+0 (secure 0 0 0) 0x7f1ab802d430 con 0x7f1ac8108cb0 2024-05-09T05:27:17.711 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:17.104+0000 7f1ace032700 1 -- 172.21.15.39:0/1416364318 >> [v2:172.21.15.39:6800/4091500272,v1:172.21.15.39:6801/4091500272] conn(0x7f1ab003e470 msgr2=0x7f1ab0040980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:27:17.711 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:17.104+0000 7f1ace032700 1 --2- 172.21.15.39:0/1416364318 >> [v2:172.21.15.39:6800/4091500272,v1:172.21.15.39:6801/4091500272] conn(0x7f1ab003e470 0x7f1ab0040980 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1abc006fd0 tx=0x7f1abc006e40 comp rx=0 tx=0).stop 2024-05-09T05:27:17.711 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:17.104+0000 7f1ace032700 1 -- 172.21.15.39:0/1416364318 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1ac8108cb0 msgr2=0x7f1ac8107620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:27:17.711 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:17.104+0000 7f1ace032700 1 --2- 172.21.15.39:0/1416364318 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1ac8108cb0 0x7f1ac8107620 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1ab8011a20 tx=0x7f1ab8011b00 comp rx=0 tx=0).stop 2024-05-09T05:27:17.711 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:17.104+0000 7f1ace032700 1 -- 172.21.15.39:0/1416364318 shutdown_connections 2024-05-09T05:27:17.711 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:17.104+0000 7f1ace032700 1 --2- 172.21.15.39:0/1416364318 >> [v2:172.21.15.39:6800/4091500272,v1:172.21.15.39:6801/4091500272] conn(0x7f1ab003e470 0x7f1ab0040980 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:27:17.711 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:17.104+0000 7f1ace032700 1 --2- 172.21.15.39:0/1416364318 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1ac8108cb0 0x7f1ac8107620 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:27:17.712 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:17.104+0000 7f1ace032700 1 -- 172.21.15.39:0/1416364318 >> 172.21.15.39:0/1416364318 conn(0x7f1ac81043d0 msgr2=0x7f1ac8194760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:27:17.712 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:17.104+0000 7f1ace032700 1 -- 172.21.15.39:0/1416364318 shutdown_connections 2024-05-09T05:27:17.712 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:17.104+0000 7f1ace032700 1 -- 172.21.15.39:0/1416364318 wait complete. 2024-05-09T05:27:18.044 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:17 smithi039 ceph-mon[30439]: from='mgr.14120 172.21.15.39:0/2177888564' entity='mgr.x' 2024-05-09T05:27:18.044 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:17 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/1416364318' entity='client.admin' 2024-05-09T05:27:19.074 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:18.171+0000 7f3f3b973700 1 Processor -- start 2024-05-09T05:27:19.075 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:18.171+0000 7f3f3b973700 1 -- start start 2024-05-09T05:27:19.075 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:18.171+0000 7f3f3b973700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3f34108120 0x7f3f34108530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:27:19.075 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:18.171+0000 7f3f3b973700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f3f34108b20 con 0x7f3f34108120 2024-05-09T05:27:19.075 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:18.171+0000 7f3f3970f700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3f34108120 0x7f3f34108530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:27:19.075 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:18.172+0000 7f3f3970f700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3f34108120 0x7f3f34108530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53124/0 (socket says 172.21.15.39:53124) 2024-05-09T05:27:19.075 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:18.172+0000 7f3f3970f700 1 -- 172.21.15.39:0/4277723577 learned_addr learned my addr 172.21.15.39:0/4277723577 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:27:19.075 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:18.172+0000 7f3f3970f700 1 -- 172.21.15.39:0/4277723577 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f34108ca0 con 0x7f3f34108120 2024-05-09T05:27:19.075 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:18.172+0000 7f3f3970f700 1 --2- 172.21.15.39:0/4277723577 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3f34108120 0x7f3f34108530 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3f300098a0 tx=0x7f3f30009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f35e97d2c10ca7c4 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:27:19.075 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:18.172+0000 7f3f2bfff700 1 -- 172.21.15.39:0/4277723577 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f30004160 con 0x7f3f34108120 2024-05-09T05:27:19.075 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:18.172+0000 7f3f2bfff700 1 -- 172.21.15.39:0/4277723577 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3f30004300 con 0x7f3f34108120 2024-05-09T05:27:19.075 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:18.172+0000 7f3f2bfff700 1 -- 172.21.15.39:0/4277723577 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f30011a20 con 0x7f3f34108120 2024-05-09T05:27:19.075 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:18.173+0000 7f3f3b973700 1 -- 172.21.15.39:0/4277723577 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3f34108120 msgr2=0x7f3f34108530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:27:19.076 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:18.173+0000 7f3f3b973700 1 --2- 172.21.15.39:0/4277723577 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3f34108120 0x7f3f34108530 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3f300098a0 tx=0x7f3f30009bb0 comp rx=0 tx=0).stop 2024-05-09T05:27:19.076 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:18.173+0000 7f3f3b973700 1 -- 172.21.15.39:0/4277723577 shutdown_connections 2024-05-09T05:27:19.076 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:18.173+0000 7f3f3b973700 1 --2- 172.21.15.39:0/4277723577 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3f34108120 0x7f3f34108530 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:27:19.076 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:18.173+0000 7f3f3b973700 1 -- 172.21.15.39:0/4277723577 >> 172.21.15.39:0/4277723577 conn(0x7f3f34103b00 msgr2=0x7f3f34105f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:27:19.076 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:18.173+0000 7f3f3b973700 1 -- 172.21.15.39:0/4277723577 shutdown_connections 2024-05-09T05:27:19.076 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:18.174+0000 7f3f3b973700 1 -- 172.21.15.39:0/4277723577 wait complete. 2024-05-09T05:27:19.076 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:18.174+0000 7f3f3b973700 1 Processor -- start 2024-05-09T05:27:19.076 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:18.174+0000 7f3f3b973700 1 -- start start 2024-05-09T05:27:19.076 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:18.174+0000 7f3f3b973700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3f34108120 0x7f3f3419e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:27:19.076 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:18.174+0000 7f3f3b973700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f3f3410e140 con 0x7f3f34108120 2024-05-09T05:27:19.076 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:18.175+0000 7f3f3970f700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3f34108120 0x7f3f3419e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:27:19.076 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:18.175+0000 7f3f3970f700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3f34108120 0x7f3f3419e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53126/0 (socket says 172.21.15.39:53126) 2024-05-09T05:27:19.076 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:18.175+0000 7f3f3970f700 1 -- 172.21.15.39:0/3421180175 learned_addr learned my addr 172.21.15.39:0/3421180175 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:27:19.076 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:18.175+0000 7f3f3970f700 1 -- 172.21.15.39:0/3421180175 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f3419e5f0 con 0x7f3f34108120 2024-05-09T05:27:19.077 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:18.175+0000 7f3f3970f700 1 --2- 172.21.15.39:0/3421180175 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3f34108120 0x7f3f3419e0b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3f30011a20 tx=0x7f3f30011b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:27:19.077 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:18.175+0000 7f3f2a7fc700 1 -- 172.21.15.39:0/3421180175 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f30003af0 con 0x7f3f34108120 2024-05-09T05:27:19.077 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:18.175+0000 7f3f3b973700 1 -- 172.21.15.39:0/3421180175 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f3419e880 con 0x7f3f34108120 2024-05-09T05:27:19.077 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:18.175+0000 7f3f2a7fc700 1 -- 172.21.15.39:0/3421180175 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3f3001b8f0 con 0x7f3f34108120 2024-05-09T05:27:19.077 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:18.175+0000 7f3f2a7fc700 1 -- 172.21.15.39:0/3421180175 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f30023890 con 0x7f3f34108120 2024-05-09T05:27:19.077 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:18.175+0000 7f3f3b973700 1 -- 172.21.15.39:0/3421180175 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f341a1490 con 0x7f3f34108120 2024-05-09T05:27:19.077 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:18.176+0000 7f3f3b973700 1 -- 172.21.15.39:0/3421180175 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f34064e20 con 0x7f3f34108120 2024-05-09T05:27:19.077 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:18.177+0000 7f3f2a7fc700 1 -- 172.21.15.39:0/3421180175 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7f3f3002c3f0 con 0x7f3f34108120 2024-05-09T05:27:19.077 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:18.177+0000 7f3f2a7fc700 1 --2- 172.21.15.39:0/3421180175 >> [v2:172.21.15.39:6800/4091500272,v1:172.21.15.39:6801/4091500272] conn(0x7f3f2003e420 0x7f3f20040930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:27:19.077 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:18.177+0000 7f3f2a7fc700 1 -- 172.21.15.39:0/3421180175 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f3f30053f20 con 0x7f3f34108120 2024-05-09T05:27:19.077 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:18.177+0000 7f3f38f0e700 1 --2- 172.21.15.39:0/3421180175 >> [v2:172.21.15.39:6800/4091500272,v1:172.21.15.39:6801/4091500272] conn(0x7f3f2003e420 0x7f3f20040930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:27:19.077 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:18.177+0000 7f3f38f0e700 1 --2- 172.21.15.39:0/3421180175 >> [v2:172.21.15.39:6800/4091500272,v1:172.21.15.39:6801/4091500272] conn(0x7f3f2003e420 0x7f3f20040930 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c00ad30 tx=0x7f3f2c0093f0 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:27:19.077 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:18.183+0000 7f3f2a7fc700 1 -- 172.21.15.39:0/3421180175 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f3f3001f030 con 0x7f3f34108120 2024-05-09T05:27:19.077 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:18.411+0000 7f3f3b973700 1 -- 172.21.15.39:0/3421180175 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7f3f341a1660 con 0x7f3f34108120 2024-05-09T05:27:19.078 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:18.416+0000 7f3f2a7fc700 1 -- 172.21.15.39:0/3421180175 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7f3f3000f2e0 con 0x7f3f34108120 2024-05-09T05:27:19.078 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:18.419+0000 7f3f3b973700 1 -- 172.21.15.39:0/3421180175 >> [v2:172.21.15.39:6800/4091500272,v1:172.21.15.39:6801/4091500272] conn(0x7f3f2003e420 msgr2=0x7f3f20040930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:27:19.078 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:18.419+0000 7f3f3b973700 1 --2- 172.21.15.39:0/3421180175 >> [v2:172.21.15.39:6800/4091500272,v1:172.21.15.39:6801/4091500272] conn(0x7f3f2003e420 0x7f3f20040930 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c00ad30 tx=0x7f3f2c0093f0 comp rx=0 tx=0).stop 2024-05-09T05:27:19.078 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:18.419+0000 7f3f3b973700 1 -- 172.21.15.39:0/3421180175 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3f34108120 msgr2=0x7f3f3419e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:27:19.078 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:18.419+0000 7f3f3b973700 1 --2- 172.21.15.39:0/3421180175 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3f34108120 0x7f3f3419e0b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3f30011a20 tx=0x7f3f30011b00 comp rx=0 tx=0).stop 2024-05-09T05:27:19.078 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:18.419+0000 7f3f3b973700 1 -- 172.21.15.39:0/3421180175 shutdown_connections 2024-05-09T05:27:19.078 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:18.419+0000 7f3f3b973700 1 --2- 172.21.15.39:0/3421180175 >> [v2:172.21.15.39:6800/4091500272,v1:172.21.15.39:6801/4091500272] conn(0x7f3f2003e420 0x7f3f20040930 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:27:19.078 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:18.419+0000 7f3f3b973700 1 --2- 172.21.15.39:0/3421180175 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3f34108120 0x7f3f3419e0b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:27:19.078 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:18.419+0000 7f3f3b973700 1 -- 172.21.15.39:0/3421180175 >> 172.21.15.39:0/3421180175 conn(0x7f3f34103b00 msgr2=0x7f3f34105480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:27:19.078 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:18.419+0000 7f3f3b973700 1 -- 172.21.15.39:0/3421180175 shutdown_connections 2024-05-09T05:27:19.078 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:18.419+0000 7f3f3b973700 1 -- 172.21.15.39:0/3421180175 wait complete. 2024-05-09T05:27:19.078 INFO:teuthology.orchestra.run.smithi039.stdout:Enabling the dashboard module... 2024-05-09T05:27:19.494 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:19 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/3421180175' entity='client.admin' 2024-05-09T05:27:20.663 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:20 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/738243610' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-05-09T05:27:20.663 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:20 smithi039 ceph-mon[30439]: from='mgr.14120 172.21.15.39:0/2177888564' entity='mgr.x' 2024-05-09T05:27:20.664 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:27:20 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: ignoring --setuser ceph since I am not root 2024-05-09T05:27:20.664 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:27:20 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: ignoring --setgroup ceph since I am not root 2024-05-09T05:27:20.664 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:27:20 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: 2024-05-09T05:27:20.642+0000 7fcb911bb200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-09T05:27:20.962 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:27:20 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: 2024-05-09T05:27:20.859+0000 7fcb911bb200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-09T05:27:20.963 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:27:20 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: 2024-05-09T05:27:20.967+0000 7fcb911bb200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-09T05:27:21.068 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:19.515+0000 7f60e5a32700 1 Processor -- start 2024-05-09T05:27:21.068 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:19.516+0000 7f60e5a32700 1 -- start start 2024-05-09T05:27:21.068 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:19.516+0000 7f60e5a32700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f60e007d520 0x7f60e010c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:27:21.068 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:19.516+0000 7f60e5a32700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f60e010cec0 con 0x7f60e007d520 2024-05-09T05:27:21.068 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:19.516+0000 7f60deffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f60e007d520 0x7f60e010c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:27:21.068 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:19.516+0000 7f60deffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f60e007d520 0x7f60e010c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53130/0 (socket says 172.21.15.39:53130) 2024-05-09T05:27:21.068 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:19.516+0000 7f60deffd700 1 -- 172.21.15.39:0/1452745369 learned_addr learned my addr 172.21.15.39:0/1452745369 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:27:21.068 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:19.516+0000 7f60deffd700 1 -- 172.21.15.39:0/1452745369 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60e010d040 con 0x7f60e007d520 2024-05-09T05:27:21.068 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:19.516+0000 7f60deffd700 1 --2- 172.21.15.39:0/1452745369 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f60e007d520 0x7f60e010c8d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f60d00098a0 tx=0x7f60d0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30f5db0bf6292afd server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:27:21.068 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:19.517+0000 7f60ddffb700 1 -- 172.21.15.39:0/1452745369 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f60d0004160 con 0x7f60e007d520 2024-05-09T05:27:21.069 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:19.517+0000 7f60ddffb700 1 -- 172.21.15.39:0/1452745369 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f60d0004300 con 0x7f60e007d520 2024-05-09T05:27:21.069 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:19.517+0000 7f60ddffb700 1 -- 172.21.15.39:0/1452745369 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f60d0011a20 con 0x7f60e007d520 2024-05-09T05:27:21.069 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:19.517+0000 7f60e5a32700 1 -- 172.21.15.39:0/1452745369 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f60e007d520 msgr2=0x7f60e010c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:27:21.069 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:19.517+0000 7f60e5a32700 1 --2- 172.21.15.39:0/1452745369 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f60e007d520 0x7f60e010c8d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f60d00098a0 tx=0x7f60d0009bb0 comp rx=0 tx=0).stop 2024-05-09T05:27:21.069 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:19.517+0000 7f60e5a32700 1 -- 172.21.15.39:0/1452745369 shutdown_connections 2024-05-09T05:27:21.069 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:19.517+0000 7f60e5a32700 1 --2- 172.21.15.39:0/1452745369 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f60e007d520 0x7f60e010c8d0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:27:21.069 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:19.517+0000 7f60e5a32700 1 -- 172.21.15.39:0/1452745369 >> 172.21.15.39:0/1452745369 conn(0x7f60e0104300 msgr2=0x7f60e0106770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:27:21.069 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:19.517+0000 7f60e5a32700 1 -- 172.21.15.39:0/1452745369 shutdown_connections 2024-05-09T05:27:21.069 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:19.517+0000 7f60e5a32700 1 -- 172.21.15.39:0/1452745369 wait complete. 2024-05-09T05:27:21.070 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:19.518+0000 7f60e5a32700 1 Processor -- start 2024-05-09T05:27:21.070 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:19.518+0000 7f60e5a32700 1 -- start start 2024-05-09T05:27:21.070 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:19.519+0000 7f60e5a32700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f60e007d520 0x7f60e019e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:27:21.070 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:19.519+0000 7f60e5a32700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f60e010e100 con 0x7f60e007d520 2024-05-09T05:27:21.070 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:19.519+0000 7f60deffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f60e007d520 0x7f60e019e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:27:21.070 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:19.519+0000 7f60deffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f60e007d520 0x7f60e019e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53140/0 (socket says 172.21.15.39:53140) 2024-05-09T05:27:21.070 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:19.519+0000 7f60deffd700 1 -- 172.21.15.39:0/738243610 learned_addr learned my addr 172.21.15.39:0/738243610 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:27:21.070 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:19.519+0000 7f60deffd700 1 -- 172.21.15.39:0/738243610 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60e019e5e0 con 0x7f60e007d520 2024-05-09T05:27:21.070 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:19.519+0000 7f60deffd700 1 --2- 172.21.15.39:0/738243610 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f60e007d520 0x7f60e019e0a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f60d00119f0 tx=0x7f60d0011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:27:21.071 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:19.519+0000 7f60e4a30700 1 -- 172.21.15.39:0/738243610 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f60d00039e0 con 0x7f60e007d520 2024-05-09T05:27:21.071 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:19.519+0000 7f60e4a30700 1 -- 172.21.15.39:0/738243610 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f60d001b8f0 con 0x7f60e007d520 2024-05-09T05:27:21.071 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:19.519+0000 7f60e5a32700 1 -- 172.21.15.39:0/738243610 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60e019e870 con 0x7f60e007d520 2024-05-09T05:27:21.071 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:19.519+0000 7f60e4a30700 1 -- 172.21.15.39:0/738243610 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f60d00237a0 con 0x7f60e007d520 2024-05-09T05:27:21.071 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:19.519+0000 7f60e5a32700 1 -- 172.21.15.39:0/738243610 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60e01a1480 con 0x7f60e007d520 2024-05-09T05:27:21.071 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:19.520+0000 7f60e5a32700 1 -- 172.21.15.39:0/738243610 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60e0064e20 con 0x7f60e007d520 2024-05-09T05:27:21.072 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:19.520+0000 7f60e4a30700 1 -- 172.21.15.39:0/738243610 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7f60d002c3f0 con 0x7f60e007d520 2024-05-09T05:27:21.072 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:19.521+0000 7f60e4a30700 1 --2- 172.21.15.39:0/738243610 >> [v2:172.21.15.39:6800/4091500272,v1:172.21.15.39:6801/4091500272] conn(0x7f60cc03e420 0x7f60cc040930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:27:21.072 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:19.521+0000 7f60e4a30700 1 -- 172.21.15.39:0/738243610 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f60d0053e60 con 0x7f60e007d520 2024-05-09T05:27:21.072 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:19.521+0000 7f60de7fc700 1 --2- 172.21.15.39:0/738243610 >> [v2:172.21.15.39:6800/4091500272,v1:172.21.15.39:6801/4091500272] conn(0x7f60cc03e420 0x7f60cc040930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:27:21.072 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:19.521+0000 7f60de7fc700 1 --2- 172.21.15.39:0/738243610 >> [v2:172.21.15.39:6800/4091500272,v1:172.21.15.39:6801/4091500272] conn(0x7f60cc03e420 0x7f60cc040930 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f60c8006fd0 tx=0x7f60c8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:27:21.072 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:19.526+0000 7f60e4a30700 1 -- 172.21.15.39:0/738243610 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f60d001f030 con 0x7f60e007d520 2024-05-09T05:27:21.072 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:19.802+0000 7f60e5a32700 1 -- 172.21.15.39:0/738243610 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7f60e01a1650 con 0x7f60e007d520 2024-05-09T05:27:21.073 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:20.422+0000 7f60e4a30700 1 -- 172.21.15.39:0/738243610 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7f60d00292a0 con 0x7f60e007d520 2024-05-09T05:27:21.073 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:20.425+0000 7f60e4a30700 1 -- 172.21.15.39:0/738243610 <== mon.0 v2:172.21.15.39:3300/0 8 ==== mgrmap(e 9) ==== 50235+0+0 (secure 0 0 0) 0x7f60d002c6e0 con 0x7f60e007d520 2024-05-09T05:27:21.073 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:20.426+0000 7f60e5a32700 1 -- 172.21.15.39:0/738243610 >> [v2:172.21.15.39:6800/4091500272,v1:172.21.15.39:6801/4091500272] conn(0x7f60cc03e420 msgr2=0x7f60cc040930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:27:21.073 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:20.426+0000 7f60e5a32700 1 --2- 172.21.15.39:0/738243610 >> [v2:172.21.15.39:6800/4091500272,v1:172.21.15.39:6801/4091500272] conn(0x7f60cc03e420 0x7f60cc040930 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f60c8006fd0 tx=0x7f60c8006e40 comp rx=0 tx=0).stop 2024-05-09T05:27:21.073 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:20.426+0000 7f60e5a32700 1 -- 172.21.15.39:0/738243610 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f60e007d520 msgr2=0x7f60e019e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:27:21.073 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:20.426+0000 7f60e5a32700 1 --2- 172.21.15.39:0/738243610 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f60e007d520 0x7f60e019e0a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f60d00119f0 tx=0x7f60d0011ad0 comp rx=0 tx=0).stop 2024-05-09T05:27:21.073 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:20.426+0000 7f60e5a32700 1 -- 172.21.15.39:0/738243610 shutdown_connections 2024-05-09T05:27:21.073 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:20.426+0000 7f60e5a32700 1 --2- 172.21.15.39:0/738243610 >> [v2:172.21.15.39:6800/4091500272,v1:172.21.15.39:6801/4091500272] conn(0x7f60cc03e420 0x7f60cc040930 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:27:21.073 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:20.426+0000 7f60e5a32700 1 --2- 172.21.15.39:0/738243610 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f60e007d520 0x7f60e019e0a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:27:21.074 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:20.426+0000 7f60e5a32700 1 -- 172.21.15.39:0/738243610 >> 172.21.15.39:0/738243610 conn(0x7f60e0104300 msgr2=0x7f60e0104be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:27:21.074 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:20.426+0000 7f60e5a32700 1 -- 172.21.15.39:0/738243610 shutdown_connections 2024-05-09T05:27:21.074 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:20.426+0000 7f60e5a32700 1 -- 172.21.15.39:0/738243610 wait complete. 2024-05-09T05:27:21.547 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:21 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/738243610' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-05-09T05:27:21.547 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:21 smithi039 ceph-mon[30439]: mgrmap e9: x(active, since 19s) 2024-05-09T05:27:21.548 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:27:21 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: 2024-05-09T05:27:21.298+0000 7fcb911bb200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-09T05:27:21.548 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:27:21 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: 2024-05-09T05:27:21.392+0000 7fcb911bb200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-09T05:27:22.384 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout { 2024-05-09T05:27:22.384 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-05-09T05:27:22.384 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "available": true, 2024-05-09T05:27:22.384 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-05-09T05:27:22.384 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-05-09T05:27:22.384 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout } 2024-05-09T05:27:22.384 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:21.541+0000 7f7bea025700 1 Processor -- start 2024-05-09T05:27:22.384 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:21.541+0000 7f7bea025700 1 -- start start 2024-05-09T05:27:22.384 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:21.541+0000 7f7bea025700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7be4108c80 0x7f7be4109090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:27:22.384 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:21.541+0000 7f7bea025700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f7be4109680 con 0x7f7be4108c80 2024-05-09T05:27:22.385 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:21.541+0000 7f7be37fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7be4108c80 0x7f7be4109090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:27:22.385 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:21.541+0000 7f7be37fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7be4108c80 0x7f7be4109090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53164/0 (socket says 172.21.15.39:53164) 2024-05-09T05:27:22.385 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:21.541+0000 7f7be37fe700 1 -- 172.21.15.39:0/4259408169 learned_addr learned my addr 172.21.15.39:0/4259408169 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:27:22.385 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:21.542+0000 7f7be37fe700 1 -- 172.21.15.39:0/4259408169 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7be4109db0 con 0x7f7be4108c80 2024-05-09T05:27:22.385 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:21.542+0000 7f7be37fe700 1 --2- 172.21.15.39:0/4259408169 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7be4108c80 0x7f7be4109090 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc0098a0 tx=0x7f7bcc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd269c18ef0cb970 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:27:22.385 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:21.542+0000 7f7be27fc700 1 -- 172.21.15.39:0/4259408169 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7bcc004160 con 0x7f7be4108c80 2024-05-09T05:27:22.385 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:21.542+0000 7f7be27fc700 1 -- 172.21.15.39:0/4259408169 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7bcc004300 con 0x7f7be4108c80 2024-05-09T05:27:22.385 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:21.542+0000 7f7be27fc700 1 -- 172.21.15.39:0/4259408169 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7bcc011a20 con 0x7f7be4108c80 2024-05-09T05:27:22.385 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:21.543+0000 7f7bea025700 1 -- 172.21.15.39:0/4259408169 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7be4108c80 msgr2=0x7f7be4109090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:27:22.386 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:21.543+0000 7f7bea025700 1 --2- 172.21.15.39:0/4259408169 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7be4108c80 0x7f7be4109090 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc0098a0 tx=0x7f7bcc009bb0 comp rx=0 tx=0).stop 2024-05-09T05:27:22.386 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:21.543+0000 7f7bea025700 1 -- 172.21.15.39:0/4259408169 shutdown_connections 2024-05-09T05:27:22.386 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:21.543+0000 7f7bea025700 1 --2- 172.21.15.39:0/4259408169 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7be4108c80 0x7f7be4109090 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:27:22.386 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:21.543+0000 7f7bea025700 1 -- 172.21.15.39:0/4259408169 >> 172.21.15.39:0/4259408169 conn(0x7f7be4104300 msgr2=0x7f7be4106770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:27:22.386 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:21.543+0000 7f7bea025700 1 -- 172.21.15.39:0/4259408169 shutdown_connections 2024-05-09T05:27:22.386 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:21.543+0000 7f7bea025700 1 -- 172.21.15.39:0/4259408169 wait complete. 2024-05-09T05:27:22.386 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:21.544+0000 7f7bea025700 1 Processor -- start 2024-05-09T05:27:22.386 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:21.544+0000 7f7bea025700 1 -- start start 2024-05-09T05:27:22.386 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:21.544+0000 7f7bea025700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7be4108c80 0x7f7be419e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:27:22.386 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:21.544+0000 7f7bea025700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f7be410d160 con 0x7f7be4108c80 2024-05-09T05:27:22.386 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:21.544+0000 7f7be37fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7be4108c80 0x7f7be419e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:27:22.387 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:21.544+0000 7f7be37fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7be4108c80 0x7f7be419e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53180/0 (socket says 172.21.15.39:53180) 2024-05-09T05:27:22.387 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:21.544+0000 7f7be37fe700 1 -- 172.21.15.39:0/4180760034 learned_addr learned my addr 172.21.15.39:0/4180760034 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:27:22.387 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:21.545+0000 7f7be37fe700 1 -- 172.21.15.39:0/4180760034 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7be419e650 con 0x7f7be4108c80 2024-05-09T05:27:22.387 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:21.545+0000 7f7be37fe700 1 --2- 172.21.15.39:0/4180760034 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7be4108c80 0x7f7be419e110 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc003e70 tx=0x7f7bcc011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:27:22.387 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:21.545+0000 7f7be0ff9700 1 -- 172.21.15.39:0/4180760034 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7bcc003aa0 con 0x7f7be4108c80 2024-05-09T05:27:22.387 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:21.545+0000 7f7bea025700 1 -- 172.21.15.39:0/4180760034 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7be419e8e0 con 0x7f7be4108c80 2024-05-09T05:27:22.387 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:21.545+0000 7f7be0ff9700 1 -- 172.21.15.39:0/4180760034 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7bcc01a8e0 con 0x7f7be4108c80 2024-05-09T05:27:22.387 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:21.545+0000 7f7be0ff9700 1 -- 172.21.15.39:0/4180760034 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7bcc024870 con 0x7f7be4108c80 2024-05-09T05:27:22.387 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:21.545+0000 7f7bea025700 1 -- 172.21.15.39:0/4180760034 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7be41a14f0 con 0x7f7be4108c80 2024-05-09T05:27:22.387 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:21.546+0000 7f7bea025700 1 -- 172.21.15.39:0/4180760034 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7be4064e20 con 0x7f7be4108c80 2024-05-09T05:27:22.388 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:21.547+0000 7f7be0ff9700 1 -- 172.21.15.39:0/4180760034 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 9) ==== 50235+0+0 (secure 0 0 0) 0x7f7bcc022020 con 0x7f7be4108c80 2024-05-09T05:27:22.388 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:21.547+0000 7f7be0ff9700 1 --2- 172.21.15.39:0/4180760034 >> [v2:172.21.15.39:6800/4091500272,v1:172.21.15.39:6801/4091500272] conn(0x7f7bd003e520 0x7f7bd0040a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:27:22.388 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:21.547+0000 7f7be0ff9700 1 -- 172.21.15.39:0/4180760034 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f7bcc053890 con 0x7f7be4108c80 2024-05-09T05:27:22.388 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:21.547+0000 7f7be2ffd700 1 -- 172.21.15.39:0/4180760034 >> [v2:172.21.15.39:6800/4091500272,v1:172.21.15.39:6801/4091500272] conn(0x7f7bd003e520 msgr2=0x7f7bd0040a30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.39:6800/4091500272 2024-05-09T05:27:22.388 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:21.547+0000 7f7be2ffd700 1 --2- 172.21.15.39:0/4180760034 >> [v2:172.21.15.39:6800/4091500272,v1:172.21.15.39:6801/4091500272] conn(0x7f7bd003e520 0x7f7bd0040a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-09T05:27:22.388 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:21.552+0000 7f7be0ff9700 1 -- 172.21.15.39:0/4180760034 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f7bcc00e260 con 0x7f7be4108c80 2024-05-09T05:27:22.388 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:21.748+0000 7f7be2ffd700 1 -- 172.21.15.39:0/4180760034 >> [v2:172.21.15.39:6800/4091500272,v1:172.21.15.39:6801/4091500272] conn(0x7f7bd003e520 msgr2=0x7f7bd0040a30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.39:6800/4091500272 2024-05-09T05:27:22.388 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:21.748+0000 7f7be2ffd700 1 --2- 172.21.15.39:0/4180760034 >> [v2:172.21.15.39:6800/4091500272,v1:172.21.15.39:6801/4091500272] conn(0x7f7bd003e520 0x7f7bd0040a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-09T05:27:22.388 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:21.876+0000 7f7bea025700 1 -- 172.21.15.39:0/4180760034 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f7be402e8b0 con 0x7f7be4108c80 2024-05-09T05:27:22.388 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:21.876+0000 7f7be0ff9700 1 -- 172.21.15.39:0/4180760034 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7f7bcc01aa90 con 0x7f7be4108c80 2024-05-09T05:27:22.389 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:21.879+0000 7f7bea025700 1 -- 172.21.15.39:0/4180760034 >> [v2:172.21.15.39:6800/4091500272,v1:172.21.15.39:6801/4091500272] conn(0x7f7bd003e520 msgr2=0x7f7bd0040a30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-09T05:27:22.389 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:21.879+0000 7f7bea025700 1 --2- 172.21.15.39:0/4180760034 >> [v2:172.21.15.39:6800/4091500272,v1:172.21.15.39:6801/4091500272] conn(0x7f7bd003e520 0x7f7bd0040a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:27:22.389 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:21.879+0000 7f7bea025700 1 -- 172.21.15.39:0/4180760034 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7be4108c80 msgr2=0x7f7be419e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:27:22.389 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:21.879+0000 7f7bea025700 1 --2- 172.21.15.39:0/4180760034 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7be4108c80 0x7f7be419e110 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc003e70 tx=0x7f7bcc011aa0 comp rx=0 tx=0).stop 2024-05-09T05:27:22.389 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:21.879+0000 7f7bea025700 1 -- 172.21.15.39:0/4180760034 shutdown_connections 2024-05-09T05:27:22.389 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:21.879+0000 7f7bea025700 1 --2- 172.21.15.39:0/4180760034 >> [v2:172.21.15.39:6800/4091500272,v1:172.21.15.39:6801/4091500272] conn(0x7f7bd003e520 0x7f7bd0040a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:27:22.389 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:21.879+0000 7f7bea025700 1 --2- 172.21.15.39:0/4180760034 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7be4108c80 0x7f7be419e110 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:27:22.389 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:21.879+0000 7f7bea025700 1 -- 172.21.15.39:0/4180760034 >> 172.21.15.39:0/4180760034 conn(0x7f7be4104300 msgr2=0x7f7be41946c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:27:22.389 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:21.879+0000 7f7bea025700 1 -- 172.21.15.39:0/4180760034 shutdown_connections 2024-05-09T05:27:22.389 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:21.879+0000 7f7bea025700 1 -- 172.21.15.39:0/4180760034 wait complete. 2024-05-09T05:27:22.389 INFO:teuthology.orchestra.run.smithi039.stdout:Waiting for the mgr to restart... 2024-05-09T05:27:22.389 INFO:teuthology.orchestra.run.smithi039.stdout:Waiting for mgr epoch 9... 2024-05-09T05:27:22.504 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:22 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/4180760034' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-05-09T05:27:22.819 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:27:22 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: 2024-05-09T05:27:22.693+0000 7fcb911bb200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-09T05:27:23.111 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:27:22 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: 2024-05-09T05:27:22.883+0000 7fcb911bb200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-09T05:27:23.111 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:27:23 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: 2024-05-09T05:27:23.062+0000 7fcb911bb200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-09T05:27:23.653 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:27:23 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: 2024-05-09T05:27:23.370+0000 7fcb911bb200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-09T05:27:23.653 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:27:23 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: 2024-05-09T05:27:23.469+0000 7fcb911bb200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-09T05:27:23.921 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:27:23 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: 2024-05-09T05:27:23.684+0000 7fcb911bb200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-09T05:27:23.921 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:27:23 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: 2024-05-09T05:27:23.897+0000 7fcb911bb200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-09T05:27:24.861 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:27:24 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: 2024-05-09T05:27:24.544+0000 7fcb911bb200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-09T05:27:24.861 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:27:24 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: 2024-05-09T05:27:24.783+0000 7fcb911bb200 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-09T05:27:25.611 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:27:25 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: 2024-05-09T05:27:25.238+0000 7fcb911bb200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-09T05:27:25.611 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:27:25 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: 2024-05-09T05:27:25.342+0000 7fcb911bb200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-09T05:27:26.106 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:27:25 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: 2024-05-09T05:27:25.732+0000 7fcb911bb200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-09T05:27:26.107 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:27:26 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: 2024-05-09T05:27:26.111+0000 7fcb911bb200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-09T05:27:26.361 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:27:26 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: 2024-05-09T05:27:26.211+0000 7fcb911bb200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-09T05:27:26.861 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:27:26 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: 2024-05-09T05:27:26.471+0000 7fcb911bb200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-09T05:27:26.861 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:27:26 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: 2024-05-09T05:27:26.613+0000 7fcb911bb200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-09T05:27:26.861 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:27:26 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: 2024-05-09T05:27:26.716+0000 7fcb911bb200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-09T05:27:27.361 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:27:27 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: 2024-05-09T05:27:27.058+0000 7fcb911bb200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-09T05:27:27.361 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:27:27 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: 2024-05-09T05:27:27.157+0000 7fcb911bb200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-09T05:27:28.080 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:27:27 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: 2024-05-09T05:27:27.797+0000 7fcb911bb200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-09T05:27:28.080 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:27:28 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: 2024-05-09T05:27:28.031+0000 7fcb911bb200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-09T05:27:28.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:28 smithi039 ceph-mon[30439]: Active manager daemon x restarted 2024-05-09T05:27:28.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:28 smithi039 ceph-mon[30439]: Activating manager daemon x 2024-05-09T05:27:28.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:28 smithi039 ceph-mon[30439]: osdmap e3: 0 total, 0 up, 0 in 2024-05-09T05:27:28.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:28 smithi039 ceph-mon[30439]: mgrmap e10: x(active, starting, since 0.00410414s) 2024-05-09T05:27:28.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:28 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-09T05:27:28.362 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:28 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-09T05:27:28.362 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:28 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-09T05:27:28.362 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:28 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-09T05:27:28.362 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:28 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-09T05:27:28.362 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:28 smithi039 ceph-mon[30439]: Manager daemon x is now available 2024-05-09T05:27:28.362 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:28 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:27:29.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:29 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-09T05:27:29.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:29 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-09T05:27:29.362 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:29 smithi039 ceph-mon[30439]: mgrmap e11: x(active, since 1.00934s) 2024-05-09T05:27:29.712 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout { 2024-05-09T05:27:29.712 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-05-09T05:27:29.713 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout "initialized": true 2024-05-09T05:27:29.713 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout } 2024-05-09T05:27:29.713 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:22.856+0000 7f139cd06700 1 Processor -- start 2024-05-09T05:27:29.713 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:22.856+0000 7f139cd06700 1 -- start start 2024-05-09T05:27:29.713 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:22.857+0000 7f139cd06700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1398109df0 0x7f139810a200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:27:29.714 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:22.857+0000 7f139cd06700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f139810a7f0 con 0x7f1398109df0 2024-05-09T05:27:29.714 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:22.857+0000 7f139659c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1398109df0 0x7f139810a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:27:29.714 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:22.857+0000 7f139659c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1398109df0 0x7f139810a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53190/0 (socket says 172.21.15.39:53190) 2024-05-09T05:27:29.720 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:22.857+0000 7f139659c700 1 -- 172.21.15.39:0/4155557606 learned_addr learned my addr 172.21.15.39:0/4155557606 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:27:29.720 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:22.857+0000 7f139659c700 1 -- 172.21.15.39:0/4155557606 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f139810aed0 con 0x7f1398109df0 2024-05-09T05:27:29.720 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:22.858+0000 7f139659c700 1 --2- 172.21.15.39:0/4155557606 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1398109df0 0x7f139810a200 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f13880098a0 tx=0x7f1388009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc4a31cde4f2a478 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:27:29.720 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:22.858+0000 7f139559a700 1 -- 172.21.15.39:0/4155557606 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1388004160 con 0x7f1398109df0 2024-05-09T05:27:29.720 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:22.858+0000 7f139559a700 1 -- 172.21.15.39:0/4155557606 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1388004300 con 0x7f1398109df0 2024-05-09T05:27:29.720 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:22.858+0000 7f139559a700 1 -- 172.21.15.39:0/4155557606 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1388011a20 con 0x7f1398109df0 2024-05-09T05:27:29.721 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:22.859+0000 7f139cd06700 1 -- 172.21.15.39:0/4155557606 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1398109df0 msgr2=0x7f139810a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:27:29.721 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:22.859+0000 7f139cd06700 1 --2- 172.21.15.39:0/4155557606 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1398109df0 0x7f139810a200 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f13880098a0 tx=0x7f1388009bb0 comp rx=0 tx=0).stop 2024-05-09T05:27:29.721 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:22.859+0000 7f139cd06700 1 -- 172.21.15.39:0/4155557606 shutdown_connections 2024-05-09T05:27:29.721 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:22.859+0000 7f139cd06700 1 --2- 172.21.15.39:0/4155557606 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1398109df0 0x7f139810a200 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:27:29.721 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:22.859+0000 7f139cd06700 1 -- 172.21.15.39:0/4155557606 >> 172.21.15.39:0/4155557606 conn(0x7f1398105450 msgr2=0x7f13981078e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:27:29.721 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:22.859+0000 7f139cd06700 1 -- 172.21.15.39:0/4155557606 shutdown_connections 2024-05-09T05:27:29.721 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:22.859+0000 7f139cd06700 1 -- 172.21.15.39:0/4155557606 wait complete. 2024-05-09T05:27:29.721 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:22.860+0000 7f139cd06700 1 Processor -- start 2024-05-09T05:27:29.721 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:22.860+0000 7f139cd06700 1 -- start start 2024-05-09T05:27:29.721 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:22.860+0000 7f139cd06700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1398109df0 0x7f139819e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:27:29.721 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:22.860+0000 7f139cd06700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f139810e280 con 0x7f1398109df0 2024-05-09T05:27:29.721 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:22.860+0000 7f139659c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1398109df0 0x7f139819e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:27:29.721 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:22.860+0000 7f139659c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1398109df0 0x7f139819e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53198/0 (socket says 172.21.15.39:53198) 2024-05-09T05:27:29.722 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:22.860+0000 7f139659c700 1 -- 172.21.15.39:0/1426442394 learned_addr learned my addr 172.21.15.39:0/1426442394 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:27:29.722 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:22.860+0000 7f139659c700 1 -- 172.21.15.39:0/1426442394 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f139819e650 con 0x7f1398109df0 2024-05-09T05:27:29.722 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:22.861+0000 7f139659c700 1 --2- 172.21.15.39:0/1426442394 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1398109df0 0x7f139819e110 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1388003e70 tx=0x7f1388011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:27:29.722 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:22.861+0000 7f13877fe700 1 -- 172.21.15.39:0/1426442394 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1388003aa0 con 0x7f1398109df0 2024-05-09T05:27:29.722 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:22.861+0000 7f13877fe700 1 -- 172.21.15.39:0/1426442394 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f138801a8e0 con 0x7f1398109df0 2024-05-09T05:27:29.722 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:22.861+0000 7f139cd06700 1 -- 172.21.15.39:0/1426442394 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f139819e8e0 con 0x7f1398109df0 2024-05-09T05:27:29.722 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:22.861+0000 7f13877fe700 1 -- 172.21.15.39:0/1426442394 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1388024870 con 0x7f1398109df0 2024-05-09T05:27:29.722 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:22.861+0000 7f139cd06700 1 -- 172.21.15.39:0/1426442394 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13981a14f0 con 0x7f1398109df0 2024-05-09T05:27:29.722 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:22.862+0000 7f13877fe700 1 -- 172.21.15.39:0/1426442394 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 9) ==== 50235+0+0 (secure 0 0 0) 0x7f1388022020 con 0x7f1398109df0 2024-05-09T05:27:29.723 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:22.862+0000 7f13877fe700 1 --2- 172.21.15.39:0/1426442394 >> [v2:172.21.15.39:6800/4091500272,v1:172.21.15.39:6801/4091500272] conn(0x7f138003e520 0x7f1380040a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:27:29.723 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:22.862+0000 7f13877fe700 1 -- 172.21.15.39:0/1426442394 --> [v2:172.21.15.39:6800/4091500272,v1:172.21.15.39:6801/4091500272] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f1380041140 con 0x7f138003e520 2024-05-09T05:27:29.723 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:22.862+0000 7f13877fe700 1 -- 172.21.15.39:0/1426442394 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f1388053bc0 con 0x7f1398109df0 2024-05-09T05:27:29.723 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:22.862+0000 7f1395d9b700 1 -- 172.21.15.39:0/1426442394 >> [v2:172.21.15.39:6800/4091500272,v1:172.21.15.39:6801/4091500272] conn(0x7f138003e520 msgr2=0x7f1380040a30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.39:6800/4091500272 2024-05-09T05:27:29.723 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:22.862+0000 7f1395d9b700 1 --2- 172.21.15.39:0/1426442394 >> [v2:172.21.15.39:6800/4091500272,v1:172.21.15.39:6801/4091500272] conn(0x7f138003e520 0x7f1380040a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-09T05:27:29.723 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:23.063+0000 7f1395d9b700 1 -- 172.21.15.39:0/1426442394 >> [v2:172.21.15.39:6800/4091500272,v1:172.21.15.39:6801/4091500272] conn(0x7f138003e520 msgr2=0x7f1380040a30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.39:6800/4091500272 2024-05-09T05:27:29.723 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:23.063+0000 7f1395d9b700 1 --2- 172.21.15.39:0/1426442394 >> [v2:172.21.15.39:6800/4091500272,v1:172.21.15.39:6801/4091500272] conn(0x7f138003e520 0x7f1380040a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-09T05:27:29.723 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:23.464+0000 7f1395d9b700 1 -- 172.21.15.39:0/1426442394 >> [v2:172.21.15.39:6800/4091500272,v1:172.21.15.39:6801/4091500272] conn(0x7f138003e520 msgr2=0x7f1380040a30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.39:6800/4091500272 2024-05-09T05:27:29.723 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:23.464+0000 7f1395d9b700 1 --2- 172.21.15.39:0/1426442394 >> [v2:172.21.15.39:6800/4091500272,v1:172.21.15.39:6801/4091500272] conn(0x7f138003e520 0x7f1380040a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-09T05:27:29.723 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:24.265+0000 7f1395d9b700 1 -- 172.21.15.39:0/1426442394 >> [v2:172.21.15.39:6800/4091500272,v1:172.21.15.39:6801/4091500272] conn(0x7f138003e520 msgr2=0x7f1380040a30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.39:6800/4091500272 2024-05-09T05:27:29.723 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:24.265+0000 7f1395d9b700 1 --2- 172.21.15.39:0/1426442394 >> [v2:172.21.15.39:6800/4091500272,v1:172.21.15.39:6801/4091500272] conn(0x7f138003e520 0x7f1380040a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-09T05:27:29.723 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:25.866+0000 7f1395d9b700 1 -- 172.21.15.39:0/1426442394 >> [v2:172.21.15.39:6800/4091500272,v1:172.21.15.39:6801/4091500272] conn(0x7f138003e520 msgr2=0x7f1380040a30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.39:6800/4091500272 2024-05-09T05:27:29.723 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:25.866+0000 7f1395d9b700 1 --2- 172.21.15.39:0/1426442394 >> [v2:172.21.15.39:6800/4091500272,v1:172.21.15.39:6801/4091500272] conn(0x7f138003e520 0x7f1380040a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-05-09T05:27:29.723 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:28.035+0000 7f13877fe700 1 -- 172.21.15.39:0/1426442394 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mgrmap(e 10) ==== 50002+0+0 (secure 0 0 0) 0x7f138802d3f0 con 0x7f1398109df0 2024-05-09T05:27:29.724 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:28.035+0000 7f13877fe700 1 -- 172.21.15.39:0/1426442394 >> [v2:172.21.15.39:6800/4091500272,v1:172.21.15.39:6801/4091500272] conn(0x7f138003e520 msgr2=0x7f1380040a30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-09T05:27:29.724 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:28.035+0000 7f13877fe700 1 --2- 172.21.15.39:0/1426442394 >> [v2:172.21.15.39:6800/4091500272,v1:172.21.15.39:6801/4091500272] conn(0x7f138003e520 0x7f1380040a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:27:29.724 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:29.039+0000 7f13877fe700 1 -- 172.21.15.39:0/1426442394 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mgrmap(e 11) ==== 50129+0+0 (secure 0 0 0) 0x7f1388055200 con 0x7f1398109df0 2024-05-09T05:27:29.724 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:29.040+0000 7f13877fe700 1 --2- 172.21.15.39:0/1426442394 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f1388053750 0x7f1380044000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:27:29.724 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:29.040+0000 7f13877fe700 1 -- 172.21.15.39:0/1426442394 --> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f1388025e70 con 0x7f1388053750 2024-05-09T05:27:29.724 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:29.040+0000 7f1395d9b700 1 --2- 172.21.15.39:0/1426442394 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f1388053750 0x7f1380044000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:27:29.724 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:29.041+0000 7f1395d9b700 1 --2- 172.21.15.39:0/1426442394 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f1388053750 0x7f1380044000 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f138c003a10 tx=0x7f138c009270 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:27:29.724 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:29.042+0000 7f13877fe700 1 -- 172.21.15.39:0/1426442394 <== mgr.14152 v2:172.21.15.39:6800/3184189003 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f1388025e70 con 0x7f1388053750 2024-05-09T05:27:29.724 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:29.050+0000 7f139cd06700 1 -- 172.21.15.39:0/1426442394 --> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f1398064e20 con 0x7f1388053750 2024-05-09T05:27:29.724 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:29.050+0000 7f13877fe700 1 -- 172.21.15.39:0/1426442394 <== mgr.14152 v2:172.21.15.39:6800/3184189003 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7f1398064e20 con 0x7f1388053750 2024-05-09T05:27:29.724 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:29.051+0000 7f139cd06700 1 -- 172.21.15.39:0/1426442394 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f1388053750 msgr2=0x7f1380044000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:27:29.724 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:29.051+0000 7f139cd06700 1 --2- 172.21.15.39:0/1426442394 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f1388053750 0x7f1380044000 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f138c003a10 tx=0x7f138c009270 comp rx=0 tx=0).stop 2024-05-09T05:27:29.724 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:29.051+0000 7f139cd06700 1 -- 172.21.15.39:0/1426442394 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1398109df0 msgr2=0x7f139819e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:27:29.725 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:29.051+0000 7f139cd06700 1 --2- 172.21.15.39:0/1426442394 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1398109df0 0x7f139819e110 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1388003e70 tx=0x7f1388011aa0 comp rx=0 tx=0).stop 2024-05-09T05:27:29.725 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:29.051+0000 7f139cd06700 1 -- 172.21.15.39:0/1426442394 shutdown_connections 2024-05-09T05:27:29.725 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:29.051+0000 7f139cd06700 1 --2- 172.21.15.39:0/1426442394 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f1388053750 0x7f1380044000 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:27:29.725 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:29.051+0000 7f139cd06700 1 --2- 172.21.15.39:0/1426442394 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1398109df0 0x7f139819e110 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:27:29.725 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:29.051+0000 7f139cd06700 1 --2- 172.21.15.39:0/1426442394 >> [v2:172.21.15.39:6800/4091500272,v1:172.21.15.39:6801/4091500272] conn(0x7f138003e520 0x7f1380040a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:27:29.725 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:29.051+0000 7f139cd06700 1 -- 172.21.15.39:0/1426442394 >> 172.21.15.39:0/1426442394 conn(0x7f1398105450 msgr2=0x7f1398105d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:27:29.725 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:29.051+0000 7f139cd06700 1 -- 172.21.15.39:0/1426442394 shutdown_connections 2024-05-09T05:27:29.725 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:29.051+0000 7f139cd06700 1 -- 172.21.15.39:0/1426442394 wait complete. 2024-05-09T05:27:29.725 INFO:teuthology.orchestra.run.smithi039.stdout:mgr epoch 9 is available 2024-05-09T05:27:29.725 INFO:teuthology.orchestra.run.smithi039.stdout:Generating a dashboard self-signed certificate... 2024-05-09T05:27:30.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:30 smithi039 ceph-mon[30439]: [09/May/2024:05:27:29] ENGINE Bus STARTING 2024-05-09T05:27:30.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:30 smithi039 ceph-mon[30439]: [09/May/2024:05:27:29] ENGINE Serving on http://172.21.15.39:8765 2024-05-09T05:27:30.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:30 smithi039 ceph-mon[30439]: [09/May/2024:05:27:29] ENGINE Serving on https://172.21.15.39:7150 2024-05-09T05:27:30.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:30 smithi039 ceph-mon[30439]: [09/May/2024:05:27:29] ENGINE Bus STARTED 2024-05-09T05:27:31.108 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-05-09T05:27:31.108 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:30.144+0000 7f9f503df700 1 Processor -- start 2024-05-09T05:27:31.108 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:30.144+0000 7f9f503df700 1 -- start start 2024-05-09T05:27:31.108 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:30.144+0000 7f9f503df700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9f4810a820 0x7f9f4810cc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:27:31.109 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:30.144+0000 7f9f503df700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f9f4807d7f0 con 0x7f9f4810a820 2024-05-09T05:27:31.109 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:30.144+0000 7f9f4e17b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9f4810a820 0x7f9f4810cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:27:31.109 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:30.145+0000 7f9f4e17b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9f4810a820 0x7f9f4810cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54154/0 (socket says 172.21.15.39:54154) 2024-05-09T05:27:31.109 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:30.145+0000 7f9f4e17b700 1 -- 172.21.15.39:0/690165852 learned_addr learned my addr 172.21.15.39:0/690165852 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:27:31.109 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:30.145+0000 7f9f4e17b700 1 -- 172.21.15.39:0/690165852 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f4810d180 con 0x7f9f4810a820 2024-05-09T05:27:31.109 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:30.145+0000 7f9f4e17b700 1 --2- 172.21.15.39:0/690165852 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9f4810a820 0x7f9f4810cc40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c0098a0 tx=0x7f9f3c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dddb91b9fd0dc1d3 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:27:31.109 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:30.145+0000 7f9f4d179700 1 -- 172.21.15.39:0/690165852 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f3c004160 con 0x7f9f4810a820 2024-05-09T05:27:31.109 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:30.145+0000 7f9f4d179700 1 -- 172.21.15.39:0/690165852 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9f3c004300 con 0x7f9f4810a820 2024-05-09T05:27:31.109 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:30.145+0000 7f9f4d179700 1 -- 172.21.15.39:0/690165852 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f3c011a20 con 0x7f9f4810a820 2024-05-09T05:27:31.109 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:30.146+0000 7f9f503df700 1 -- 172.21.15.39:0/690165852 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9f4810a820 msgr2=0x7f9f4810cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:27:31.109 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:30.146+0000 7f9f503df700 1 --2- 172.21.15.39:0/690165852 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9f4810a820 0x7f9f4810cc40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c0098a0 tx=0x7f9f3c009bb0 comp rx=0 tx=0).stop 2024-05-09T05:27:31.109 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:30.146+0000 7f9f503df700 1 -- 172.21.15.39:0/690165852 shutdown_connections 2024-05-09T05:27:31.109 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:30.146+0000 7f9f503df700 1 --2- 172.21.15.39:0/690165852 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9f4810a820 0x7f9f4810cc40 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:27:31.109 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:30.146+0000 7f9f503df700 1 -- 172.21.15.39:0/690165852 >> 172.21.15.39:0/690165852 conn(0x7f9f481042c0 msgr2=0x7f9f48106730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:27:31.110 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:30.146+0000 7f9f503df700 1 -- 172.21.15.39:0/690165852 shutdown_connections 2024-05-09T05:27:31.110 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:30.146+0000 7f9f503df700 1 -- 172.21.15.39:0/690165852 wait complete. 2024-05-09T05:27:31.110 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:30.147+0000 7f9f503df700 1 Processor -- start 2024-05-09T05:27:31.110 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:30.147+0000 7f9f503df700 1 -- start start 2024-05-09T05:27:31.110 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:30.147+0000 7f9f503df700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9f4810a820 0x7f9f4819e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:27:31.110 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:30.147+0000 7f9f503df700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f9f4810e0c0 con 0x7f9f4810a820 2024-05-09T05:27:31.110 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:30.147+0000 7f9f4e17b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9f4810a820 0x7f9f4819e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:27:31.110 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:30.147+0000 7f9f4e17b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9f4810a820 0x7f9f4819e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54168/0 (socket says 172.21.15.39:54168) 2024-05-09T05:27:31.110 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:30.147+0000 7f9f4e17b700 1 -- 172.21.15.39:0/885657474 learned_addr learned my addr 172.21.15.39:0/885657474 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:27:31.110 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:30.147+0000 7f9f4e17b700 1 -- 172.21.15.39:0/885657474 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f4819e5c0 con 0x7f9f4810a820 2024-05-09T05:27:31.110 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:30.148+0000 7f9f4e17b700 1 --2- 172.21.15.39:0/885657474 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9f4810a820 0x7f9f4819e080 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c000c00 tx=0x7f9f3c011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:27:31.110 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:30.148+0000 7f9f3b7fe700 1 -- 172.21.15.39:0/885657474 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f3c003aa0 con 0x7f9f4810a820 2024-05-09T05:27:31.110 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:30.148+0000 7f9f3b7fe700 1 -- 172.21.15.39:0/885657474 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9f3c01b8f0 con 0x7f9f4810a820 2024-05-09T05:27:31.111 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:30.148+0000 7f9f503df700 1 -- 172.21.15.39:0/885657474 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f4819e850 con 0x7f9f4810a820 2024-05-09T05:27:31.111 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:30.148+0000 7f9f3b7fe700 1 -- 172.21.15.39:0/885657474 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f3c023890 con 0x7f9f4810a820 2024-05-09T05:27:31.111 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:30.148+0000 7f9f503df700 1 -- 172.21.15.39:0/885657474 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f481a1460 con 0x7f9f4810a820 2024-05-09T05:27:31.111 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:30.149+0000 7f9f3b7fe700 1 -- 172.21.15.39:0/885657474 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 12) ==== 50235+0+0 (secure 0 0 0) 0x7f9f3c02c3f0 con 0x7f9f4810a820 2024-05-09T05:27:31.111 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:30.149+0000 7f9f503df700 1 -- 172.21.15.39:0/885657474 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f48064e20 con 0x7f9f4810a820 2024-05-09T05:27:31.111 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:30.149+0000 7f9f3b7fe700 1 --2- 172.21.15.39:0/885657474 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f9f3403e520 0x7f9f34040a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:27:31.111 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:30.149+0000 7f9f3b7fe700 1 -- 172.21.15.39:0/885657474 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f9f3c053ed0 con 0x7f9f4810a820 2024-05-09T05:27:31.111 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:30.149+0000 7f9f4d97a700 1 --2- 172.21.15.39:0/885657474 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f9f3403e520 0x7f9f34040a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:27:31.111 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:30.150+0000 7f9f4d97a700 1 --2- 172.21.15.39:0/885657474 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f9f3403e520 0x7f9f34040a30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9f44006fd0 tx=0x7f9f44006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:27:31.111 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:30.154+0000 7f9f3b7fe700 1 -- 172.21.15.39:0/885657474 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f9f3c01f030 con 0x7f9f4810a820 2024-05-09T05:27:31.111 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:30.377+0000 7f9f503df700 1 -- 172.21.15.39:0/885657474 --> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7f9f48105270 con 0x7f9f3403e520 2024-05-09T05:27:31.111 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:30.515+0000 7f9f3b7fe700 1 -- 172.21.15.39:0/885657474 <== mgr.14152 v2:172.21.15.39:6800/3184189003 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7f9f48105270 con 0x7f9f3403e520 2024-05-09T05:27:31.111 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:30.518+0000 7f9f503df700 1 -- 172.21.15.39:0/885657474 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f9f3403e520 msgr2=0x7f9f34040a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:27:31.111 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:30.518+0000 7f9f503df700 1 --2- 172.21.15.39:0/885657474 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f9f3403e520 0x7f9f34040a30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9f44006fd0 tx=0x7f9f44006e40 comp rx=0 tx=0).stop 2024-05-09T05:27:31.112 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:30.518+0000 7f9f503df700 1 -- 172.21.15.39:0/885657474 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9f4810a820 msgr2=0x7f9f4819e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:27:31.112 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:30.518+0000 7f9f503df700 1 --2- 172.21.15.39:0/885657474 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9f4810a820 0x7f9f4819e080 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c000c00 tx=0x7f9f3c011aa0 comp rx=0 tx=0).stop 2024-05-09T05:27:31.112 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:30.518+0000 7f9f503df700 1 -- 172.21.15.39:0/885657474 shutdown_connections 2024-05-09T05:27:31.112 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:30.518+0000 7f9f503df700 1 --2- 172.21.15.39:0/885657474 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f9f3403e520 0x7f9f34040a30 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:27:31.112 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:30.518+0000 7f9f503df700 1 --2- 172.21.15.39:0/885657474 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9f4810a820 0x7f9f4819e080 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:27:31.112 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:30.518+0000 7f9f503df700 1 -- 172.21.15.39:0/885657474 >> 172.21.15.39:0/885657474 conn(0x7f9f481042c0 msgr2=0x7f9f48104b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:27:31.112 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:30.518+0000 7f9f503df700 1 -- 172.21.15.39:0/885657474 shutdown_connections 2024-05-09T05:27:31.112 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:30.518+0000 7f9f503df700 1 -- 172.21.15.39:0/885657474 wait complete. 2024-05-09T05:27:31.112 INFO:teuthology.orchestra.run.smithi039.stdout:Creating initial admin user... 2024-05-09T05:27:31.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:31 smithi039 ceph-mon[30439]: mgrmap e12: x(active, since 2s) 2024-05-09T05:27:31.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:31 smithi039 ceph-mon[30439]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T05:27:31.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:31 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:27:31.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:31 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:27:31.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:31 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:27:32.641 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$VX54iySWiGez4R2bvpNoq.jkmIXqshhH4rTu1yKg/2AAqEYIwpeji", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1715232452, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-05-09T05:27:32.641 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:31.603+0000 7fe3fe0e9700 1 Processor -- start 2024-05-09T05:27:32.641 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:31.604+0000 7fe3fe0e9700 1 -- start start 2024-05-09T05:27:32.641 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:31.604+0000 7fe3fe0e9700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe3f807cc70 0x7fe3f810ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:27:32.641 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:31.604+0000 7fe3fe0e9700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fe3f810f260 con 0x7fe3f807cc70 2024-05-09T05:27:32.641 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:31.604+0000 7fe3f77fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe3f807cc70 0x7fe3f810ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:27:32.642 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:31.604+0000 7fe3f77fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe3f807cc70 0x7fe3f810ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54184/0 (socket says 172.21.15.39:54184) 2024-05-09T05:27:32.642 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:31.604+0000 7fe3f77fe700 1 -- 172.21.15.39:0/3421558502 learned_addr learned my addr 172.21.15.39:0/3421558502 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:27:32.642 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:31.604+0000 7fe3f77fe700 1 -- 172.21.15.39:0/3421558502 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3f810f3e0 con 0x7fe3f807cc70 2024-05-09T05:27:32.642 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:31.605+0000 7fe3f77fe700 1 --2- 172.21.15.39:0/3421558502 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe3f807cc70 0x7fe3f810ed20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe3e00098a0 tx=0x7fe3e0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4f7a8ecab0b3464 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:27:32.642 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:31.605+0000 7fe3f67fc700 1 -- 172.21.15.39:0/3421558502 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3e0004160 con 0x7fe3f807cc70 2024-05-09T05:27:32.642 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:31.605+0000 7fe3f67fc700 1 -- 172.21.15.39:0/3421558502 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe3e0004300 con 0x7fe3f807cc70 2024-05-09T05:27:32.642 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:31.605+0000 7fe3f67fc700 1 -- 172.21.15.39:0/3421558502 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3e0011a20 con 0x7fe3f807cc70 2024-05-09T05:27:32.642 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:31.606+0000 7fe3fe0e9700 1 -- 172.21.15.39:0/3421558502 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe3f807cc70 msgr2=0x7fe3f810ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:27:32.642 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:31.606+0000 7fe3fe0e9700 1 --2- 172.21.15.39:0/3421558502 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe3f807cc70 0x7fe3f810ed20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe3e00098a0 tx=0x7fe3e0009bb0 comp rx=0 tx=0).stop 2024-05-09T05:27:32.642 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:31.606+0000 7fe3fe0e9700 1 -- 172.21.15.39:0/3421558502 shutdown_connections 2024-05-09T05:27:32.642 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:31.606+0000 7fe3fe0e9700 1 --2- 172.21.15.39:0/3421558502 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe3f807cc70 0x7fe3f810ed20 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:27:32.642 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:31.606+0000 7fe3fe0e9700 1 -- 172.21.15.39:0/3421558502 >> 172.21.15.39:0/3421558502 conn(0x7fe3f81043d0 msgr2=0x7fe3f8106820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:27:32.642 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:31.606+0000 7fe3fe0e9700 1 -- 172.21.15.39:0/3421558502 shutdown_connections 2024-05-09T05:27:32.643 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:31.606+0000 7fe3fe0e9700 1 -- 172.21.15.39:0/3421558502 wait complete. 2024-05-09T05:27:32.643 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:31.606+0000 7fe3fe0e9700 1 Processor -- start 2024-05-09T05:27:32.643 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:31.607+0000 7fe3fe0e9700 1 -- start start 2024-05-09T05:27:32.643 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:31.607+0000 7fe3fe0e9700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe3f807cc70 0x7fe3f81a02d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:27:32.643 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:31.607+0000 7fe3fe0e9700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fe3f8110330 con 0x7fe3f807cc70 2024-05-09T05:27:32.643 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:31.607+0000 7fe3f77fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe3f807cc70 0x7fe3f81a02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:27:32.643 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:31.607+0000 7fe3f77fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe3f807cc70 0x7fe3f81a02d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54192/0 (socket says 172.21.15.39:54192) 2024-05-09T05:27:32.643 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:31.607+0000 7fe3f77fe700 1 -- 172.21.15.39:0/1198417541 learned_addr learned my addr 172.21.15.39:0/1198417541 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:27:32.643 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:31.607+0000 7fe3f77fe700 1 -- 172.21.15.39:0/1198417541 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3f81a0810 con 0x7fe3f807cc70 2024-05-09T05:27:32.643 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:31.608+0000 7fe3f77fe700 1 --2- 172.21.15.39:0/1198417541 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe3f807cc70 0x7fe3f81a02d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe3e0009520 tx=0x7fe3e0011b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:27:32.643 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:31.608+0000 7fe3f4ff9700 1 -- 172.21.15.39:0/1198417541 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3e0003b70 con 0x7fe3f807cc70 2024-05-09T05:27:32.643 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:31.608+0000 7fe3f4ff9700 1 -- 172.21.15.39:0/1198417541 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe3e001b8f0 con 0x7fe3f807cc70 2024-05-09T05:27:32.643 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:31.608+0000 7fe3f4ff9700 1 -- 172.21.15.39:0/1198417541 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3e0019800 con 0x7fe3f807cc70 2024-05-09T05:27:32.644 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:31.608+0000 7fe3fe0e9700 1 -- 172.21.15.39:0/1198417541 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3f81a0aa0 con 0x7fe3f807cc70 2024-05-09T05:27:32.644 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:31.608+0000 7fe3fe0e9700 1 -- 172.21.15.39:0/1198417541 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3f81a36b0 con 0x7fe3f807cc70 2024-05-09T05:27:32.644 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:31.609+0000 7fe3fe0e9700 1 -- 172.21.15.39:0/1198417541 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3f8064e20 con 0x7fe3f807cc70 2024-05-09T05:27:32.644 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:31.609+0000 7fe3f4ff9700 1 -- 172.21.15.39:0/1198417541 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 12) ==== 50235+0+0 (secure 0 0 0) 0x7fe3e0019b00 con 0x7fe3f807cc70 2024-05-09T05:27:32.644 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:31.609+0000 7fe3f4ff9700 1 --2- 172.21.15.39:0/1198417541 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fe3e403e470 0x7fe3e4040980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:27:32.644 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:31.609+0000 7fe3f4ff9700 1 -- 172.21.15.39:0/1198417541 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fe3e0054230 con 0x7fe3f807cc70 2024-05-09T05:27:32.644 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:31.610+0000 7fe3f6ffd700 1 --2- 172.21.15.39:0/1198417541 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fe3e403e470 0x7fe3e4040980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:27:32.644 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:31.610+0000 7fe3f6ffd700 1 --2- 172.21.15.39:0/1198417541 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fe3e403e470 0x7fe3e4040980 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe3e8006fd0 tx=0x7fe3e8006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:27:32.644 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:31.615+0000 7fe3f4ff9700 1 -- 172.21.15.39:0/1198417541 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fe3e001f030 con 0x7fe3f807cc70 2024-05-09T05:27:32.644 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:31.854+0000 7fe3fe0e9700 1 -- 172.21.15.39:0/1198417541 --> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7fe3f81a3880 con 0x7fe3e403e470 2024-05-09T05:27:32.644 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:32.101+0000 7fe3f4ff9700 1 -- 172.21.15.39:0/1198417541 <== mgr.14152 v2:172.21.15.39:6800/3184189003 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7fe3f81a3880 con 0x7fe3e403e470 2024-05-09T05:27:32.644 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:32.104+0000 7fe3fe0e9700 1 -- 172.21.15.39:0/1198417541 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fe3e403e470 msgr2=0x7fe3e4040980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:27:32.644 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:32.104+0000 7fe3fe0e9700 1 --2- 172.21.15.39:0/1198417541 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fe3e403e470 0x7fe3e4040980 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe3e8006fd0 tx=0x7fe3e8006e40 comp rx=0 tx=0).stop 2024-05-09T05:27:32.644 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:32.104+0000 7fe3fe0e9700 1 -- 172.21.15.39:0/1198417541 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe3f807cc70 msgr2=0x7fe3f81a02d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:27:32.645 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:32.104+0000 7fe3fe0e9700 1 --2- 172.21.15.39:0/1198417541 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe3f807cc70 0x7fe3f81a02d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe3e0009520 tx=0x7fe3e0011b10 comp rx=0 tx=0).stop 2024-05-09T05:27:32.645 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:32.104+0000 7fe3fe0e9700 1 -- 172.21.15.39:0/1198417541 shutdown_connections 2024-05-09T05:27:32.645 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:32.104+0000 7fe3fe0e9700 1 --2- 172.21.15.39:0/1198417541 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fe3e403e470 0x7fe3e4040980 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:27:32.645 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:32.104+0000 7fe3fe0e9700 1 --2- 172.21.15.39:0/1198417541 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe3f807cc70 0x7fe3f81a02d0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:27:32.645 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:32.104+0000 7fe3fe0e9700 1 -- 172.21.15.39:0/1198417541 >> 172.21.15.39:0/1198417541 conn(0x7fe3f81043d0 msgr2=0x7fe3f8105d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:27:32.645 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:32.104+0000 7fe3fe0e9700 1 -- 172.21.15.39:0/1198417541 shutdown_connections 2024-05-09T05:27:32.645 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:32.104+0000 7fe3fe0e9700 1 -- 172.21.15.39:0/1198417541 wait complete. 2024-05-09T05:27:32.645 INFO:teuthology.orchestra.run.smithi039.stdout:Fetching dashboard port number... 2024-05-09T05:27:32.927 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:32 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:27:32.927 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:32 smithi039 ceph-mon[30439]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T05:27:32.927 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:32 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:27:33.967 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stdout 8443 2024-05-09T05:27:33.967 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:33.049+0000 7fd59f38c700 1 Processor -- start 2024-05-09T05:27:33.967 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:33.049+0000 7fd59f38c700 1 -- start start 2024-05-09T05:27:33.967 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:33.049+0000 7fd59f38c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd59810a1c0 0x7fd59810a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:27:33.967 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:33.049+0000 7fd59f38c700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fd59810abc0 con 0x7fd59810a1c0 2024-05-09T05:27:33.967 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:33.049+0000 7fd59d128700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd59810a1c0 0x7fd59810a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:27:33.967 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:33.049+0000 7fd59d128700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd59810a1c0 0x7fd59810a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54202/0 (socket says 172.21.15.39:54202) 2024-05-09T05:27:33.967 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:33.049+0000 7fd59d128700 1 -- 172.21.15.39:0/1275414315 learned_addr learned my addr 172.21.15.39:0/1275414315 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:27:33.968 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:33.050+0000 7fd59d128700 1 -- 172.21.15.39:0/1275414315 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd598108ee0 con 0x7fd59810a1c0 2024-05-09T05:27:33.968 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:33.050+0000 7fd59d128700 1 --2- 172.21.15.39:0/1275414315 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd59810a1c0 0x7fd59810a5d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd5940098a0 tx=0x7fd594009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9db92c5359387b5 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:27:33.968 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:33.050+0000 7fd58ffff700 1 -- 172.21.15.39:0/1275414315 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd594004160 con 0x7fd59810a1c0 2024-05-09T05:27:33.968 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:33.050+0000 7fd58ffff700 1 -- 172.21.15.39:0/1275414315 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd594004300 con 0x7fd59810a1c0 2024-05-09T05:27:33.968 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:33.050+0000 7fd58ffff700 1 -- 172.21.15.39:0/1275414315 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd594011a20 con 0x7fd59810a1c0 2024-05-09T05:27:33.968 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:33.051+0000 7fd59f38c700 1 -- 172.21.15.39:0/1275414315 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd59810a1c0 msgr2=0x7fd59810a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:27:33.968 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:33.051+0000 7fd59f38c700 1 --2- 172.21.15.39:0/1275414315 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd59810a1c0 0x7fd59810a5d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd5940098a0 tx=0x7fd594009bb0 comp rx=0 tx=0).stop 2024-05-09T05:27:33.968 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:33.051+0000 7fd59f38c700 1 -- 172.21.15.39:0/1275414315 shutdown_connections 2024-05-09T05:27:33.968 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:33.051+0000 7fd59f38c700 1 --2- 172.21.15.39:0/1275414315 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd59810a1c0 0x7fd59810a5d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:27:33.968 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:33.051+0000 7fd59f38c700 1 -- 172.21.15.39:0/1275414315 >> 172.21.15.39:0/1275414315 conn(0x7fd598103b00 msgr2=0x7fd598105f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:27:33.968 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:33.051+0000 7fd59f38c700 1 -- 172.21.15.39:0/1275414315 shutdown_connections 2024-05-09T05:27:33.968 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:33.051+0000 7fd59f38c700 1 -- 172.21.15.39:0/1275414315 wait complete. 2024-05-09T05:27:33.968 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:33.051+0000 7fd59f38c700 1 Processor -- start 2024-05-09T05:27:33.968 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:33.052+0000 7fd59f38c700 1 -- start start 2024-05-09T05:27:33.969 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:33.052+0000 7fd59f38c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd59810a1c0 0x7fd598108750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:27:33.969 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:33.052+0000 7fd59f38c700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fd59810d120 con 0x7fd59810a1c0 2024-05-09T05:27:33.969 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:33.052+0000 7fd59d128700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd59810a1c0 0x7fd598108750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:27:33.969 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:33.052+0000 7fd59d128700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd59810a1c0 0x7fd598108750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54204/0 (socket says 172.21.15.39:54204) 2024-05-09T05:27:33.969 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:33.052+0000 7fd59d128700 1 -- 172.21.15.39:0/3949776685 learned_addr learned my addr 172.21.15.39:0/3949776685 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:27:33.969 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:33.052+0000 7fd59d128700 1 -- 172.21.15.39:0/3949776685 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd598108c90 con 0x7fd59810a1c0 2024-05-09T05:27:33.969 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:33.052+0000 7fd59d128700 1 --2- 172.21.15.39:0/3949776685 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd59810a1c0 0x7fd598108750 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd594011a20 tx=0x7fd594011b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:27:33.969 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:33.052+0000 7fd58e7fc700 1 -- 172.21.15.39:0/3949776685 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd594003af0 con 0x7fd59810a1c0 2024-05-09T05:27:33.969 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:33.052+0000 7fd58e7fc700 1 -- 172.21.15.39:0/3949776685 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd59401b8f0 con 0x7fd59810a1c0 2024-05-09T05:27:33.969 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:33.052+0000 7fd59f38c700 1 -- 172.21.15.39:0/3949776685 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5981a0ec0 con 0x7fd59810a1c0 2024-05-09T05:27:33.969 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:33.053+0000 7fd58e7fc700 1 -- 172.21.15.39:0/3949776685 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd594023890 con 0x7fd59810a1c0 2024-05-09T05:27:33.969 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:33.053+0000 7fd59f38c700 1 -- 172.21.15.39:0/3949776685 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5981a1340 con 0x7fd59810a1c0 2024-05-09T05:27:33.969 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:33.053+0000 7fd59f38c700 1 -- 172.21.15.39:0/3949776685 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd598064e20 con 0x7fd59810a1c0 2024-05-09T05:27:33.969 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:33.054+0000 7fd58e7fc700 1 -- 172.21.15.39:0/3949776685 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 12) ==== 50235+0+0 (secure 0 0 0) 0x7fd59402c3f0 con 0x7fd59810a1c0 2024-05-09T05:27:33.970 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:33.054+0000 7fd58e7fc700 1 --2- 172.21.15.39:0/3949776685 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fd58403e470 0x7fd584040980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:27:33.970 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:33.054+0000 7fd58e7fc700 1 -- 172.21.15.39:0/3949776685 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fd594054000 con 0x7fd59810a1c0 2024-05-09T05:27:33.970 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:33.054+0000 7fd59c927700 1 --2- 172.21.15.39:0/3949776685 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fd58403e470 0x7fd584040980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:27:33.970 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:33.054+0000 7fd59c927700 1 --2- 172.21.15.39:0/3949776685 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fd58403e470 0x7fd584040980 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd588006fd0 tx=0x7fd588006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:27:33.970 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:33.059+0000 7fd58e7fc700 1 -- 172.21.15.39:0/3949776685 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fd59401f030 con 0x7fd59810a1c0 2024-05-09T05:27:33.970 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:33.311+0000 7fd59f38c700 1 -- 172.21.15.39:0/3949776685 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7fd5981a1c40 con 0x7fd59810a1c0 2024-05-09T05:27:33.970 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:33.311+0000 7fd58e7fc700 1 -- 172.21.15.39:0/3949776685 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7fd594017e90 con 0x7fd59810a1c0 2024-05-09T05:27:33.970 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:33.314+0000 7fd59f38c700 1 -- 172.21.15.39:0/3949776685 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fd58403e470 msgr2=0x7fd584040980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:27:33.970 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:33.314+0000 7fd59f38c700 1 --2- 172.21.15.39:0/3949776685 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fd58403e470 0x7fd584040980 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd588006fd0 tx=0x7fd588006e40 comp rx=0 tx=0).stop 2024-05-09T05:27:33.970 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:33.314+0000 7fd59f38c700 1 -- 172.21.15.39:0/3949776685 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd59810a1c0 msgr2=0x7fd598108750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:27:33.971 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:33.314+0000 7fd59f38c700 1 --2- 172.21.15.39:0/3949776685 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd59810a1c0 0x7fd598108750 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd594011a20 tx=0x7fd594011b00 comp rx=0 tx=0).stop 2024-05-09T05:27:33.971 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:33.314+0000 7fd59f38c700 1 -- 172.21.15.39:0/3949776685 shutdown_connections 2024-05-09T05:27:33.971 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:33.314+0000 7fd59f38c700 1 --2- 172.21.15.39:0/3949776685 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fd58403e470 0x7fd584040980 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:27:33.971 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:33.314+0000 7fd59f38c700 1 --2- 172.21.15.39:0/3949776685 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd59810a1c0 0x7fd598108750 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:27:33.971 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:33.314+0000 7fd59f38c700 1 -- 172.21.15.39:0/3949776685 >> 172.21.15.39:0/3949776685 conn(0x7fd598103b00 msgr2=0x7fd5981053e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:27:33.971 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:33.314+0000 7fd59f38c700 1 -- 172.21.15.39:0/3949776685 shutdown_connections 2024-05-09T05:27:33.971 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:33.314+0000 7fd59f38c700 1 -- 172.21.15.39:0/3949776685 wait complete. 2024-05-09T05:27:33.976 INFO:teuthology.orchestra.run.smithi039.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-05-09T05:27:33.976 INFO:teuthology.orchestra.run.smithi039.stdout:systemctl: stdout disabled 2024-05-09T05:27:33.985 INFO:teuthology.orchestra.run.smithi039.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-05-09T05:27:33.985 INFO:teuthology.orchestra.run.smithi039.stdout:systemctl: stdout inactive 2024-05-09T05:27:33.985 INFO:teuthology.orchestra.run.smithi039.stdout:firewalld.service is not enabled 2024-05-09T05:27:33.985 INFO:teuthology.orchestra.run.smithi039.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-05-09T05:27:33.986 INFO:teuthology.orchestra.run.smithi039.stdout:Ceph Dashboard is now available at: 2024-05-09T05:27:33.986 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-09T05:27:33.986 INFO:teuthology.orchestra.run.smithi039.stdout: URL: https://smithi039.front.sepia.ceph.com:8443/ 2024-05-09T05:27:33.986 INFO:teuthology.orchestra.run.smithi039.stdout: User: admin 2024-05-09T05:27:33.986 INFO:teuthology.orchestra.run.smithi039.stdout: Password: sataakl0zs 2024-05-09T05:27:33.986 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-09T05:27:33.987 INFO:teuthology.orchestra.run.smithi039.stdout:Saving cluster configuration to /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/config directory 2024-05-09T05:27:33.987 INFO:teuthology.orchestra.run.smithi039.stdout:Enabling autotune for osd_memory_target 2024-05-09T05:27:34.112 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:33 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/3949776685' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-05-09T05:27:35.846 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:34.787+0000 7fb9601c5700 1 Processor -- start 2024-05-09T05:27:35.847 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:34.787+0000 7fb9601c5700 1 -- start start 2024-05-09T05:27:35.847 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:34.787+0000 7fb9601c5700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb95810a890 0x7fb95810ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:27:35.847 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:34.787+0000 7fb9601c5700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fb95807cdc0 con 0x7fb95810a890 2024-05-09T05:27:35.847 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:34.788+0000 7fb95df61700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb95810a890 0x7fb95810ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:27:35.847 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:34.788+0000 7fb95df61700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb95810a890 0x7fb95810ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54214/0 (socket says 172.21.15.39:54214) 2024-05-09T05:27:35.847 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:34.788+0000 7fb95df61700 1 -- 172.21.15.39:0/3359953742 learned_addr learned my addr 172.21.15.39:0/3359953742 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:27:35.847 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:34.788+0000 7fb95df61700 1 -- 172.21.15.39:0/3359953742 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb95810d1f0 con 0x7fb95810a890 2024-05-09T05:27:35.847 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:34.788+0000 7fb95df61700 1 --2- 172.21.15.39:0/3359953742 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb95810a890 0x7fb95810ccb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb94c0098a0 tx=0x7fb94c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a35d87161546ae9 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:27:35.847 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:34.788+0000 7fb95cf5f700 1 -- 172.21.15.39:0/3359953742 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb94c004160 con 0x7fb95810a890 2024-05-09T05:27:35.848 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:34.789+0000 7fb95cf5f700 1 -- 172.21.15.39:0/3359953742 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb94c004300 con 0x7fb95810a890 2024-05-09T05:27:35.848 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:34.789+0000 7fb95cf5f700 1 -- 172.21.15.39:0/3359953742 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb94c011a20 con 0x7fb95810a890 2024-05-09T05:27:35.848 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:34.789+0000 7fb9601c5700 1 -- 172.21.15.39:0/3359953742 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb95810a890 msgr2=0x7fb95810ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:27:35.848 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:34.789+0000 7fb9601c5700 1 --2- 172.21.15.39:0/3359953742 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb95810a890 0x7fb95810ccb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb94c0098a0 tx=0x7fb94c009bb0 comp rx=0 tx=0).stop 2024-05-09T05:27:35.848 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:34.789+0000 7fb9601c5700 1 -- 172.21.15.39:0/3359953742 shutdown_connections 2024-05-09T05:27:35.848 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:34.789+0000 7fb9601c5700 1 --2- 172.21.15.39:0/3359953742 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb95810a890 0x7fb95810ccb0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:27:35.848 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:34.789+0000 7fb9601c5700 1 -- 172.21.15.39:0/3359953742 >> 172.21.15.39:0/3359953742 conn(0x7fb9581043d0 msgr2=0x7fb958106820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:27:35.848 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:34.790+0000 7fb9601c5700 1 -- 172.21.15.39:0/3359953742 shutdown_connections 2024-05-09T05:27:35.848 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:34.790+0000 7fb9601c5700 1 -- 172.21.15.39:0/3359953742 wait complete. 2024-05-09T05:27:35.848 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:34.790+0000 7fb9601c5700 1 Processor -- start 2024-05-09T05:27:35.848 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:34.790+0000 7fb9601c5700 1 -- start start 2024-05-09T05:27:35.849 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:34.791+0000 7fb9601c5700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb95810a890 0x7fb95819e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:27:35.849 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:34.791+0000 7fb9601c5700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fb95810e130 con 0x7fb95810a890 2024-05-09T05:27:35.849 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:34.791+0000 7fb95df61700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb95810a890 0x7fb95819e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:27:35.849 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:34.791+0000 7fb95df61700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb95810a890 0x7fb95819e0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54220/0 (socket says 172.21.15.39:54220) 2024-05-09T05:27:35.849 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:34.791+0000 7fb95df61700 1 -- 172.21.15.39:0/3258809833 learned_addr learned my addr 172.21.15.39:0/3258809833 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:27:35.849 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:34.791+0000 7fb95df61700 1 -- 172.21.15.39:0/3258809833 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb95819e610 con 0x7fb95810a890 2024-05-09T05:27:35.849 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:34.791+0000 7fb95df61700 1 --2- 172.21.15.39:0/3258809833 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb95810a890 0x7fb95819e0d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb94c004660 tx=0x7fb94c011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:27:35.849 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:34.791+0000 7fb94affd700 1 -- 172.21.15.39:0/3258809833 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb94c003a60 con 0x7fb95810a890 2024-05-09T05:27:35.849 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:34.791+0000 7fb94affd700 1 -- 172.21.15.39:0/3258809833 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb94c01b8f0 con 0x7fb95810a890 2024-05-09T05:27:35.849 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:34.791+0000 7fb9601c5700 1 -- 172.21.15.39:0/3258809833 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb95819e8a0 con 0x7fb95810a890 2024-05-09T05:27:35.849 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:34.791+0000 7fb94affd700 1 -- 172.21.15.39:0/3258809833 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb94c023890 con 0x7fb95810a890 2024-05-09T05:27:35.849 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:34.791+0000 7fb9601c5700 1 -- 172.21.15.39:0/3258809833 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9581a14b0 con 0x7fb95810a890 2024-05-09T05:27:35.849 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:34.792+0000 7fb94affd700 1 -- 172.21.15.39:0/3258809833 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 12) ==== 50235+0+0 (secure 0 0 0) 0x7fb94c02c3f0 con 0x7fb95810a890 2024-05-09T05:27:35.850 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:34.792+0000 7fb9601c5700 1 -- 172.21.15.39:0/3258809833 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb958064e20 con 0x7fb95810a890 2024-05-09T05:27:35.850 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:34.793+0000 7fb94affd700 1 --2- 172.21.15.39:0/3258809833 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fb94403e470 0x7fb944040980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:27:35.850 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:34.793+0000 7fb94affd700 1 -- 172.21.15.39:0/3258809833 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fb94c0541f0 con 0x7fb95810a890 2024-05-09T05:27:35.850 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:34.793+0000 7fb95d760700 1 --2- 172.21.15.39:0/3258809833 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fb94403e470 0x7fb944040980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:27:35.850 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:34.793+0000 7fb95d760700 1 --2- 172.21.15.39:0/3258809833 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fb94403e470 0x7fb944040980 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb954006fd0 tx=0x7fb954006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:27:35.850 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:34.798+0000 7fb94affd700 1 -- 172.21.15.39:0/3258809833 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fb94c01f030 con 0x7fb95810a890 2024-05-09T05:27:35.850 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:34.856+0000 7fb94affd700 1 -- 172.21.15.39:0/3258809833 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7fb94c02cca0 con 0x7fb95810a890 2024-05-09T05:27:35.850 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:35.014+0000 7fb9601c5700 1 -- 172.21.15.39:0/3258809833 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) -- 0x7fb9581a1680 con 0x7fb95810a890 2024-05-09T05:27:35.850 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:35.015+0000 7fb94affd700 1 -- 172.21.15.39:0/3258809833 <== mon.0 v2:172.21.15.39:3300/0 8 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) ==== 127+0+0 (secure 0 0 0) 0x7fb94c021300 con 0x7fb95810a890 2024-05-09T05:27:35.850 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:35.017+0000 7fb9601c5700 1 -- 172.21.15.39:0/3258809833 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fb94403e470 msgr2=0x7fb944040980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:27:35.850 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:35.017+0000 7fb9601c5700 1 --2- 172.21.15.39:0/3258809833 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fb94403e470 0x7fb944040980 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb954006fd0 tx=0x7fb954006e40 comp rx=0 tx=0).stop 2024-05-09T05:27:35.850 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:35.017+0000 7fb9601c5700 1 -- 172.21.15.39:0/3258809833 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb95810a890 msgr2=0x7fb95819e0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:27:35.851 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:35.017+0000 7fb9601c5700 1 --2- 172.21.15.39:0/3258809833 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb95810a890 0x7fb95819e0d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb94c004660 tx=0x7fb94c011aa0 comp rx=0 tx=0).stop 2024-05-09T05:27:35.851 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:35.017+0000 7fb9601c5700 1 -- 172.21.15.39:0/3258809833 shutdown_connections 2024-05-09T05:27:35.851 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:35.017+0000 7fb9601c5700 1 --2- 172.21.15.39:0/3258809833 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fb94403e470 0x7fb944040980 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:27:35.851 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:35.017+0000 7fb9601c5700 1 --2- 172.21.15.39:0/3258809833 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb95810a890 0x7fb95819e0d0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:27:35.851 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:35.017+0000 7fb9601c5700 1 -- 172.21.15.39:0/3258809833 >> 172.21.15.39:0/3258809833 conn(0x7fb9581043d0 msgr2=0x7fb958105d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:27:35.851 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:35.017+0000 7fb9601c5700 1 -- 172.21.15.39:0/3258809833 shutdown_connections 2024-05-09T05:27:35.851 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:35.018+0000 7fb9601c5700 1 -- 172.21.15.39:0/3258809833 wait complete. 2024-05-09T05:27:36.111 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:35 smithi039 ceph-mon[30439]: mgrmap e13: x(active, since 6s) 2024-05-09T05:27:37.236 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:36.245+0000 7f27dc122700 1 Processor -- start 2024-05-09T05:27:37.236 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:36.245+0000 7f27dc122700 1 -- start start 2024-05-09T05:27:37.236 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:36.245+0000 7f27dc122700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f27d407d500 0x7f27d410c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:27:37.236 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:36.245+0000 7f27dc122700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f27d410cec0 con 0x7f27d407d500 2024-05-09T05:27:37.236 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:36.246+0000 7f27d9ebe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f27d407d500 0x7f27d410c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:27:37.237 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:36.246+0000 7f27d9ebe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f27d407d500 0x7f27d410c8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54226/0 (socket says 172.21.15.39:54226) 2024-05-09T05:27:37.237 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:36.246+0000 7f27d9ebe700 1 -- 172.21.15.39:0/1380903965 learned_addr learned my addr 172.21.15.39:0/1380903965 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:27:37.237 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:36.246+0000 7f27d9ebe700 1 -- 172.21.15.39:0/1380903965 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27d410d040 con 0x7f27d407d500 2024-05-09T05:27:37.237 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:36.246+0000 7f27d9ebe700 1 --2- 172.21.15.39:0/1380903965 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f27d407d500 0x7f27d410c8f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f27d00098a0 tx=0x7f27d0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4eac8d710a459d8 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:27:37.237 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:36.246+0000 7f27d8ebc700 1 -- 172.21.15.39:0/1380903965 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27d0004160 con 0x7f27d407d500 2024-05-09T05:27:37.237 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:36.246+0000 7f27d8ebc700 1 -- 172.21.15.39:0/1380903965 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f27d0004300 con 0x7f27d407d500 2024-05-09T05:27:37.237 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:36.246+0000 7f27d8ebc700 1 -- 172.21.15.39:0/1380903965 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27d0011a20 con 0x7f27d407d500 2024-05-09T05:27:37.237 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:36.247+0000 7f27dc122700 1 -- 172.21.15.39:0/1380903965 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f27d407d500 msgr2=0x7f27d410c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:27:37.237 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:36.247+0000 7f27dc122700 1 --2- 172.21.15.39:0/1380903965 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f27d407d500 0x7f27d410c8f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f27d00098a0 tx=0x7f27d0009bb0 comp rx=0 tx=0).stop 2024-05-09T05:27:37.237 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:36.247+0000 7f27dc122700 1 -- 172.21.15.39:0/1380903965 shutdown_connections 2024-05-09T05:27:37.237 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:36.247+0000 7f27dc122700 1 --2- 172.21.15.39:0/1380903965 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f27d407d500 0x7f27d410c8f0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:27:37.237 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:36.247+0000 7f27dc122700 1 -- 172.21.15.39:0/1380903965 >> 172.21.15.39:0/1380903965 conn(0x7f27d4104300 msgr2=0x7f27d4106770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:27:37.238 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:36.247+0000 7f27dc122700 1 -- 172.21.15.39:0/1380903965 shutdown_connections 2024-05-09T05:27:37.238 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:36.247+0000 7f27dc122700 1 -- 172.21.15.39:0/1380903965 wait complete. 2024-05-09T05:27:37.238 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:36.248+0000 7f27dc122700 1 Processor -- start 2024-05-09T05:27:37.238 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:36.248+0000 7f27dc122700 1 -- start start 2024-05-09T05:27:37.238 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:36.248+0000 7f27dc122700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f27d407d500 0x7f27d419e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:27:37.238 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:36.248+0000 7f27dc122700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f27d410e100 con 0x7f27d407d500 2024-05-09T05:27:37.238 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:36.248+0000 7f27d9ebe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f27d407d500 0x7f27d419e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:27:37.238 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:36.248+0000 7f27d9ebe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f27d407d500 0x7f27d419e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54234/0 (socket says 172.21.15.39:54234) 2024-05-09T05:27:37.238 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:36.248+0000 7f27d9ebe700 1 -- 172.21.15.39:0/1751808447 learned_addr learned my addr 172.21.15.39:0/1751808447 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:27:37.238 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:36.249+0000 7f27d9ebe700 1 -- 172.21.15.39:0/1751808447 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27d419e5c0 con 0x7f27d407d500 2024-05-09T05:27:37.238 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:36.249+0000 7f27d9ebe700 1 --2- 172.21.15.39:0/1751808447 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f27d407d500 0x7f27d419e080 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f27d0006af0 tx=0x7f27d0011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:27:37.238 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:36.249+0000 7f27caffd700 1 -- 172.21.15.39:0/1751808447 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27d0003b20 con 0x7f27d407d500 2024-05-09T05:27:37.238 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:36.249+0000 7f27dc122700 1 -- 172.21.15.39:0/1751808447 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27d419e850 con 0x7f27d407d500 2024-05-09T05:27:37.238 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:36.249+0000 7f27caffd700 1 -- 172.21.15.39:0/1751808447 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f27d001b8f0 con 0x7f27d407d500 2024-05-09T05:27:37.239 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:36.249+0000 7f27caffd700 1 -- 172.21.15.39:0/1751808447 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27d00238c0 con 0x7f27d407d500 2024-05-09T05:27:37.239 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:36.249+0000 7f27dc122700 1 -- 172.21.15.39:0/1751808447 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27d41a1460 con 0x7f27d407d500 2024-05-09T05:27:37.239 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:36.250+0000 7f27dc122700 1 -- 172.21.15.39:0/1751808447 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27d4064e20 con 0x7f27d407d500 2024-05-09T05:27:37.239 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:36.250+0000 7f27caffd700 1 -- 172.21.15.39:0/1751808447 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f27d0023b70 con 0x7f27d407d500 2024-05-09T05:27:37.239 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:36.251+0000 7f27caffd700 1 --2- 172.21.15.39:0/1751808447 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f27c003e510 0x7f27c0040a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:27:37.239 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:36.251+0000 7f27caffd700 1 -- 172.21.15.39:0/1751808447 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f27d0054330 con 0x7f27d407d500 2024-05-09T05:27:37.239 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:36.251+0000 7f27d96bd700 1 --2- 172.21.15.39:0/1751808447 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f27c003e510 0x7f27c0040a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:27:37.239 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:36.251+0000 7f27d96bd700 1 --2- 172.21.15.39:0/1751808447 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f27c003e510 0x7f27c0040a20 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f27c4006fd0 tx=0x7f27c4006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:27:37.239 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:36.256+0000 7f27caffd700 1 -- 172.21.15.39:0/1751808447 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f27d001f030 con 0x7f27d407d500 2024-05-09T05:27:37.239 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:36.587+0000 7f27dc122700 1 -- 172.21.15.39:0/1751808447 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7f27d41a1750 con 0x7f27d407d500 2024-05-09T05:27:37.239 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:36.590+0000 7f27caffd700 1 -- 172.21.15.39:0/1751808447 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v27)=0 set mgr/dashboard/cluster/status v27) ==== 153+0+0 (secure 0 0 0) 0x7f27d001b620 con 0x7f27d407d500 2024-05-09T05:27:37.239 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:36.592+0000 7f27dc122700 1 -- 172.21.15.39:0/1751808447 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f27c003e510 msgr2=0x7f27c0040a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:27:37.240 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:36.592+0000 7f27dc122700 1 --2- 172.21.15.39:0/1751808447 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f27c003e510 0x7f27c0040a20 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f27c4006fd0 tx=0x7f27c4006e40 comp rx=0 tx=0).stop 2024-05-09T05:27:37.240 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:36.592+0000 7f27dc122700 1 -- 172.21.15.39:0/1751808447 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f27d407d500 msgr2=0x7f27d419e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:27:37.240 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:36.592+0000 7f27dc122700 1 --2- 172.21.15.39:0/1751808447 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f27d407d500 0x7f27d419e080 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f27d0006af0 tx=0x7f27d0011aa0 comp rx=0 tx=0).stop 2024-05-09T05:27:37.240 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:36.592+0000 7f27dc122700 1 -- 172.21.15.39:0/1751808447 shutdown_connections 2024-05-09T05:27:37.240 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:36.592+0000 7f27dc122700 1 --2- 172.21.15.39:0/1751808447 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f27c003e510 0x7f27c0040a20 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:27:37.240 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:36.592+0000 7f27dc122700 1 --2- 172.21.15.39:0/1751808447 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f27d407d500 0x7f27d419e080 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:27:37.240 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:36.592+0000 7f27dc122700 1 -- 172.21.15.39:0/1751808447 >> 172.21.15.39:0/1751808447 conn(0x7f27d4104300 msgr2=0x7f27d4104b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:27:37.240 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:36.592+0000 7f27dc122700 1 -- 172.21.15.39:0/1751808447 shutdown_connections 2024-05-09T05:27:37.240 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr 2024-05-09T05:27:36.592+0000 7f27dc122700 1 -- 172.21.15.39:0/1751808447 wait complete. 2024-05-09T05:27:37.240 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-05-09T05:27:37.240 INFO:teuthology.orchestra.run.smithi039.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-05-09T05:27:37.240 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-09T05:27:37.240 INFO:teuthology.orchestra.run.smithi039.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-05-09T05:27:37.240 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-09T05:27:37.241 INFO:teuthology.orchestra.run.smithi039.stdout:Or, if you are only running a single cluster on this host: 2024-05-09T05:27:37.241 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-09T05:27:37.241 INFO:teuthology.orchestra.run.smithi039.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-05-09T05:27:37.242 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-09T05:27:37.242 INFO:teuthology.orchestra.run.smithi039.stdout:Please consider enabling telemetry to help improve Ceph: 2024-05-09T05:27:37.242 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-09T05:27:37.242 INFO:teuthology.orchestra.run.smithi039.stdout: ceph telemetry on 2024-05-09T05:27:37.242 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-09T05:27:37.242 INFO:teuthology.orchestra.run.smithi039.stdout:For more information see: 2024-05-09T05:27:37.242 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-09T05:27:37.242 INFO:teuthology.orchestra.run.smithi039.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-05-09T05:27:37.242 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-09T05:27:37.242 INFO:teuthology.orchestra.run.smithi039.stdout:Bootstrap complete. 2024-05-09T05:27:37.276 INFO:tasks.cephadm:Fetching config... 2024-05-09T05:27:37.276 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-05-09T05:27:37.276 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-05-09T05:27:37.294 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-05-09T05:27:37.294 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-05-09T05:27:37.294 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-05-09T05:27:37.351 INFO:tasks.cephadm:Fetching mon keyring... 2024-05-09T05:27:37.352 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-05-09T05:27:37.352 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/keyring of=/dev/stdout 2024-05-09T05:27:37.420 INFO:tasks.cephadm:Fetching pub ssh key... 2024-05-09T05:27:37.420 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-05-09T05:27:37.420 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-05-09T05:27:37.477 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-05-09T05:27:37.477 DEBUG:teuthology.orchestra.run.smithi039:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC5cAw5nNw3w8j10PeIBbyqRaxdHF1dwKvSJh++B46vwQeQKPUH+qIjrvpCMBN6mIb1h/t8KGic9kLjBlIotyCYlTfjIlRGqxzZI9ChAEEVN/6XaQRvfqIWft0d/5YCkFisaeym2YNFC81NZXcmPiuCcocc4R3ibNeI+2HCLovwPf2ZuCbtKyETC115RPDoSz0S0qpshdgFL8sFY7LkiZuGhRahdIXJH7ZMWwfo2d4q+/y4CVshdtBGnpnz17OJiZDlInzBOC+ghXcOGVulyJiLY730EATJUYztgZrtWA6BwsgNO6EHbyZeFtQL9S4rznmFWxa1PPKDtR1XW9HiL9jkHxGpag4OpKrW/0nmTUEYKISFTN6eZYN5R217/eqQpLUUmHBRtUObYEzyyU+VI3ixDC756yl3gd8W0lv3z1nor8yLL436ZAiNxkgut3f84NsQDWpazMkPdx4wVSgnJd/YRfPd15WzDvAN44KqvPf3WPJsl8fRy6eLB0W1IDw6IYE= ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-05-09T05:27:37.563 INFO:teuthology.orchestra.run.smithi039.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC5cAw5nNw3w8j10PeIBbyqRaxdHF1dwKvSJh++B46vwQeQKPUH+qIjrvpCMBN6mIb1h/t8KGic9kLjBlIotyCYlTfjIlRGqxzZI9ChAEEVN/6XaQRvfqIWft0d/5YCkFisaeym2YNFC81NZXcmPiuCcocc4R3ibNeI+2HCLovwPf2ZuCbtKyETC115RPDoSz0S0qpshdgFL8sFY7LkiZuGhRahdIXJH7ZMWwfo2d4q+/y4CVshdtBGnpnz17OJiZDlInzBOC+ghXcOGVulyJiLY730EATJUYztgZrtWA6BwsgNO6EHbyZeFtQL9S4rznmFWxa1PPKDtR1XW9HiL9jkHxGpag4OpKrW/0nmTUEYKISFTN6eZYN5R217/eqQpLUUmHBRtUObYEzyyU+VI3ixDC756yl3gd8W0lv3z1nor8yLL436ZAiNxkgut3f84NsQDWpazMkPdx4wVSgnJd/YRfPd15WzDvAN44KqvPf3WPJsl8fRy6eLB0W1IDw6IYE= ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968 2024-05-09T05:27:37.575 DEBUG:teuthology.orchestra.run.smithi060:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC5cAw5nNw3w8j10PeIBbyqRaxdHF1dwKvSJh++B46vwQeQKPUH+qIjrvpCMBN6mIb1h/t8KGic9kLjBlIotyCYlTfjIlRGqxzZI9ChAEEVN/6XaQRvfqIWft0d/5YCkFisaeym2YNFC81NZXcmPiuCcocc4R3ibNeI+2HCLovwPf2ZuCbtKyETC115RPDoSz0S0qpshdgFL8sFY7LkiZuGhRahdIXJH7ZMWwfo2d4q+/y4CVshdtBGnpnz17OJiZDlInzBOC+ghXcOGVulyJiLY730EATJUYztgZrtWA6BwsgNO6EHbyZeFtQL9S4rznmFWxa1PPKDtR1XW9HiL9jkHxGpag4OpKrW/0nmTUEYKISFTN6eZYN5R217/eqQpLUUmHBRtUObYEzyyU+VI3ixDC756yl3gd8W0lv3z1nor8yLL436ZAiNxkgut3f84NsQDWpazMkPdx4wVSgnJd/YRfPd15WzDvAN44KqvPf3WPJsl8fRy6eLB0W1IDw6IYE= ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-05-09T05:27:37.615 INFO:teuthology.orchestra.run.smithi060.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC5cAw5nNw3w8j10PeIBbyqRaxdHF1dwKvSJh++B46vwQeQKPUH+qIjrvpCMBN6mIb1h/t8KGic9kLjBlIotyCYlTfjIlRGqxzZI9ChAEEVN/6XaQRvfqIWft0d/5YCkFisaeym2YNFC81NZXcmPiuCcocc4R3ibNeI+2HCLovwPf2ZuCbtKyETC115RPDoSz0S0qpshdgFL8sFY7LkiZuGhRahdIXJH7ZMWwfo2d4q+/y4CVshdtBGnpnz17OJiZDlInzBOC+ghXcOGVulyJiLY730EATJUYztgZrtWA6BwsgNO6EHbyZeFtQL9S4rznmFWxa1PPKDtR1XW9HiL9jkHxGpag4OpKrW/0nmTUEYKISFTN6eZYN5R217/eqQpLUUmHBRtUObYEzyyU+VI3ixDC756yl3gd8W0lv3z1nor8yLL436ZAiNxkgut3f84NsQDWpazMkPdx4wVSgnJd/YRfPd15WzDvAN44KqvPf3WPJsl8fRy6eLB0W1IDw6IYE= ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968 2024-05-09T05:27:37.627 DEBUG:teuthology.orchestra.run.smithi100:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC5cAw5nNw3w8j10PeIBbyqRaxdHF1dwKvSJh++B46vwQeQKPUH+qIjrvpCMBN6mIb1h/t8KGic9kLjBlIotyCYlTfjIlRGqxzZI9ChAEEVN/6XaQRvfqIWft0d/5YCkFisaeym2YNFC81NZXcmPiuCcocc4R3ibNeI+2HCLovwPf2ZuCbtKyETC115RPDoSz0S0qpshdgFL8sFY7LkiZuGhRahdIXJH7ZMWwfo2d4q+/y4CVshdtBGnpnz17OJiZDlInzBOC+ghXcOGVulyJiLY730EATJUYztgZrtWA6BwsgNO6EHbyZeFtQL9S4rznmFWxa1PPKDtR1XW9HiL9jkHxGpag4OpKrW/0nmTUEYKISFTN6eZYN5R217/eqQpLUUmHBRtUObYEzyyU+VI3ixDC756yl3gd8W0lv3z1nor8yLL436ZAiNxkgut3f84NsQDWpazMkPdx4wVSgnJd/YRfPd15WzDvAN44KqvPf3WPJsl8fRy6eLB0W1IDw6IYE= ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-05-09T05:27:37.668 INFO:teuthology.orchestra.run.smithi100.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC5cAw5nNw3w8j10PeIBbyqRaxdHF1dwKvSJh++B46vwQeQKPUH+qIjrvpCMBN6mIb1h/t8KGic9kLjBlIotyCYlTfjIlRGqxzZI9ChAEEVN/6XaQRvfqIWft0d/5YCkFisaeym2YNFC81NZXcmPiuCcocc4R3ibNeI+2HCLovwPf2ZuCbtKyETC115RPDoSz0S0qpshdgFL8sFY7LkiZuGhRahdIXJH7ZMWwfo2d4q+/y4CVshdtBGnpnz17OJiZDlInzBOC+ghXcOGVulyJiLY730EATJUYztgZrtWA6BwsgNO6EHbyZeFtQL9S4rznmFWxa1PPKDtR1XW9HiL9jkHxGpag4OpKrW/0nmTUEYKISFTN6eZYN5R217/eqQpLUUmHBRtUObYEzyyU+VI3ixDC756yl3gd8W0lv3z1nor8yLL436ZAiNxkgut3f84NsQDWpazMkPdx4wVSgnJd/YRfPd15WzDvAN44KqvPf3WPJsl8fRy6eLB0W1IDw6IYE= ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968 2024-05-09T05:27:37.679 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-05-09T05:27:37.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:37 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/1751808447' entity='client.admin' 2024-05-09T05:27:37.931 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T05:27:39.966 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:39.970+0000 7fd5bfd9a700 1 -- 172.21.15.39:0/2633384733 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd5b8102ae0 msgr2=0x7fd5b8102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:27:39.966 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:39.970+0000 7fd5bfd9a700 1 --2- 172.21.15.39:0/2633384733 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd5b8102ae0 0x7fd5b8102ef0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd5b4009910 tx=0x7fd5b4009c20 comp rx=0 tx=0).stop 2024-05-09T05:27:39.967 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:39.970+0000 7fd5bfd9a700 1 -- 172.21.15.39:0/2633384733 shutdown_connections 2024-05-09T05:27:39.967 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:39.970+0000 7fd5bfd9a700 1 --2- 172.21.15.39:0/2633384733 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd5b8102ae0 0x7fd5b8102ef0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:27:39.967 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:39.970+0000 7fd5bfd9a700 1 -- 172.21.15.39:0/2633384733 >> 172.21.15.39:0/2633384733 conn(0x7fd5b80fe140 msgr2=0x7fd5b81005d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:27:39.967 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:39.970+0000 7fd5bfd9a700 1 -- 172.21.15.39:0/2633384733 shutdown_connections 2024-05-09T05:27:39.967 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:39.970+0000 7fd5bfd9a700 1 -- 172.21.15.39:0/2633384733 wait complete. 2024-05-09T05:27:39.967 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:39.971+0000 7fd5bfd9a700 1 Processor -- start 2024-05-09T05:27:39.967 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:39.971+0000 7fd5bfd9a700 1 -- start start 2024-05-09T05:27:39.967 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:39.971+0000 7fd5bfd9a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd5b8102ae0 0x7fd5b806c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:27:39.967 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:39.971+0000 7fd5bfd9a700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fd5b8108aa0 con 0x7fd5b8102ae0 2024-05-09T05:27:39.967 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:39.971+0000 7fd5bdb36700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd5b8102ae0 0x7fd5b806c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:27:39.967 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:39.971+0000 7fd5bdb36700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd5b8102ae0 0x7fd5b806c460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:58550/0 (socket says 172.21.15.39:58550) 2024-05-09T05:27:39.967 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:39.971+0000 7fd5bdb36700 1 -- 172.21.15.39:0/2808622395 learned_addr learned my addr 172.21.15.39:0/2808622395 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:27:39.967 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:39.972+0000 7fd5bdb36700 1 -- 172.21.15.39:0/2808622395 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5b806c9a0 con 0x7fd5b8102ae0 2024-05-09T05:27:39.968 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:39.972+0000 7fd5bdb36700 1 --2- 172.21.15.39:0/2808622395 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd5b8102ae0 0x7fd5b806c460 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd5b40057d0 tx=0x7fd5b4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:27:39.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:39.972+0000 7fd5aeffd700 1 -- 172.21.15.39:0/2808622395 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5b4027070 con 0x7fd5b8102ae0 2024-05-09T05:27:39.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:39.972+0000 7fd5aeffd700 1 -- 172.21.15.39:0/2808622395 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd5b400be10 con 0x7fd5b8102ae0 2024-05-09T05:27:39.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:39.972+0000 7fd5bfd9a700 1 -- 172.21.15.39:0/2808622395 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5b819c4d0 con 0x7fd5b8102ae0 2024-05-09T05:27:39.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:39.972+0000 7fd5aeffd700 1 -- 172.21.15.39:0/2808622395 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5b4022dd0 con 0x7fd5b8102ae0 2024-05-09T05:27:39.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:39.972+0000 7fd5bfd9a700 1 -- 172.21.15.39:0/2808622395 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5b819c950 con 0x7fd5b8102ae0 2024-05-09T05:27:39.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:39.973+0000 7fd5aeffd700 1 -- 172.21.15.39:0/2808622395 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7fd5b402a070 con 0x7fd5b8102ae0 2024-05-09T05:27:39.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:39.973+0000 7fd5bfd9a700 1 -- 172.21.15.39:0/2808622395 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5b8109220 con 0x7fd5b8102ae0 2024-05-09T05:27:39.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:39.973+0000 7fd5aeffd700 1 --2- 172.21.15.39:0/2808622395 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fd5a403e510 0x7fd5a4040a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:27:39.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:39.973+0000 7fd5aeffd700 1 -- 172.21.15.39:0/2808622395 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fd5b401e030 con 0x7fd5b8102ae0 2024-05-09T05:27:39.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:39.973+0000 7fd5bd335700 1 --2- 172.21.15.39:0/2808622395 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fd5a403e510 0x7fd5a4040a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:27:39.970 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:39.974+0000 7fd5bd335700 1 --2- 172.21.15.39:0/2808622395 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fd5a403e510 0x7fd5a4040a20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd5a8006fd0 tx=0x7fd5a8006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:27:39.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:39.979+0000 7fd5aeffd700 1 -- 172.21.15.39:0/2808622395 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fd5b4013070 con 0x7fd5b8102ae0 2024-05-09T05:27:40.188 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:40.194+0000 7fd5bfd9a700 1 -- 172.21.15.39:0/2808622395 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7fd5b802e870 con 0x7fd5b8102ae0 2024-05-09T05:27:40.191 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:40.196+0000 7fd5aeffd700 1 -- 172.21.15.39:0/2808622395 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7fd5b40310c0 con 0x7fd5b8102ae0 2024-05-09T05:27:40.193 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:40.198+0000 7fd5bfd9a700 1 -- 172.21.15.39:0/2808622395 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fd5a403e510 msgr2=0x7fd5a4040a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:27:40.193 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:40.198+0000 7fd5bfd9a700 1 --2- 172.21.15.39:0/2808622395 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fd5a403e510 0x7fd5a4040a20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd5a8006fd0 tx=0x7fd5a8006e40 comp rx=0 tx=0).stop 2024-05-09T05:27:40.194 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:40.198+0000 7fd5bfd9a700 1 -- 172.21.15.39:0/2808622395 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd5b8102ae0 msgr2=0x7fd5b806c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:27:40.194 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:40.198+0000 7fd5bfd9a700 1 --2- 172.21.15.39:0/2808622395 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd5b8102ae0 0x7fd5b806c460 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd5b40057d0 tx=0x7fd5b4005800 comp rx=0 tx=0).stop 2024-05-09T05:27:40.194 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:40.199+0000 7fd5bfd9a700 1 -- 172.21.15.39:0/2808622395 shutdown_connections 2024-05-09T05:27:40.194 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:40.199+0000 7fd5bfd9a700 1 --2- 172.21.15.39:0/2808622395 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fd5a403e510 0x7fd5a4040a20 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:27:40.194 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:40.199+0000 7fd5bfd9a700 1 --2- 172.21.15.39:0/2808622395 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd5b8102ae0 0x7fd5b806c460 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:27:40.194 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:40.199+0000 7fd5bfd9a700 1 -- 172.21.15.39:0/2808622395 >> 172.21.15.39:0/2808622395 conn(0x7fd5b80fe140 msgr2=0x7fd5b80fee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:27:40.194 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:40.199+0000 7fd5bfd9a700 1 -- 172.21.15.39:0/2808622395 shutdown_connections 2024-05-09T05:27:40.194 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:40.199+0000 7fd5bfd9a700 1 -- 172.21.15.39:0/2808622395 wait complete. 2024-05-09T05:27:40.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:40 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:27:40.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:40 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:27:40.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:40 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi039", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:27:40.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:40 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:27:40.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:40 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:27:40.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:40 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:27:40.846 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-05-09T05:27:40.846 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-05-09T05:27:41.100 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T05:27:41.529 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:41 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/2808622395' entity='client.admin' 2024-05-09T05:27:41.529 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:41 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:27:41.529 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:41 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:27:42.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:42.567+0000 7f86f9601700 1 -- 172.21.15.39:0/3289534161 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f86f4102f00 msgr2=0x7f86f4103310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:27:42.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:42.567+0000 7f86f9601700 1 --2- 172.21.15.39:0/3289534161 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f86f4102f00 0x7f86f4103310 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f86e400b0a0 tx=0x7f86e400b3b0 comp rx=0 tx=0).stop 2024-05-09T05:27:42.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:42.568+0000 7f86f9601700 1 -- 172.21.15.39:0/3289534161 shutdown_connections 2024-05-09T05:27:42.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:42.568+0000 7f86f9601700 1 --2- 172.21.15.39:0/3289534161 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f86f4102f00 0x7f86f4103310 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:27:42.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:42.568+0000 7f86f9601700 1 -- 172.21.15.39:0/3289534161 >> 172.21.15.39:0/3289534161 conn(0x7f86f40fd6d0 msgr2=0x7f86f40ffba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:27:42.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:42.568+0000 7f86f9601700 1 -- 172.21.15.39:0/3289534161 shutdown_connections 2024-05-09T05:27:42.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:42.568+0000 7f86f9601700 1 -- 172.21.15.39:0/3289534161 wait complete. 2024-05-09T05:27:42.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:42.568+0000 7f86f9601700 1 Processor -- start 2024-05-09T05:27:42.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:42.569+0000 7f86f9601700 1 -- start start 2024-05-09T05:27:42.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:42.569+0000 7f86f9601700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f86f4102f00 0x7f86f4199570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:27:42.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:42.569+0000 7f86f9601700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f86f41088f0 con 0x7f86f4102f00 2024-05-09T05:27:42.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:42.569+0000 7f86f2ffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f86f4102f00 0x7f86f4199570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:27:42.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:42.569+0000 7f86f2ffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f86f4102f00 0x7f86f4199570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:58566/0 (socket says 172.21.15.39:58566) 2024-05-09T05:27:42.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:42.569+0000 7f86f2ffd700 1 -- 172.21.15.39:0/2801899335 learned_addr learned my addr 172.21.15.39:0/2801899335 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:27:42.567 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:42.569+0000 7f86f2ffd700 1 -- 172.21.15.39:0/2801899335 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86f4199ab0 con 0x7f86f4102f00 2024-05-09T05:27:42.567 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:42.569+0000 7f86f2ffd700 1 --2- 172.21.15.39:0/2801899335 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f86f4102f00 0x7f86f4199570 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f86e4015040 tx=0x7f86e4003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:27:42.567 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:42.570+0000 7f86ebfff700 1 -- 172.21.15.39:0/2801899335 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86e4021020 con 0x7f86f4102f00 2024-05-09T05:27:42.567 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:42.570+0000 7f86ebfff700 1 -- 172.21.15.39:0/2801899335 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f86e400bdd0 con 0x7f86f4102f00 2024-05-09T05:27:42.567 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:42.570+0000 7f86f9601700 1 -- 172.21.15.39:0/2801899335 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86f4199d40 con 0x7f86f4102f00 2024-05-09T05:27:42.567 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:42.570+0000 7f86ebfff700 1 -- 172.21.15.39:0/2801899335 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f86e4017040 con 0x7f86f4102f00 2024-05-09T05:27:42.567 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:42.570+0000 7f86f9601700 1 -- 172.21.15.39:0/2801899335 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86f419c950 con 0x7f86f4102f00 2024-05-09T05:27:42.567 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:42.571+0000 7f86f9601700 1 -- 172.21.15.39:0/2801899335 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86f4109070 con 0x7f86f4102f00 2024-05-09T05:27:42.567 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:42.571+0000 7f86ebfff700 1 -- 172.21.15.39:0/2801899335 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f86e4024020 con 0x7f86f4102f00 2024-05-09T05:27:42.567 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:42.571+0000 7f86ebfff700 1 --2- 172.21.15.39:0/2801899335 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f86e003e570 0x7f86e0040a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:27:42.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:42.571+0000 7f86ebfff700 1 -- 172.21.15.39:0/2801899335 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f86e400f050 con 0x7f86f4102f00 2024-05-09T05:27:42.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:42.571+0000 7f86f27fc700 1 --2- 172.21.15.39:0/2801899335 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f86e003e570 0x7f86e0040a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:27:42.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:42.571+0000 7f86f27fc700 1 --2- 172.21.15.39:0/2801899335 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f86e003e570 0x7f86e0040a80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f86dc006fd0 tx=0x7f86dc006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:27:42.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:42.576+0000 7f86ebfff700 1 -- 172.21.15.39:0/2801899335 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f86e402b020 con 0x7f86f4102f00 2024-05-09T05:27:42.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:42.792+0000 7f86f9601700 1 -- 172.21.15.39:0/2801899335 --> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7f86f4063c00 con 0x7f86e003e570 2024-05-09T05:27:42.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:42.801+0000 7f86ebfff700 1 -- 172.21.15.39:0/2801899335 <== mgr.14152 v2:172.21.15.39:6800/3184189003 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f86f4063c00 con 0x7f86e003e570 2024-05-09T05:27:42.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:42.803+0000 7f86f9601700 1 -- 172.21.15.39:0/2801899335 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f86e003e570 msgr2=0x7f86e0040a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:27:42.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:42.803+0000 7f86f9601700 1 --2- 172.21.15.39:0/2801899335 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f86e003e570 0x7f86e0040a80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f86dc006fd0 tx=0x7f86dc006e40 comp rx=0 tx=0).stop 2024-05-09T05:27:42.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:42.803+0000 7f86f9601700 1 -- 172.21.15.39:0/2801899335 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f86f4102f00 msgr2=0x7f86f4199570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:27:42.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:42.803+0000 7f86f9601700 1 --2- 172.21.15.39:0/2801899335 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f86f4102f00 0x7f86f4199570 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f86e4015040 tx=0x7f86e4003ce0 comp rx=0 tx=0).stop 2024-05-09T05:27:42.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:42.803+0000 7f86f9601700 1 -- 172.21.15.39:0/2801899335 shutdown_connections 2024-05-09T05:27:42.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:42.803+0000 7f86f9601700 1 --2- 172.21.15.39:0/2801899335 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f86e003e570 0x7f86e0040a80 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:27:42.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:42.803+0000 7f86f9601700 1 --2- 172.21.15.39:0/2801899335 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f86f4102f00 0x7f86f4199570 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:27:42.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:42.803+0000 7f86f9601700 1 -- 172.21.15.39:0/2801899335 >> 172.21.15.39:0/2801899335 conn(0x7f86f40fd6d0 msgr2=0x7f86f41021c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:27:42.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:42.803+0000 7f86f9601700 1 -- 172.21.15.39:0/2801899335 shutdown_connections 2024-05-09T05:27:42.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:42.803+0000 7f86f9601700 1 -- 172.21.15.39:0/2801899335 wait complete. 2024-05-09T05:27:43.561 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi060 2024-05-09T05:27:43.561 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-05-09T05:27:43.561 DEBUG:teuthology.orchestra.run.smithi060:> dd of=/etc/ceph/ceph.conf 2024-05-09T05:27:43.580 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-05-09T05:27:43.580 DEBUG:teuthology.orchestra.run.smithi060:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-09T05:27:43.638 INFO:tasks.cephadm:Adding host smithi060 to orchestrator... 2024-05-09T05:27:43.638 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph orch host add smithi060 2024-05-09T05:27:43.891 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T05:27:44.111 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:43 smithi039 ceph-mon[30439]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T05:27:44.111 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:43 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:27:44.111 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:43 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:27:44.111 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:43 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:27:44.111 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:43 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:27:44.111 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:43 smithi039 ceph-mon[30439]: Updating smithi039:/etc/ceph/ceph.conf 2024-05-09T05:27:44.111 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:43 smithi039 ceph-mon[30439]: Updating smithi039:/var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T05:27:44.111 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:43 smithi039 ceph-mon[30439]: Updating smithi039:/etc/ceph/ceph.client.admin.keyring 2024-05-09T05:27:45.190 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:44 smithi039 ceph-mon[30439]: Updating smithi039:/var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-09T05:27:45.190 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:44 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:27:45.190 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:44 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:27:45.190 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:44 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:27:45.431 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:45.436+0000 7fb3fd4fd700 1 -- 172.21.15.39:0/1464572632 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb3f8108a70 msgr2=0x7fb3f8108e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:27:45.431 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:45.436+0000 7fb3fd4fd700 1 --2- 172.21.15.39:0/1464572632 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb3f8108a70 0x7fb3f8108e80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb3e8009910 tx=0x7fb3e8009c20 comp rx=0 tx=0).stop 2024-05-09T05:27:45.431 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:45.436+0000 7fb3fd4fd700 1 -- 172.21.15.39:0/1464572632 shutdown_connections 2024-05-09T05:27:45.431 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:45.436+0000 7fb3fd4fd700 1 --2- 172.21.15.39:0/1464572632 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb3f8108a70 0x7fb3f8108e80 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:27:45.431 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:45.436+0000 7fb3fd4fd700 1 -- 172.21.15.39:0/1464572632 >> 172.21.15.39:0/1464572632 conn(0x7fb3f80fe5c0 msgr2=0x7fb3f8100a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:27:45.431 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:45.436+0000 7fb3fd4fd700 1 -- 172.21.15.39:0/1464572632 shutdown_connections 2024-05-09T05:27:45.432 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:45.436+0000 7fb3fd4fd700 1 -- 172.21.15.39:0/1464572632 wait complete. 2024-05-09T05:27:45.432 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:45.437+0000 7fb3fd4fd700 1 Processor -- start 2024-05-09T05:27:45.433 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:45.437+0000 7fb3fd4fd700 1 -- start start 2024-05-09T05:27:45.433 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:45.437+0000 7fb3fd4fd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb3f8108a70 0x7fb3f819a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:27:45.433 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:45.437+0000 7fb3fd4fd700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fb3f810cfc0 con 0x7fb3f8108a70 2024-05-09T05:27:45.433 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:45.437+0000 7fb3f6ffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb3f8108a70 0x7fb3f819a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:27:45.433 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:45.437+0000 7fb3f6ffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb3f8108a70 0x7fb3f819a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:58596/0 (socket says 172.21.15.39:58596) 2024-05-09T05:27:45.433 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:45.437+0000 7fb3f6ffd700 1 -- 172.21.15.39:0/314194046 learned_addr learned my addr 172.21.15.39:0/314194046 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:27:45.434 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:45.437+0000 7fb3f6ffd700 1 -- 172.21.15.39:0/314194046 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3f806ca70 con 0x7fb3f8108a70 2024-05-09T05:27:45.434 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:45.438+0000 7fb3f6ffd700 1 --2- 172.21.15.39:0/314194046 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb3f8108a70 0x7fb3f819a780 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb3e80056d0 tx=0x7fb3e80057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:27:45.434 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:45.438+0000 7fb3dffff700 1 -- 172.21.15.39:0/314194046 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3e8027070 con 0x7fb3f8108a70 2024-05-09T05:27:45.434 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:45.438+0000 7fb3dffff700 1 -- 172.21.15.39:0/314194046 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb3e800be10 con 0x7fb3f8108a70 2024-05-09T05:27:45.434 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:45.438+0000 7fb3dffff700 1 -- 172.21.15.39:0/314194046 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3e8022d20 con 0x7fb3f8108a70 2024-05-09T05:27:45.434 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:45.438+0000 7fb3fd4fd700 1 -- 172.21.15.39:0/314194046 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3f819ad80 con 0x7fb3f8108a70 2024-05-09T05:27:45.434 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:45.438+0000 7fb3fd4fd700 1 -- 172.21.15.39:0/314194046 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3f819b240 con 0x7fb3f8108a70 2024-05-09T05:27:45.435 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:45.439+0000 7fb3dffff700 1 -- 172.21.15.39:0/314194046 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7fb3e802a070 con 0x7fb3f8108a70 2024-05-09T05:27:45.435 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:45.439+0000 7fb3fd4fd700 1 -- 172.21.15.39:0/314194046 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3f8104180 con 0x7fb3f8108a70 2024-05-09T05:27:45.435 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:45.439+0000 7fb3dffff700 1 --2- 172.21.15.39:0/314194046 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fb3e003e570 0x7fb3e0040a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:27:45.435 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:45.439+0000 7fb3dffff700 1 -- 172.21.15.39:0/314194046 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fb3e801e030 con 0x7fb3f8108a70 2024-05-09T05:27:45.435 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:45.439+0000 7fb3f67fc700 1 --2- 172.21.15.39:0/314194046 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fb3e003e570 0x7fb3e0040a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:27:45.435 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:45.440+0000 7fb3f67fc700 1 --2- 172.21.15.39:0/314194046 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fb3e003e570 0x7fb3e0040a80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb3ec006fd0 tx=0x7fb3ec006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:27:45.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:45.445+0000 7fb3dffff700 1 -- 172.21.15.39:0/314194046 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fb3e8013070 con 0x7fb3f8108a70 2024-05-09T05:27:45.659 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:45.664+0000 7fb3fd4fd700 1 -- 172.21.15.39:0/314194046 --> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi060", "target": ["mon-mgr", ""]}) -- 0x7fb3f806c1c0 con 0x7fb3e003e570 2024-05-09T05:27:46.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:46 smithi039 ceph-mon[30439]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi060", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T05:27:46.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:46 smithi039 ceph-mon[30439]: Deploying cephadm binary to smithi060 2024-05-09T05:27:49.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:49 smithi039 ceph-mon[30439]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:27:49.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:50.004+0000 7fb3dffff700 1 -- 172.21.15.39:0/314194046 <== mgr.14152 v2:172.21.15.39:6800/3184189003 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7fb3f806c1c0 con 0x7fb3e003e570 2024-05-09T05:27:49.999 INFO:teuthology.orchestra.run.smithi039.stdout:Added host 'smithi060' with addr '172.21.15.60' 2024-05-09T05:27:50.002 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:50.006+0000 7fb3fd4fd700 1 -- 172.21.15.39:0/314194046 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fb3e003e570 msgr2=0x7fb3e0040a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:27:50.002 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:50.006+0000 7fb3fd4fd700 1 --2- 172.21.15.39:0/314194046 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fb3e003e570 0x7fb3e0040a80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb3ec006fd0 tx=0x7fb3ec006e40 comp rx=0 tx=0).stop 2024-05-09T05:27:50.002 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:50.006+0000 7fb3fd4fd700 1 -- 172.21.15.39:0/314194046 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb3f8108a70 msgr2=0x7fb3f819a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:27:50.002 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:50.006+0000 7fb3fd4fd700 1 --2- 172.21.15.39:0/314194046 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb3f8108a70 0x7fb3f819a780 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb3e80056d0 tx=0x7fb3e80057b0 comp rx=0 tx=0).stop 2024-05-09T05:27:50.002 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:50.006+0000 7fb3fd4fd700 1 -- 172.21.15.39:0/314194046 shutdown_connections 2024-05-09T05:27:50.003 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:50.006+0000 7fb3fd4fd700 1 --2- 172.21.15.39:0/314194046 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fb3e003e570 0x7fb3e0040a80 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:27:50.003 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:50.006+0000 7fb3fd4fd700 1 --2- 172.21.15.39:0/314194046 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb3f8108a70 0x7fb3f819a780 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:27:50.003 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:50.006+0000 7fb3fd4fd700 1 -- 172.21.15.39:0/314194046 >> 172.21.15.39:0/314194046 conn(0x7fb3f80fe5c0 msgr2=0x7fb3f80ff4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:27:50.004 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:50.007+0000 7fb3fd4fd700 1 -- 172.21.15.39:0/314194046 shutdown_connections 2024-05-09T05:27:50.004 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:50.007+0000 7fb3fd4fd700 1 -- 172.21.15.39:0/314194046 wait complete. 2024-05-09T05:27:50.672 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph orch host ls --format=json 2024-05-09T05:27:50.920 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T05:27:51.326 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:51 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:27:51.326 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:51 smithi039 ceph-mon[30439]: Added host smithi060 2024-05-09T05:27:51.326 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:51 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:27:51.326 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:51 smithi039 ceph-mon[30439]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:27:51.326 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:51 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:27:52.231 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:52 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:27:52.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:52.479+0000 7fa19b4eb700 1 -- 172.21.15.39:0/446631674 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa194104cf0 msgr2=0x7fa194105100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:27:52.475 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:52.479+0000 7fa19b4eb700 1 --2- 172.21.15.39:0/446631674 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa194104cf0 0x7fa194105100 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa18400b0a0 tx=0x7fa18400b3b0 comp rx=0 tx=0).stop 2024-05-09T05:27:52.475 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:52.479+0000 7fa19b4eb700 1 -- 172.21.15.39:0/446631674 shutdown_connections 2024-05-09T05:27:52.475 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:52.479+0000 7fa19b4eb700 1 --2- 172.21.15.39:0/446631674 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa194104cf0 0x7fa194105100 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:27:52.475 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:52.479+0000 7fa19b4eb700 1 -- 172.21.15.39:0/446631674 >> 172.21.15.39:0/446631674 conn(0x7fa1940785b0 msgr2=0x7fa194078a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:27:52.475 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:52.479+0000 7fa19b4eb700 1 -- 172.21.15.39:0/446631674 shutdown_connections 2024-05-09T05:27:52.475 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:52.479+0000 7fa19b4eb700 1 -- 172.21.15.39:0/446631674 wait complete. 2024-05-09T05:27:52.476 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:52.480+0000 7fa19b4eb700 1 Processor -- start 2024-05-09T05:27:52.476 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:52.480+0000 7fa19b4eb700 1 -- start start 2024-05-09T05:27:52.476 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:52.480+0000 7fa19b4eb700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa194104cf0 0x7fa19419f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:27:52.476 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:52.480+0000 7fa19b4eb700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fa19410e150 con 0x7fa194104cf0 2024-05-09T05:27:52.476 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:52.480+0000 7fa199287700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa194104cf0 0x7fa19419f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:27:52.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:52.480+0000 7fa199287700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa194104cf0 0x7fa19419f5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47646/0 (socket says 172.21.15.39:47646) 2024-05-09T05:27:52.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:52.480+0000 7fa199287700 1 -- 172.21.15.39:0/1387359894 learned_addr learned my addr 172.21.15.39:0/1387359894 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:27:52.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:52.481+0000 7fa199287700 1 -- 172.21.15.39:0/1387359894 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa19419fae0 con 0x7fa194104cf0 2024-05-09T05:27:52.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:52.481+0000 7fa199287700 1 --2- 172.21.15.39:0/1387359894 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa194104cf0 0x7fa19419f5a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa184015040 tx=0x7fa184009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:27:52.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:52.481+0000 7fa1927fc700 1 -- 172.21.15.39:0/1387359894 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa184021020 con 0x7fa194104cf0 2024-05-09T05:27:52.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:52.481+0000 7fa1927fc700 1 -- 172.21.15.39:0/1387359894 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa184004000 con 0x7fa194104cf0 2024-05-09T05:27:52.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:52.481+0000 7fa19b4eb700 1 -- 172.21.15.39:0/1387359894 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa19419fd70 con 0x7fa194104cf0 2024-05-09T05:27:52.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:52.481+0000 7fa1927fc700 1 -- 172.21.15.39:0/1387359894 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa184017040 con 0x7fa194104cf0 2024-05-09T05:27:52.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:52.481+0000 7fa19b4eb700 1 -- 172.21.15.39:0/1387359894 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa194199730 con 0x7fa194104cf0 2024-05-09T05:27:52.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:52.482+0000 7fa1927fc700 1 -- 172.21.15.39:0/1387359894 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7fa184024020 con 0x7fa194104cf0 2024-05-09T05:27:52.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:52.482+0000 7fa19b4eb700 1 -- 172.21.15.39:0/1387359894 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa19406b670 con 0x7fa194104cf0 2024-05-09T05:27:52.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:52.482+0000 7fa1927fc700 1 --2- 172.21.15.39:0/1387359894 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fa17c03e570 0x7fa17c040a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:27:52.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:52.482+0000 7fa1927fc700 1 -- 172.21.15.39:0/1387359894 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fa18400f050 con 0x7fa194104cf0 2024-05-09T05:27:52.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:52.483+0000 7fa198a86700 1 --2- 172.21.15.39:0/1387359894 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fa17c03e570 0x7fa17c040a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:27:52.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:52.483+0000 7fa198a86700 1 --2- 172.21.15.39:0/1387359894 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fa17c03e570 0x7fa17c040a80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa188006fd0 tx=0x7fa188006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:27:52.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:52.488+0000 7fa1927fc700 1 -- 172.21.15.39:0/1387359894 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fa18402b020 con 0x7fa194104cf0 2024-05-09T05:27:52.705 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:52.709+0000 7fa19b4eb700 1 -- 172.21.15.39:0/1387359894 --> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa19419ac40 con 0x7fa17c03e570 2024-05-09T05:27:52.739 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:52.711+0000 7fa1927fc700 1 -- 172.21.15.39:0/1387359894 <== mgr.14152 v2:172.21.15.39:6800/3184189003 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+159 (secure 0 0 0) 0x7fa19419ac40 con 0x7fa17c03e570 2024-05-09T05:27:52.740 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-09T05:27:52.740 INFO:teuthology.orchestra.run.smithi039.stdout:[{"addr": "172.21.15.39", "hostname": "smithi039", "labels": [], "status": ""}, {"addr": "172.21.15.60", "hostname": "smithi060", "labels": [], "status": ""}] 2024-05-09T05:27:52.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:52.713+0000 7fa19b4eb700 1 -- 172.21.15.39:0/1387359894 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fa17c03e570 msgr2=0x7fa17c040a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:27:52.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:52.713+0000 7fa19b4eb700 1 --2- 172.21.15.39:0/1387359894 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fa17c03e570 0x7fa17c040a80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa188006fd0 tx=0x7fa188006e40 comp rx=0 tx=0).stop 2024-05-09T05:27:52.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:52.713+0000 7fa19b4eb700 1 -- 172.21.15.39:0/1387359894 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa194104cf0 msgr2=0x7fa19419f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:27:52.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:52.713+0000 7fa19b4eb700 1 --2- 172.21.15.39:0/1387359894 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa194104cf0 0x7fa19419f5a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa184015040 tx=0x7fa184009800 comp rx=0 tx=0).stop 2024-05-09T05:27:52.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:52.713+0000 7fa19b4eb700 1 -- 172.21.15.39:0/1387359894 shutdown_connections 2024-05-09T05:27:52.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:52.713+0000 7fa19b4eb700 1 --2- 172.21.15.39:0/1387359894 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fa17c03e570 0x7fa17c040a80 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:27:52.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:52.713+0000 7fa19b4eb700 1 --2- 172.21.15.39:0/1387359894 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa194104cf0 0x7fa19419f5a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:27:52.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:52.713+0000 7fa19b4eb700 1 -- 172.21.15.39:0/1387359894 >> 172.21.15.39:0/1387359894 conn(0x7fa1940785b0 msgr2=0x7fa194105b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:27:52.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:52.713+0000 7fa19b4eb700 1 -- 172.21.15.39:0/1387359894 shutdown_connections 2024-05-09T05:27:52.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:52.713+0000 7fa19b4eb700 1 -- 172.21.15.39:0/1387359894 wait complete. 2024-05-09T05:27:53.236 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:53 smithi039 ceph-mon[30439]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:27:53.237 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:53 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:27:53.238 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi100 2024-05-09T05:27:53.238 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-05-09T05:27:53.238 DEBUG:teuthology.orchestra.run.smithi100:> dd of=/etc/ceph/ceph.conf 2024-05-09T05:27:53.256 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-05-09T05:27:53.256 DEBUG:teuthology.orchestra.run.smithi100:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-09T05:27:53.313 INFO:tasks.cephadm:Adding host smithi100 to orchestrator... 2024-05-09T05:27:53.314 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph orch host add smithi100 2024-05-09T05:27:53.566 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T05:27:54.517 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:54 smithi039 ceph-mon[30439]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-09T05:27:55.090 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:55.093+0000 7fbbeb1a9700 1 -- 172.21.15.39:0/754159929 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbbe4108a60 msgr2=0x7fbbe4108e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:27:55.090 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:55.093+0000 7fbbeb1a9700 1 --2- 172.21.15.39:0/754159929 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbbe4108a60 0x7fbbe4108e70 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbbd8009910 tx=0x7fbbd8009c20 comp rx=0 tx=0).stop 2024-05-09T05:27:55.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:55.093+0000 7fbbeb1a9700 1 -- 172.21.15.39:0/754159929 shutdown_connections 2024-05-09T05:27:55.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:55.093+0000 7fbbeb1a9700 1 --2- 172.21.15.39:0/754159929 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbbe4108a60 0x7fbbe4108e70 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:27:55.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:55.093+0000 7fbbeb1a9700 1 -- 172.21.15.39:0/754159929 >> 172.21.15.39:0/754159929 conn(0x7fbbe40fe570 msgr2=0x7fbbe41009c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:27:55.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:55.094+0000 7fbbeb1a9700 1 -- 172.21.15.39:0/754159929 shutdown_connections 2024-05-09T05:27:55.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:55.094+0000 7fbbeb1a9700 1 -- 172.21.15.39:0/754159929 wait complete. 2024-05-09T05:27:55.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:55.094+0000 7fbbeb1a9700 1 Processor -- start 2024-05-09T05:27:55.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:55.094+0000 7fbbeb1a9700 1 -- start start 2024-05-09T05:27:55.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:55.095+0000 7fbbeb1a9700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbbe4108a60 0x7fbbe40ff510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:27:55.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:55.095+0000 7fbbeb1a9700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fbbe410cfb0 con 0x7fbbe4108a60 2024-05-09T05:27:55.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:55.095+0000 7fbbe8f45700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbbe4108a60 0x7fbbe40ff510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:27:55.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:55.095+0000 7fbbe8f45700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbbe4108a60 0x7fbbe40ff510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47676/0 (socket says 172.21.15.39:47676) 2024-05-09T05:27:55.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:55.095+0000 7fbbe8f45700 1 -- 172.21.15.39:0/4019686561 learned_addr learned my addr 172.21.15.39:0/4019686561 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:27:55.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:55.095+0000 7fbbe8f45700 1 -- 172.21.15.39:0/4019686561 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbe4101360 con 0x7fbbe4108a60 2024-05-09T05:27:55.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:55.095+0000 7fbbe8f45700 1 --2- 172.21.15.39:0/4019686561 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbbe4108a60 0x7fbbe40ff510 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fbbd80092e0 tx=0x7fbbd8005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:27:55.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:55.095+0000 7fbbe1ffb700 1 -- 172.21.15.39:0/4019686561 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbbd8026070 con 0x7fbbe4108a60 2024-05-09T05:27:55.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:55.095+0000 7fbbe1ffb700 1 -- 172.21.15.39:0/4019686561 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbbd800b6f0 con 0x7fbbe4108a60 2024-05-09T05:27:55.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:55.095+0000 7fbbeb1a9700 1 -- 172.21.15.39:0/4019686561 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbe40ffa50 con 0x7fbbe4108a60 2024-05-09T05:27:55.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:55.095+0000 7fbbe1ffb700 1 -- 172.21.15.39:0/4019686561 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbbd80037f0 con 0x7fbbe4108a60 2024-05-09T05:27:55.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:55.096+0000 7fbbeb1a9700 1 -- 172.21.15.39:0/4019686561 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbe40fff10 con 0x7fbbe4108a60 2024-05-09T05:27:55.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:55.097+0000 7fbbeb1a9700 1 -- 172.21.15.39:0/4019686561 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbe4104170 con 0x7fbbe4108a60 2024-05-09T05:27:55.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:55.097+0000 7fbbe1ffb700 1 -- 172.21.15.39:0/4019686561 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7fbbd8029070 con 0x7fbbe4108a60 2024-05-09T05:27:55.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:55.097+0000 7fbbe1ffb700 1 --2- 172.21.15.39:0/4019686561 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fbbd403e510 0x7fbbd4040a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:27:55.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:55.097+0000 7fbbe1ffb700 1 -- 172.21.15.39:0/4019686561 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fbbd801e070 con 0x7fbbe4108a60 2024-05-09T05:27:55.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:55.097+0000 7fbbe3fff700 1 --2- 172.21.15.39:0/4019686561 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fbbd403e510 0x7fbbd4040a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:27:55.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:55.098+0000 7fbbe3fff700 1 --2- 172.21.15.39:0/4019686561 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fbbd403e510 0x7fbbd4040a20 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fbbd0006fd0 tx=0x7fbbd0006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:27:55.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:55.102+0000 7fbbe1ffb700 1 -- 172.21.15.39:0/4019686561 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fbbd8013070 con 0x7fbbe4108a60 2024-05-09T05:27:55.318 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:55.323+0000 7fbbeb1a9700 1 -- 172.21.15.39:0/4019686561 --> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi100", "target": ["mon-mgr", ""]}) -- 0x7fbbe4100ab0 con 0x7fbbd403e510 2024-05-09T05:27:55.318 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:55 smithi039 ceph-mon[30439]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:27:56.612 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:56 smithi039 ceph-mon[30439]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi100", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T05:27:56.612 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:56 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:27:56.612 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:56 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:27:56.612 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:56 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:27:56.613 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:56 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:27:56.613 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:56 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi060", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:27:56.613 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:56 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:27:56.613 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:56 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:27:57.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:57 smithi039 ceph-mon[30439]: Updating smithi060:/etc/ceph/ceph.conf 2024-05-09T05:27:57.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:57 smithi039 ceph-mon[30439]: Deploying cephadm binary to smithi100 2024-05-09T05:27:57.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:57 smithi039 ceph-mon[30439]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:27:57.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:57 smithi039 ceph-mon[30439]: Updating smithi060:/var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T05:27:57.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:57 smithi039 ceph-mon[30439]: Updating smithi060:/etc/ceph/ceph.client.admin.keyring 2024-05-09T05:27:59.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:27:59 smithi039 ceph-mon[30439]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:27:59.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:59.667+0000 7fbbe1ffb700 1 -- 172.21.15.39:0/4019686561 <== mgr.14152 v2:172.21.15.39:6800/3184189003 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7fbbe4100ab0 con 0x7fbbd403e510 2024-05-09T05:27:59.662 INFO:teuthology.orchestra.run.smithi039.stdout:Added host 'smithi100' with addr '172.21.15.100' 2024-05-09T05:27:59.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:59.669+0000 7fbbeb1a9700 1 -- 172.21.15.39:0/4019686561 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fbbd403e510 msgr2=0x7fbbd4040a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:27:59.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:59.669+0000 7fbbeb1a9700 1 --2- 172.21.15.39:0/4019686561 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fbbd403e510 0x7fbbd4040a20 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fbbd0006fd0 tx=0x7fbbd0006e40 comp rx=0 tx=0).stop 2024-05-09T05:27:59.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:59.670+0000 7fbbeb1a9700 1 -- 172.21.15.39:0/4019686561 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbbe4108a60 msgr2=0x7fbbe40ff510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:27:59.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:59.670+0000 7fbbeb1a9700 1 --2- 172.21.15.39:0/4019686561 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbbe4108a60 0x7fbbe40ff510 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fbbd80092e0 tx=0x7fbbd8005780 comp rx=0 tx=0).stop 2024-05-09T05:27:59.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:59.670+0000 7fbbeb1a9700 1 -- 172.21.15.39:0/4019686561 shutdown_connections 2024-05-09T05:27:59.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:59.670+0000 7fbbeb1a9700 1 --2- 172.21.15.39:0/4019686561 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fbbd403e510 0x7fbbd4040a20 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:27:59.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:59.670+0000 7fbbeb1a9700 1 --2- 172.21.15.39:0/4019686561 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbbe4108a60 0x7fbbe40ff510 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:27:59.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:59.670+0000 7fbbeb1a9700 1 -- 172.21.15.39:0/4019686561 >> 172.21.15.39:0/4019686561 conn(0x7fbbe40fe570 msgr2=0x7fbbe4106540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:27:59.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:59.670+0000 7fbbeb1a9700 1 -- 172.21.15.39:0/4019686561 shutdown_connections 2024-05-09T05:27:59.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:27:59.670+0000 7fbbeb1a9700 1 -- 172.21.15.39:0/4019686561 wait complete. 2024-05-09T05:28:00.294 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph orch host ls --format=json 2024-05-09T05:28:00.540 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T05:28:00.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:00 smithi039 ceph-mon[30439]: Updating smithi060:/var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-09T05:28:00.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:00 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:00.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:00 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:00.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:00 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:00.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:00 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:00.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:00 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:28:00.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:00 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:01.598 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:01 smithi039 ceph-mon[30439]: Added host smithi100 2024-05-09T05:28:01.598 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:01 smithi039 ceph-mon[30439]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:28:01.598 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:01 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:02.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:02.089+0000 7f08d9932700 1 -- 172.21.15.39:0/379981590 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f08d4104d20 msgr2=0x7f08d4105130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:28:02.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:02.089+0000 7f08d9932700 1 --2- 172.21.15.39:0/379981590 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f08d4104d20 0x7f08d4105130 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f08c400b0a0 tx=0x7f08c400b3b0 comp rx=0 tx=0).stop 2024-05-09T05:28:02.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:02.089+0000 7f08d9932700 1 -- 172.21.15.39:0/379981590 shutdown_connections 2024-05-09T05:28:02.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:02.089+0000 7f08d9932700 1 --2- 172.21.15.39:0/379981590 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f08d4104d20 0x7f08d4105130 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:28:02.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:02.089+0000 7f08d9932700 1 -- 172.21.15.39:0/379981590 >> 172.21.15.39:0/379981590 conn(0x7f08d40fe5b0 msgr2=0x7f08d4100a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:28:02.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:02.089+0000 7f08d9932700 1 -- 172.21.15.39:0/379981590 shutdown_connections 2024-05-09T05:28:02.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:02.089+0000 7f08d9932700 1 -- 172.21.15.39:0/379981590 wait complete. 2024-05-09T05:28:02.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:02.090+0000 7f08d9932700 1 Processor -- start 2024-05-09T05:28:02.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:02.090+0000 7f08d9932700 1 -- start start 2024-05-09T05:28:02.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:02.091+0000 7f08d9932700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f08d4104d20 0x7f08d419f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:28:02.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:02.091+0000 7f08d9932700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f08d410e0c0 con 0x7f08d4104d20 2024-05-09T05:28:02.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:02.091+0000 7f08d2ffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f08d4104d20 0x7f08d419f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:28:02.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:02.091+0000 7f08d2ffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f08d4104d20 0x7f08d419f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:52626/0 (socket says 172.21.15.39:52626) 2024-05-09T05:28:02.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:02.091+0000 7f08d2ffd700 1 -- 172.21.15.39:0/2527327153 learned_addr learned my addr 172.21.15.39:0/2527327153 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:28:02.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:02.091+0000 7f08d2ffd700 1 -- 172.21.15.39:0/2527327153 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08d419faa0 con 0x7f08d4104d20 2024-05-09T05:28:02.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:02.091+0000 7f08d2ffd700 1 --2- 172.21.15.39:0/2527327153 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f08d4104d20 0x7f08d419f560 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f08c400d010 tx=0x7f08c4003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:28:02.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:02.091+0000 7f08d8930700 1 -- 172.21.15.39:0/2527327153 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08c4021020 con 0x7f08d4104d20 2024-05-09T05:28:02.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:02.091+0000 7f08d9932700 1 -- 172.21.15.39:0/2527327153 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08d419fd30 con 0x7f08d4104d20 2024-05-09T05:28:02.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:02.091+0000 7f08d8930700 1 -- 172.21.15.39:0/2527327153 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f08c40044b0 con 0x7f08d4104d20 2024-05-09T05:28:02.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:02.091+0000 7f08d8930700 1 -- 172.21.15.39:0/2527327153 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08c4017040 con 0x7f08d4104d20 2024-05-09T05:28:02.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:02.091+0000 7f08d9932700 1 -- 172.21.15.39:0/2527327153 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08d41996f0 con 0x7f08d4104d20 2024-05-09T05:28:02.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:02.092+0000 7f08d9932700 1 -- 172.21.15.39:0/2527327153 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08d406c100 con 0x7f08d4104d20 2024-05-09T05:28:02.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:02.092+0000 7f08d8930700 1 -- 172.21.15.39:0/2527327153 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f08c4024020 con 0x7f08d4104d20 2024-05-09T05:28:02.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:02.093+0000 7f08d8930700 1 --2- 172.21.15.39:0/2527327153 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f08c003e560 0x7f08c0040a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:28:02.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:02.093+0000 7f08d8930700 1 -- 172.21.15.39:0/2527327153 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f08c400f050 con 0x7f08d4104d20 2024-05-09T05:28:02.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:02.093+0000 7f08d27fc700 1 --2- 172.21.15.39:0/2527327153 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f08c003e560 0x7f08c0040a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:28:02.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:02.093+0000 7f08d27fc700 1 --2- 172.21.15.39:0/2527327153 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f08c003e560 0x7f08c0040a70 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f08bc006fd0 tx=0x7f08bc006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:28:02.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:02.098+0000 7f08d8930700 1 -- 172.21.15.39:0/2527327153 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f08c402b020 con 0x7f08d4104d20 2024-05-09T05:28:02.314 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:02.320+0000 7f08d9932700 1 -- 172.21.15.39:0/2527327153 --> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f08d419ac00 con 0x7f08c003e560 2024-05-09T05:28:02.315 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:02.321+0000 7f08d8930700 1 -- 172.21.15.39:0/2527327153 <== mgr.14152 v2:172.21.15.39:6800/3184189003 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+239 (secure 0 0 0) 0x7f08d419ac00 con 0x7f08c003e560 2024-05-09T05:28:02.315 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-09T05:28:02.316 INFO:teuthology.orchestra.run.smithi039.stdout:[{"addr": "172.21.15.39", "hostname": "smithi039", "labels": [], "status": ""}, {"addr": "172.21.15.60", "hostname": "smithi060", "labels": [], "status": ""}, {"addr": "172.21.15.100", "hostname": "smithi100", "labels": [], "status": ""}] 2024-05-09T05:28:02.318 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:02.323+0000 7f08d9932700 1 -- 172.21.15.39:0/2527327153 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f08c003e560 msgr2=0x7f08c0040a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:28:02.318 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:02.323+0000 7f08d9932700 1 --2- 172.21.15.39:0/2527327153 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f08c003e560 0x7f08c0040a70 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f08bc006fd0 tx=0x7f08bc006e40 comp rx=0 tx=0).stop 2024-05-09T05:28:02.318 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:02.323+0000 7f08d9932700 1 -- 172.21.15.39:0/2527327153 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f08d4104d20 msgr2=0x7f08d419f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:28:02.318 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:02.323+0000 7f08d9932700 1 --2- 172.21.15.39:0/2527327153 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f08d4104d20 0x7f08d419f560 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f08c400d010 tx=0x7f08c4003ce0 comp rx=0 tx=0).stop 2024-05-09T05:28:02.318 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:02.323+0000 7f08d9932700 1 -- 172.21.15.39:0/2527327153 shutdown_connections 2024-05-09T05:28:02.318 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:02.323+0000 7f08d9932700 1 --2- 172.21.15.39:0/2527327153 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f08c003e560 0x7f08c0040a70 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:28:02.319 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:02.323+0000 7f08d9932700 1 --2- 172.21.15.39:0/2527327153 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f08d4104d20 0x7f08d419f560 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:28:02.319 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:02.323+0000 7f08d9932700 1 -- 172.21.15.39:0/2527327153 >> 172.21.15.39:0/2527327153 conn(0x7f08d40fe5b0 msgr2=0x7f08d4105aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:28:02.319 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:02.323+0000 7f08d9932700 1 -- 172.21.15.39:0/2527327153 shutdown_connections 2024-05-09T05:28:02.319 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:02.323+0000 7f08d9932700 1 -- 172.21.15.39:0/2527327153 wait complete. 2024-05-09T05:28:02.885 INFO:tasks.cephadm:Setting crush tunables to default 2024-05-09T05:28:02.885 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph osd crush tunables default 2024-05-09T05:28:03.135 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T05:28:03.491 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:03 smithi039 ceph-mon[30439]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:28:03.491 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:03 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:03.491 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:03 smithi039 ceph-mon[30439]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-09T05:28:04.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:04.548+0000 7fddea626700 1 -- 172.21.15.39:0/4141983743 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdde4109c30 msgr2=0x7fdde410a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:28:04.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:04.548+0000 7fddea626700 1 --2- 172.21.15.39:0/4141983743 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdde4109c30 0x7fdde410a040 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fddd4009910 tx=0x7fddd4009c20 comp rx=0 tx=0).stop 2024-05-09T05:28:04.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:04.548+0000 7fddea626700 1 -- 172.21.15.39:0/4141983743 shutdown_connections 2024-05-09T05:28:04.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:04.548+0000 7fddea626700 1 --2- 172.21.15.39:0/4141983743 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdde4109c30 0x7fdde410a040 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:28:04.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:04.548+0000 7fddea626700 1 -- 172.21.15.39:0/4141983743 >> 172.21.15.39:0/4141983743 conn(0x7fdde40ff670 msgr2=0x7fdde4101ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:28:04.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:04.548+0000 7fddea626700 1 -- 172.21.15.39:0/4141983743 shutdown_connections 2024-05-09T05:28:04.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:04.548+0000 7fddea626700 1 -- 172.21.15.39:0/4141983743 wait complete. 2024-05-09T05:28:04.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:04.549+0000 7fddea626700 1 Processor -- start 2024-05-09T05:28:04.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:04.549+0000 7fddea626700 1 -- start start 2024-05-09T05:28:04.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:04.549+0000 7fddea626700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdde4109c30 0x7fdde419f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:28:04.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:04.549+0000 7fddea626700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fdde410e110 con 0x7fdde4109c30 2024-05-09T05:28:04.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:04.549+0000 7fdde3fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdde4109c30 0x7fdde419f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:28:04.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:04.550+0000 7fdde3fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdde4109c30 0x7fdde419f5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:52638/0 (socket says 172.21.15.39:52638) 2024-05-09T05:28:04.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:04.550+0000 7fdde3fff700 1 -- 172.21.15.39:0/370908538 learned_addr learned my addr 172.21.15.39:0/370908538 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:28:04.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:04.550+0000 7fdde3fff700 1 -- 172.21.15.39:0/370908538 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdde419fb30 con 0x7fdde4109c30 2024-05-09T05:28:04.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:04.550+0000 7fdde3fff700 1 --2- 172.21.15.39:0/370908538 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdde4109c30 0x7fdde419f5f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fddd40092e0 tx=0x7fddd4005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:28:04.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:04.550+0000 7fdde1ffb700 1 -- 172.21.15.39:0/370908538 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fddd4026070 con 0x7fdde4109c30 2024-05-09T05:28:04.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:04.550+0000 7fdde1ffb700 1 -- 172.21.15.39:0/370908538 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fddd400b750 con 0x7fdde4109c30 2024-05-09T05:28:04.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:04.550+0000 7fddea626700 1 -- 172.21.15.39:0/370908538 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdde419fdc0 con 0x7fdde4109c30 2024-05-09T05:28:04.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:04.550+0000 7fdde1ffb700 1 -- 172.21.15.39:0/370908538 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fddd40038a0 con 0x7fdde4109c30 2024-05-09T05:28:04.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:04.550+0000 7fddea626700 1 -- 172.21.15.39:0/370908538 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdde4199780 con 0x7fdde4109c30 2024-05-09T05:28:04.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:04.551+0000 7fddea626700 1 -- 172.21.15.39:0/370908538 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdde4105200 con 0x7fdde4109c30 2024-05-09T05:28:04.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:04.551+0000 7fdde1ffb700 1 -- 172.21.15.39:0/370908538 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7fddd4029070 con 0x7fdde4109c30 2024-05-09T05:28:04.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:04.552+0000 7fdde1ffb700 1 --2- 172.21.15.39:0/370908538 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fddd003e570 0x7fddd0040a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:28:04.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:04.552+0000 7fdde1ffb700 1 -- 172.21.15.39:0/370908538 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fddd401e070 con 0x7fdde4109c30 2024-05-09T05:28:04.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:04.552+0000 7fdddbfff700 1 --2- 172.21.15.39:0/370908538 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fddd003e570 0x7fddd0040a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:28:04.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:04.552+0000 7fdddbfff700 1 --2- 172.21.15.39:0/370908538 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fddd003e570 0x7fddd0040a80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fddcc006fd0 tx=0x7fddcc006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:28:04.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:04.557+0000 7fdde1ffb700 1 -- 172.21.15.39:0/370908538 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fddd4013070 con 0x7fdde4109c30 2024-05-09T05:28:04.773 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:04.778+0000 7fddea626700 1 -- 172.21.15.39:0/370908538 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fdde419ac90 con 0x7fdde4109c30 2024-05-09T05:28:05.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:05.239+0000 7fdde1ffb700 1 -- 172.21.15.39:0/370908538 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7fddd400e3e0 con 0x7fdde4109c30 2024-05-09T05:28:05.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:05.242+0000 7fddea626700 1 -- 172.21.15.39:0/370908538 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fddd003e570 msgr2=0x7fddd0040a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:28:05.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:05.242+0000 7fddea626700 1 --2- 172.21.15.39:0/370908538 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fddd003e570 0x7fddd0040a80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fddcc006fd0 tx=0x7fddcc006e40 comp rx=0 tx=0).stop 2024-05-09T05:28:05.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:05.242+0000 7fddea626700 1 -- 172.21.15.39:0/370908538 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdde4109c30 msgr2=0x7fdde419f5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:28:05.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:05.242+0000 7fddea626700 1 --2- 172.21.15.39:0/370908538 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdde4109c30 0x7fdde419f5f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fddd40092e0 tx=0x7fddd4005780 comp rx=0 tx=0).stop 2024-05-09T05:28:05.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:05.242+0000 7fddea626700 1 -- 172.21.15.39:0/370908538 shutdown_connections 2024-05-09T05:28:05.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:05.242+0000 7fddea626700 1 --2- 172.21.15.39:0/370908538 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fddd003e570 0x7fddd0040a80 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:28:05.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:05.242+0000 7fddea626700 1 --2- 172.21.15.39:0/370908538 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdde4109c30 0x7fdde419f5f0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:28:05.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:05.242+0000 7fddea626700 1 -- 172.21.15.39:0/370908538 >> 172.21.15.39:0/370908538 conn(0x7fdde40ff670 msgr2=0x7fdde4100540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:28:05.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:05.242+0000 7fddea626700 1 -- 172.21.15.39:0/370908538 shutdown_connections 2024-05-09T05:28:05.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:05.242+0000 7fddea626700 1 -- 172.21.15.39:0/370908538 wait complete. 2024-05-09T05:28:05.238 INFO:teuthology.orchestra.run.smithi039.stderr:adjusted tunables profile to default 2024-05-09T05:28:05.551 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:05 smithi039 ceph-mon[30439]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:28:05.551 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:05 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/370908538' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-05-09T05:28:05.551 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:05 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:05.551 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:05 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:05.551 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:05 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:05.551 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:05 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:05.551 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:05 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi100", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:28:05.552 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:05 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:28:05.552 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:05 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:28:05.838 INFO:tasks.cephadm:Adding mon.a on smithi039 2024-05-09T05:28:05.838 INFO:tasks.cephadm:Adding mon.b on smithi060 2024-05-09T05:28:05.838 INFO:tasks.cephadm:Adding mon.c on smithi100 2024-05-09T05:28:05.838 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph orch apply mon '3;smithi039:172.21.15.39=a;smithi060:172.21.15.60=b;smithi100:172.21.15.100=c' 2024-05-09T05:28:06.071 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T05:28:06.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:06 smithi039 ceph-mon[30439]: Updating smithi100:/etc/ceph/ceph.conf 2024-05-09T05:28:06.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:06 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/370908538' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-05-09T05:28:06.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:06 smithi039 ceph-mon[30439]: osdmap e4: 0 total, 0 up, 0 in 2024-05-09T05:28:06.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:06 smithi039 ceph-mon[30439]: Updating smithi100:/var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T05:28:06.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:06 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:06.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:06 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:06.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:06 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:07.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:07.591+0000 7f31a35a2700 1 -- 172.21.15.100:0/803709772 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f319c103410 msgr2=0x7f319c103820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:28:07.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:07.591+0000 7f31a35a2700 1 --2- 172.21.15.100:0/803709772 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f319c103410 0x7f319c103820 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3198009910 tx=0x7f3198009c20 comp rx=0 tx=0).stop 2024-05-09T05:28:07.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:07.591+0000 7f31a35a2700 1 -- 172.21.15.100:0/803709772 shutdown_connections 2024-05-09T05:28:07.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:07.591+0000 7f31a35a2700 1 --2- 172.21.15.100:0/803709772 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f319c103410 0x7f319c103820 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:28:07.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:07.591+0000 7f31a35a2700 1 -- 172.21.15.100:0/803709772 >> 172.21.15.100:0/803709772 conn(0x7f319c0fde30 msgr2=0x7f319c100250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:28:07.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:07.591+0000 7f31a35a2700 1 -- 172.21.15.100:0/803709772 shutdown_connections 2024-05-09T05:28:07.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:07.591+0000 7f31a35a2700 1 -- 172.21.15.100:0/803709772 wait complete. 2024-05-09T05:28:07.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:07.591+0000 7f31a35a2700 1 Processor -- start 2024-05-09T05:28:07.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:07.591+0000 7f31a35a2700 1 -- start start 2024-05-09T05:28:07.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:07.592+0000 7f31a35a2700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f319c103410 0x7f319c19e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:28:07.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:07.592+0000 7f31a35a2700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f319c10d1e0 con 0x7f319c103410 2024-05-09T05:28:07.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:07.592+0000 7f31a133e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f319c103410 0x7f319c19e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:28:07.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:07.592+0000 7f31a133e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f319c103410 0x7f319c19e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.100:51918/0 (socket says 172.21.15.100:51918) 2024-05-09T05:28:07.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:07.592+0000 7f31a133e700 1 -- 172.21.15.100:0/2956735290 learned_addr learned my addr 172.21.15.100:0/2956735290 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:28:07.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:07.592+0000 7f31a133e700 1 -- 172.21.15.100:0/2956735290 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f319c19ebc0 con 0x7f319c103410 2024-05-09T05:28:07.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:07.592+0000 7f31a133e700 1 --2- 172.21.15.100:0/2956735290 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f319c103410 0x7f319c19e680 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f31980056d0 tx=0x7f31980057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:28:07.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:07.593+0000 7f31927fc700 1 -- 172.21.15.100:0/2956735290 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3198026070 con 0x7f319c103410 2024-05-09T05:28:07.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:07.593+0000 7f31a35a2700 1 -- 172.21.15.100:0/2956735290 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f319c19eeb0 con 0x7f319c103410 2024-05-09T05:28:07.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:07.593+0000 7f31927fc700 1 -- 172.21.15.100:0/2956735290 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f319800bba0 con 0x7f319c103410 2024-05-09T05:28:07.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:07.593+0000 7f31927fc700 1 -- 172.21.15.100:0/2956735290 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3198003920 con 0x7f319c103410 2024-05-09T05:28:07.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:07.593+0000 7f31a35a2700 1 -- 172.21.15.100:0/2956735290 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f319c1988f0 con 0x7f319c103410 2024-05-09T05:28:07.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:07.594+0000 7f31a35a2700 1 -- 172.21.15.100:0/2956735290 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f319c104430 con 0x7f319c103410 2024-05-09T05:28:07.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:07.594+0000 7f31927fc700 1 -- 172.21.15.100:0/2956735290 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f3198029070 con 0x7f319c103410 2024-05-09T05:28:07.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:07.594+0000 7f31927fc700 1 --2- 172.21.15.100:0/2956735290 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f318803e510 0x7f3188040a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:28:07.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:07.594+0000 7f31927fc700 1 -- 172.21.15.100:0/2956735290 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f319801e070 con 0x7f319c103410 2024-05-09T05:28:07.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:07.594+0000 7f31a0b3d700 1 --2- 172.21.15.100:0/2956735290 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f318803e510 0x7f3188040a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:28:07.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:07.595+0000 7f31a0b3d700 1 --2- 172.21.15.100:0/2956735290 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f318803e510 0x7f3188040a20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f318c006fd0 tx=0x7f318c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:28:07.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:07.600+0000 7f31927fc700 1 -- 172.21.15.100:0/2956735290 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f3198013070 con 0x7f319c103410 2024-05-09T05:28:07.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:07 smithi039 ceph-mon[30439]: Updating smithi100:/etc/ceph/ceph.client.admin.keyring 2024-05-09T05:28:07.612 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:07 smithi039 ceph-mon[30439]: Updating smithi100:/var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-09T05:28:07.612 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:07 smithi039 ceph-mon[30439]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:28:07.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:07.818+0000 7f31a35a2700 1 -- 172.21.15.100:0/2956735290 --> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi039:172.21.15.39=a;smithi060:172.21.15.60=b;smithi100:172.21.15.100=c", "target": ["mon-mgr", ""]}) -- 0x7f319c199dd0 con 0x7f318803e510 2024-05-09T05:28:07.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:07.825+0000 7f31927fc700 1 -- 172.21.15.100:0/2956735290 <== mgr.14152 v2:172.21.15.39:6800/3184189003 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f319c199dd0 con 0x7f318803e510 2024-05-09T05:28:07.820 INFO:teuthology.orchestra.run.smithi100.stdout:Scheduled mon update... 2024-05-09T05:28:07.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:07.828+0000 7f31a35a2700 1 -- 172.21.15.100:0/2956735290 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f318803e510 msgr2=0x7f3188040a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:28:07.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:07.828+0000 7f31a35a2700 1 --2- 172.21.15.100:0/2956735290 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f318803e510 0x7f3188040a20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f318c006fd0 tx=0x7f318c006e40 comp rx=0 tx=0).stop 2024-05-09T05:28:07.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:07.828+0000 7f31a35a2700 1 -- 172.21.15.100:0/2956735290 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f319c103410 msgr2=0x7f319c19e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:28:07.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:07.828+0000 7f31a35a2700 1 --2- 172.21.15.100:0/2956735290 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f319c103410 0x7f319c19e680 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f31980056d0 tx=0x7f31980057b0 comp rx=0 tx=0).stop 2024-05-09T05:28:07.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:07.828+0000 7f31a35a2700 1 -- 172.21.15.100:0/2956735290 shutdown_connections 2024-05-09T05:28:07.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:07.828+0000 7f31a35a2700 1 --2- 172.21.15.100:0/2956735290 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f318803e510 0x7f3188040a20 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:28:07.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:07.828+0000 7f31a35a2700 1 --2- 172.21.15.100:0/2956735290 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f319c103410 0x7f319c19e680 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:28:07.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:07.828+0000 7f31a35a2700 1 -- 172.21.15.100:0/2956735290 >> 172.21.15.100:0/2956735290 conn(0x7f319c0fde30 msgr2=0x7f319c108a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:28:07.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:07.828+0000 7f31a35a2700 1 -- 172.21.15.100:0/2956735290 shutdown_connections 2024-05-09T05:28:07.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:07.828+0000 7f31a35a2700 1 -- 172.21.15.100:0/2956735290 wait complete. 2024-05-09T05:28:08.585 DEBUG:teuthology.orchestra.run.smithi060:mon.b> sudo journalctl -f -n 0 -u ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@mon.b.service 2024-05-09T05:28:08.590 DEBUG:teuthology.orchestra.run.smithi100:mon.c> sudo journalctl -f -n 0 -u ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@mon.c.service 2024-05-09T05:28:08.592 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-05-09T05:28:08.592 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-09T05:28:09.111 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:08 smithi039 ceph-mon[30439]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi039:172.21.15.39=a;smithi060:172.21.15.60=b;smithi100:172.21.15.100=c", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T05:28:09.111 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:08 smithi039 ceph-mon[30439]: Saving service mon spec with placement smithi039:172.21.15.39=a;smithi060:172.21.15.60=b;smithi100:172.21.15.100=c;count:3 2024-05-09T05:28:09.111 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:08 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:09.111 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:08 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:28:09.111 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:08 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:28:09.111 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:08 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:28:09.112 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:08 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:09.112 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:08 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-09T05:28:09.112 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:08 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:28:09.112 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:08 smithi039 ceph-mon[30439]: Deploying daemon mon.c on smithi100 2024-05-09T05:28:09.112 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:08 smithi039 ceph-mon[30439]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:28:09.677 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T05:28:11.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:11 smithi039 ceph-mon[30439]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:28:12.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:12.082+0000 7f4417c75700 1 -- 172.21.15.100:0/229455876 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4410102320 msgr2=0x7f4410102730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:28:12.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:12.082+0000 7f4417c75700 1 --2- 172.21.15.100:0/229455876 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4410102320 0x7f4410102730 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4400009910 tx=0x7f4400009c20 comp rx=0 tx=0).stop 2024-05-09T05:28:12.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:12.082+0000 7f4417c75700 1 -- 172.21.15.100:0/229455876 shutdown_connections 2024-05-09T05:28:12.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:12.082+0000 7f4417c75700 1 --2- 172.21.15.100:0/229455876 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4410102320 0x7f4410102730 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:28:12.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:12.082+0000 7f4417c75700 1 -- 172.21.15.100:0/229455876 >> 172.21.15.100:0/229455876 conn(0x7f44100fde30 msgr2=0x7f4410100250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:28:12.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:12.082+0000 7f4417c75700 1 -- 172.21.15.100:0/229455876 shutdown_connections 2024-05-09T05:28:12.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:12.083+0000 7f4417c75700 1 -- 172.21.15.100:0/229455876 wait complete. 2024-05-09T05:28:12.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:12.083+0000 7f4417c75700 1 Processor -- start 2024-05-09T05:28:12.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:12.083+0000 7f4417c75700 1 -- start start 2024-05-09T05:28:12.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:12.084+0000 7f4417c75700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4410102320 0x7f441019f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:28:12.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:12.084+0000 7f4417c75700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f441010e0d0 con 0x7f4410102320 2024-05-09T05:28:12.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:12.084+0000 7f4415a11700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4410102320 0x7f441019f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:28:12.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:12.084+0000 7f4415a11700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4410102320 0x7f441019f5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.100:41988/0 (socket says 172.21.15.100:41988) 2024-05-09T05:28:12.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:12.084+0000 7f4415a11700 1 -- 172.21.15.100:0/3443088347 learned_addr learned my addr 172.21.15.100:0/3443088347 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:28:12.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:12.084+0000 7f4415a11700 1 -- 172.21.15.100:0/3443088347 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f441019fb30 con 0x7f4410102320 2024-05-09T05:28:12.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:12.084+0000 7f4415a11700 1 --2- 172.21.15.100:0/3443088347 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4410102320 0x7f441019f5f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f44000056d0 tx=0x7f44000057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:28:12.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:12.084+0000 7f4406ffd700 1 -- 172.21.15.100:0/3443088347 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4400027070 con 0x7f4410102320 2024-05-09T05:28:12.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:12.085+0000 7f4417c75700 1 -- 172.21.15.100:0/3443088347 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f441019fe20 con 0x7f4410102320 2024-05-09T05:28:12.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:12.085+0000 7f4406ffd700 1 -- 172.21.15.100:0/3443088347 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f440000be10 con 0x7f4410102320 2024-05-09T05:28:12.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:12.085+0000 7f4406ffd700 1 -- 172.21.15.100:0/3443088347 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4400022d20 con 0x7f4410102320 2024-05-09T05:28:12.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:12.085+0000 7f4417c75700 1 -- 172.21.15.100:0/3443088347 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4410199830 con 0x7f4410102320 2024-05-09T05:28:12.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:12.085+0000 7f4417c75700 1 -- 172.21.15.100:0/3443088347 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44101053b0 con 0x7f4410102320 2024-05-09T05:28:12.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:12.086+0000 7f4406ffd700 1 -- 172.21.15.100:0/3443088347 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f440002a070 con 0x7f4410102320 2024-05-09T05:28:12.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:12.086+0000 7f4406ffd700 1 --2- 172.21.15.100:0/3443088347 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f43fc03e510 0x7f43fc040a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:28:12.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:12.086+0000 7f4406ffd700 1 -- 172.21.15.100:0/3443088347 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f440001e030 con 0x7f4410102320 2024-05-09T05:28:12.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:12.086+0000 7f4415210700 1 --2- 172.21.15.100:0/3443088347 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f43fc03e510 0x7f43fc040a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:28:12.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:12.087+0000 7f4415210700 1 --2- 172.21.15.100:0/3443088347 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f43fc03e510 0x7f43fc040a20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f440c006fd0 tx=0x7f440c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:28:12.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:12.092+0000 7f4406ffd700 1 -- 172.21.15.100:0/3443088347 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f4400013070 con 0x7f4410102320 2024-05-09T05:28:12.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:12.398+0000 7f4417c75700 1 -- 172.21.15.100:0/3443088347 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f441019ad40 con 0x7f4410102320 2024-05-09T05:28:12.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:12.399+0000 7f4406ffd700 1 -- 172.21.15.100:0/3443088347 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+745 (secure 0 0 0) 0x7f4400031090 con 0x7f4410102320 2024-05-09T05:28:12.394 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:28:12.394 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":1,"fsid":"86d4cc60-0dc4-11ef-bc97-c7b262605968","modified":"2024-05-09T05:26:29.940750Z","created":"2024-05-09T05:26:29.940750Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:3300","nonce":0},{"type":"v1","addr":"172.21.15.39:6789","nonce":0}]},"addr":"172.21.15.39:6789/0","public_addr":"172.21.15.39:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-09T05:28:12.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:12.401+0000 7f4417c75700 1 -- 172.21.15.100:0/3443088347 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f43fc03e510 msgr2=0x7f43fc040a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:28:12.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:12.401+0000 7f4417c75700 1 --2- 172.21.15.100:0/3443088347 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f43fc03e510 0x7f43fc040a20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f440c006fd0 tx=0x7f440c006e40 comp rx=0 tx=0).stop 2024-05-09T05:28:12.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:12.401+0000 7f4417c75700 1 -- 172.21.15.100:0/3443088347 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4410102320 msgr2=0x7f441019f5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:28:12.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:12.401+0000 7f4417c75700 1 --2- 172.21.15.100:0/3443088347 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4410102320 0x7f441019f5f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f44000056d0 tx=0x7f44000057b0 comp rx=0 tx=0).stop 2024-05-09T05:28:12.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:12.402+0000 7f4417c75700 1 -- 172.21.15.100:0/3443088347 shutdown_connections 2024-05-09T05:28:12.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:12.402+0000 7f4417c75700 1 --2- 172.21.15.100:0/3443088347 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f43fc03e510 0x7f43fc040a20 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:28:12.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:12.402+0000 7f4417c75700 1 --2- 172.21.15.100:0/3443088347 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4410102320 0x7f441019f5f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:28:12.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:12.402+0000 7f4417c75700 1 -- 172.21.15.100:0/3443088347 >> 172.21.15.100:0/3443088347 conn(0x7f44100fde30 msgr2=0x7f44101057b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:28:12.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:12.402+0000 7f4417c75700 1 -- 172.21.15.100:0/3443088347 shutdown_connections 2024-05-09T05:28:12.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:12.402+0000 7f4417c75700 1 -- 172.21.15.100:0/3443088347 wait complete. 2024-05-09T05:28:12.398 INFO:teuthology.orchestra.run.smithi100.stderr:dumped monmap epoch 1 2024-05-09T05:28:13.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:13 smithi039 ceph-mon[30439]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:28:13.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:13 smithi039 ceph-mon[30439]: from='client.? 172.21.15.100:0/3443088347' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-09T05:28:13.380 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 podman[34334]: 2024-05-09 05:28:13.202451328 +0000 UTC m=+0.018424959 image pull db794d706f492c144ccc8f2c5bbc1870e116f5c4f3309dfab4416b39d099f8d7 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584 2024-05-09T05:28:13.676 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 podman[34334]: 2024-05-09 05:28:13.47027073 +0000 UTC m=+0.286244348 container init 636febe0454da429ec5373253ab41d70cacabddae44ba9b1afb81862bda15c65 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mon-c, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-05-09T05:28:13.676 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 podman[34334]: 2024-05-09 05:28:13.4731614 +0000 UTC m=+0.289135017 container start 636febe0454da429ec5373253ab41d70cacabddae44ba9b1afb81862bda15c65 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mon-c, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404) 2024-05-09T05:28:13.676 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: set uid:gid to 167:167 (ceph:ceph) 2024-05-09T05:28:13.676 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: ceph version 19.0.0-3594-gc9da4049 (c9da4049f638c0f84bdd9b4e33c42e86046ac554) squid (dev), process ceph-mon, pid 2 2024-05-09T05:28:13.676 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: pidfile_write: ignore empty --pid-file 2024-05-09T05:28:13.676 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: load: jerasure load: lrc 2024-05-09T05:28:13.676 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: RocksDB version: 7.9.2 2024-05-09T05:28:13.676 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Git sha 0 2024-05-09T05:28:13.677 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Compile date 2024-05-08 19:33:14 2024-05-09T05:28:13.677 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: DB SUMMARY 2024-05-09T05:28:13.677 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: DB Session ID: 68GOIGVYREHSBINK8NGJ 2024-05-09T05:28:13.677 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: CURRENT file: CURRENT 2024-05-09T05:28:13.677 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: IDENTITY file: IDENTITY 2024-05-09T05:28:13.677 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-05-09T05:28:13.677 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-05-09T05:28:13.677 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-05-09T05:28:13.677 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.error_if_exists: 0 2024-05-09T05:28:13.677 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.create_if_missing: 0 2024-05-09T05:28:13.677 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.paranoid_checks: 1 2024-05-09T05:28:13.677 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.flush_verify_memtable_count: 1 2024-05-09T05:28:13.677 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-05-09T05:28:13.677 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-05-09T05:28:13.678 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.env: 0x556b22f79500 2024-05-09T05:28:13.678 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.fs: PosixFileSystem 2024-05-09T05:28:13.678 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.info_log: 0x556b244d4020 2024-05-09T05:28:13.678 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.max_file_opening_threads: 16 2024-05-09T05:28:13.678 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.statistics: (nil) 2024-05-09T05:28:13.678 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.use_fsync: 0 2024-05-09T05:28:13.678 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.max_log_file_size: 0 2024-05-09T05:28:13.678 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-05-09T05:28:13.678 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.log_file_time_to_roll: 0 2024-05-09T05:28:13.678 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.keep_log_file_num: 1000 2024-05-09T05:28:13.678 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.recycle_log_file_num: 0 2024-05-09T05:28:13.678 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.allow_fallocate: 1 2024-05-09T05:28:13.678 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.allow_mmap_reads: 0 2024-05-09T05:28:13.679 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.allow_mmap_writes: 0 2024-05-09T05:28:13.679 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.use_direct_reads: 0 2024-05-09T05:28:13.679 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-05-09T05:28:13.679 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.create_missing_column_families: 0 2024-05-09T05:28:13.679 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.db_log_dir: 2024-05-09T05:28:13.679 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.wal_dir: 2024-05-09T05:28:13.679 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.table_cache_numshardbits: 6 2024-05-09T05:28:13.679 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.WAL_ttl_seconds: 0 2024-05-09T05:28:13.679 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.WAL_size_limit_MB: 0 2024-05-09T05:28:13.679 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-05-09T05:28:13.679 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-05-09T05:28:13.679 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.is_fd_close_on_exec: 1 2024-05-09T05:28:13.679 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.advise_random_on_open: 1 2024-05-09T05:28:13.679 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.db_write_buffer_size: 0 2024-05-09T05:28:13.680 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.write_buffer_manager: 0x556b2439e8c0 2024-05-09T05:28:13.680 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-05-09T05:28:13.680 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-05-09T05:28:13.680 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.use_adaptive_mutex: 0 2024-05-09T05:28:13.680 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.rate_limiter: (nil) 2024-05-09T05:28:13.680 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-05-09T05:28:13.680 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.wal_recovery_mode: 2 2024-05-09T05:28:13.680 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.enable_thread_tracking: 0 2024-05-09T05:28:13.680 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.enable_pipelined_write: 0 2024-05-09T05:28:13.680 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.unordered_write: 0 2024-05-09T05:28:13.680 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-05-09T05:28:13.680 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-05-09T05:28:13.680 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-05-09T05:28:13.680 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-05-09T05:28:13.680 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.row_cache: None 2024-05-09T05:28:13.681 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.wal_filter: None 2024-05-09T05:28:13.681 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-05-09T05:28:13.681 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.allow_ingest_behind: 0 2024-05-09T05:28:13.681 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.two_write_queues: 0 2024-05-09T05:28:13.681 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.manual_wal_flush: 0 2024-05-09T05:28:13.681 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.wal_compression: 0 2024-05-09T05:28:13.681 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.atomic_flush: 0 2024-05-09T05:28:13.681 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-05-09T05:28:13.681 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.persist_stats_to_disk: 0 2024-05-09T05:28:13.682 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.write_dbid_to_manifest: 0 2024-05-09T05:28:13.682 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.log_readahead_size: 0 2024-05-09T05:28:13.682 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-05-09T05:28:13.682 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.best_efforts_recovery: 0 2024-05-09T05:28:13.682 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-05-09T05:28:13.682 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-05-09T05:28:13.682 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.allow_data_in_errors: 0 2024-05-09T05:28:13.682 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.db_host_id: __hostname__ 2024-05-09T05:28:13.682 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.enforce_single_del_contracts: true 2024-05-09T05:28:13.682 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.max_background_jobs: 2 2024-05-09T05:28:13.682 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.max_background_compactions: -1 2024-05-09T05:28:13.682 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.max_subcompactions: 1 2024-05-09T05:28:13.683 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-05-09T05:28:13.683 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-05-09T05:28:13.683 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.delayed_write_rate : 16777216 2024-05-09T05:28:13.683 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.max_total_wal_size: 0 2024-05-09T05:28:13.683 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-05-09T05:28:13.683 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.stats_dump_period_sec: 600 2024-05-09T05:28:13.683 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.stats_persist_period_sec: 600 2024-05-09T05:28:13.683 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-05-09T05:28:13.683 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.max_open_files: -1 2024-05-09T05:28:13.683 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.bytes_per_sync: 0 2024-05-09T05:28:13.683 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.wal_bytes_per_sync: 0 2024-05-09T05:28:13.683 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.strict_bytes_per_sync: 0 2024-05-09T05:28:13.683 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.compaction_readahead_size: 0 2024-05-09T05:28:13.683 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.max_background_flushes: -1 2024-05-09T05:28:13.683 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Compression algorithms supported: 2024-05-09T05:28:13.684 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-05-09T05:28:13.684 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: kZSTD supported: 0 2024-05-09T05:28:13.684 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: kXpressCompression supported: 0 2024-05-09T05:28:13.684 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: kLZ4HCCompression supported: 1 2024-05-09T05:28:13.684 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: kZlibCompression supported: 1 2024-05-09T05:28:13.684 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: kSnappyCompression supported: 1 2024-05-09T05:28:13.684 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: kLZ4Compression supported: 1 2024-05-09T05:28:13.684 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: kBZip2Compression supported: 0 2024-05-09T05:28:13.684 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Fast CRC32 supported: Supported on x86 2024-05-09T05:28:13.684 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: DMutex implementation: pthread_mutex_t 2024-05-09T05:28:13.684 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-05-09T05:28:13.684 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-05-09T05:28:13.684 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-05-09T05:28:13.684 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.merge_operator: 2024-05-09T05:28:13.685 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.compaction_filter: None 2024-05-09T05:28:13.685 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.compaction_filter_factory: None 2024-05-09T05:28:13.685 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.sst_partitioner_factory: None 2024-05-09T05:28:13.685 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.memtable_factory: SkipListFactory 2024-05-09T05:28:13.685 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.table_factory: BlockBasedTable 2024-05-09T05:28:13.685 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x556b244d41e0) 2024-05-09T05:28:13.685 INFO:journalctl@ceph.mon.c.smithi100.stdout: cache_index_and_filter_blocks: 1 2024-05-09T05:28:13.685 INFO:journalctl@ceph.mon.c.smithi100.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-05-09T05:28:13.685 INFO:journalctl@ceph.mon.c.smithi100.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-05-09T05:28:13.685 INFO:journalctl@ceph.mon.c.smithi100.stdout: pin_top_level_index_and_filter: 1 2024-05-09T05:28:13.685 INFO:journalctl@ceph.mon.c.smithi100.stdout: index_type: 0 2024-05-09T05:28:13.686 INFO:journalctl@ceph.mon.c.smithi100.stdout: data_block_index_type: 0 2024-05-09T05:28:13.686 INFO:journalctl@ceph.mon.c.smithi100.stdout: index_shortening: 1 2024-05-09T05:28:13.686 INFO:journalctl@ceph.mon.c.smithi100.stdout: data_block_hash_table_util_ratio: 0.750000 2024-05-09T05:28:13.686 INFO:journalctl@ceph.mon.c.smithi100.stdout: checksum: 4 2024-05-09T05:28:13.686 INFO:journalctl@ceph.mon.c.smithi100.stdout: no_block_cache: 0 2024-05-09T05:28:13.686 INFO:journalctl@ceph.mon.c.smithi100.stdout: block_cache: 0x556b243d11f0 2024-05-09T05:28:13.686 INFO:journalctl@ceph.mon.c.smithi100.stdout: block_cache_name: BinnedLRUCache 2024-05-09T05:28:13.686 INFO:journalctl@ceph.mon.c.smithi100.stdout: block_cache_options: 2024-05-09T05:28:13.686 INFO:journalctl@ceph.mon.c.smithi100.stdout: capacity : 536870912 2024-05-09T05:28:13.686 INFO:journalctl@ceph.mon.c.smithi100.stdout: num_shard_bits : 4 2024-05-09T05:28:13.686 INFO:journalctl@ceph.mon.c.smithi100.stdout: strict_capacity_limit : 0 2024-05-09T05:28:13.686 INFO:journalctl@ceph.mon.c.smithi100.stdout: high_pri_pool_ratio: 0.000 2024-05-09T05:28:13.686 INFO:journalctl@ceph.mon.c.smithi100.stdout: block_cache_compressed: (nil) 2024-05-09T05:28:13.687 INFO:journalctl@ceph.mon.c.smithi100.stdout: persistent_cache: (nil) 2024-05-09T05:28:13.687 INFO:journalctl@ceph.mon.c.smithi100.stdout: block_size: 4096 2024-05-09T05:28:13.687 INFO:journalctl@ceph.mon.c.smithi100.stdout: block_size_deviation: 10 2024-05-09T05:28:13.687 INFO:journalctl@ceph.mon.c.smithi100.stdout: block_restart_interval: 16 2024-05-09T05:28:13.687 INFO:journalctl@ceph.mon.c.smithi100.stdout: index_block_restart_interval: 1 2024-05-09T05:28:13.687 INFO:journalctl@ceph.mon.c.smithi100.stdout: metadata_block_size: 4096 2024-05-09T05:28:13.687 INFO:journalctl@ceph.mon.c.smithi100.stdout: partition_filters: 0 2024-05-09T05:28:13.687 INFO:journalctl@ceph.mon.c.smithi100.stdout: use_delta_encoding: 1 2024-05-09T05:28:13.687 INFO:journalctl@ceph.mon.c.smithi100.stdout: filter_policy: bloomfilter 2024-05-09T05:28:13.687 INFO:journalctl@ceph.mon.c.smithi100.stdout: whole_key_filtering: 1 2024-05-09T05:28:13.687 INFO:journalctl@ceph.mon.c.smithi100.stdout: verify_compression: 0 2024-05-09T05:28:13.687 INFO:journalctl@ceph.mon.c.smithi100.stdout: read_amp_bytes_per_bit: 0 2024-05-09T05:28:13.687 INFO:journalctl@ceph.mon.c.smithi100.stdout: format_version: 5 2024-05-09T05:28:13.688 INFO:journalctl@ceph.mon.c.smithi100.stdout: enable_index_compression: 1 2024-05-09T05:28:13.688 INFO:journalctl@ceph.mon.c.smithi100.stdout: block_align: 0 2024-05-09T05:28:13.688 INFO:journalctl@ceph.mon.c.smithi100.stdout: max_auto_readahead_size: 262144 2024-05-09T05:28:13.688 INFO:journalctl@ceph.mon.c.smithi100.stdout: prepopulate_block_cache: 0 2024-05-09T05:28:13.688 INFO:journalctl@ceph.mon.c.smithi100.stdout: initial_auto_readahead_size: 8192 2024-05-09T05:28:13.689 INFO:journalctl@ceph.mon.c.smithi100.stdout: num_file_reads_for_auto_readahead: 2 2024-05-09T05:28:13.689 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.write_buffer_size: 33554432 2024-05-09T05:28:13.689 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.max_write_buffer_number: 2 2024-05-09T05:28:13.689 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.compression: NoCompression 2024-05-09T05:28:13.689 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.bottommost_compression: Disabled 2024-05-09T05:28:13.690 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.prefix_extractor: nullptr 2024-05-09T05:28:13.690 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-05-09T05:28:13.690 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.num_levels: 7 2024-05-09T05:28:13.690 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-05-09T05:28:13.690 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-05-09T05:28:13.690 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-05-09T05:28:13.690 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-05-09T05:28:13.690 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-05-09T05:28:13.690 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-05-09T05:28:13.690 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-05-09T05:28:13.690 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-05-09T05:28:13.690 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-05-09T05:28:13.691 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-05-09T05:28:13.691 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-05-09T05:28:13.691 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-05-09T05:28:13.691 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.compression_opts.window_bits: -14 2024-05-09T05:28:13.691 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.compression_opts.level: 32767 2024-05-09T05:28:13.691 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.compression_opts.strategy: 0 2024-05-09T05:28:13.691 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-05-09T05:28:13.691 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-05-09T05:28:13.691 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-05-09T05:28:13.691 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-05-09T05:28:13.691 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.compression_opts.enabled: false 2024-05-09T05:28:13.691 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-05-09T05:28:13.692 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-05-09T05:28:13.692 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-05-09T05:28:13.692 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-05-09T05:28:13.692 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.target_file_size_base: 67108864 2024-05-09T05:28:13.692 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.target_file_size_multiplier: 1 2024-05-09T05:28:13.692 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-05-09T05:28:13.692 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-05-09T05:28:13.692 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-05-09T05:28:13.692 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-05-09T05:28:13.692 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-05-09T05:28:13.692 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-05-09T05:28:13.692 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-05-09T05:28:13.692 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-05-09T05:28:13.692 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-05-09T05:28:13.693 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-05-09T05:28:13.693 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-05-09T05:28:13.693 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-05-09T05:28:13.693 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-05-09T05:28:13.693 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.arena_block_size: 1048576 2024-05-09T05:28:13.693 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-05-09T05:28:13.693 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-05-09T05:28:13.693 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.disable_auto_compactions: 0 2024-05-09T05:28:13.693 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-05-09T05:28:13.693 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-05-09T05:28:13.693 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-05-09T05:28:13.693 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-05-09T05:28:13.693 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-05-09T05:28:13.694 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-05-09T05:28:13.694 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-05-09T05:28:13.694 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-05-09T05:28:13.694 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-05-09T05:28:13.694 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-05-09T05:28:13.694 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-05-09T05:28:13.694 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.inplace_update_support: 0 2024-05-09T05:28:13.694 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.inplace_update_num_locks: 10000 2024-05-09T05:28:13.694 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-05-09T05:28:13.694 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-05-09T05:28:13.694 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.memtable_huge_page_size: 0 2024-05-09T05:28:13.694 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.bloom_locality: 0 2024-05-09T05:28:13.694 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.max_successive_merges: 0 2024-05-09T05:28:13.694 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.optimize_filters_for_hits: 0 2024-05-09T05:28:13.695 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.paranoid_file_checks: 0 2024-05-09T05:28:13.695 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.force_consistency_checks: 1 2024-05-09T05:28:13.695 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.report_bg_io_stats: 0 2024-05-09T05:28:13.695 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.ttl: 2592000 2024-05-09T05:28:13.695 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.periodic_compaction_seconds: 0 2024-05-09T05:28:13.695 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-05-09T05:28:13.695 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-05-09T05:28:13.695 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.enable_blob_files: false 2024-05-09T05:28:13.695 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.min_blob_size: 0 2024-05-09T05:28:13.695 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.blob_file_size: 268435456 2024-05-09T05:28:13.695 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.blob_compression_type: NoCompression 2024-05-09T05:28:13.695 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.enable_blob_garbage_collection: false 2024-05-09T05:28:13.695 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-05-09T05:28:13.695 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-05-09T05:28:13.696 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-05-09T05:28:13.696 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.blob_file_starting_level: 0 2024-05-09T05:28:13.696 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-05-09T05:28:13.696 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-05-09T05:28:13.696 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-05-09T05:28:13.696 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 87392fb0-6b9a-424c-965d-edb4dd02e3b7 2024-05-09T05:28:13.696 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715232493512984, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-05-09T05:28:13.696 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-05-09T05:28:13.696 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715232493513408, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1715232493, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "87392fb0-6b9a-424c-965d-edb4dd02e3b7", "db_session_id": "68GOIGVYREHSBINK8NGJ", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-05-09T05:28:13.696 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715232493513485, "job": 1, "event": "recovery_finished"} 2024-05-09T05:28:13.696 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-05-09T05:28:13.697 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-05-09T05:28:13.697 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x556b243b5c00 2024-05-09T05:28:13.697 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: DB pointer 0x556b291a8000 2024-05-09T05:28:13.697 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-05-09T05:28:13.697 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-05-09T05:28:13.697 INFO:journalctl@ceph.mon.c.smithi100.stdout: ** DB Stats ** 2024-05-09T05:28:13.697 INFO:journalctl@ceph.mon.c.smithi100.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-09T05:28:13.697 INFO:journalctl@ceph.mon.c.smithi100.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-05-09T05:28:13.698 INFO:journalctl@ceph.mon.c.smithi100.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-09T05:28:13.698 INFO:journalctl@ceph.mon.c.smithi100.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-09T05:28:13.698 INFO:journalctl@ceph.mon.c.smithi100.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-05-09T05:28:13.698 INFO:journalctl@ceph.mon.c.smithi100.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-09T05:28:13.698 INFO:journalctl@ceph.mon.c.smithi100.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-09T05:28:13.698 INFO:journalctl@ceph.mon.c.smithi100.stdout: 2024-05-09T05:28:13.698 INFO:journalctl@ceph.mon.c.smithi100.stdout: ** Compaction Stats [default] ** 2024-05-09T05:28:13.698 INFO:journalctl@ceph.mon.c.smithi100.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-09T05:28:13.698 INFO:journalctl@ceph.mon.c.smithi100.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-05-09T05:28:13.698 INFO:journalctl@ceph.mon.c.smithi100.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-05-09T05:28:13.699 INFO:journalctl@ceph.mon.c.smithi100.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-05-09T05:28:13.699 INFO:journalctl@ceph.mon.c.smithi100.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-05-09T05:28:13.699 INFO:journalctl@ceph.mon.c.smithi100.stdout: 2024-05-09T05:28:13.699 INFO:journalctl@ceph.mon.c.smithi100.stdout: ** Compaction Stats [default] ** 2024-05-09T05:28:13.699 INFO:journalctl@ceph.mon.c.smithi100.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-09T05:28:13.699 INFO:journalctl@ceph.mon.c.smithi100.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-05-09T05:28:13.699 INFO:journalctl@ceph.mon.c.smithi100.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-05-09T05:28:13.699 INFO:journalctl@ceph.mon.c.smithi100.stdout: 2024-05-09T05:28:13.699 INFO:journalctl@ceph.mon.c.smithi100.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-05-09T05:28:13.699 INFO:journalctl@ceph.mon.c.smithi100.stdout: 2024-05-09T05:28:13.699 INFO:journalctl@ceph.mon.c.smithi100.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-09T05:28:13.699 INFO:journalctl@ceph.mon.c.smithi100.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-05-09T05:28:13.699 INFO:journalctl@ceph.mon.c.smithi100.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-05-09T05:28:13.699 INFO:journalctl@ceph.mon.c.smithi100.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-05-09T05:28:13.700 INFO:journalctl@ceph.mon.c.smithi100.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-05-09T05:28:13.700 INFO:journalctl@ceph.mon.c.smithi100.stdout: AddFile(Keys): cumulative 0, interval 0 2024-05-09T05:28:13.700 INFO:journalctl@ceph.mon.c.smithi100.stdout: Cumulative compaction: 0.00 GB write, 0.65 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-09T05:28:13.700 INFO:journalctl@ceph.mon.c.smithi100.stdout: Interval compaction: 0.00 GB write, 0.65 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-09T05:28:13.700 INFO:journalctl@ceph.mon.c.smithi100.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-05-09T05:28:13.700 INFO:journalctl@ceph.mon.c.smithi100.stdout: Block cache BinnedLRUCache@0x556b243d11f0#2 capacity: 512.00 MB usage: 0.23 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-05-09T05:28:13.700 INFO:journalctl@ceph.mon.c.smithi100.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.12 KB,2.23517e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-05-09T05:28:13.700 INFO:journalctl@ceph.mon.c.smithi100.stdout: 2024-05-09T05:28:13.700 INFO:journalctl@ceph.mon.c.smithi100.stdout: ** File Read Latency Histogram By Level [default] ** 2024-05-09T05:28:13.700 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-05-09T05:28:13.700 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: using public_addr v2:172.21.15.100:0/0 -> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] 2024-05-09T05:28:13.700 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: starting mon.c rank -1 at public addrs [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] at bind addrs [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 2024-05-09T05:28:13.700 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: mon.c@-1(???) e0 preinit fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 2024-05-09T05:28:13.700 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: mon.c@-1(synchronizing).mds e1 new map 2024-05-09T05:28:13.701 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: mon.c@-1(synchronizing).mds e1 print_map 2024-05-09T05:28:13.701 INFO:journalctl@ceph.mon.c.smithi100.stdout: e1 2024-05-09T05:28:13.701 INFO:journalctl@ceph.mon.c.smithi100.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-05-09T05:28:13.701 INFO:journalctl@ceph.mon.c.smithi100.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-05-09T05:28:13.701 INFO:journalctl@ceph.mon.c.smithi100.stdout: legacy client fscid: -1 2024-05-09T05:28:13.701 INFO:journalctl@ceph.mon.c.smithi100.stdout: 2024-05-09T05:28:13.701 INFO:journalctl@ceph.mon.c.smithi100.stdout: No filesystems configured 2024-05-09T05:28:13.701 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-05-09T05:28:13.701 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-05-09T05:28:13.701 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-05-09T05:28:13.701 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-05-09T05:28:13.701 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-05-09T05:28:13.701 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-05-09T05:28:13.701 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-05-09T05:28:13.702 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-05-09T05:28:13.702 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-05-09T05:28:13.702 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-05-09T05:28:13.702 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:28:13.702 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi100", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T05:28:13.702 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:13.702 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:13.702 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:13.702 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:13.702 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi060", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:28:13.703 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:28:13.703 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:28:13.704 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: Updating smithi060:/etc/ceph/ceph.conf 2024-05-09T05:28:13.704 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: Deploying cephadm binary to smithi100 2024-05-09T05:28:13.704 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:28:13.704 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: Updating smithi060:/var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T05:28:13.704 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: Updating smithi060:/etc/ceph/ceph.client.admin.keyring 2024-05-09T05:28:13.704 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:28:13.704 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: Updating smithi060:/var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-09T05:28:13.704 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:13.704 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:13.704 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:13.704 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:13.704 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:28:13.704 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:13.705 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: Added host smithi100 2024-05-09T05:28:13.705 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:28:13.705 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:13.705 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:28:13.705 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:13.705 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-09T05:28:13.705 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:28:13.705 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: from='client.? 172.21.15.39:0/370908538' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-05-09T05:28:13.705 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:13.705 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:13.705 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:13.705 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:13.705 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi100", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:28:13.705 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:28:13.705 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:28:13.706 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: Updating smithi100:/etc/ceph/ceph.conf 2024-05-09T05:28:13.706 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: from='client.? 172.21.15.39:0/370908538' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-05-09T05:28:13.706 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: osdmap e4: 0 total, 0 up, 0 in 2024-05-09T05:28:13.706 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: Updating smithi100:/var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T05:28:13.706 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:13.706 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:13.706 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:13.706 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: Updating smithi100:/etc/ceph/ceph.client.admin.keyring 2024-05-09T05:28:13.706 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: Updating smithi100:/var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-09T05:28:13.706 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:28:13.706 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi039:172.21.15.39=a;smithi060:172.21.15.60=b;smithi100:172.21.15.100=c", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T05:28:13.706 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: Saving service mon spec with placement smithi039:172.21.15.39=a;smithi060:172.21.15.60=b;smithi100:172.21.15.100=c;count:3 2024-05-09T05:28:13.707 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:13.707 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:28:13.707 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:28:13.707 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:28:13.707 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:13.707 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-09T05:28:13.707 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:28:13.707 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: Deploying daemon mon.c on smithi100 2024-05-09T05:28:13.707 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:28:13.707 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:28:13.708 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:28:13.708 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: from='client.? 172.21.15.100:0/3443088347' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-09T05:28:13.708 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 ceph-mon[34353]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-05-09T05:28:13.708 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 bash[34334]: 636febe0454da429ec5373253ab41d70cacabddae44ba9b1afb81862bda15c65 2024-05-09T05:28:13.708 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:13 smithi100 systemd[1]: Started Ceph mon.c for 86d4cc60-0dc4-11ef-bc97-c7b262605968. 2024-05-09T05:28:14.092 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-05-09T05:28:14.092 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-09T05:28:14.326 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.c/config 2024-05-09T05:28:18.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:18.847+0000 7f649746e700 1 -- 172.21.15.100:0/2909988610 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6490102de0 msgr2=0x7f647c005610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:28:18.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:18.847+0000 7f649746e700 1 --2- 172.21.15.100:0/2909988610 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6490102de0 0x7f647c005610 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f648c005fa0 tx=0x7f648c00ffc0 comp rx=0 tx=0).stop 2024-05-09T05:28:18.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:18.847+0000 7f649746e700 1 -- 172.21.15.100:0/2909988610 shutdown_connections 2024-05-09T05:28:18.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:18.847+0000 7f649746e700 1 --2- 172.21.15.100:0/2909988610 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6490102de0 0x7f647c005610 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:28:18.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:18.847+0000 7f649746e700 1 -- 172.21.15.100:0/2909988610 >> 172.21.15.100:0/2909988610 conn(0x7f64900fe630 msgr2=0x7f6490100aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:28:18.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:18.847+0000 7f649746e700 1 -- 172.21.15.100:0/2909988610 shutdown_connections 2024-05-09T05:28:18.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:18.847+0000 7f649746e700 1 -- 172.21.15.100:0/2909988610 wait complete. 2024-05-09T05:28:18.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:18.848+0000 7f649746e700 1 Processor -- start 2024-05-09T05:28:18.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:18.848+0000 7f649746e700 1 -- start start 2024-05-09T05:28:18.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:18.849+0000 7f649746e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6490102de0 0x7f649019f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:28:18.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:18.849+0000 7f649746e700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f649019fc10 0x7f64901998f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:28:18.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:18.849+0000 7f649746e700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f649010ab20 con 0x7f6490102de0 2024-05-09T05:28:18.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:18.849+0000 7f649746e700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f649010a9a0 con 0x7f649019fc10 2024-05-09T05:28:18.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:18.849+0000 7f6494a09700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f649019fc10 0x7f64901998f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:28:18.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:18.849+0000 7f6494a09700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f649019fc10 0x7f64901998f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35426/0 (socket says 172.21.15.100:35426) 2024-05-09T05:28:18.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:18.849+0000 7f6494a09700 1 -- 172.21.15.100:0/3718832328 learned_addr learned my addr 172.21.15.100:0/3718832328 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:28:18.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:18.849+0000 7f649520a700 1 --2- 172.21.15.100:0/3718832328 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6490102de0 0x7f649019f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:28:18.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:18.849+0000 7f6494a09700 1 -- 172.21.15.100:0/3718832328 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f649019fc10 msgr2=0x7f64901998f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-05-09T05:28:18.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:18.849+0000 7f6494a09700 1 -- 172.21.15.100:0/3718832328 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f649019fc10 msgr2=0x7f64901998f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-09T05:28:18.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:18.849+0000 7f6494a09700 1 --2- 172.21.15.100:0/3718832328 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f649019fc10 0x7f64901998f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-09T05:28:18.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:18.849+0000 7f6494a09700 1 --2- 172.21.15.100:0/3718832328 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f649019fc10 0x7f64901998f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-09T05:28:18.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:18.849+0000 7f649520a700 1 -- 172.21.15.100:0/3718832328 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f649019fc10 msgr2=0x7f64901998f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-09T05:28:18.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:18.849+0000 7f649520a700 1 --2- 172.21.15.100:0/3718832328 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f649019fc10 0x7f64901998f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:28:18.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:18.849+0000 7f649520a700 1 -- 172.21.15.100:0/3718832328 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64901a01e0 con 0x7f6490102de0 2024-05-09T05:28:18.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:18.850+0000 7f649520a700 1 --2- 172.21.15.100:0/3718832328 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6490102de0 0x7f649019f6d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f648c005fa0 tx=0x7f648c004d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:28:18.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:18.850+0000 7f64867fc700 1 -- 172.21.15.100:0/3718832328 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f648c005230 con 0x7f6490102de0 2024-05-09T05:28:18.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:18.850+0000 7f64867fc700 1 -- 172.21.15.100:0/3718832328 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f648c01b430 con 0x7f6490102de0 2024-05-09T05:28:18.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:18.850+0000 7f649746e700 1 -- 172.21.15.100:0/3718832328 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6490199e90 con 0x7f6490102de0 2024-05-09T05:28:18.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:18.850+0000 7f64867fc700 1 -- 172.21.15.100:0/3718832328 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f648c011670 con 0x7f6490102de0 2024-05-09T05:28:18.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:18.850+0000 7f649746e700 1 -- 172.21.15.100:0/3718832328 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f649019a420 con 0x7f6490102de0 2024-05-09T05:28:18.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:18.851+0000 7f649746e700 1 -- 172.21.15.100:0/3718832328 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6490104290 con 0x7f6490102de0 2024-05-09T05:28:18.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:18.851+0000 7f64867fc700 1 -- 172.21.15.100:0/3718832328 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f648c011920 con 0x7f6490102de0 2024-05-09T05:28:18.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:18.851+0000 7f64867fc700 1 --2- 172.21.15.100:0/3718832328 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f647403e300 0x7f6474040810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:28:18.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:18.852+0000 7f64867fc700 1 -- 172.21.15.100:0/3718832328 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f648c054cb0 con 0x7f6490102de0 2024-05-09T05:28:18.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:18.852+0000 7f6494a09700 1 --2- 172.21.15.100:0/3718832328 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f647403e300 0x7f6474040810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:28:18.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:18.852+0000 7f6494a09700 1 --2- 172.21.15.100:0/3718832328 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f647403e300 0x7f6474040810 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f649006cbe0 tx=0x7f6480008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:28:18.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:18.857+0000 7f64867fc700 1 -- 172.21.15.100:0/3718832328 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f648c022070 con 0x7f6490102de0 2024-05-09T05:28:18.925 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:18 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-09T05:28:18.925 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:18 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-09T05:28:18.925 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:18 smithi100 ceph-mon[34353]: mon.a calling monitor election 2024-05-09T05:28:18.925 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:18 smithi100 ceph-mon[34353]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:28:18.925 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:18 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-09T05:28:18.925 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:18 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-09T05:28:18.925 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:18 smithi100 ceph-mon[34353]: mon.c calling monitor election 2024-05-09T05:28:18.925 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:18 smithi100 ceph-mon[34353]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:28:18.925 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:18 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-09T05:28:18.925 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:18 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-09T05:28:18.925 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:18 smithi100 ceph-mon[34353]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:28:18.925 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:18 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-09T05:28:18.926 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:18 smithi100 ceph-mon[34353]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-05-09T05:28:18.926 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:18 smithi100 ceph-mon[34353]: monmap epoch 2 2024-05-09T05:28:18.926 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:18 smithi100 ceph-mon[34353]: fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 2024-05-09T05:28:18.926 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:18 smithi100 ceph-mon[34353]: last_changed 2024-05-09T05:28:13.540900+0000 2024-05-09T05:28:18.926 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:18 smithi100 ceph-mon[34353]: created 2024-05-09T05:26:29.940750+0000 2024-05-09T05:28:18.926 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:18 smithi100 ceph-mon[34353]: min_mon_release 19 (squid) 2024-05-09T05:28:18.926 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:18 smithi100 ceph-mon[34353]: election_strategy: 1 2024-05-09T05:28:18.926 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:18 smithi100 ceph-mon[34353]: 0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-05-09T05:28:18.926 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:18 smithi100 ceph-mon[34353]: 1: [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] mon.c 2024-05-09T05:28:18.926 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:18 smithi100 ceph-mon[34353]: fsmap 2024-05-09T05:28:18.926 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:18 smithi100 ceph-mon[34353]: osdmap e4: 0 total, 0 up, 0 in 2024-05-09T05:28:18.926 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:18 smithi100 ceph-mon[34353]: mgrmap e13: x(active, since 50s) 2024-05-09T05:28:18.926 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:18 smithi100 ceph-mon[34353]: overall HEALTH_OK 2024-05-09T05:28:18.927 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:18 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:18.927 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:18 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:18.927 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:18 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:18.927 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:18 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-09T05:28:18.927 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:18 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:28:19.111 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:18 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-09T05:28:19.111 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:18 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-09T05:28:19.111 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:18 smithi039 ceph-mon[30439]: mon.a calling monitor election 2024-05-09T05:28:19.111 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:18 smithi039 ceph-mon[30439]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:28:19.111 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:18 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-09T05:28:19.111 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:18 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-09T05:28:19.112 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:18 smithi039 ceph-mon[30439]: mon.c calling monitor election 2024-05-09T05:28:19.112 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:18 smithi039 ceph-mon[30439]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:28:19.112 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:18 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-09T05:28:19.112 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:18 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-09T05:28:19.112 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:18 smithi039 ceph-mon[30439]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:28:19.112 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:18 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-09T05:28:19.112 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:18 smithi039 ceph-mon[30439]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-05-09T05:28:19.112 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:18 smithi039 ceph-mon[30439]: monmap epoch 2 2024-05-09T05:28:19.112 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:18 smithi039 ceph-mon[30439]: fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 2024-05-09T05:28:19.112 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:18 smithi039 ceph-mon[30439]: last_changed 2024-05-09T05:28:13.540900+0000 2024-05-09T05:28:19.112 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:18 smithi039 ceph-mon[30439]: created 2024-05-09T05:26:29.940750+0000 2024-05-09T05:28:19.112 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:18 smithi039 ceph-mon[30439]: min_mon_release 19 (squid) 2024-05-09T05:28:19.112 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:18 smithi039 ceph-mon[30439]: election_strategy: 1 2024-05-09T05:28:19.113 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:18 smithi039 ceph-mon[30439]: 0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-05-09T05:28:19.113 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:18 smithi039 ceph-mon[30439]: 1: [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] mon.c 2024-05-09T05:28:19.113 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:18 smithi039 ceph-mon[30439]: fsmap 2024-05-09T05:28:19.113 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:18 smithi039 ceph-mon[30439]: osdmap e4: 0 total, 0 up, 0 in 2024-05-09T05:28:19.113 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:18 smithi039 ceph-mon[30439]: mgrmap e13: x(active, since 50s) 2024-05-09T05:28:19.113 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:18 smithi039 ceph-mon[30439]: overall HEALTH_OK 2024-05-09T05:28:19.113 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:18 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:19.113 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:18 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:19.113 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:18 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:19.113 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:18 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-09T05:28:19.113 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:18 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:28:19.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:19.153+0000 7f649746e700 1 -- 172.21.15.100:0/3718832328 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f649019ae20 con 0x7f6490102de0 2024-05-09T05:28:19.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:19.153+0000 7f64867fc700 1 -- 172.21.15.100:0/3718832328 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7f648c02d360 con 0x7f6490102de0 2024-05-09T05:28:19.148 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:28:19.148 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":2,"fsid":"86d4cc60-0dc4-11ef-bc97-c7b262605968","modified":"2024-05-09T05:28:13.540900Z","created":"2024-05-09T05:26:29.940750Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:3300","nonce":0},{"type":"v1","addr":"172.21.15.39:6789","nonce":0}]},"addr":"172.21.15.39:6789/0","public_addr":"172.21.15.39:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-05-09T05:28:19.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:19.156+0000 7f649746e700 1 -- 172.21.15.100:0/3718832328 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f647403e300 msgr2=0x7f6474040810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:28:19.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:19.156+0000 7f649746e700 1 --2- 172.21.15.100:0/3718832328 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f647403e300 0x7f6474040810 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f649006cbe0 tx=0x7f6480008040 comp rx=0 tx=0).stop 2024-05-09T05:28:19.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:19.156+0000 7f649746e700 1 -- 172.21.15.100:0/3718832328 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6490102de0 msgr2=0x7f649019f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:28:19.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:19.156+0000 7f649746e700 1 --2- 172.21.15.100:0/3718832328 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6490102de0 0x7f649019f6d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f648c005fa0 tx=0x7f648c004d60 comp rx=0 tx=0).stop 2024-05-09T05:28:19.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:19.156+0000 7f649746e700 1 -- 172.21.15.100:0/3718832328 shutdown_connections 2024-05-09T05:28:19.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:19.156+0000 7f649746e700 1 --2- 172.21.15.100:0/3718832328 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f647403e300 0x7f6474040810 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:28:19.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:19.156+0000 7f649746e700 1 --2- 172.21.15.100:0/3718832328 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6490102de0 0x7f649019f6d0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:28:19.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:19.156+0000 7f649746e700 1 --2- 172.21.15.100:0/3718832328 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f649019fc10 0x7f64901998f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:28:19.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:19.156+0000 7f649746e700 1 -- 172.21.15.100:0/3718832328 >> 172.21.15.100:0/3718832328 conn(0x7f64900fe630 msgr2=0x7f64901090d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:28:19.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:19.156+0000 7f649746e700 1 -- 172.21.15.100:0/3718832328 shutdown_connections 2024-05-09T05:28:19.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:19.156+0000 7f649746e700 1 -- 172.21.15.100:0/3718832328 wait complete. 2024-05-09T05:28:19.152 INFO:teuthology.orchestra.run.smithi100.stderr:dumped monmap epoch 2 2024-05-09T05:28:19.718 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:19 smithi100 ceph-mon[34353]: Deploying daemon mon.b on smithi060 2024-05-09T05:28:19.718 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:19 smithi100 ceph-mon[34353]: from='client.? 172.21.15.100:0/3718832328' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-09T05:28:19.718 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:19 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-09T05:28:20.111 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:19 smithi039 ceph-mon[30439]: Deploying daemon mon.b on smithi060 2024-05-09T05:28:20.111 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:19 smithi039 ceph-mon[30439]: from='client.? 172.21.15.100:0/3718832328' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-09T05:28:20.111 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:19 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-09T05:28:20.745 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-05-09T05:28:20.746 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-09T05:28:20.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:20 smithi039 ceph-mon[30439]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:28:20.861 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:28:20 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: 2024-05-09T05:28:20.540+0000 7fcb56c32700 -1 mgr.server handle_report got status from non-daemon mon.c 2024-05-09T05:28:20.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:20 smithi100 ceph-mon[34353]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:28:20.981 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.c/config 2024-05-09T05:28:22.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:22.459+0000 7f77f128c700 1 -- 172.21.15.100:0/2211905791 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f77ec108c30 msgr2=0x7f77ec109040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:28:22.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:22.459+0000 7f77f128c700 1 --2- 172.21.15.100:0/2211905791 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f77ec108c30 0x7f77ec109040 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f77e0009910 tx=0x7f77e0009c20 comp rx=0 tx=0).stop 2024-05-09T05:28:22.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:22.459+0000 7f77f128c700 1 -- 172.21.15.100:0/2211905791 shutdown_connections 2024-05-09T05:28:22.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:22.459+0000 7f77f128c700 1 --2- 172.21.15.100:0/2211905791 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f77ec108c30 0x7f77ec109040 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:28:22.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:22.459+0000 7f77f128c700 1 -- 172.21.15.100:0/2211905791 >> 172.21.15.100:0/2211905791 conn(0x7f77ec0fe670 msgr2=0x7f77ec100ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:28:22.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:22.459+0000 7f77f128c700 1 -- 172.21.15.100:0/2211905791 shutdown_connections 2024-05-09T05:28:22.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:22.459+0000 7f77f128c700 1 -- 172.21.15.100:0/2211905791 wait complete. 2024-05-09T05:28:22.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:22.459+0000 7f77f128c700 1 Processor -- start 2024-05-09T05:28:22.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:22.460+0000 7f77f128c700 1 -- start start 2024-05-09T05:28:22.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:22.460+0000 7f77f128c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f77ec108c30 0x7f77ec19a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:28:22.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:22.460+0000 7f77f128c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77ec19af10 0x7f77ec19b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:28:22.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:22.460+0000 7f77f128c700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f77ec10d110 con 0x7f77ec108c30 2024-05-09T05:28:22.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:22.460+0000 7f77f128c700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f77ec10cf90 con 0x7f77ec19af10 2024-05-09T05:28:22.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:22.460+0000 7f77ea7fc700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77ec19af10 0x7f77ec19b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:28:22.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:22.460+0000 7f77ea7fc700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77ec19af10 0x7f77ec19b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35428/0 (socket says 172.21.15.100:35428) 2024-05-09T05:28:22.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:22.460+0000 7f77ea7fc700 1 -- 172.21.15.100:0/3402424936 learned_addr learned my addr 172.21.15.100:0/3402424936 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:28:22.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:22.460+0000 7f77eaffd700 1 --2- 172.21.15.100:0/3402424936 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f77ec108c30 0x7f77ec19a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:28:22.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:22.460+0000 7f77ea7fc700 1 -- 172.21.15.100:0/3402424936 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77ec19af10 msgr2=0x7f77ec19b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-05-09T05:28:22.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:22.460+0000 7f77ea7fc700 1 -- 172.21.15.100:0/3402424936 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77ec19af10 msgr2=0x7f77ec19b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-09T05:28:22.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:22.460+0000 7f77ea7fc700 1 --2- 172.21.15.100:0/3402424936 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77ec19af10 0x7f77ec19b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-09T05:28:22.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:22.460+0000 7f77ea7fc700 1 --2- 172.21.15.100:0/3402424936 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77ec19af10 0x7f77ec19b320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-09T05:28:22.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:22.460+0000 7f77eaffd700 1 -- 172.21.15.100:0/3402424936 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77ec19af10 msgr2=0x7f77ec19b320 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-09T05:28:22.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:22.460+0000 7f77eaffd700 1 --2- 172.21.15.100:0/3402424936 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77ec19af10 0x7f77ec19b320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:28:22.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:22.460+0000 7f77eaffd700 1 -- 172.21.15.100:0/3402424936 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77ec1a3a40 con 0x7f77ec108c30 2024-05-09T05:28:22.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:22.461+0000 7f77eaffd700 1 --2- 172.21.15.100:0/3402424936 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f77ec108c30 0x7f77ec19a9d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f77e0009910 tx=0x7f77e0005030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:28:22.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:22.461+0000 7f77d3fff700 1 -- 172.21.15.100:0/3402424936 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f77e0005dc0 con 0x7f77ec108c30 2024-05-09T05:28:22.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:22.461+0000 7f77d3fff700 1 -- 172.21.15.100:0/3402424936 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f77e000b750 con 0x7f77ec108c30 2024-05-09T05:28:22.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:22.461+0000 7f77f128c700 1 -- 172.21.15.100:0/3402424936 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77ec1a3c10 con 0x7f77ec108c30 2024-05-09T05:28:22.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:22.461+0000 7f77d3fff700 1 -- 172.21.15.100:0/3402424936 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f77e0003980 con 0x7f77ec108c30 2024-05-09T05:28:22.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:22.461+0000 7f77f128c700 1 -- 172.21.15.100:0/3402424936 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77ec1a4110 con 0x7f77ec108c30 2024-05-09T05:28:22.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:22.462+0000 7f77f128c700 1 -- 172.21.15.100:0/3402424936 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77ec104200 con 0x7f77ec108c30 2024-05-09T05:28:22.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:22.462+0000 7f77d3fff700 1 -- 172.21.15.100:0/3402424936 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f77e0029070 con 0x7f77ec108c30 2024-05-09T05:28:22.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:22.462+0000 7f77d3fff700 1 --2- 172.21.15.100:0/3402424936 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f77d403e300 0x7f77d4040810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:28:22.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:22.462+0000 7f77d3fff700 1 -- 172.21.15.100:0/3402424936 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f77e001e070 con 0x7f77ec108c30 2024-05-09T05:28:22.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:22.462+0000 7f77ea7fc700 1 --2- 172.21.15.100:0/3402424936 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f77d403e300 0x7f77d4040810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:28:22.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:22.463+0000 7f77ea7fc700 1 --2- 172.21.15.100:0/3402424936 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f77d403e300 0x7f77d4040810 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f77ec101cc0 tx=0x7f77dc008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:28:22.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:22.468+0000 7f77d3fff700 1 -- 172.21.15.100:0/3402424936 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f77e0013070 con 0x7f77ec108c30 2024-05-09T05:28:22.721 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-05-09T05:28:22.721 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-05-09T05:28:22.721 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-05-09T05:28:22.721 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-05-09T05:28:22.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:22.753+0000 7f77d3fff700 1 -- 172.21.15.100:0/3402424936 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77e002ae20 con 0x7f77ec108c30 2024-05-09T05:28:22.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:22.760+0000 7f77f128c700 1 -- 172.21.15.100:0/3402424936 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f77ec1a4480 con 0x7f77ec108c30 2024-05-09T05:28:23.048 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-05-09T05:28:23.048 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-05-09T05:28:23.048 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-05-09T05:28:23.048 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-05-09T05:28:23.048 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-05-09T05:28:23.048 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-05-09T05:28:23.049 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-05-09T05:28:23.049 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-05-09T05:28:23.049 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-05-09T05:28:23.049 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: rocksdb: Options.arena_block_size: 1048576 2024-05-09T05:28:23.049 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-05-09T05:28:23.049 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-05-09T05:28:23.049 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: rocksdb: Options.disable_auto_compactions: 0 2024-05-09T05:28:23.049 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-05-09T05:28:23.049 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-05-09T05:28:23.049 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-05-09T05:28:23.049 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-05-09T05:28:23.049 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-05-09T05:28:23.049 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-05-09T05:28:23.049 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-05-09T05:28:23.050 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-05-09T05:28:23.050 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-05-09T05:28:23.050 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-05-09T05:28:23.050 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-05-09T05:28:23.050 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: rocksdb: Options.inplace_update_support: 0 2024-05-09T05:28:23.050 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: rocksdb: Options.inplace_update_num_locks: 10000 2024-05-09T05:28:23.050 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-05-09T05:28:23.050 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-05-09T05:28:23.050 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: rocksdb: Options.memtable_huge_page_size: 0 2024-05-09T05:28:23.050 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: rocksdb: Options.bloom_locality: 0 2024-05-09T05:28:23.050 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: rocksdb: Options.max_successive_merges: 0 2024-05-09T05:28:23.050 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: rocksdb: Options.optimize_filters_for_hits: 0 2024-05-09T05:28:23.050 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: rocksdb: Options.paranoid_file_checks: 0 2024-05-09T05:28:23.050 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: rocksdb: Options.force_consistency_checks: 1 2024-05-09T05:28:23.051 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: rocksdb: Options.report_bg_io_stats: 0 2024-05-09T05:28:23.051 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: rocksdb: Options.ttl: 2592000 2024-05-09T05:28:23.051 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: rocksdb: Options.periodic_compaction_seconds: 0 2024-05-09T05:28:23.051 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-05-09T05:28:23.051 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-05-09T05:28:23.051 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: rocksdb: Options.enable_blob_files: false 2024-05-09T05:28:23.051 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: rocksdb: Options.min_blob_size: 0 2024-05-09T05:28:23.051 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: rocksdb: Options.blob_file_size: 268435456 2024-05-09T05:28:23.051 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: rocksdb: Options.blob_compression_type: NoCompression 2024-05-09T05:28:23.051 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: rocksdb: Options.enable_blob_garbage_collection: false 2024-05-09T05:28:23.051 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-05-09T05:28:23.051 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-05-09T05:28:23.051 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-05-09T05:28:23.051 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: rocksdb: Options.blob_file_starting_level: 0 2024-05-09T05:28:23.051 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-05-09T05:28:23.051 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-05-09T05:28:23.052 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-05-09T05:28:23.052 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 62ed3b7f-8217-4b42-9145-e7c35944b95a 2024-05-09T05:28:23.052 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715232502723015, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-05-09T05:28:23.052 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-05-09T05:28:23.052 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715232502723637, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1773, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1715232502, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "62ed3b7f-8217-4b42-9145-e7c35944b95a", "db_session_id": "5W2NF3R1K9FZ7J3JF8B4", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-05-09T05:28:23.052 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715232502723750, "job": 1, "event": "recovery_finished"} 2024-05-09T05:28:23.052 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-05-09T05:28:23.052 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-05-09T05:28:23.052 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x558c1f2f3c00 2024-05-09T05:28:23.052 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: rocksdb: DB pointer 0x558c240e6000 2024-05-09T05:28:23.052 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-05-09T05:28:23.052 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-05-09T05:28:23.052 INFO:journalctl@ceph.mon.b.smithi060.stdout: ** DB Stats ** 2024-05-09T05:28:23.052 INFO:journalctl@ceph.mon.b.smithi060.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-09T05:28:23.052 INFO:journalctl@ceph.mon.b.smithi060.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-05-09T05:28:23.053 INFO:journalctl@ceph.mon.b.smithi060.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-09T05:28:23.053 INFO:journalctl@ceph.mon.b.smithi060.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-09T05:28:23.053 INFO:journalctl@ceph.mon.b.smithi060.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-05-09T05:28:23.053 INFO:journalctl@ceph.mon.b.smithi060.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-09T05:28:23.053 INFO:journalctl@ceph.mon.b.smithi060.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-09T05:28:23.053 INFO:journalctl@ceph.mon.b.smithi060.stdout: 2024-05-09T05:28:23.053 INFO:journalctl@ceph.mon.b.smithi060.stdout: ** Compaction Stats [default] ** 2024-05-09T05:28:23.053 INFO:journalctl@ceph.mon.b.smithi060.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-09T05:28:23.053 INFO:journalctl@ceph.mon.b.smithi060.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-05-09T05:28:23.053 INFO:journalctl@ceph.mon.b.smithi060.stdout: L0 1/0 1.73 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-09T05:28:23.053 INFO:journalctl@ceph.mon.b.smithi060.stdout: Sum 1/0 1.73 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-09T05:28:23.053 INFO:journalctl@ceph.mon.b.smithi060.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-09T05:28:23.053 INFO:journalctl@ceph.mon.b.smithi060.stdout: 2024-05-09T05:28:23.053 INFO:journalctl@ceph.mon.b.smithi060.stdout: ** Compaction Stats [default] ** 2024-05-09T05:28:23.053 INFO:journalctl@ceph.mon.b.smithi060.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-09T05:28:23.054 INFO:journalctl@ceph.mon.b.smithi060.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-05-09T05:28:23.054 INFO:journalctl@ceph.mon.b.smithi060.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-09T05:28:23.054 INFO:journalctl@ceph.mon.b.smithi060.stdout: 2024-05-09T05:28:23.054 INFO:journalctl@ceph.mon.b.smithi060.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-05-09T05:28:23.054 INFO:journalctl@ceph.mon.b.smithi060.stdout: 2024-05-09T05:28:23.054 INFO:journalctl@ceph.mon.b.smithi060.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-09T05:28:23.054 INFO:journalctl@ceph.mon.b.smithi060.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-05-09T05:28:23.054 INFO:journalctl@ceph.mon.b.smithi060.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-05-09T05:28:23.054 INFO:journalctl@ceph.mon.b.smithi060.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-05-09T05:28:23.054 INFO:journalctl@ceph.mon.b.smithi060.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-05-09T05:28:23.054 INFO:journalctl@ceph.mon.b.smithi060.stdout: AddFile(Keys): cumulative 0, interval 0 2024-05-09T05:28:23.054 INFO:journalctl@ceph.mon.b.smithi060.stdout: Cumulative compaction: 0.00 GB write, 0.45 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-09T05:28:23.054 INFO:journalctl@ceph.mon.b.smithi060.stdout: Interval compaction: 0.00 GB write, 0.45 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-09T05:28:23.055 INFO:journalctl@ceph.mon.b.smithi060.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-05-09T05:28:23.055 INFO:journalctl@ceph.mon.b.smithi060.stdout: Block cache BinnedLRUCache@0x558c1f30f1f0#2 capacity: 512.00 MB usage: 0.23 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-05-09T05:28:23.055 INFO:journalctl@ceph.mon.b.smithi060.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.12 KB,2.23517e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-05-09T05:28:23.055 INFO:journalctl@ceph.mon.b.smithi060.stdout: 2024-05-09T05:28:23.055 INFO:journalctl@ceph.mon.b.smithi060.stdout: ** File Read Latency Histogram By Level [default] ** 2024-05-09T05:28:23.055 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: mon.b does not exist in monmap, will attempt to join an existing cluster 2024-05-09T05:28:23.055 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: using public_addr v2:172.21.15.60:0/0 -> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] 2024-05-09T05:28:23.055 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: starting mon.b rank -1 at public addrs [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] at bind addrs [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 2024-05-09T05:28:23.055 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: mon.b@-1(???) e0 preinit fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 2024-05-09T05:28:23.055 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: mon.b@-1(synchronizing).mds e1 new map 2024-05-09T05:28:23.055 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: mon.b@-1(synchronizing).mds e1 print_map 2024-05-09T05:28:23.055 INFO:journalctl@ceph.mon.b.smithi060.stdout: e1 2024-05-09T05:28:23.055 INFO:journalctl@ceph.mon.b.smithi060.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-05-09T05:28:23.055 INFO:journalctl@ceph.mon.b.smithi060.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-05-09T05:28:23.055 INFO:journalctl@ceph.mon.b.smithi060.stdout: legacy client fscid: -1 2024-05-09T05:28:23.055 INFO:journalctl@ceph.mon.b.smithi060.stdout: 2024-05-09T05:28:23.056 INFO:journalctl@ceph.mon.b.smithi060.stdout: No filesystems configured 2024-05-09T05:28:23.056 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-05-09T05:28:23.056 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-05-09T05:28:23.056 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-05-09T05:28:23.056 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-05-09T05:28:23.056 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-05-09T05:28:23.056 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-05-09T05:28:23.056 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-05-09T05:28:23.056 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-05-09T05:28:23.056 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-05-09T05:28:23.056 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-05-09T05:28:23.056 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:28:23.057 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi100", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T05:28:23.057 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:23.057 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:23.057 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:23.057 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:23.057 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi060", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:28:23.057 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:28:23.057 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:28:23.057 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: Updating smithi060:/etc/ceph/ceph.conf 2024-05-09T05:28:23.057 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: Deploying cephadm binary to smithi100 2024-05-09T05:28:23.058 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:28:23.058 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: Updating smithi060:/var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T05:28:23.058 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: Updating smithi060:/etc/ceph/ceph.client.admin.keyring 2024-05-09T05:28:23.058 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:28:23.058 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: Updating smithi060:/var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-09T05:28:23.058 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:23.058 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:23.058 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:23.058 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:23.058 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:28:23.058 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:23.058 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: Added host smithi100 2024-05-09T05:28:23.058 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:28:23.058 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:23.059 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:28:23.059 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:23.059 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-09T05:28:23.059 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:28:23.059 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: from='client.? 172.21.15.39:0/370908538' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-05-09T05:28:23.059 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:23.059 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:23.059 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:23.059 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:23.059 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi100", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:28:23.059 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:28:23.059 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:28:23.059 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: Updating smithi100:/etc/ceph/ceph.conf 2024-05-09T05:28:23.059 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: from='client.? 172.21.15.39:0/370908538' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-05-09T05:28:23.059 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: osdmap e4: 0 total, 0 up, 0 in 2024-05-09T05:28:23.059 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: Updating smithi100:/var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T05:28:23.060 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:23.060 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:23.060 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:23.060 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: Updating smithi100:/etc/ceph/ceph.client.admin.keyring 2024-05-09T05:28:23.060 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: Updating smithi100:/var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-09T05:28:23.060 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:28:23.060 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi039:172.21.15.39=a;smithi060:172.21.15.60=b;smithi100:172.21.15.100=c", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T05:28:23.060 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: Saving service mon spec with placement smithi039:172.21.15.39=a;smithi060:172.21.15.60=b;smithi100:172.21.15.100=c;count:3 2024-05-09T05:28:23.060 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:23.060 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:28:23.060 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:28:23.060 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:28:23.060 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:23.060 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-09T05:28:23.060 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:28:23.060 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: Deploying daemon mon.c on smithi100 2024-05-09T05:28:23.061 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:28:23.061 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:28:23.061 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:28:23.061 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: from='client.? 172.21.15.100:0/3443088347' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-09T05:28:23.061 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-09T05:28:23.061 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-09T05:28:23.061 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: mon.a calling monitor election 2024-05-09T05:28:23.061 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:28:23.061 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-09T05:28:23.061 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-09T05:28:23.061 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: mon.c calling monitor election 2024-05-09T05:28:23.061 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:28:23.061 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-09T05:28:23.061 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-09T05:28:23.062 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:28:23.062 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-09T05:28:23.062 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-05-09T05:28:23.062 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: monmap epoch 2 2024-05-09T05:28:23.062 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 2024-05-09T05:28:23.062 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: last_changed 2024-05-09T05:28:13.540900+0000 2024-05-09T05:28:23.062 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: created 2024-05-09T05:26:29.940750+0000 2024-05-09T05:28:23.062 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: min_mon_release 19 (squid) 2024-05-09T05:28:23.062 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: election_strategy: 1 2024-05-09T05:28:23.062 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: 0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-05-09T05:28:23.062 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: 1: [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] mon.c 2024-05-09T05:28:23.062 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: fsmap 2024-05-09T05:28:23.062 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: osdmap e4: 0 total, 0 up, 0 in 2024-05-09T05:28:23.062 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: mgrmap e13: x(active, since 50s) 2024-05-09T05:28:23.063 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: overall HEALTH_OK 2024-05-09T05:28:23.063 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:23.063 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:23.063 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:23.063 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-09T05:28:23.063 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:28:23.063 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: Deploying daemon mon.b on smithi060 2024-05-09T05:28:23.063 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: from='client.? 172.21.15.100:0/3718832328' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-09T05:28:23.063 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-09T05:28:23.063 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:28:23.063 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 ceph-mon[34555]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-05-09T05:28:23.063 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 bash[34537]: 2d6b6454a11041ed3c797fde4e492d7da66fca80b79011b5fa1c7fcbcd5430a9 2024-05-09T05:28:23.063 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:22 smithi060 systemd[1]: Started Ceph mon.b for 86d4cc60-0dc4-11ef-bc97-c7b262605968. 2024-05-09T05:28:27.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:27.765+0000 7f77d3fff700 1 -- 172.21.15.100:0/3402424936 <== mon.0 v2:172.21.15.39:3300/0 8 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1279 (secure 0 0 0) 0x7f77e0030050 con 0x7f77ec108c30 2024-05-09T05:28:27.760 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-05-09T05:28:27.760 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":3,"fsid":"86d4cc60-0dc4-11ef-bc97-c7b262605968","modified":"2024-05-09T05:28:22.753302Z","created":"2024-05-09T05:26:29.940750Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:3300","nonce":0},{"type":"v1","addr":"172.21.15.39:6789","nonce":0}]},"addr":"172.21.15.39:6789/0","public_addr":"172.21.15.39:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-05-09T05:28:27.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:27.768+0000 7f77f128c700 1 -- 172.21.15.100:0/3402424936 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f77d403e300 msgr2=0x7f77d4040810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:28:27.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:27.768+0000 7f77f128c700 1 --2- 172.21.15.100:0/3402424936 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f77d403e300 0x7f77d4040810 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f77ec101cc0 tx=0x7f77dc008040 comp rx=0 tx=0).stop 2024-05-09T05:28:27.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:27.768+0000 7f77f128c700 1 -- 172.21.15.100:0/3402424936 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f77ec108c30 msgr2=0x7f77ec19a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:28:27.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:27.768+0000 7f77f128c700 1 --2- 172.21.15.100:0/3402424936 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f77ec108c30 0x7f77ec19a9d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f77e0009910 tx=0x7f77e0005030 comp rx=0 tx=0).stop 2024-05-09T05:28:27.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:27.768+0000 7f77f128c700 1 -- 172.21.15.100:0/3402424936 shutdown_connections 2024-05-09T05:28:27.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:27.768+0000 7f77f128c700 1 --2- 172.21.15.100:0/3402424936 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f77d403e300 0x7f77d4040810 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:28:27.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:27.768+0000 7f77f128c700 1 --2- 172.21.15.100:0/3402424936 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f77ec108c30 0x7f77ec19a9d0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:28:27.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:27.768+0000 7f77f128c700 1 --2- 172.21.15.100:0/3402424936 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77ec19af10 0x7f77ec19b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:28:27.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:27.768+0000 7f77f128c700 1 -- 172.21.15.100:0/3402424936 >> 172.21.15.100:0/3402424936 conn(0x7f77ec0fe670 msgr2=0x7f77ec0ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:28:27.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:27.769+0000 7f77f128c700 1 -- 172.21.15.100:0/3402424936 shutdown_connections 2024-05-09T05:28:27.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:27.769+0000 7f77f128c700 1 -- 172.21.15.100:0/3402424936 wait complete. 2024-05-09T05:28:27.764 INFO:teuthology.orchestra.run.smithi100.stderr:dumped monmap epoch 3 2024-05-09T05:28:28.069 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:27 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-09T05:28:28.069 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:27 smithi039 ceph-mon[30439]: mon.a calling monitor election 2024-05-09T05:28:28.069 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:27 smithi039 ceph-mon[30439]: mon.c calling monitor election 2024-05-09T05:28:28.069 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:27 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-09T05:28:28.069 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:27 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-09T05:28:28.069 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:27 smithi039 ceph-mon[30439]: from='client.? 172.21.15.100:0/3402424936' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-09T05:28:28.069 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:27 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-09T05:28:28.070 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:27 smithi039 ceph-mon[30439]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:28:28.070 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:27 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-09T05:28:28.070 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:27 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-09T05:28:28.070 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:27 smithi039 ceph-mon[30439]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:28:28.070 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:27 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-09T05:28:28.070 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:27 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-09T05:28:28.070 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:27 smithi039 ceph-mon[30439]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-05-09T05:28:28.070 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:27 smithi039 ceph-mon[30439]: monmap epoch 3 2024-05-09T05:28:28.070 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:27 smithi039 ceph-mon[30439]: fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 2024-05-09T05:28:28.070 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:27 smithi039 ceph-mon[30439]: last_changed 2024-05-09T05:28:22.753302+0000 2024-05-09T05:28:28.070 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:27 smithi039 ceph-mon[30439]: created 2024-05-09T05:26:29.940750+0000 2024-05-09T05:28:28.071 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:27 smithi039 ceph-mon[30439]: min_mon_release 19 (squid) 2024-05-09T05:28:28.071 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:27 smithi039 ceph-mon[30439]: election_strategy: 1 2024-05-09T05:28:28.071 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:27 smithi039 ceph-mon[30439]: 0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-05-09T05:28:28.071 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:27 smithi039 ceph-mon[30439]: 1: [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] mon.c 2024-05-09T05:28:28.071 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:27 smithi039 ceph-mon[30439]: 2: [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] mon.b 2024-05-09T05:28:28.071 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:27 smithi039 ceph-mon[30439]: fsmap 2024-05-09T05:28:28.071 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:27 smithi039 ceph-mon[30439]: osdmap e4: 0 total, 0 up, 0 in 2024-05-09T05:28:28.071 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:27 smithi039 ceph-mon[30439]: mgrmap e13: x(active, since 59s) 2024-05-09T05:28:28.071 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:27 smithi039 ceph-mon[30439]: overall HEALTH_OK 2024-05-09T05:28:28.071 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:27 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:28.071 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:27 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:28.071 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:27 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:28.071 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:27 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:28.089 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:27 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-09T05:28:28.089 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:27 smithi100 ceph-mon[34353]: mon.a calling monitor election 2024-05-09T05:28:28.089 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:27 smithi100 ceph-mon[34353]: mon.c calling monitor election 2024-05-09T05:28:28.089 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:27 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-09T05:28:28.089 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:27 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-09T05:28:28.089 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:27 smithi100 ceph-mon[34353]: from='client.? 172.21.15.100:0/3402424936' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-09T05:28:28.089 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:27 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-09T05:28:28.090 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:27 smithi100 ceph-mon[34353]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:28:28.090 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:27 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-09T05:28:28.090 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:27 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-09T05:28:28.090 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:27 smithi100 ceph-mon[34353]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:28:28.090 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:27 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-09T05:28:28.090 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:27 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-09T05:28:28.090 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:27 smithi100 ceph-mon[34353]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-05-09T05:28:28.090 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:27 smithi100 ceph-mon[34353]: monmap epoch 3 2024-05-09T05:28:28.090 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:27 smithi100 ceph-mon[34353]: fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 2024-05-09T05:28:28.090 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:27 smithi100 ceph-mon[34353]: last_changed 2024-05-09T05:28:22.753302+0000 2024-05-09T05:28:28.090 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:27 smithi100 ceph-mon[34353]: created 2024-05-09T05:26:29.940750+0000 2024-05-09T05:28:28.091 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:27 smithi100 ceph-mon[34353]: min_mon_release 19 (squid) 2024-05-09T05:28:28.091 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:27 smithi100 ceph-mon[34353]: election_strategy: 1 2024-05-09T05:28:28.091 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:27 smithi100 ceph-mon[34353]: 0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-05-09T05:28:28.091 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:27 smithi100 ceph-mon[34353]: 1: [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] mon.c 2024-05-09T05:28:28.091 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:27 smithi100 ceph-mon[34353]: 2: [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] mon.b 2024-05-09T05:28:28.091 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:27 smithi100 ceph-mon[34353]: fsmap 2024-05-09T05:28:28.091 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:27 smithi100 ceph-mon[34353]: osdmap e4: 0 total, 0 up, 0 in 2024-05-09T05:28:28.092 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:27 smithi100 ceph-mon[34353]: mgrmap e13: x(active, since 59s) 2024-05-09T05:28:28.092 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:27 smithi100 ceph-mon[34353]: overall HEALTH_OK 2024-05-09T05:28:28.092 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:27 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:28.092 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:27 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:28.092 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:27 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:28.092 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:27 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:28.411 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-05-09T05:28:28.411 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph config generate-minimal-conf 2024-05-09T05:28:28.674 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T05:28:29.111 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:28 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:28:29.111 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:28 smithi039 ceph-mon[30439]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:28:29.111 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:28 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:29.111 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:28 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-09T05:28:29.174 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:28 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:28:29.174 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:28 smithi100 ceph-mon[34353]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:28:29.175 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:28 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:29.175 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:28 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-09T05:28:30.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:29 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-09T05:28:30.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:29 smithi060 ceph-mon[34555]: mon.a calling monitor election 2024-05-09T05:28:30.048 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:29 smithi060 ceph-mon[34555]: mon.c calling monitor election 2024-05-09T05:28:30.048 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:29 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-09T05:28:30.048 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:29 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-09T05:28:30.048 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:29 smithi060 ceph-mon[34555]: from='client.? 172.21.15.100:0/3402424936' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-09T05:28:30.048 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:29 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-09T05:28:30.048 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:29 smithi060 ceph-mon[34555]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:28:30.048 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:29 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-09T05:28:30.048 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:29 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-09T05:28:30.048 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:29 smithi060 ceph-mon[34555]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:28:30.048 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:29 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-09T05:28:30.048 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:29 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-09T05:28:30.048 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:29 smithi060 ceph-mon[34555]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-05-09T05:28:30.048 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:29 smithi060 ceph-mon[34555]: monmap epoch 3 2024-05-09T05:28:30.049 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:29 smithi060 ceph-mon[34555]: fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 2024-05-09T05:28:30.049 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:29 smithi060 ceph-mon[34555]: last_changed 2024-05-09T05:28:22.753302+0000 2024-05-09T05:28:30.049 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:29 smithi060 ceph-mon[34555]: created 2024-05-09T05:26:29.940750+0000 2024-05-09T05:28:30.049 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:29 smithi060 ceph-mon[34555]: min_mon_release 19 (squid) 2024-05-09T05:28:30.049 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:29 smithi060 ceph-mon[34555]: election_strategy: 1 2024-05-09T05:28:30.049 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:29 smithi060 ceph-mon[34555]: 0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-05-09T05:28:30.049 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:29 smithi060 ceph-mon[34555]: 1: [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] mon.c 2024-05-09T05:28:30.049 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:29 smithi060 ceph-mon[34555]: 2: [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] mon.b 2024-05-09T05:28:30.049 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:29 smithi060 ceph-mon[34555]: fsmap 2024-05-09T05:28:30.049 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:29 smithi060 ceph-mon[34555]: osdmap e4: 0 total, 0 up, 0 in 2024-05-09T05:28:30.049 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:29 smithi060 ceph-mon[34555]: mgrmap e13: x(active, since 59s) 2024-05-09T05:28:30.049 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:29 smithi060 ceph-mon[34555]: overall HEALTH_OK 2024-05-09T05:28:30.049 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:29 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:30.049 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:29 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:30.049 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:29 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:30.050 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:29 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:30.050 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:29 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:28:30.050 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:29 smithi060 ceph-mon[34555]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:28:30.050 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:29 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:30.050 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:29 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-09T05:28:30.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:30.322+0000 7f80454fe700 1 -- 172.21.15.39:0/3693813111 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8040103df0 msgr2=0x7f8040104200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:28:30.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:30.322+0000 7f80454fe700 1 --2- 172.21.15.39:0/3693813111 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8040103df0 0x7f8040104200 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8030009910 tx=0x7f8030009c20 comp rx=0 tx=0).stop 2024-05-09T05:28:30.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:30.322+0000 7f80454fe700 1 -- 172.21.15.39:0/3693813111 shutdown_connections 2024-05-09T05:28:30.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:30.322+0000 7f80454fe700 1 --2- 172.21.15.39:0/3693813111 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8040103df0 0x7f8040104200 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:28:30.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:30.322+0000 7f80454fe700 1 -- 172.21.15.39:0/3693813111 >> 172.21.15.39:0/3693813111 conn(0x7f80400ff6a0 msgr2=0x7f8040101af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:28:30.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:30.322+0000 7f80454fe700 1 -- 172.21.15.39:0/3693813111 shutdown_connections 2024-05-09T05:28:30.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:30.322+0000 7f80454fe700 1 -- 172.21.15.39:0/3693813111 wait complete. 2024-05-09T05:28:30.318 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:30 smithi039 ceph-mon[30439]: mon.b calling monitor election 2024-05-09T05:28:30.318 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:30 smithi039 ceph-mon[30439]: mon.b calling monitor election 2024-05-09T05:28:30.318 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:30 smithi039 ceph-mon[30439]: mon.c calling monitor election 2024-05-09T05:28:30.318 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:30 smithi039 ceph-mon[30439]: mon.a calling monitor election 2024-05-09T05:28:30.318 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:30 smithi039 ceph-mon[30439]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-05-09T05:28:30.318 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:30 smithi039 ceph-mon[30439]: monmap epoch 3 2024-05-09T05:28:30.318 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:30 smithi039 ceph-mon[30439]: fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 2024-05-09T05:28:30.318 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:30 smithi039 ceph-mon[30439]: last_changed 2024-05-09T05:28:22.753302+0000 2024-05-09T05:28:30.318 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:30 smithi039 ceph-mon[30439]: created 2024-05-09T05:26:29.940750+0000 2024-05-09T05:28:30.318 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:30 smithi039 ceph-mon[30439]: min_mon_release 19 (squid) 2024-05-09T05:28:30.318 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:30 smithi039 ceph-mon[30439]: election_strategy: 1 2024-05-09T05:28:30.319 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:30 smithi039 ceph-mon[30439]: 0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-05-09T05:28:30.319 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:30 smithi039 ceph-mon[30439]: 1: [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] mon.c 2024-05-09T05:28:30.319 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:30 smithi039 ceph-mon[30439]: 2: [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] mon.b 2024-05-09T05:28:30.319 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:30 smithi039 ceph-mon[30439]: fsmap 2024-05-09T05:28:30.319 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:30 smithi039 ceph-mon[30439]: osdmap e4: 0 total, 0 up, 0 in 2024-05-09T05:28:30.319 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:30 smithi039 ceph-mon[30439]: mgrmap e13: x(active, since 61s) 2024-05-09T05:28:30.319 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:30 smithi039 ceph-mon[30439]: overall HEALTH_OK 2024-05-09T05:28:30.319 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:30 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:30.319 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:30 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:30.319 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:30 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:30.319 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:30 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:30.319 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:30 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:30.319 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:30 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:30.319 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:30 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:30.320 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:30 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:30.320 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:30 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:30.320 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:30 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:30.320 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:30 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:30.320 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:30 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-09T05:28:30.320 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:30 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-09T05:28:30.320 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:30 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:28:30.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:30.323+0000 7f80454fe700 1 Processor -- start 2024-05-09T05:28:30.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:30.323+0000 7f80454fe700 1 -- start start 2024-05-09T05:28:30.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:30.324+0000 7f80454fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8040103df0 0x7f804019be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:28:30.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:30.324+0000 7f80454fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f804019c340 0x7f80401a0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:28:30.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:30.324+0000 7f80454fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f80401a0b70 0x7f80401a0f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:28:30.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:30.324+0000 7f80454fe700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f804010e0e0 con 0x7f80401a0b70 2024-05-09T05:28:30.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:30.324+0000 7f80454fe700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f804010df60 con 0x7f8040103df0 2024-05-09T05:28:30.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:30.324+0000 7f80454fe700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f804010e260 con 0x7f804019c340 2024-05-09T05:28:30.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:30.324+0000 7f803f7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f80401a0b70 0x7f80401a0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:28:30.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:30.324+0000 7f803f7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f80401a0b70 0x7f80401a0f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:41332/0 (socket says 172.21.15.39:41332) 2024-05-09T05:28:30.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:30.324+0000 7f803f7fe700 1 -- 172.21.15.39:0/1713969338 learned_addr learned my addr 172.21.15.39:0/1713969338 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:28:30.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:30.324+0000 7f803e7fc700 1 --2- 172.21.15.39:0/1713969338 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f804019c340 0x7f80401a0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:28:30.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:30.324+0000 7f803effd700 1 --2- 172.21.15.39:0/1713969338 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8040103df0 0x7f804019be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:28:30.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:30.324+0000 7f803f7fe700 1 -- 172.21.15.39:0/1713969338 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f804019c340 msgr2=0x7f80401a0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:28:30.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:30.324+0000 7f803f7fe700 1 --2- 172.21.15.39:0/1713969338 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f804019c340 0x7f80401a0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:28:30.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:30.324+0000 7f803f7fe700 1 -- 172.21.15.39:0/1713969338 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8040103df0 msgr2=0x7f804019be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:28:30.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:30.324+0000 7f803f7fe700 1 --2- 172.21.15.39:0/1713969338 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8040103df0 0x7f804019be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:28:30.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:30.324+0000 7f803f7fe700 1 -- 172.21.15.39:0/1713969338 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80401a88e0 con 0x7f80401a0b70 2024-05-09T05:28:30.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:30.324+0000 7f803e7fc700 1 --2- 172.21.15.39:0/1713969338 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f804019c340 0x7f80401a0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T05:28:30.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:30.325+0000 7f803f7fe700 1 --2- 172.21.15.39:0/1713969338 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f80401a0b70 0x7f80401a0f80 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f803800ba50 tx=0x7f803800bd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:28:30.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:30.325+0000 7f8027fff700 1 -- 172.21.15.39:0/1713969338 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8038019070 con 0x7f80401a0b70 2024-05-09T05:28:30.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:30.325+0000 7f8027fff700 1 -- 172.21.15.39:0/1713969338 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f803800cde0 con 0x7f80401a0b70 2024-05-09T05:28:30.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:30.325+0000 7f80454fe700 1 -- 172.21.15.39:0/1713969338 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80401a8b10 con 0x7f80401a0b70 2024-05-09T05:28:30.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:30.325+0000 7f8027fff700 1 -- 172.21.15.39:0/1713969338 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8038007350 con 0x7f80401a0b70 2024-05-09T05:28:30.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:30.325+0000 7f80454fe700 1 -- 172.21.15.39:0/1713969338 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80401a9050 con 0x7f80401a0b70 2024-05-09T05:28:30.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:30.326+0000 7f8027fff700 1 -- 172.21.15.39:0/1713969338 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f803801c070 con 0x7f80401a0b70 2024-05-09T05:28:30.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:30.326+0000 7f80454fe700 1 -- 172.21.15.39:0/1713969338 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8040064e20 con 0x7f80401a0b70 2024-05-09T05:28:30.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:30.326+0000 7f8027fff700 1 --2- 172.21.15.39:0/1713969338 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f802803e9a0 0x7f8028040eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:28:30.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:30.326+0000 7f8027fff700 1 -- 172.21.15.39:0/1713969338 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f8038052c90 con 0x7f80401a0b70 2024-05-09T05:28:30.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:30.327+0000 7f803effd700 1 --2- 172.21.15.39:0/1713969338 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f802803e9a0 0x7f8028040eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:28:30.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:30.327+0000 7f803effd700 1 --2- 172.21.15.39:0/1713969338 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f802803e9a0 0x7f8028040eb0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f8030009750 tx=0x7f803001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:28:30.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:30.332+0000 7f8027fff700 1 -- 172.21.15.39:0/1713969338 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f8038007d90 con 0x7f80401a0b70 2024-05-09T05:28:30.548 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:30 smithi060 ceph-mon[34555]: mon.b calling monitor election 2024-05-09T05:28:30.548 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:30 smithi060 ceph-mon[34555]: mon.b calling monitor election 2024-05-09T05:28:30.548 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:30 smithi060 ceph-mon[34555]: mon.c calling monitor election 2024-05-09T05:28:30.548 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:30 smithi060 ceph-mon[34555]: mon.a calling monitor election 2024-05-09T05:28:30.548 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:30 smithi060 ceph-mon[34555]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-05-09T05:28:30.548 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:30 smithi060 ceph-mon[34555]: monmap epoch 3 2024-05-09T05:28:30.548 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:30 smithi060 ceph-mon[34555]: fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 2024-05-09T05:28:30.548 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:30 smithi060 ceph-mon[34555]: last_changed 2024-05-09T05:28:22.753302+0000 2024-05-09T05:28:30.548 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:30 smithi060 ceph-mon[34555]: created 2024-05-09T05:26:29.940750+0000 2024-05-09T05:28:30.548 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:30 smithi060 ceph-mon[34555]: min_mon_release 19 (squid) 2024-05-09T05:28:30.548 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:30 smithi060 ceph-mon[34555]: election_strategy: 1 2024-05-09T05:28:30.549 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:30 smithi060 ceph-mon[34555]: 0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-05-09T05:28:30.549 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:30 smithi060 ceph-mon[34555]: 1: [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] mon.c 2024-05-09T05:28:30.549 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:30 smithi060 ceph-mon[34555]: 2: [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] mon.b 2024-05-09T05:28:30.549 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:30 smithi060 ceph-mon[34555]: fsmap 2024-05-09T05:28:30.549 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:30 smithi060 ceph-mon[34555]: osdmap e4: 0 total, 0 up, 0 in 2024-05-09T05:28:30.549 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:30 smithi060 ceph-mon[34555]: mgrmap e13: x(active, since 61s) 2024-05-09T05:28:30.549 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:30 smithi060 ceph-mon[34555]: overall HEALTH_OK 2024-05-09T05:28:30.549 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:30 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:30.549 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:30 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:30.549 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:30 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:30.549 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:30 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:30.549 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:30 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:30.549 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:30 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:30.549 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:30 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:30.550 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:30 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:30.550 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:30 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:30.550 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:30 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:30.550 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:30 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:30.550 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:30 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-09T05:28:30.550 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:30 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-09T05:28:30.550 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:30 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:28:30.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:30.554+0000 7f80454fe700 1 -- 172.21.15.39:0/1713969338 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f804002e7b0 con 0x7f80401a0b70 2024-05-09T05:28:30.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:30.555+0000 7f8027fff700 1 -- 172.21.15.39:0/1713969338 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+273 (secure 0 0 0) 0x7f8038013a90 con 0x7f80401a0b70 2024-05-09T05:28:30.551 INFO:teuthology.orchestra.run.smithi039.stdout:# minimal ceph.conf for 86d4cc60-0dc4-11ef-bc97-c7b262605968 2024-05-09T05:28:30.551 INFO:teuthology.orchestra.run.smithi039.stdout:[global] 2024-05-09T05:28:30.551 INFO:teuthology.orchestra.run.smithi039.stdout: fsid = 86d4cc60-0dc4-11ef-bc97-c7b262605968 2024-05-09T05:28:30.551 INFO:teuthology.orchestra.run.smithi039.stdout: mon_host = [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] 2024-05-09T05:28:30.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:30.558+0000 7f80454fe700 1 -- 172.21.15.39:0/1713969338 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f802803e9a0 msgr2=0x7f8028040eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:28:30.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:30.558+0000 7f80454fe700 1 --2- 172.21.15.39:0/1713969338 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f802803e9a0 0x7f8028040eb0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f8030009750 tx=0x7f803001a040 comp rx=0 tx=0).stop 2024-05-09T05:28:30.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:30.558+0000 7f80454fe700 1 -- 172.21.15.39:0/1713969338 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f80401a0b70 msgr2=0x7f80401a0f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:28:30.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:30.558+0000 7f80454fe700 1 --2- 172.21.15.39:0/1713969338 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f80401a0b70 0x7f80401a0f80 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f803800ba50 tx=0x7f803800bd60 comp rx=0 tx=0).stop 2024-05-09T05:28:30.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:30.558+0000 7f80454fe700 1 -- 172.21.15.39:0/1713969338 shutdown_connections 2024-05-09T05:28:30.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:30.558+0000 7f80454fe700 1 --2- 172.21.15.39:0/1713969338 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f802803e9a0 0x7f8028040eb0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:28:30.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:30.558+0000 7f80454fe700 1 --2- 172.21.15.39:0/1713969338 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f80401a0b70 0x7f80401a0f80 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:28:30.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:30.558+0000 7f80454fe700 1 --2- 172.21.15.39:0/1713969338 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8040103df0 0x7f804019be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:28:30.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:30.558+0000 7f80454fe700 1 --2- 172.21.15.39:0/1713969338 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f804019c340 0x7f80401a0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:28:30.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:30.558+0000 7f80454fe700 1 -- 172.21.15.39:0/1713969338 >> 172.21.15.39:0/1713969338 conn(0x7f80400ff6a0 msgr2=0x7f8040075df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:28:30.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:30.558+0000 7f80454fe700 1 -- 172.21.15.39:0/1713969338 shutdown_connections 2024-05-09T05:28:30.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:30.558+0000 7f80454fe700 1 -- 172.21.15.39:0/1713969338 wait complete. 2024-05-09T05:28:30.675 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:30 smithi100 ceph-mon[34353]: mon.b calling monitor election 2024-05-09T05:28:30.675 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:30 smithi100 ceph-mon[34353]: mon.b calling monitor election 2024-05-09T05:28:30.675 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:30 smithi100 ceph-mon[34353]: mon.c calling monitor election 2024-05-09T05:28:30.675 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:30 smithi100 ceph-mon[34353]: mon.a calling monitor election 2024-05-09T05:28:30.675 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:30 smithi100 ceph-mon[34353]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-05-09T05:28:30.675 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:30 smithi100 ceph-mon[34353]: monmap epoch 3 2024-05-09T05:28:30.675 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:30 smithi100 ceph-mon[34353]: fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 2024-05-09T05:28:30.676 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:30 smithi100 ceph-mon[34353]: last_changed 2024-05-09T05:28:22.753302+0000 2024-05-09T05:28:30.676 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:30 smithi100 ceph-mon[34353]: created 2024-05-09T05:26:29.940750+0000 2024-05-09T05:28:30.676 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:30 smithi100 ceph-mon[34353]: min_mon_release 19 (squid) 2024-05-09T05:28:30.676 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:30 smithi100 ceph-mon[34353]: election_strategy: 1 2024-05-09T05:28:30.676 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:30 smithi100 ceph-mon[34353]: 0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-05-09T05:28:30.676 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:30 smithi100 ceph-mon[34353]: 1: [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] mon.c 2024-05-09T05:28:30.676 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:30 smithi100 ceph-mon[34353]: 2: [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] mon.b 2024-05-09T05:28:30.676 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:30 smithi100 ceph-mon[34353]: fsmap 2024-05-09T05:28:30.676 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:30 smithi100 ceph-mon[34353]: osdmap e4: 0 total, 0 up, 0 in 2024-05-09T05:28:30.676 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:30 smithi100 ceph-mon[34353]: mgrmap e13: x(active, since 61s) 2024-05-09T05:28:30.676 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:30 smithi100 ceph-mon[34353]: overall HEALTH_OK 2024-05-09T05:28:30.676 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:30 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:30.676 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:30 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:30.676 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:30 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:30.677 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:30 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:30.677 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:30 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:30.677 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:30 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:30.677 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:30 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:30.677 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:30 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:30.677 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:30 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:30.677 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:30 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:30.677 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:30 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:30.677 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:30 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-09T05:28:30.677 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:30 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-09T05:28:30.677 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:30 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:28:31.126 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-05-09T05:28:31.126 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-05-09T05:28:31.126 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/etc/ceph/ceph.conf 2024-05-09T05:28:31.155 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-05-09T05:28:31.155 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-09T05:28:31.222 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-05-09T05:28:31.222 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/etc/ceph/ceph.conf 2024-05-09T05:28:31.255 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-05-09T05:28:31.255 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-09T05:28:31.324 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-05-09T05:28:31.324 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/etc/ceph/ceph.conf 2024-05-09T05:28:31.356 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-05-09T05:28:31.356 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-09T05:28:31.360 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:31 smithi039 ceph-mon[30439]: Updating smithi039:/var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T05:28:31.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:31 smithi039 ceph-mon[30439]: Updating smithi060:/var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T05:28:31.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:31 smithi039 ceph-mon[30439]: Updating smithi100:/var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T05:28:31.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:31 smithi039 ceph-mon[30439]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:28:31.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:31 smithi039 ceph-mon[30439]: Reconfiguring mon.a (unknown last config time)... 2024-05-09T05:28:31.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:31 smithi039 ceph-mon[30439]: Reconfiguring daemon mon.a on smithi039 2024-05-09T05:28:31.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:31 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/1713969338' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:28:31.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:31 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-09T05:28:31.421 INFO:tasks.cephadm:Adding mgr.x on smithi039 2024-05-09T05:28:31.422 INFO:tasks.cephadm:Adding mgr.y on smithi060 2024-05-09T05:28:31.422 INFO:tasks.cephadm:Adding mgr.z on smithi100 2024-05-09T05:28:31.422 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph orch apply mgr '3;smithi039=x;smithi060=y;smithi100=z' 2024-05-09T05:28:31.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:31 smithi060 ceph-mon[34555]: Updating smithi039:/var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T05:28:31.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:31 smithi060 ceph-mon[34555]: Updating smithi060:/var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T05:28:31.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:31 smithi060 ceph-mon[34555]: Updating smithi100:/var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T05:28:31.548 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:31 smithi060 ceph-mon[34555]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:28:31.548 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:31 smithi060 ceph-mon[34555]: Reconfiguring mon.a (unknown last config time)... 2024-05-09T05:28:31.548 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:31 smithi060 ceph-mon[34555]: Reconfiguring daemon mon.a on smithi039 2024-05-09T05:28:31.548 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:31 smithi060 ceph-mon[34555]: from='client.? 172.21.15.39:0/1713969338' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:28:31.548 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:31 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-09T05:28:31.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:31 smithi100 ceph-mon[34353]: Updating smithi039:/var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T05:28:31.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:31 smithi100 ceph-mon[34353]: Updating smithi060:/var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T05:28:31.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:31 smithi100 ceph-mon[34353]: Updating smithi100:/var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T05:28:31.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:31 smithi100 ceph-mon[34353]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:28:31.675 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:31 smithi100 ceph-mon[34353]: Reconfiguring mon.a (unknown last config time)... 2024-05-09T05:28:31.675 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:31 smithi100 ceph-mon[34353]: Reconfiguring daemon mon.a on smithi039 2024-05-09T05:28:31.675 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:31 smithi100 ceph-mon[34353]: from='client.? 172.21.15.39:0/1713969338' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:28:31.675 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:31 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-09T05:28:31.693 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.c/config 2024-05-09T05:28:32.056 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:28:31 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: 2024-05-09T05:28:31.753+0000 7fcb56c32700 -1 mgr.server handle_report got status from non-daemon mon.b 2024-05-09T05:28:33.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:33.252+0000 7f227b8e3700 1 -- 172.21.15.100:0/679004933 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f22741047f0 msgr2=0x7f2274106c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:28:33.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:33.252+0000 7f227b8e3700 1 --2- 172.21.15.100:0/679004933 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f22741047f0 0x7f2274106c10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f227000b0a0 tx=0x7f227000b3b0 comp rx=0 tx=0).stop 2024-05-09T05:28:33.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:33.252+0000 7f227b8e3700 1 -- 172.21.15.100:0/679004933 shutdown_connections 2024-05-09T05:28:33.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:33.252+0000 7f227b8e3700 1 --2- 172.21.15.100:0/679004933 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f22741047f0 0x7f2274106c10 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:28:33.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:33.252+0000 7f227b8e3700 1 -- 172.21.15.100:0/679004933 >> 172.21.15.100:0/679004933 conn(0x7f22740fe250 msgr2=0x7f22741006e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:28:33.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:33.252+0000 7f227b8e3700 1 -- 172.21.15.100:0/679004933 shutdown_connections 2024-05-09T05:28:33.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:33.252+0000 7f227b8e3700 1 -- 172.21.15.100:0/679004933 wait complete. 2024-05-09T05:28:33.248 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:33 smithi100 ceph-mon[34353]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:28:33.248 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:33 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:33.249 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:33 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:33.249 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:33 smithi100 ceph-mon[34353]: Reconfiguring mon.b (monmap changed)... 2024-05-09T05:28:33.249 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:33 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-09T05:28:33.249 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:33 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-09T05:28:33.249 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:33 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:28:33.249 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:33 smithi100 ceph-mon[34353]: Reconfiguring daemon mon.b on smithi060 2024-05-09T05:28:33.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:33.253+0000 7f227b8e3700 1 Processor -- start 2024-05-09T05:28:33.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:33.253+0000 7f227b8e3700 1 -- start start 2024-05-09T05:28:33.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:33.253+0000 7f227b8e3700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22741047f0 0x7f2274199980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:28:33.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:33.253+0000 7f227b8e3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2274199ec0 0x7f227419ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:28:33.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:33.253+0000 7f227b8e3700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f227419f390 0x7f22741a17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:28:33.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:33.253+0000 7f227b8e3700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f2274109c60 con 0x7f227419f390 2024-05-09T05:28:33.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:33.253+0000 7f227b8e3700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f2274109ae0 con 0x7f2274199ec0 2024-05-09T05:28:33.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:33.253+0000 7f227b8e3700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2274109de0 con 0x7f22741047f0 2024-05-09T05:28:33.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:33.253+0000 7f227967f700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22741047f0 0x7f2274199980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:28:33.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:33.253+0000 7f227967f700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22741047f0 0x7f2274199980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:55328/0 (socket says 172.21.15.100:55328) 2024-05-09T05:28:33.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:33.253+0000 7f227967f700 1 -- 172.21.15.100:0/748640210 learned_addr learned my addr 172.21.15.100:0/748640210 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:28:33.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:33.253+0000 7f2279e80700 1 --2- 172.21.15.100:0/748640210 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f227419f390 0x7f22741a17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:28:33.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:33.253+0000 7f2278e7e700 1 --2- 172.21.15.100:0/748640210 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2274199ec0 0x7f227419ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:28:33.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:33.253+0000 7f227967f700 1 -- 172.21.15.100:0/748640210 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2274199ec0 msgr2=0x7f227419ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:28:33.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:33.253+0000 7f227967f700 1 --2- 172.21.15.100:0/748640210 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2274199ec0 0x7f227419ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:28:33.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:33.253+0000 7f227967f700 1 -- 172.21.15.100:0/748640210 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f227419f390 msgr2=0x7f22741a17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:28:33.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:33.253+0000 7f227967f700 1 --2- 172.21.15.100:0/748640210 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f227419f390 0x7f22741a17b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:28:33.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:33.253+0000 7f227967f700 1 -- 172.21.15.100:0/748640210 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22741a1d20 con 0x7f22741047f0 2024-05-09T05:28:33.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:33.253+0000 7f2278e7e700 1 --2- 172.21.15.100:0/748640210 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2274199ec0 0x7f227419ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T05:28:33.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:33.254+0000 7f227967f700 1 --2- 172.21.15.100:0/748640210 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22741047f0 0x7f2274199980 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f227000b830 tx=0x7f227000bd10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:28:33.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:33.254+0000 7f226a7fc700 1 -- 172.21.15.100:0/748640210 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2270017040 con 0x7f22741047f0 2024-05-09T05:28:33.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:33.254+0000 7f226a7fc700 1 -- 172.21.15.100:0/748640210 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2270005780 con 0x7f22741047f0 2024-05-09T05:28:33.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:33.254+0000 7f226a7fc700 1 -- 172.21.15.100:0/748640210 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22700129d0 con 0x7f22741047f0 2024-05-09T05:28:33.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:33.254+0000 7f227b8e3700 1 -- 172.21.15.100:0/748640210 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22741a1fb0 con 0x7f22741047f0 2024-05-09T05:28:33.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:33.254+0000 7f227b8e3700 1 -- 172.21.15.100:0/748640210 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22741a24e0 con 0x7f22741047f0 2024-05-09T05:28:33.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:33.255+0000 7f226a7fc700 1 -- 172.21.15.100:0/748640210 <== mon.1 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f2270012b70 con 0x7f22741047f0 2024-05-09T05:28:33.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:33.255+0000 7f227b8e3700 1 -- 172.21.15.100:0/748640210 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2274064e20 con 0x7f22741047f0 2024-05-09T05:28:33.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:33.255+0000 7f226a7fc700 1 --2- 172.21.15.100:0/748640210 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f226003e9a0 0x7f2260040eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:28:33.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:33.255+0000 7f226a7fc700 1 -- 172.21.15.100:0/748640210 <== mon.1 v2:172.21.15.100:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f227000f020 con 0x7f22741047f0 2024-05-09T05:28:33.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:33.256+0000 7f2278e7e700 1 --2- 172.21.15.100:0/748640210 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f226003e9a0 0x7f2260040eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:28:33.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:33.256+0000 7f2278e7e700 1 --2- 172.21.15.100:0/748640210 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f226003e9a0 0x7f2260040eb0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f227419aa30 tx=0x7f2264008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:28:33.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:33.261+0000 7f226a7fc700 1 -- 172.21.15.100:0/748640210 <== mon.1 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f2270029020 con 0x7f22741047f0 2024-05-09T05:28:33.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:33.474+0000 7f227b8e3700 1 -- 172.21.15.100:0/748640210 --> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi039=x;smithi060=y;smithi100=z", "target": ["mon-mgr", ""]}) -- 0x7f22741000f0 con 0x7f226003e9a0 2024-05-09T05:28:33.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:33.482+0000 7f226a7fc700 1 -- 172.21.15.100:0/748640210 <== mgr.14152 v2:172.21.15.39:6800/3184189003 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f22741000f0 con 0x7f226003e9a0 2024-05-09T05:28:33.477 INFO:teuthology.orchestra.run.smithi100.stdout:Scheduled mgr update... 2024-05-09T05:28:33.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:33.485+0000 7f227b8e3700 1 -- 172.21.15.100:0/748640210 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f226003e9a0 msgr2=0x7f2260040eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:28:33.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:33.485+0000 7f227b8e3700 1 --2- 172.21.15.100:0/748640210 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f226003e9a0 0x7f2260040eb0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f227419aa30 tx=0x7f2264008040 comp rx=0 tx=0).stop 2024-05-09T05:28:33.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:33.485+0000 7f227b8e3700 1 -- 172.21.15.100:0/748640210 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22741047f0 msgr2=0x7f2274199980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:28:33.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:33.485+0000 7f227b8e3700 1 --2- 172.21.15.100:0/748640210 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22741047f0 0x7f2274199980 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f227000b830 tx=0x7f227000bd10 comp rx=0 tx=0).stop 2024-05-09T05:28:33.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:33.485+0000 7f227b8e3700 1 -- 172.21.15.100:0/748640210 shutdown_connections 2024-05-09T05:28:33.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:33.485+0000 7f227b8e3700 1 --2- 172.21.15.100:0/748640210 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f226003e9a0 0x7f2260040eb0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:28:33.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:33.485+0000 7f227b8e3700 1 --2- 172.21.15.100:0/748640210 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f227419f390 0x7f22741a17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:28:33.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:33.485+0000 7f227b8e3700 1 --2- 172.21.15.100:0/748640210 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22741047f0 0x7f2274199980 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:28:33.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:33.485+0000 7f227b8e3700 1 --2- 172.21.15.100:0/748640210 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2274199ec0 0x7f227419ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:28:33.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:33.485+0000 7f227b8e3700 1 -- 172.21.15.100:0/748640210 >> 172.21.15.100:0/748640210 conn(0x7f22740fe250 msgr2=0x7f22740ff9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:28:33.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:33.485+0000 7f227b8e3700 1 -- 172.21.15.100:0/748640210 shutdown_connections 2024-05-09T05:28:33.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:28:33.485+0000 7f227b8e3700 1 -- 172.21.15.100:0/748640210 wait complete. 2024-05-09T05:28:33.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:33 smithi060 ceph-mon[34555]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:28:33.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:33 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:33.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:33 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:33.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:33 smithi060 ceph-mon[34555]: Reconfiguring mon.b (monmap changed)... 2024-05-09T05:28:33.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:33 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-09T05:28:33.548 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:33 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-09T05:28:33.548 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:33 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:28:33.548 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:33 smithi060 ceph-mon[34555]: Reconfiguring daemon mon.b on smithi060 2024-05-09T05:28:33.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:33 smithi039 ceph-mon[30439]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:28:33.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:33 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:33.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:33 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:33.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:33 smithi039 ceph-mon[30439]: Reconfiguring mon.b (monmap changed)... 2024-05-09T05:28:33.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:33 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-09T05:28:33.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:33 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-09T05:28:33.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:33 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:28:33.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:33 smithi039 ceph-mon[30439]: Reconfiguring daemon mon.b on smithi060 2024-05-09T05:28:34.100 DEBUG:teuthology.orchestra.run.smithi060:mgr.y> sudo journalctl -f -n 0 -u ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@mgr.y.service 2024-05-09T05:28:34.103 DEBUG:teuthology.orchestra.run.smithi100:mgr.z> sudo journalctl -f -n 0 -u ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@mgr.z.service 2024-05-09T05:28:34.105 INFO:tasks.cephadm:Deploying OSDs... 2024-05-09T05:28:34.105 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-05-09T05:28:34.105 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/scratch_devs of=/dev/stdout 2024-05-09T05:28:34.126 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-09T05:28:34.126 DEBUG:teuthology.orchestra.run.smithi039:> stat /dev/vg_nvme/lv_1 2024-05-09T05:28:34.185 INFO:teuthology.orchestra.run.smithi039.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-09T05:28:34.185 INFO:teuthology.orchestra.run.smithi039.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T05:28:34.186 INFO:teuthology.orchestra.run.smithi039.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-05-09T05:28:34.186 INFO:teuthology.orchestra.run.smithi039.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T05:28:34.186 INFO:teuthology.orchestra.run.smithi039.stdout:Context: system_u:object_r:device_t:s0 2024-05-09T05:28:34.186 INFO:teuthology.orchestra.run.smithi039.stdout:Access: 2024-05-09 05:27:38.240567691 +0000 2024-05-09T05:28:34.186 INFO:teuthology.orchestra.run.smithi039.stdout:Modify: 2024-05-09 05:22:53.840161385 +0000 2024-05-09T05:28:34.186 INFO:teuthology.orchestra.run.smithi039.stdout:Change: 2024-05-09 05:22:53.840161385 +0000 2024-05-09T05:28:34.186 INFO:teuthology.orchestra.run.smithi039.stdout: Birth: 2024-05-09 05:22:53.840161385 +0000 2024-05-09T05:28:34.186 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-09T05:28:34.254 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records in 2024-05-09T05:28:34.254 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records out 2024-05-09T05:28:34.254 INFO:teuthology.orchestra.run.smithi039.stderr:512 bytes copied, 0.000324126 s, 1.6 MB/s 2024-05-09T05:28:34.255 DEBUG:teuthology.orchestra.run.smithi039:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-09T05:28:34.314 DEBUG:teuthology.orchestra.run.smithi039:> stat /dev/vg_nvme/lv_2 2024-05-09T05:28:34.372 INFO:teuthology.orchestra.run.smithi039.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-09T05:28:34.372 INFO:teuthology.orchestra.run.smithi039.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T05:28:34.372 INFO:teuthology.orchestra.run.smithi039.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-05-09T05:28:34.372 INFO:teuthology.orchestra.run.smithi039.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T05:28:34.372 INFO:teuthology.orchestra.run.smithi039.stdout:Context: system_u:object_r:device_t:s0 2024-05-09T05:28:34.372 INFO:teuthology.orchestra.run.smithi039.stdout:Access: 2024-05-09 05:27:38.267567166 +0000 2024-05-09T05:28:34.372 INFO:teuthology.orchestra.run.smithi039.stdout:Modify: 2024-05-09 05:22:54.178154851 +0000 2024-05-09T05:28:34.372 INFO:teuthology.orchestra.run.smithi039.stdout:Change: 2024-05-09 05:22:54.178154851 +0000 2024-05-09T05:28:34.373 INFO:teuthology.orchestra.run.smithi039.stdout: Birth: 2024-05-09 05:22:54.178154851 +0000 2024-05-09T05:28:34.373 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-09T05:28:34.441 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records in 2024-05-09T05:28:34.441 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records out 2024-05-09T05:28:34.441 INFO:teuthology.orchestra.run.smithi039.stderr:512 bytes copied, 0.000293385 s, 1.7 MB/s 2024-05-09T05:28:34.442 DEBUG:teuthology.orchestra.run.smithi039:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-09T05:28:34.500 DEBUG:teuthology.orchestra.run.smithi039:> stat /dev/vg_nvme/lv_3 2024-05-09T05:28:34.557 INFO:teuthology.orchestra.run.smithi039.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-09T05:28:34.557 INFO:teuthology.orchestra.run.smithi039.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T05:28:34.557 INFO:teuthology.orchestra.run.smithi039.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-05-09T05:28:34.557 INFO:teuthology.orchestra.run.smithi039.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T05:28:34.557 INFO:teuthology.orchestra.run.smithi039.stdout:Context: system_u:object_r:device_t:s0 2024-05-09T05:28:34.557 INFO:teuthology.orchestra.run.smithi039.stdout:Access: 2024-05-09 05:27:38.293566661 +0000 2024-05-09T05:28:34.557 INFO:teuthology.orchestra.run.smithi039.stdout:Modify: 2024-05-09 05:22:54.557147526 +0000 2024-05-09T05:28:34.557 INFO:teuthology.orchestra.run.smithi039.stdout:Change: 2024-05-09 05:22:54.557147526 +0000 2024-05-09T05:28:34.557 INFO:teuthology.orchestra.run.smithi039.stdout: Birth: 2024-05-09 05:22:54.557147526 +0000 2024-05-09T05:28:34.558 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-09T05:28:34.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:34 smithi039 ceph-mon[30439]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi039=x;smithi060=y;smithi100=z", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T05:28:34.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:34 smithi039 ceph-mon[30439]: Saving service mgr spec with placement smithi039=x;smithi060=y;smithi100=z;count:3 2024-05-09T05:28:34.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:34 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:34.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:34 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:34.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:34 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:34.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:34 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-09T05:28:34.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:34 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-09T05:28:34.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:34 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:28:34.622 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records in 2024-05-09T05:28:34.622 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records out 2024-05-09T05:28:34.623 INFO:teuthology.orchestra.run.smithi039.stderr:512 bytes copied, 0.000298644 s, 1.7 MB/s 2024-05-09T05:28:34.624 DEBUG:teuthology.orchestra.run.smithi039:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-09T05:28:34.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:34 smithi100 ceph-mon[34353]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi039=x;smithi060=y;smithi100=z", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T05:28:34.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:34 smithi100 ceph-mon[34353]: Saving service mgr spec with placement smithi039=x;smithi060=y;smithi100=z;count:3 2024-05-09T05:28:34.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:34 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:34.675 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:34 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:34.675 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:34 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:34.675 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:34 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-09T05:28:34.675 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:34 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-09T05:28:34.675 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:34 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:28:34.682 DEBUG:teuthology.orchestra.run.smithi039:> stat /dev/vg_nvme/lv_4 2024-05-09T05:28:34.738 INFO:teuthology.orchestra.run.smithi039.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-09T05:28:34.739 INFO:teuthology.orchestra.run.smithi039.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T05:28:34.739 INFO:teuthology.orchestra.run.smithi039.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-05-09T05:28:34.739 INFO:teuthology.orchestra.run.smithi039.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T05:28:34.739 INFO:teuthology.orchestra.run.smithi039.stdout:Context: system_u:object_r:device_t:s0 2024-05-09T05:28:34.739 INFO:teuthology.orchestra.run.smithi039.stdout:Access: 2024-05-09 05:27:38.321566117 +0000 2024-05-09T05:28:34.739 INFO:teuthology.orchestra.run.smithi039.stdout:Modify: 2024-05-09 05:22:54.910140702 +0000 2024-05-09T05:28:34.739 INFO:teuthology.orchestra.run.smithi039.stdout:Change: 2024-05-09 05:22:54.910140702 +0000 2024-05-09T05:28:34.739 INFO:teuthology.orchestra.run.smithi039.stdout: Birth: 2024-05-09 05:22:54.910140702 +0000 2024-05-09T05:28:34.739 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-09T05:28:34.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:34 smithi060 ceph-mon[34555]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi039=x;smithi060=y;smithi100=z", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T05:28:34.798 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:34 smithi060 ceph-mon[34555]: Saving service mgr spec with placement smithi039=x;smithi060=y;smithi100=z;count:3 2024-05-09T05:28:34.798 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:34 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:34.798 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:34 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:34.798 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:34 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:34.798 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:34 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-09T05:28:34.798 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:34 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-09T05:28:34.798 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:34 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:28:34.802 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records in 2024-05-09T05:28:34.803 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records out 2024-05-09T05:28:34.803 INFO:teuthology.orchestra.run.smithi039.stderr:512 bytes copied, 0.000302577 s, 1.7 MB/s 2024-05-09T05:28:34.804 DEBUG:teuthology.orchestra.run.smithi039:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-09T05:28:34.862 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-05-09T05:28:34.862 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/scratch_devs of=/dev/stdout 2024-05-09T05:28:34.881 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-09T05:28:34.881 DEBUG:teuthology.orchestra.run.smithi060:> stat /dev/vg_nvme/lv_1 2024-05-09T05:28:34.940 INFO:teuthology.orchestra.run.smithi060.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-09T05:28:34.940 INFO:teuthology.orchestra.run.smithi060.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T05:28:34.940 INFO:teuthology.orchestra.run.smithi060.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-05-09T05:28:34.940 INFO:teuthology.orchestra.run.smithi060.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T05:28:34.940 INFO:teuthology.orchestra.run.smithi060.stdout:Context: system_u:object_r:device_t:s0 2024-05-09T05:28:34.941 INFO:teuthology.orchestra.run.smithi060.stdout:Access: 2024-05-09 05:28:22.183654888 +0000 2024-05-09T05:28:34.941 INFO:teuthology.orchestra.run.smithi060.stdout:Modify: 2024-05-09 05:23:10.232034980 +0000 2024-05-09T05:28:34.941 INFO:teuthology.orchestra.run.smithi060.stdout:Change: 2024-05-09 05:23:10.232034980 +0000 2024-05-09T05:28:34.941 INFO:teuthology.orchestra.run.smithi060.stdout: Birth: 2024-05-09 05:23:10.232034980 +0000 2024-05-09T05:28:34.941 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-09T05:28:35.008 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records in 2024-05-09T05:28:35.009 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records out 2024-05-09T05:28:35.009 INFO:teuthology.orchestra.run.smithi060.stderr:512 bytes copied, 0.000116779 s, 4.4 MB/s 2024-05-09T05:28:35.010 DEBUG:teuthology.orchestra.run.smithi060:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-09T05:28:35.070 DEBUG:teuthology.orchestra.run.smithi060:> stat /dev/vg_nvme/lv_2 2024-05-09T05:28:35.128 INFO:teuthology.orchestra.run.smithi060.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-09T05:28:35.128 INFO:teuthology.orchestra.run.smithi060.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T05:28:35.128 INFO:teuthology.orchestra.run.smithi060.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-05-09T05:28:35.128 INFO:teuthology.orchestra.run.smithi060.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T05:28:35.128 INFO:teuthology.orchestra.run.smithi060.stdout:Context: system_u:object_r:device_t:s0 2024-05-09T05:28:35.128 INFO:teuthology.orchestra.run.smithi060.stdout:Access: 2024-05-09 05:28:22.183654888 +0000 2024-05-09T05:28:35.128 INFO:teuthology.orchestra.run.smithi060.stdout:Modify: 2024-05-09 05:23:10.566031977 +0000 2024-05-09T05:28:35.128 INFO:teuthology.orchestra.run.smithi060.stdout:Change: 2024-05-09 05:23:10.566031977 +0000 2024-05-09T05:28:35.129 INFO:teuthology.orchestra.run.smithi060.stdout: Birth: 2024-05-09 05:23:10.566031977 +0000 2024-05-09T05:28:35.129 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-09T05:28:35.196 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records in 2024-05-09T05:28:35.196 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records out 2024-05-09T05:28:35.196 INFO:teuthology.orchestra.run.smithi060.stderr:512 bytes copied, 0.000116515 s, 4.4 MB/s 2024-05-09T05:28:35.198 DEBUG:teuthology.orchestra.run.smithi060:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-09T05:28:35.258 DEBUG:teuthology.orchestra.run.smithi060:> stat /dev/vg_nvme/lv_3 2024-05-09T05:28:35.316 INFO:teuthology.orchestra.run.smithi060.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-09T05:28:35.316 INFO:teuthology.orchestra.run.smithi060.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T05:28:35.316 INFO:teuthology.orchestra.run.smithi060.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-05-09T05:28:35.317 INFO:teuthology.orchestra.run.smithi060.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T05:28:35.317 INFO:teuthology.orchestra.run.smithi060.stdout:Context: system_u:object_r:device_t:s0 2024-05-09T05:28:35.317 INFO:teuthology.orchestra.run.smithi060.stdout:Access: 2024-05-09 05:28:22.184654880 +0000 2024-05-09T05:28:35.317 INFO:teuthology.orchestra.run.smithi060.stdout:Modify: 2024-05-09 05:23:10.930028704 +0000 2024-05-09T05:28:35.317 INFO:teuthology.orchestra.run.smithi060.stdout:Change: 2024-05-09 05:23:10.930028704 +0000 2024-05-09T05:28:35.317 INFO:teuthology.orchestra.run.smithi060.stdout: Birth: 2024-05-09 05:23:10.930028704 +0000 2024-05-09T05:28:35.317 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-09T05:28:35.384 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records in 2024-05-09T05:28:35.384 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records out 2024-05-09T05:28:35.385 INFO:teuthology.orchestra.run.smithi060.stderr:512 bytes copied, 0.000111499 s, 4.6 MB/s 2024-05-09T05:28:35.386 DEBUG:teuthology.orchestra.run.smithi060:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-09T05:28:35.446 DEBUG:teuthology.orchestra.run.smithi060:> stat /dev/vg_nvme/lv_4 2024-05-09T05:28:35.504 INFO:teuthology.orchestra.run.smithi060.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-09T05:28:35.504 INFO:teuthology.orchestra.run.smithi060.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T05:28:35.504 INFO:teuthology.orchestra.run.smithi060.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-05-09T05:28:35.504 INFO:teuthology.orchestra.run.smithi060.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T05:28:35.504 INFO:teuthology.orchestra.run.smithi060.stdout:Context: system_u:object_r:device_t:s0 2024-05-09T05:28:35.504 INFO:teuthology.orchestra.run.smithi060.stdout:Access: 2024-05-09 05:28:22.184654880 +0000 2024-05-09T05:28:35.505 INFO:teuthology.orchestra.run.smithi060.stdout:Modify: 2024-05-09 05:23:11.269025656 +0000 2024-05-09T05:28:35.505 INFO:teuthology.orchestra.run.smithi060.stdout:Change: 2024-05-09 05:23:11.269025656 +0000 2024-05-09T05:28:35.505 INFO:teuthology.orchestra.run.smithi060.stdout: Birth: 2024-05-09 05:23:11.269025656 +0000 2024-05-09T05:28:35.505 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-09T05:28:35.571 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records in 2024-05-09T05:28:35.571 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records out 2024-05-09T05:28:35.571 INFO:teuthology.orchestra.run.smithi060.stderr:512 bytes copied, 0.000120438 s, 4.3 MB/s 2024-05-09T05:28:35.572 DEBUG:teuthology.orchestra.run.smithi060:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-09T05:28:35.631 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-05-09T05:28:35.631 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/scratch_devs of=/dev/stdout 2024-05-09T05:28:35.650 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-09T05:28:35.651 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_1 2024-05-09T05:28:35.708 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-09T05:28:35.708 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T05:28:35.708 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-05-09T05:28:35.708 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T05:28:35.709 INFO:teuthology.orchestra.run.smithi100.stdout:Context: system_u:object_r:device_t:s0 2024-05-09T05:28:35.709 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2024-05-09 05:28:12.753400196 +0000 2024-05-09T05:28:35.709 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2024-05-09 05:22:59.450219907 +0000 2024-05-09T05:28:35.709 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2024-05-09 05:22:59.450219907 +0000 2024-05-09T05:28:35.709 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: 2024-05-09 05:22:59.450219907 +0000 2024-05-09T05:28:35.709 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-09T05:28:35.772 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:35 smithi100 ceph-mon[34353]: Reconfiguring mon.c (monmap changed)... 2024-05-09T05:28:35.772 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:35 smithi100 ceph-mon[34353]: Reconfiguring daemon mon.c on smithi100 2024-05-09T05:28:35.772 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:35 smithi100 ceph-mon[34353]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:28:35.772 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:35 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:35.772 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:35 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:35.772 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:35 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:28:35.775 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2024-05-09T05:28:35.775 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2024-05-09T05:28:35.775 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.000280777 s, 1.8 MB/s 2024-05-09T05:28:35.777 DEBUG:teuthology.orchestra.run.smithi100:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-09T05:28:35.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:35 smithi060 ceph-mon[34555]: Reconfiguring mon.c (monmap changed)... 2024-05-09T05:28:35.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:35 smithi060 ceph-mon[34555]: Reconfiguring daemon mon.c on smithi100 2024-05-09T05:28:35.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:35 smithi060 ceph-mon[34555]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:28:35.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:35 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:35.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:35 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:35.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:35 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:28:35.834 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_2 2024-05-09T05:28:35.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:35 smithi039 ceph-mon[30439]: Reconfiguring mon.c (monmap changed)... 2024-05-09T05:28:35.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:35 smithi039 ceph-mon[30439]: Reconfiguring daemon mon.c on smithi100 2024-05-09T05:28:35.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:35 smithi039 ceph-mon[30439]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:28:35.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:35 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:35.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:35 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:35.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:35 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:28:35.891 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-09T05:28:35.891 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T05:28:35.891 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 5h/5d Inode: 683 Links: 1 2024-05-09T05:28:35.891 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T05:28:35.891 INFO:teuthology.orchestra.run.smithi100.stdout:Context: system_u:object_r:device_t:s0 2024-05-09T05:28:35.891 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2024-05-09 05:28:12.754400171 +0000 2024-05-09T05:28:35.891 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2024-05-09 05:22:59.794210897 +0000 2024-05-09T05:28:35.891 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2024-05-09 05:22:59.794210897 +0000 2024-05-09T05:28:35.891 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: 2024-05-09 05:22:59.794210897 +0000 2024-05-09T05:28:35.892 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-09T05:28:35.954 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2024-05-09T05:28:35.955 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2024-05-09T05:28:35.955 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.000205215 s, 2.5 MB/s 2024-05-09T05:28:35.956 DEBUG:teuthology.orchestra.run.smithi100:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-09T05:28:36.012 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_3 2024-05-09T05:28:36.067 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-09T05:28:36.067 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T05:28:36.067 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-05-09T05:28:36.068 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T05:28:36.068 INFO:teuthology.orchestra.run.smithi100.stdout:Context: system_u:object_r:device_t:s0 2024-05-09T05:28:36.068 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2024-05-09 05:28:12.754400171 +0000 2024-05-09T05:28:36.068 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2024-05-09 05:23:00.131202071 +0000 2024-05-09T05:28:36.068 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2024-05-09 05:23:00.131202071 +0000 2024-05-09T05:28:36.068 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: 2024-05-09 05:23:00.131202071 +0000 2024-05-09T05:28:36.068 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-09T05:28:36.131 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2024-05-09T05:28:36.131 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2024-05-09T05:28:36.131 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.000228506 s, 2.2 MB/s 2024-05-09T05:28:36.132 DEBUG:teuthology.orchestra.run.smithi100:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-09T05:28:36.188 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_4 2024-05-09T05:28:36.244 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-09T05:28:36.244 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-09T05:28:36.244 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-05-09T05:28:36.244 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T05:28:36.244 INFO:teuthology.orchestra.run.smithi100.stdout:Context: system_u:object_r:device_t:s0 2024-05-09T05:28:36.244 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2024-05-09 05:28:12.755400146 +0000 2024-05-09T05:28:36.245 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2024-05-09 05:23:00.460193455 +0000 2024-05-09T05:28:36.245 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2024-05-09 05:23:00.460193455 +0000 2024-05-09T05:28:36.245 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: 2024-05-09 05:23:00.460193455 +0000 2024-05-09T05:28:36.245 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-09T05:28:36.307 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2024-05-09T05:28:36.308 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2024-05-09T05:28:36.308 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.000201534 s, 2.5 MB/s 2024-05-09T05:28:36.309 DEBUG:teuthology.orchestra.run.smithi100:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-09T05:28:36.365 INFO:tasks.cephadm:Deploying osd.0 on smithi039 with /dev/vg_nvme/lv_4... 2024-05-09T05:28:36.366 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-05-09T05:28:36.613 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T05:28:36.740 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:36 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:28:36.741 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:36 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:28:36.741 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:36 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:36.741 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:36 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-09T05:28:36.741 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:36 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-09T05:28:36.741 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:36 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-09T05:28:36.741 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:36 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:28:36.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:36 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:28:36.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:36 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:28:36.798 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:36 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:36.798 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:36 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-09T05:28:36.798 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:36 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-09T05:28:36.798 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:36 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-09T05:28:36.798 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:36 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:28:36.798 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:36 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:28:36.798 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:36 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:28:36.799 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:36 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:36.799 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:36 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-09T05:28:36.799 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:36 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-09T05:28:36.799 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:36 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-09T05:28:36.799 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:36 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:28:37.649 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:37 smithi100 ceph-mon[34353]: Deploying daemon mgr.z on smithi100 2024-05-09T05:28:37.649 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:37 smithi100 ceph-mon[34353]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:28:37.743 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:37 smithi039 ceph-mon[30439]: Deploying daemon mgr.z on smithi100 2024-05-09T05:28:37.743 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:37 smithi039 ceph-mon[30439]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:28:37.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:37 smithi060 ceph-mon[34555]: Deploying daemon mgr.z on smithi100 2024-05-09T05:28:37.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:37 smithi060 ceph-mon[34555]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:28:37.925 INFO:journalctl@ceph.mgr.z.smithi100.stdout:May 09 05:28:37 smithi100 systemd[1]: Starting Ceph mgr.z for 86d4cc60-0dc4-11ef-bc97-c7b262605968... 2024-05-09T05:28:38.364 INFO:journalctl@ceph.mgr.z.smithi100.stdout:May 09 05:28:38 smithi100 podman[36188]: 2024-05-09 05:28:37.988174414 +0000 UTC m=+0.017881976 image pull db794d706f492c144ccc8f2c5bbc1870e116f5c4f3309dfab4416b39d099f8d7 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584 2024-05-09T05:28:38.364 INFO:journalctl@ceph.mgr.z.smithi100.stdout:May 09 05:28:38 smithi100 podman[36188]: 2024-05-09 05:28:38.092582516 +0000 UTC m=+0.122290123 container create 0e88cf8e9140934292872bbf3014b969eadc3e74932fe0695ee75e6054b41733 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-z, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5) 2024-05-09T05:28:38.364 INFO:journalctl@ceph.mgr.z.smithi100.stdout:May 09 05:28:38 smithi100 podman[36188]: 2024-05-09 05:28:38.287660722 +0000 UTC m=+0.317368284 container init 0e88cf8e9140934292872bbf3014b969eadc3e74932fe0695ee75e6054b41733 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-z, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-09T05:28:38.364 INFO:journalctl@ceph.mgr.z.smithi100.stdout:May 09 05:28:38 smithi100 podman[36188]: 2024-05-09 05:28:38.290908499 +0000 UTC m=+0.320616061 container start 0e88cf8e9140934292872bbf3014b969eadc3e74932fe0695ee75e6054b41733 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-z, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5) 2024-05-09T05:28:38.364 INFO:journalctl@ceph.mgr.z.smithi100.stdout:May 09 05:28:38 smithi100 ceph-mgr[36208]: -- 172.21.15.100:0/912836722 <== mon.1 v2:172.21.15.100:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5628725f05a0 con 0x56287737a900 2024-05-09T05:28:38.364 INFO:journalctl@ceph.mgr.z.smithi100.stdout:May 09 05:28:38 smithi100 bash[36188]: 0e88cf8e9140934292872bbf3014b969eadc3e74932fe0695ee75e6054b41733 2024-05-09T05:28:38.637 INFO:journalctl@ceph.mgr.z.smithi100.stdout:May 09 05:28:38 smithi100 systemd[1]: Started Ceph mgr.z for 86d4cc60-0dc4-11ef-bc97-c7b262605968. 2024-05-09T05:28:38.637 INFO:journalctl@ceph.mgr.z.smithi100.stdout:May 09 05:28:38 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-z[36203]: 2024-05-09T05:28:38.459+0000 7feafc799200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-09T05:28:38.716 INFO:teuthology.orchestra.run.smithi039.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-05-09T05:28:38.716 INFO:teuthology.orchestra.run.smithi039.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-05-09T05:28:38.716 INFO:teuthology.orchestra.run.smithi039.stderr: stderr: 10+0 records in 2024-05-09T05:28:38.716 INFO:teuthology.orchestra.run.smithi039.stderr:10+0 records out 2024-05-09T05:28:38.716 INFO:teuthology.orchestra.run.smithi039.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0105022 s, 998 MB/s 2024-05-09T05:28:38.717 INFO:teuthology.orchestra.run.smithi039.stderr:--> Zapping successful for: 2024-05-09T05:28:38.924 INFO:journalctl@ceph.mgr.z.smithi100.stdout:May 09 05:28:38 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-z[36203]: 2024-05-09T05:28:38.658+0000 7feafc799200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-09T05:28:38.924 INFO:journalctl@ceph.mgr.z.smithi100.stdout:May 09 05:28:38 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-z[36203]: 2024-05-09T05:28:38.765+0000 7feafc799200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-09T05:28:39.293 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi039:vg_nvme/lv_4 2024-05-09T05:28:39.424 INFO:journalctl@ceph.mgr.z.smithi100.stdout:May 09 05:28:39 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-z[36203]: 2024-05-09T05:28:39.084+0000 7feafc799200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-09T05:28:39.424 INFO:journalctl@ceph.mgr.z.smithi100.stdout:May 09 05:28:39 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-z[36203]: 2024-05-09T05:28:39.171+0000 7feafc799200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-09T05:28:39.544 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T05:28:39.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:39 smithi039 ceph-mon[30439]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:28:39.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:39 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:39.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:39 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:39.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:39 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:39.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:39 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-09T05:28:39.612 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:39 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-09T05:28:39.612 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:39 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-09T05:28:39.612 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:39 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:28:39.612 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:39 smithi039 ceph-mon[30439]: Deploying daemon mgr.y on smithi060 2024-05-09T05:28:39.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:39 smithi060 ceph-mon[34555]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:28:39.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:39 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:39.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:39 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:39.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:39 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:39.798 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:39 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-09T05:28:39.798 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:39 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-09T05:28:39.798 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:39 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-09T05:28:39.798 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:39 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:28:39.798 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:39 smithi060 ceph-mon[34555]: Deploying daemon mgr.y on smithi060 2024-05-09T05:28:39.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:39 smithi100 ceph-mon[34353]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:28:39.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:39 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:39.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:39 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:39.925 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:39 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:39.925 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:39 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-09T05:28:39.925 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:39 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-09T05:28:39.925 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:39 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-09T05:28:39.925 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:39 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:28:39.925 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:39 smithi100 ceph-mon[34353]: Deploying daemon mgr.y on smithi060 2024-05-09T05:28:40.674 INFO:journalctl@ceph.mgr.z.smithi100.stdout:May 09 05:28:40 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-z[36203]: 2024-05-09T05:28:40.368+0000 7feafc799200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-09T05:28:40.674 INFO:journalctl@ceph.mgr.z.smithi100.stdout:May 09 05:28:40 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-z[36203]: 2024-05-09T05:28:40.536+0000 7feafc799200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-09T05:28:40.797 INFO:journalctl@ceph.mgr.y.smithi060.stdout:May 09 05:28:40 smithi060 systemd[1]: Starting Ceph mgr.y for 86d4cc60-0dc4-11ef-bc97-c7b262605968... 2024-05-09T05:28:40.984 INFO:journalctl@ceph.mgr.z.smithi100.stdout:May 09 05:28:40 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-z[36203]: 2024-05-09T05:28:40.705+0000 7feafc799200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-09T05:28:40.984 INFO:journalctl@ceph.mgr.z.smithi100.stdout:May 09 05:28:40 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-z[36203]: 2024-05-09T05:28:40.989+0000 7feafc799200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-09T05:28:41.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:41.050+0000 7f40d87d5700 1 -- 172.21.15.39:0/2080077919 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f40d01077b0 msgr2=0x7f40d0109bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:28:41.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:41.050+0000 7f40d87d5700 1 --2- 172.21.15.39:0/2080077919 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f40d01077b0 0x7f40d0109bd0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f40c0009990 tx=0x7f40c0009ca0 comp rx=0 tx=0).stop 2024-05-09T05:28:41.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:41.050+0000 7f40d87d5700 1 -- 172.21.15.39:0/2080077919 shutdown_connections 2024-05-09T05:28:41.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:41.050+0000 7f40d87d5700 1 --2- 172.21.15.39:0/2080077919 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40d010a110 0x7f40d010c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:28:41.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:41.050+0000 7f40d87d5700 1 --2- 172.21.15.39:0/2080077919 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40d01026c0 0x7f40d0102b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:28:41.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:41.050+0000 7f40d87d5700 1 --2- 172.21.15.39:0/2080077919 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f40d01077b0 0x7f40d0109bd0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:28:41.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:41.050+0000 7f40d87d5700 1 -- 172.21.15.39:0/2080077919 >> 172.21.15.39:0/2080077919 conn(0x7f40d00fe020 msgr2=0x7f40d01004d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:28:41.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:41.050+0000 7f40d87d5700 1 -- 172.21.15.39:0/2080077919 shutdown_connections 2024-05-09T05:28:41.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:41.050+0000 7f40d87d5700 1 -- 172.21.15.39:0/2080077919 wait complete. 2024-05-09T05:28:41.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:41.051+0000 7f40d87d5700 1 Processor -- start 2024-05-09T05:28:41.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:41.051+0000 7f40d87d5700 1 -- start start 2024-05-09T05:28:41.048 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:41.051+0000 7f40d87d5700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40d01026c0 0x7f40d019a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:28:41.048 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:41.051+0000 7f40d87d5700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f40d01077b0 0x7f40d019ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:28:41.048 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:41.051+0000 7f40d87d5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40d010a110 0x7f40d01a1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:28:41.048 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:41.051+0000 7f40d87d5700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f40d010fd90 con 0x7f40d01077b0 2024-05-09T05:28:41.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:41.051+0000 7f40d87d5700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f40d010fc10 con 0x7f40d010a110 2024-05-09T05:28:41.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:41.051+0000 7f40d87d5700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f40d010ff10 con 0x7f40d01026c0 2024-05-09T05:28:41.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:41.051+0000 7f40d5d70700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f40d01077b0 0x7f40d019ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:28:41.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:41.051+0000 7f40d6571700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40d01026c0 0x7f40d019a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:28:41.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:41.051+0000 7f40d5d70700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f40d01077b0 0x7f40d019ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:56332/0 (socket says 172.21.15.39:56332) 2024-05-09T05:28:41.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:41.051+0000 7f40d5d70700 1 -- 172.21.15.39:0/1954109762 learned_addr learned my addr 172.21.15.39:0/1954109762 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:28:41.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:41.051+0000 7f40d6d72700 1 --2- 172.21.15.39:0/1954109762 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40d010a110 0x7f40d01a1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:28:41.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:41.051+0000 7f40d6571700 1 -- 172.21.15.39:0/1954109762 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40d010a110 msgr2=0x7f40d01a1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:28:41.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:41.051+0000 7f40d6571700 1 --2- 172.21.15.39:0/1954109762 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40d010a110 0x7f40d01a1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:28:41.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:41.052+0000 7f40d6571700 1 -- 172.21.15.39:0/1954109762 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f40d01077b0 msgr2=0x7f40d019ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:28:41.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:41.052+0000 7f40d6571700 1 --2- 172.21.15.39:0/1954109762 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f40d01077b0 0x7f40d019ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:28:41.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:41.052+0000 7f40d6571700 1 -- 172.21.15.39:0/1954109762 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40d01a2400 con 0x7f40d01026c0 2024-05-09T05:28:41.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:41.052+0000 7f40d5d70700 1 --2- 172.21.15.39:0/1954109762 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f40d01077b0 0x7f40d019ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T05:28:41.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:41.052+0000 7f40d6571700 1 --2- 172.21.15.39:0/1954109762 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40d01026c0 0x7f40d019a8a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f40cc00ef10 tx=0x7f40cc00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:28:41.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:41.052+0000 7f40c77fe700 1 -- 172.21.15.39:0/1954109762 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40cc00c9c0 con 0x7f40d01026c0 2024-05-09T05:28:41.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:41.052+0000 7f40d87d5700 1 -- 172.21.15.39:0/1954109762 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40d01a2690 con 0x7f40d01026c0 2024-05-09T05:28:41.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:41.052+0000 7f40c77fe700 1 -- 172.21.15.39:0/1954109762 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f40cc019070 con 0x7f40d01026c0 2024-05-09T05:28:41.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:41.052+0000 7f40c77fe700 1 -- 172.21.15.39:0/1954109762 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40cc014480 con 0x7f40d01026c0 2024-05-09T05:28:41.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:41.052+0000 7f40d87d5700 1 -- 172.21.15.39:0/1954109762 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40d01a2c20 con 0x7f40d01026c0 2024-05-09T05:28:41.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:41.053+0000 7f40d87d5700 1 -- 172.21.15.39:0/1954109762 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40d00512c0 con 0x7f40d01026c0 2024-05-09T05:28:41.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:41.053+0000 7f40c77fe700 1 -- 172.21.15.39:0/1954109762 <== mon.1 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f40cc012050 con 0x7f40d01026c0 2024-05-09T05:28:41.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:41.053+0000 7f40c77fe700 1 --2- 172.21.15.39:0/1954109762 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f40bc03e750 0x7f40bc040c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:28:41.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:41.053+0000 7f40c77fe700 1 -- 172.21.15.39:0/1954109762 <== mon.1 v2:172.21.15.100:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f40cc0529b0 con 0x7f40d01026c0 2024-05-09T05:28:41.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:41.053+0000 7f40d5d70700 1 --2- 172.21.15.39:0/1954109762 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f40bc03e750 0x7f40bc040c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:28:41.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:41.054+0000 7f40d5d70700 1 --2- 172.21.15.39:0/1954109762 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f40bc03e750 0x7f40bc040c60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f40c000b2e0 tx=0x7f40c0005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:28:41.053 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:41.059+0000 7f40c77fe700 1 -- 172.21.15.39:0/1954109762 <== mon.1 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f40cc010040 con 0x7f40d01026c0 2024-05-09T05:28:41.099 INFO:journalctl@ceph.mgr.y.smithi060.stdout:May 09 05:28:40 smithi060 podman[35924]: 2024-05-09 05:28:40.742648086 +0000 UTC m=+0.018519875 image pull db794d706f492c144ccc8f2c5bbc1870e116f5c4f3309dfab4416b39d099f8d7 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584 2024-05-09T05:28:41.099 INFO:journalctl@ceph.mgr.y.smithi060.stdout:May 09 05:28:40 smithi060 podman[35924]: 2024-05-09 05:28:40.855006674 +0000 UTC m=+0.130878438 container create e4c3c25c4dab69148bbadb67616fe4bfdafe7d242c19a5aa7c7cc08be96b6937 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-y, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-09T05:28:41.099 INFO:journalctl@ceph.mgr.y.smithi060.stdout:May 09 05:28:41 smithi060 podman[35924]: 2024-05-09 05:28:41.065574964 +0000 UTC m=+0.341446729 container init e4c3c25c4dab69148bbadb67616fe4bfdafe7d242c19a5aa7c7cc08be96b6937 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-y, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-09T05:28:41.099 INFO:journalctl@ceph.mgr.y.smithi060.stdout:May 09 05:28:41 smithi060 podman[35924]: 2024-05-09 05:28:41.068194102 +0000 UTC m=+0.344065866 container start e4c3c25c4dab69148bbadb67616fe4bfdafe7d242c19a5aa7c7cc08be96b6937 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-y, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, ceph=True, org.label-schema.vendor=CentOS) 2024-05-09T05:28:41.099 INFO:journalctl@ceph.mgr.y.smithi060.stdout:May 09 05:28:41 smithi060 ceph-mgr[35943]: -- 172.21.15.60:0/2160090159 <== mon.2 v2:172.21.15.60:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558d7104c5a0 con 0x558d75dd6480 2024-05-09T05:28:41.276 INFO:journalctl@ceph.mgr.z.smithi100.stdout:May 09 05:28:41 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-z[36203]: 2024-05-09T05:28:41.081+0000 7feafc799200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-09T05:28:41.276 INFO:journalctl@ceph.mgr.z.smithi100.stdout:May 09 05:28:41 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-z[36203]: 2024-05-09T05:28:41.281+0000 7feafc799200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-09T05:28:41.284 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:41.290+0000 7f40d87d5700 1 -- 172.21.15.39:0/1954109762 --> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi039:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f40d0063c00 con 0x7f40bc03e750 2024-05-09T05:28:41.448 INFO:journalctl@ceph.mgr.y.smithi060.stdout:May 09 05:28:41 smithi060 bash[35924]: e4c3c25c4dab69148bbadb67616fe4bfdafe7d242c19a5aa7c7cc08be96b6937 2024-05-09T05:28:41.448 INFO:journalctl@ceph.mgr.y.smithi060.stdout:May 09 05:28:41 smithi060 systemd[1]: Started Ceph mgr.y for 86d4cc60-0dc4-11ef-bc97-c7b262605968. 2024-05-09T05:28:41.448 INFO:journalctl@ceph.mgr.y.smithi060.stdout:May 09 05:28:41 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-y[35939]: 2024-05-09T05:28:41.242+0000 7f59932e8200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-09T05:28:41.448 INFO:journalctl@ceph.mgr.y.smithi060.stdout:May 09 05:28:41 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-y[35939]: 2024-05-09T05:28:41.453+0000 7f59932e8200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-09T05:28:41.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:41 smithi039 ceph-mon[30439]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:28:41.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:41 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:41.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:41 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:41.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:41 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:41.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:41 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:41.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:41 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T05:28:41.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:41 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T05:28:41.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:41 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:28:41.674 INFO:journalctl@ceph.mgr.z.smithi100.stdout:May 09 05:28:41 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-z[36203]: 2024-05-09T05:28:41.472+0000 7feafc799200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-09T05:28:41.675 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:41 smithi100 ceph-mon[34353]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:28:41.675 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:41 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:41.675 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:41 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:41.675 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:41 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:41.675 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:41 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:41.675 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:41 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T05:28:41.675 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:41 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T05:28:41.675 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:41 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:28:41.797 INFO:journalctl@ceph.mgr.y.smithi060.stdout:May 09 05:28:41 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-y[35939]: 2024-05-09T05:28:41.566+0000 7f59932e8200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-09T05:28:41.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:41 smithi060 ceph-mon[34555]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:28:41.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:41 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:41.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:41 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:41.798 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:41 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:41.798 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:41 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:41.798 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:41 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T05:28:41.798 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:41 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T05:28:41.798 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:41 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:28:42.297 INFO:journalctl@ceph.mgr.y.smithi060.stdout:May 09 05:28:41 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-y[35939]: 2024-05-09T05:28:41.905+0000 7f59932e8200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-09T05:28:42.297 INFO:journalctl@ceph.mgr.y.smithi060.stdout:May 09 05:28:42 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-y[35939]: 2024-05-09T05:28:42.006+0000 7f59932e8200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-09T05:28:42.424 INFO:journalctl@ceph.mgr.z.smithi100.stdout:May 09 05:28:42 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-z[36203]: 2024-05-09T05:28:42.113+0000 7feafc799200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-09T05:28:42.425 INFO:journalctl@ceph.mgr.z.smithi100.stdout:May 09 05:28:42 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-z[36203]: 2024-05-09T05:28:42.338+0000 7feafc799200 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-09T05:28:42.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:42 smithi039 ceph-mon[30439]: from='client.24115 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi039:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T05:28:42.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:42 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:28:42.774 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:42 smithi100 ceph-mon[34353]: from='client.24115 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi039:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T05:28:42.774 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:42 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:28:42.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:42 smithi060 ceph-mon[34555]: from='client.24115 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi039:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T05:28:42.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:42 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:28:43.174 INFO:journalctl@ceph.mgr.z.smithi100.stdout:May 09 05:28:42 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-z[36203]: 2024-05-09T05:28:42.778+0000 7feafc799200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-09T05:28:43.174 INFO:journalctl@ceph.mgr.z.smithi100.stdout:May 09 05:28:42 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-z[36203]: 2024-05-09T05:28:42.876+0000 7feafc799200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-09T05:28:43.594 INFO:journalctl@ceph.mgr.z.smithi100.stdout:May 09 05:28:43 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-z[36203]: 2024-05-09T05:28:43.245+0000 7feafc799200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-09T05:28:43.594 INFO:journalctl@ceph.mgr.z.smithi100.stdout:May 09 05:28:43 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-z[36203]: 2024-05-09T05:28:43.599+0000 7feafc799200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-09T05:28:43.594 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:43 smithi100 ceph-mon[34353]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:28:43.594 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:43 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:43.594 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:43 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:43.594 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:43 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:43.595 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:43 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:43.595 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:43 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:28:43.595 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:43 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:28:43.595 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:43 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:43.595 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:43 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-09T05:28:43.595 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:43 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-09T05:28:43.595 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:43 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:28:43.595 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:43 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:43.660 INFO:journalctl@ceph.mgr.y.smithi060.stdout:May 09 05:28:43 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-y[35939]: 2024-05-09T05:28:43.312+0000 7f59932e8200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-09T05:28:43.660 INFO:journalctl@ceph.mgr.y.smithi060.stdout:May 09 05:28:43 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-y[35939]: 2024-05-09T05:28:43.489+0000 7f59932e8200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-09T05:28:43.660 INFO:journalctl@ceph.mgr.y.smithi060.stdout:May 09 05:28:43 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-y[35939]: 2024-05-09T05:28:43.665+0000 7f59932e8200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-09T05:28:43.661 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:43 smithi060 ceph-mon[34555]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:28:43.661 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:43 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:43.661 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:43 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:43.661 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:43 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:43.661 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:43 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:43.661 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:43 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:28:43.661 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:43 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:28:43.661 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:43 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:43.661 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:43 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-09T05:28:43.661 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:43 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-09T05:28:43.661 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:43 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:28:43.661 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:43 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:43.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:43 smithi039 ceph-mon[30439]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:28:43.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:43 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:43.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:43 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:43.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:43 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:43.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:43 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:43.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:43 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:28:43.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:43 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:28:43.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:43 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:43.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:43 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-09T05:28:43.862 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:43 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-09T05:28:43.862 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:43 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:28:43.862 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:43 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:43.924 INFO:journalctl@ceph.mgr.z.smithi100.stdout:May 09 05:28:43 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-z[36203]: 2024-05-09T05:28:43.691+0000 7feafc799200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-09T05:28:44.265 INFO:journalctl@ceph.mgr.y.smithi060.stdout:May 09 05:28:43 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-y[35939]: 2024-05-09T05:28:43.965+0000 7f59932e8200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-09T05:28:44.265 INFO:journalctl@ceph.mgr.y.smithi060.stdout:May 09 05:28:44 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-y[35939]: 2024-05-09T05:28:44.060+0000 7f59932e8200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-09T05:28:44.265 INFO:journalctl@ceph.mgr.y.smithi060.stdout:May 09 05:28:44 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-y[35939]: 2024-05-09T05:28:44.270+0000 7f59932e8200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-09T05:28:44.424 INFO:journalctl@ceph.mgr.z.smithi100.stdout:May 09 05:28:43 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-z[36203]: 2024-05-09T05:28:43.930+0000 7feafc799200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-09T05:28:44.424 INFO:journalctl@ceph.mgr.z.smithi100.stdout:May 09 05:28:44 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-z[36203]: 2024-05-09T05:28:44.062+0000 7feafc799200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-09T05:28:44.424 INFO:journalctl@ceph.mgr.z.smithi100.stdout:May 09 05:28:44 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-z[36203]: 2024-05-09T05:28:44.156+0000 7feafc799200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-09T05:28:44.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:44 smithi060 ceph-mon[34555]: Reconfiguring mgr.x (unknown last config time)... 2024-05-09T05:28:44.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:44 smithi060 ceph-mon[34555]: Reconfiguring daemon mgr.x on smithi039 2024-05-09T05:28:44.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:44 smithi060 ceph-mon[34555]: from='client.? 172.21.15.39:0/1144689679' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3491bbda-3a9b-40d2-8627-87d15660f864"}]: dispatch 2024-05-09T05:28:44.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:44 smithi060 ceph-mon[34555]: from='client.? 172.21.15.39:0/1144689679' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3491bbda-3a9b-40d2-8627-87d15660f864"}]': finished 2024-05-09T05:28:44.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:44 smithi060 ceph-mon[34555]: osdmap e5: 1 total, 0 up, 1 in 2024-05-09T05:28:44.548 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:44 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-09T05:28:44.548 INFO:journalctl@ceph.mgr.y.smithi060.stdout:May 09 05:28:44 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-y[35939]: 2024-05-09T05:28:44.469+0000 7f59932e8200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-09T05:28:44.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:44 smithi039 ceph-mon[30439]: Reconfiguring mgr.x (unknown last config time)... 2024-05-09T05:28:44.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:44 smithi039 ceph-mon[30439]: Reconfiguring daemon mgr.x on smithi039 2024-05-09T05:28:44.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:44 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/1144689679' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3491bbda-3a9b-40d2-8627-87d15660f864"}]: dispatch 2024-05-09T05:28:44.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:44 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/1144689679' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3491bbda-3a9b-40d2-8627-87d15660f864"}]': finished 2024-05-09T05:28:44.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:44 smithi039 ceph-mon[30439]: osdmap e5: 1 total, 0 up, 1 in 2024-05-09T05:28:44.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:44 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-09T05:28:44.924 INFO:journalctl@ceph.mgr.z.smithi100.stdout:May 09 05:28:44 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-z[36203]: 2024-05-09T05:28:44.480+0000 7feafc799200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-09T05:28:44.924 INFO:journalctl@ceph.mgr.z.smithi100.stdout:May 09 05:28:44 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-z[36203]: 2024-05-09T05:28:44.571+0000 7feafc799200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-09T05:28:44.925 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:44 smithi100 ceph-mon[34353]: Reconfiguring mgr.x (unknown last config time)... 2024-05-09T05:28:44.925 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:44 smithi100 ceph-mon[34353]: Reconfiguring daemon mgr.x on smithi039 2024-05-09T05:28:44.925 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:44 smithi100 ceph-mon[34353]: from='client.? 172.21.15.39:0/1144689679' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3491bbda-3a9b-40d2-8627-87d15660f864"}]: dispatch 2024-05-09T05:28:44.925 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:44 smithi100 ceph-mon[34353]: from='client.? 172.21.15.39:0/1144689679' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3491bbda-3a9b-40d2-8627-87d15660f864"}]': finished 2024-05-09T05:28:44.925 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:44 smithi100 ceph-mon[34353]: osdmap e5: 1 total, 0 up, 1 in 2024-05-09T05:28:44.925 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:44 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-09T05:28:45.424 INFO:journalctl@ceph.mgr.z.smithi100.stdout:May 09 05:28:45 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-z[36203]: 2024-05-09T05:28:45.169+0000 7feafc799200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-09T05:28:45.424 INFO:journalctl@ceph.mgr.z.smithi100.stdout:May 09 05:28:45 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-z[36203]: 2024-05-09T05:28:45.381+0000 7feafc799200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-09T05:28:45.547 INFO:journalctl@ceph.mgr.y.smithi060.stdout:May 09 05:28:45 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-y[35939]: 2024-05-09T05:28:45.099+0000 7f59932e8200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-09T05:28:45.547 INFO:journalctl@ceph.mgr.y.smithi060.stdout:May 09 05:28:45 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-y[35939]: 2024-05-09T05:28:45.328+0000 7f59932e8200 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-09T05:28:45.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:45 smithi100 ceph-mon[34353]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:28:45.925 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:45 smithi100 ceph-mon[34353]: from='client.? 172.21.15.39:0/3375119006' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap", "output-file": "/var/lib/ceph/osd/ceph-0/activate.monmap"}]: dispatch 2024-05-09T05:28:45.925 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:45 smithi100 ceph-mon[34353]: Standby manager daemon z started 2024-05-09T05:28:45.925 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:45 smithi100 ceph-mon[34353]: from='mgr.? 172.21.15.100:0/2988689277' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-05-09T05:28:45.925 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:45 smithi100 ceph-mon[34353]: from='mgr.? 172.21.15.100:0/2988689277' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-09T05:28:45.925 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:45 smithi100 ceph-mon[34353]: from='mgr.? 172.21.15.100:0/2988689277' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-05-09T05:28:45.925 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:45 smithi100 ceph-mon[34353]: from='mgr.? 172.21.15.100:0/2988689277' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-09T05:28:46.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:45 smithi060 ceph-mon[34555]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:28:46.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:45 smithi060 ceph-mon[34555]: from='client.? 172.21.15.39:0/3375119006' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap", "output-file": "/var/lib/ceph/osd/ceph-0/activate.monmap"}]: dispatch 2024-05-09T05:28:46.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:45 smithi060 ceph-mon[34555]: Standby manager daemon z started 2024-05-09T05:28:46.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:45 smithi060 ceph-mon[34555]: from='mgr.? 172.21.15.100:0/2988689277' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-05-09T05:28:46.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:45 smithi060 ceph-mon[34555]: from='mgr.? 172.21.15.100:0/2988689277' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-09T05:28:46.048 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:45 smithi060 ceph-mon[34555]: from='mgr.? 172.21.15.100:0/2988689277' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-05-09T05:28:46.048 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:45 smithi060 ceph-mon[34555]: from='mgr.? 172.21.15.100:0/2988689277' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-09T05:28:46.048 INFO:journalctl@ceph.mgr.y.smithi060.stdout:May 09 05:28:45 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-y[35939]: 2024-05-09T05:28:45.767+0000 7f59932e8200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-09T05:28:46.048 INFO:journalctl@ceph.mgr.y.smithi060.stdout:May 09 05:28:45 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-y[35939]: 2024-05-09T05:28:45.867+0000 7f59932e8200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-09T05:28:46.111 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:45 smithi039 ceph-mon[30439]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:28:46.111 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:45 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/3375119006' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap", "output-file": "/var/lib/ceph/osd/ceph-0/activate.monmap"}]: dispatch 2024-05-09T05:28:46.111 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:45 smithi039 ceph-mon[30439]: Standby manager daemon z started 2024-05-09T05:28:46.111 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:45 smithi039 ceph-mon[30439]: from='mgr.? 172.21.15.100:0/2988689277' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-05-09T05:28:46.111 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:45 smithi039 ceph-mon[30439]: from='mgr.? 172.21.15.100:0/2988689277' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-09T05:28:46.111 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:45 smithi039 ceph-mon[30439]: from='mgr.? 172.21.15.100:0/2988689277' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-05-09T05:28:46.111 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:45 smithi039 ceph-mon[30439]: from='mgr.? 172.21.15.100:0/2988689277' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-09T05:28:46.229 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:46.234+0000 7f40c77fe700 1 -- 172.21.15.39:0/1954109762 <== mon.1 v2:172.21.15.100:3300/0 7 ==== mgrmap(e 14) ==== 99937+0+0 (secure 0 0 0) 0x7f40cc052d10 con 0x7f40d01026c0 2024-05-09T05:28:46.547 INFO:journalctl@ceph.mgr.y.smithi060.stdout:May 09 05:28:46 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-y[35939]: 2024-05-09T05:28:46.251+0000 7f59932e8200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-09T05:28:46.969 INFO:journalctl@ceph.mgr.y.smithi060.stdout:May 09 05:28:46 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-y[35939]: 2024-05-09T05:28:46.625+0000 7f59932e8200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-09T05:28:46.969 INFO:journalctl@ceph.mgr.y.smithi060.stdout:May 09 05:28:46 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-y[35939]: 2024-05-09T05:28:46.720+0000 7f59932e8200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-09T05:28:47.231 INFO:journalctl@ceph.mgr.y.smithi060.stdout:May 09 05:28:46 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-y[35939]: 2024-05-09T05:28:46.974+0000 7f59932e8200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-09T05:28:47.232 INFO:journalctl@ceph.mgr.y.smithi060.stdout:May 09 05:28:47 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-y[35939]: 2024-05-09T05:28:47.113+0000 7f59932e8200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-09T05:28:47.232 INFO:journalctl@ceph.mgr.y.smithi060.stdout:May 09 05:28:47 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-y[35939]: 2024-05-09T05:28:47.212+0000 7f59932e8200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-09T05:28:47.545 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:47 smithi060 ceph-mon[34555]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:28:47.545 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:47 smithi060 ceph-mon[34555]: mgrmap e14: x(active, since 78s), standbys: z 2024-05-09T05:28:47.545 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:47 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-05-09T05:28:47.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:47 smithi039 ceph-mon[30439]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:28:47.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:47 smithi039 ceph-mon[30439]: mgrmap e14: x(active, since 78s), standbys: z 2024-05-09T05:28:47.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:47 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-05-09T05:28:47.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:47 smithi100 ceph-mon[34353]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:28:47.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:47 smithi100 ceph-mon[34353]: mgrmap e14: x(active, since 78s), standbys: z 2024-05-09T05:28:47.675 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:47 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-05-09T05:28:47.797 INFO:journalctl@ceph.mgr.y.smithi060.stdout:May 09 05:28:47 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-y[35939]: 2024-05-09T05:28:47.550+0000 7f59932e8200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-09T05:28:47.797 INFO:journalctl@ceph.mgr.y.smithi060.stdout:May 09 05:28:47 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-y[35939]: 2024-05-09T05:28:47.645+0000 7f59932e8200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-09T05:28:48.547 INFO:journalctl@ceph.mgr.y.smithi060.stdout:May 09 05:28:48 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-y[35939]: 2024-05-09T05:28:48.274+0000 7f59932e8200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-09T05:28:48.547 INFO:journalctl@ceph.mgr.y.smithi060.stdout:May 09 05:28:48 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-y[35939]: 2024-05-09T05:28:48.497+0000 7f59932e8200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-09T05:28:49.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:28:49.255+0000 7f40c77fe700 1 -- 172.21.15.39:0/1954109762 <== mon.1 v2:172.21.15.100:3300/0 8 ==== mgrmap(e 15) ==== 149596+0+0 (secure 0 0 0) 0x7f40cc03e670 con 0x7f40d01026c0 2024-05-09T05:28:49.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:49 smithi039 ceph-mon[30439]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:28:49.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:49 smithi039 ceph-mon[30439]: Standby manager daemon y started 2024-05-09T05:28:49.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:49 smithi039 ceph-mon[30439]: from='mgr.? 172.21.15.60:0/2255512630' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-09T05:28:49.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:49 smithi039 ceph-mon[30439]: from='mgr.? 172.21.15.60:0/2255512630' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-09T05:28:49.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:49 smithi039 ceph-mon[30439]: from='mgr.? 172.21.15.60:0/2255512630' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-09T05:28:49.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:49 smithi039 ceph-mon[30439]: from='mgr.? 172.21.15.60:0/2255512630' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-09T05:28:49.492 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:49 smithi100 ceph-mon[34353]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:28:49.493 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:49 smithi100 ceph-mon[34353]: Standby manager daemon y started 2024-05-09T05:28:49.493 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:49 smithi100 ceph-mon[34353]: from='mgr.? 172.21.15.60:0/2255512630' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-09T05:28:49.493 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:49 smithi100 ceph-mon[34353]: from='mgr.? 172.21.15.60:0/2255512630' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-09T05:28:49.493 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:49 smithi100 ceph-mon[34353]: from='mgr.? 172.21.15.60:0/2255512630' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-09T05:28:49.493 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:49 smithi100 ceph-mon[34353]: from='mgr.? 172.21.15.60:0/2255512630' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-09T05:28:49.551 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:49 smithi060 ceph-mon[34555]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:28:49.551 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:49 smithi060 ceph-mon[34555]: Standby manager daemon y started 2024-05-09T05:28:49.551 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:49 smithi060 ceph-mon[34555]: from='mgr.? 172.21.15.60:0/2255512630' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-09T05:28:49.551 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:49 smithi060 ceph-mon[34555]: from='mgr.? 172.21.15.60:0/2255512630' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-09T05:28:49.552 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:49 smithi060 ceph-mon[34555]: from='mgr.? 172.21.15.60:0/2255512630' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-09T05:28:49.552 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:49 smithi060 ceph-mon[34555]: from='mgr.? 172.21.15.60:0/2255512630' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-09T05:28:50.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:50 smithi039 ceph-mon[30439]: mgrmap e15: x(active, since 81s), standbys: z, y 2024-05-09T05:28:50.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:50 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-09T05:28:50.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:50 smithi060 ceph-mon[34555]: mgrmap e15: x(active, since 81s), standbys: z, y 2024-05-09T05:28:50.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:50 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-09T05:28:50.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:50 smithi100 ceph-mon[34353]: mgrmap e15: x(active, since 81s), standbys: z, y 2024-05-09T05:28:50.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:50 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-09T05:28:51.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:51 smithi039 ceph-mon[30439]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:28:51.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:51 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:51.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:51 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:51.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:51 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:28:51.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:51 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:28:51.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:51 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:28:51.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:51 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:51.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:51 smithi060 ceph-mon[34555]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:28:51.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:51 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:51.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:51 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:51.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:51 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:28:51.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:51 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:28:51.548 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:51 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:28:51.548 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:51 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:51.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:51 smithi100 ceph-mon[34353]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:28:51.675 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:51 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:51.675 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:51 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:51.675 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:51 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:28:51.675 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:51 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:28:51.675 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:51 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:28:51.675 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:51 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:53.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:53 smithi060 ceph-mon[34555]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:28:53.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:53 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-09T05:28:53.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:53 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:28:53.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:53 smithi039 ceph-mon[30439]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:28:53.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:53 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-09T05:28:53.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:53 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:28:53.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:53 smithi100 ceph-mon[34353]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:28:53.675 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:53 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-09T05:28:53.675 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:53 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:28:54.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:54 smithi039 ceph-mon[30439]: Deploying daemon osd.0 on smithi039 2024-05-09T05:28:54.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:54 smithi060 ceph-mon[34555]: Deploying daemon osd.0 on smithi039 2024-05-09T05:28:54.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:54 smithi100 ceph-mon[34353]: Deploying daemon osd.0 on smithi039 2024-05-09T05:28:55.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:55 smithi060 ceph-mon[34555]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:28:55.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:55 smithi039 ceph-mon[30439]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:28:55.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:55 smithi100 ceph-mon[34353]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:28:57.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:57 smithi060 ceph-mon[34555]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:28:57.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:57 smithi039 ceph-mon[30439]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:28:57.675 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:57 smithi100 ceph-mon[34353]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:28:59.362 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:59 smithi039 ceph-mon[30439]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:28:59.363 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:59 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:59.363 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:59 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:59.363 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:28:59 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:28:59.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:59 smithi060 ceph-mon[34555]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:28:59.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:59 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:59.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:59 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:59.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:28:59 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:28:59.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:59 smithi100 ceph-mon[34353]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:28:59.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:59 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:59.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:59 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:28:59.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:28:59 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:29:01.525 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:01 smithi039 ceph-mon[30439]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:29:01.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:01 smithi060 ceph-mon[34555]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:29:01.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:01 smithi100 ceph-mon[34353]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:29:02.604 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:02 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:29:02.604 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:02 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:29:02.604 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:02 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:29:02.604 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:02 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:29:02.605 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:02 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:29:02.690 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:29:02.695+0000 7f40c77fe700 1 -- 172.21.15.39:0/1954109762 <== mgr.14152 v2:172.21.15.39:6800/3184189003 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f40d0063c00 con 0x7f40bc03e750 2024-05-09T05:29:02.690 INFO:teuthology.orchestra.run.smithi039.stdout:Created osd(s) 0 on host 'smithi039' 2024-05-09T05:29:02.693 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:29:02.698+0000 7f40d87d5700 1 -- 172.21.15.39:0/1954109762 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f40bc03e750 msgr2=0x7f40bc040c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:29:02.693 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:29:02.698+0000 7f40d87d5700 1 --2- 172.21.15.39:0/1954109762 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f40bc03e750 0x7f40bc040c60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f40c000b2e0 tx=0x7f40c0005fb0 comp rx=0 tx=0).stop 2024-05-09T05:29:02.693 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:29:02.698+0000 7f40d87d5700 1 -- 172.21.15.39:0/1954109762 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40d01026c0 msgr2=0x7f40d019a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:29:02.693 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:29:02.698+0000 7f40d87d5700 1 --2- 172.21.15.39:0/1954109762 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40d01026c0 0x7f40d019a8a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f40cc00ef10 tx=0x7f40cc00c3a0 comp rx=0 tx=0).stop 2024-05-09T05:29:02.693 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:29:02.698+0000 7f40d87d5700 1 -- 172.21.15.39:0/1954109762 shutdown_connections 2024-05-09T05:29:02.693 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:29:02.698+0000 7f40d87d5700 1 --2- 172.21.15.39:0/1954109762 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f40bc03e750 0x7f40bc040c60 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:29:02.693 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:29:02.698+0000 7f40d87d5700 1 --2- 172.21.15.39:0/1954109762 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40d010a110 0x7f40d01a1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:29:02.693 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:29:02.698+0000 7f40d87d5700 1 --2- 172.21.15.39:0/1954109762 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40d01026c0 0x7f40d019a8a0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:29:02.693 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:29:02.698+0000 7f40d87d5700 1 --2- 172.21.15.39:0/1954109762 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f40d01077b0 0x7f40d019ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:29:02.694 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:29:02.698+0000 7f40d87d5700 1 -- 172.21.15.39:0/1954109762 >> 172.21.15.39:0/1954109762 conn(0x7f40d00fe020 msgr2=0x7f40d01086d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:29:02.694 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:29:02.698+0000 7f40d87d5700 1 -- 172.21.15.39:0/1954109762 shutdown_connections 2024-05-09T05:29:02.694 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:29:02.698+0000 7f40d87d5700 1 -- 172.21.15.39:0/1954109762 wait complete. 2024-05-09T05:29:02.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:02 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:29:02.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:02 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:29:02.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:02 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:29:02.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:02 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:29:02.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:02 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:29:02.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:02 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:29:02.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:02 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:29:02.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:02 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:29:02.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:02 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:29:02.925 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:02 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:29:03.293 DEBUG:teuthology.orchestra.run.smithi039:osd.0> sudo journalctl -f -n 0 -u ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@osd.0.service 2024-05-09T05:29:03.295 INFO:tasks.cephadm:Deploying osd.1 on smithi060 with /dev/vg_nvme/lv_4... 2024-05-09T05:29:03.295 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-05-09T05:29:03.550 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.b/config 2024-05-09T05:29:03.593 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:03 smithi039 ceph-mon[30439]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:29:03.594 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:03 smithi039 ceph-mon[30439]: from='osd.0 [v2:172.21.15.39:6802/1056276932,v1:172.21.15.39:6803/1056276932]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-09T05:29:03.594 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:03 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:29:03.594 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:03 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:29:03.594 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:03 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:29:03.662 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:03 smithi060 ceph-mon[34555]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:29:03.662 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:03 smithi060 ceph-mon[34555]: from='osd.0 [v2:172.21.15.39:6802/1056276932,v1:172.21.15.39:6803/1056276932]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-09T05:29:03.662 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:03 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:29:03.662 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:03 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:29:03.662 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:03 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:29:03.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:03 smithi100 ceph-mon[34353]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:29:03.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:03 smithi100 ceph-mon[34353]: from='osd.0 [v2:172.21.15.39:6802/1056276932,v1:172.21.15.39:6803/1056276932]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-09T05:29:03.925 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:03 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:29:03.925 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:03 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:29:03.925 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:03 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:29:04.602 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:04 smithi039 ceph-mon[30439]: from='osd.0 [v2:172.21.15.39:6802/1056276932,v1:172.21.15.39:6803/1056276932]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-05-09T05:29:04.603 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:04 smithi039 ceph-mon[30439]: osdmap e6: 1 total, 0 up, 1 in 2024-05-09T05:29:04.603 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:04 smithi039 ceph-mon[30439]: from='osd.0 [v2:172.21.15.39:6802/1056276932,v1:172.21.15.39:6803/1056276932]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]: dispatch 2024-05-09T05:29:04.603 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:04 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-09T05:29:04.603 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:04 smithi039 ceph-mon[30439]: from='osd.0 [v2:172.21.15.39:6802/1056276932,v1:172.21.15.39:6803/1056276932]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]': finished 2024-05-09T05:29:04.603 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:04 smithi039 ceph-mon[30439]: osdmap e7: 1 total, 0 up, 1 in 2024-05-09T05:29:04.603 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:04 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-09T05:29:04.760 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:04 smithi060 ceph-mon[34555]: from='osd.0 [v2:172.21.15.39:6802/1056276932,v1:172.21.15.39:6803/1056276932]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-05-09T05:29:04.760 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:04 smithi060 ceph-mon[34555]: osdmap e6: 1 total, 0 up, 1 in 2024-05-09T05:29:04.760 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:04 smithi060 ceph-mon[34555]: from='osd.0 [v2:172.21.15.39:6802/1056276932,v1:172.21.15.39:6803/1056276932]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]: dispatch 2024-05-09T05:29:04.760 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:04 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-09T05:29:04.760 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:04 smithi060 ceph-mon[34555]: from='osd.0 [v2:172.21.15.39:6802/1056276932,v1:172.21.15.39:6803/1056276932]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]': finished 2024-05-09T05:29:04.760 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:04 smithi060 ceph-mon[34555]: osdmap e7: 1 total, 0 up, 1 in 2024-05-09T05:29:04.760 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:04 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-09T05:29:04.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:04 smithi100 ceph-mon[34353]: from='osd.0 [v2:172.21.15.39:6802/1056276932,v1:172.21.15.39:6803/1056276932]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-05-09T05:29:04.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:04 smithi100 ceph-mon[34353]: osdmap e6: 1 total, 0 up, 1 in 2024-05-09T05:29:04.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:04 smithi100 ceph-mon[34353]: from='osd.0 [v2:172.21.15.39:6802/1056276932,v1:172.21.15.39:6803/1056276932]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]: dispatch 2024-05-09T05:29:04.925 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:04 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-09T05:29:04.925 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:04 smithi100 ceph-mon[34353]: from='osd.0 [v2:172.21.15.39:6802/1056276932,v1:172.21.15.39:6803/1056276932]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]': finished 2024-05-09T05:29:04.925 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:04 smithi100 ceph-mon[34353]: osdmap e7: 1 total, 0 up, 1 in 2024-05-09T05:29:04.925 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:04 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-09T05:29:05.474 INFO:teuthology.orchestra.run.smithi060.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-05-09T05:29:05.475 INFO:teuthology.orchestra.run.smithi060.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-05-09T05:29:05.475 INFO:teuthology.orchestra.run.smithi060.stderr: stderr: 10+0 records in 2024-05-09T05:29:05.475 INFO:teuthology.orchestra.run.smithi060.stderr:10+0 records out 2024-05-09T05:29:05.475 INFO:teuthology.orchestra.run.smithi060.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0135814 s, 772 MB/s 2024-05-09T05:29:05.475 INFO:teuthology.orchestra.run.smithi060.stderr:--> Zapping successful for: 2024-05-09T05:29:05.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:05 smithi060 ceph-mon[34555]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:29:05.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:05 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-09T05:29:05.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:05 smithi060 ceph-mon[34555]: from='osd.0 [v2:172.21.15.39:6802/1056276932,v1:172.21.15.39:6803/1056276932]' entity='osd.0' 2024-05-09T05:29:05.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:05 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-09T05:29:05.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:05 smithi039 ceph-mon[30439]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:29:05.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:05 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-09T05:29:05.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:05 smithi039 ceph-mon[30439]: from='osd.0 [v2:172.21.15.39:6802/1056276932,v1:172.21.15.39:6803/1056276932]' entity='osd.0' 2024-05-09T05:29:05.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:05 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-09T05:29:05.862 INFO:journalctl@ceph.osd.0.smithi039.stdout:May 09 05:29:05 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-0[42469]: 2024-05-09T05:29:05.488+0000 7f5d9fa97700 -1 osd.0 0 waiting for initial osdmap 2024-05-09T05:29:05.862 INFO:journalctl@ceph.osd.0.smithi039.stdout:May 09 05:29:05 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-0[42469]: 2024-05-09T05:29:05.532+0000 7f5d97844700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T05:29:05.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:05 smithi100 ceph-mon[34353]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:29:05.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:05 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-09T05:29:05.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:05 smithi100 ceph-mon[34353]: from='osd.0 [v2:172.21.15.39:6802/1056276932,v1:172.21.15.39:6803/1056276932]' entity='osd.0' 2024-05-09T05:29:05.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:05 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-09T05:29:06.059 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi060:vg_nvme/lv_4 2024-05-09T05:29:06.314 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.b/config 2024-05-09T05:29:06.643 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:06 smithi060 ceph-mon[34555]: purged_snaps scrub starts 2024-05-09T05:29:06.643 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:06 smithi060 ceph-mon[34555]: purged_snaps scrub ok 2024-05-09T05:29:06.643 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:06 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:29:06.643 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:06 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:29:06.643 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:06 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:29:06.643 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:06 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:29:06.643 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:06 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:29:06.643 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:06 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:29:06.643 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:06 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:29:06.643 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:06 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-09T05:29:06.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:06 smithi039 ceph-mon[30439]: purged_snaps scrub starts 2024-05-09T05:29:06.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:06 smithi039 ceph-mon[30439]: purged_snaps scrub ok 2024-05-09T05:29:06.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:06 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:29:06.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:06 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:29:06.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:06 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:29:06.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:06 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:29:06.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:06 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:29:06.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:06 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:29:06.862 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:06 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:29:06.862 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:06 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-09T05:29:06.925 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:06 smithi100 ceph-mon[34353]: purged_snaps scrub starts 2024-05-09T05:29:06.925 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:06 smithi100 ceph-mon[34353]: purged_snaps scrub ok 2024-05-09T05:29:06.925 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:06 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:29:06.925 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:06 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:29:06.925 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:06 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:29:06.925 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:06 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:29:06.925 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:06 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:29:06.925 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:06 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:29:06.925 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:06 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:29:06.926 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:06 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-09T05:29:07.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:07 smithi060 ceph-mon[34555]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:29:07.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:07 smithi060 ceph-mon[34555]: Detected new or changed devices on smithi039 2024-05-09T05:29:07.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:07 smithi060 ceph-mon[34555]: Adjusting osd_memory_target on smithi039 to 17088M 2024-05-09T05:29:07.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:07 smithi060 ceph-mon[34555]: osd.0 [v2:172.21.15.39:6802/1056276932,v1:172.21.15.39:6803/1056276932] boot 2024-05-09T05:29:07.548 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:07 smithi060 ceph-mon[34555]: osdmap e8: 1 total, 1 up, 1 in 2024-05-09T05:29:07.548 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:07 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-09T05:29:07.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:29:07.806+0000 7fa7b0e7a700 1 -- 172.21.15.60:0/1672246868 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7ac104d10 msgr2=0x7fa7ac10b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:29:07.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:29:07.806+0000 7fa7b0e7a700 1 --2- 172.21.15.60:0/1672246868 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7ac104d10 0x7fa7ac10b5c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa7a4009990 tx=0x7fa7a4009ca0 comp rx=0 tx=0).stop 2024-05-09T05:29:07.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:29:07.806+0000 7fa7b0e7a700 1 -- 172.21.15.60:0/1672246868 shutdown_connections 2024-05-09T05:29:07.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:29:07.806+0000 7fa7b0e7a700 1 --2- 172.21.15.60:0/1672246868 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7ac104d10 0x7fa7ac10b5c0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:29:07.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:29:07.806+0000 7fa7b0e7a700 1 --2- 172.21.15.60:0/1672246868 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa7ac103240 0x7fa7ac103650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:29:07.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:29:07.806+0000 7fa7b0e7a700 1 --2- 172.21.15.60:0/1672246868 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa7ac104370 0x7fa7ac104780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:29:07.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:29:07.806+0000 7fa7b0e7a700 1 -- 172.21.15.60:0/1672246868 >> 172.21.15.60:0/1672246868 conn(0x7fa7ac0fe880 msgr2=0x7fa7ac100d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:29:07.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:29:07.806+0000 7fa7b0e7a700 1 -- 172.21.15.60:0/1672246868 shutdown_connections 2024-05-09T05:29:07.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:29:07.806+0000 7fa7b0e7a700 1 -- 172.21.15.60:0/1672246868 wait complete. 2024-05-09T05:29:07.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:29:07.807+0000 7fa7b0e7a700 1 Processor -- start 2024-05-09T05:29:07.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:29:07.807+0000 7fa7b0e7a700 1 -- start start 2024-05-09T05:29:07.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:29:07.807+0000 7fa7b0e7a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa7ac103240 0x7fa7ac06c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:29:07.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:29:07.807+0000 7fa7b0e7a700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa7ac104370 0x7fa7ac19f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:29:07.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:29:07.807+0000 7fa7b0e7a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7ac104d10 0x7fa7ac1a1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:29:07.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:29:07.807+0000 7fa7b0e7a700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fa7ac10ecc0 con 0x7fa7ac103240 2024-05-09T05:29:07.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:29:07.807+0000 7fa7b0e7a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa7ac10eb40 con 0x7fa7ac104d10 2024-05-09T05:29:07.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:29:07.807+0000 7fa7b0e7a700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa7ac10ee40 con 0x7fa7ac104370 2024-05-09T05:29:07.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:29:07.808+0000 7fa7aad9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7ac104d10 0x7fa7ac1a1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:29:07.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:29:07.808+0000 7fa7aad9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7ac104d10 0x7fa7ac1a1be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:57952/0 (socket says 172.21.15.60:57952) 2024-05-09T05:29:07.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:29:07.808+0000 7fa7aad9d700 1 -- 172.21.15.60:0/891779521 learned_addr learned my addr 172.21.15.60:0/891779521 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-05-09T05:29:07.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:29:07.808+0000 7fa7a9d9b700 1 --2- 172.21.15.60:0/891779521 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa7ac104370 0x7fa7ac19f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:29:07.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:29:07.808+0000 7fa7aa59c700 1 --2- 172.21.15.60:0/891779521 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa7ac103240 0x7fa7ac06c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:29:07.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:29:07.808+0000 7fa7aad9d700 1 -- 172.21.15.60:0/891779521 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa7ac104370 msgr2=0x7fa7ac19f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:29:07.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:29:07.808+0000 7fa7aad9d700 1 --2- 172.21.15.60:0/891779521 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa7ac104370 0x7fa7ac19f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:29:07.807 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:29:07.808+0000 7fa7aad9d700 1 -- 172.21.15.60:0/891779521 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa7ac103240 msgr2=0x7fa7ac06c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:29:07.807 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:29:07.808+0000 7fa7aad9d700 1 --2- 172.21.15.60:0/891779521 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa7ac103240 0x7fa7ac06c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:29:07.807 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:29:07.808+0000 7fa7aad9d700 1 -- 172.21.15.60:0/891779521 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7ac1a2410 con 0x7fa7ac104d10 2024-05-09T05:29:07.807 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:29:07.808+0000 7fa7a9d9b700 1 --2- 172.21.15.60:0/891779521 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa7ac104370 0x7fa7ac19f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T05:29:07.807 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:29:07.808+0000 7fa7aad9d700 1 --2- 172.21.15.60:0/891779521 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7ac104d10 0x7fa7ac1a1be0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa7a40059d0 tx=0x7fa7a40047b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:29:07.807 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:29:07.808+0000 7fa7a37fe700 1 -- 172.21.15.60:0/891779521 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7a4027070 con 0x7fa7ac104d10 2024-05-09T05:29:07.807 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:29:07.808+0000 7fa7a37fe700 1 -- 172.21.15.60:0/891779521 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa7a400fbc0 con 0x7fa7ac104d10 2024-05-09T05:29:07.807 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:29:07.808+0000 7fa7b0e7a700 1 -- 172.21.15.60:0/891779521 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7ac1a26a0 con 0x7fa7ac104d10 2024-05-09T05:29:07.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:29:07.808+0000 7fa7a37fe700 1 -- 172.21.15.60:0/891779521 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7a4017650 con 0x7fa7ac104d10 2024-05-09T05:29:07.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:29:07.808+0000 7fa7b0e7a700 1 -- 172.21.15.60:0/891779521 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7ac1a2af0 con 0x7fa7ac104d10 2024-05-09T05:29:07.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:29:07.810+0000 7fa7b0e7a700 1 -- 172.21.15.60:0/891779521 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7ac0512c0 con 0x7fa7ac104d10 2024-05-09T05:29:07.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:29:07.811+0000 7fa7a37fe700 1 -- 172.21.15.60:0/891779521 <== mon.2 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 15) ==== 149596+0+0 (secure 0 0 0) 0x7fa7a402a070 con 0x7fa7ac104d10 2024-05-09T05:29:07.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:29:07.812+0000 7fa7a37fe700 1 --2- 172.21.15.60:0/891779521 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fa7980b2870 0x7fa7980b4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:29:07.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:29:07.812+0000 7fa7a37fe700 1 -- 172.21.15.60:0/891779521 <== mon.2 v2:172.21.15.60:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1767+0+0 (secure 0 0 0) 0x7fa7a40e18e0 con 0x7fa7ac104d10 2024-05-09T05:29:07.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:29:07.812+0000 7fa7aa59c700 1 --2- 172.21.15.60:0/891779521 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fa7980b2870 0x7fa7980b4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:29:07.810 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:29:07.813+0000 7fa7aa59c700 1 --2- 172.21.15.60:0/891779521 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fa7980b2870 0x7fa7980b4d80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa7ac104270 tx=0x7fa79c00b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:29:07.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:29:07.817+0000 7fa7a37fe700 1 -- 172.21.15.60:0/891779521 <== mon.2 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fa7a4013070 con 0x7fa7ac104d10 2024-05-09T05:29:07.825 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:07 smithi100 ceph-mon[34353]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:29:07.825 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:07 smithi100 ceph-mon[34353]: Detected new or changed devices on smithi039 2024-05-09T05:29:07.826 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:07 smithi100 ceph-mon[34353]: Adjusting osd_memory_target on smithi039 to 17088M 2024-05-09T05:29:07.826 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:07 smithi100 ceph-mon[34353]: osd.0 [v2:172.21.15.39:6802/1056276932,v1:172.21.15.39:6803/1056276932] boot 2024-05-09T05:29:07.826 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:07 smithi100 ceph-mon[34353]: osdmap e8: 1 total, 1 up, 1 in 2024-05-09T05:29:07.826 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:07 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-09T05:29:07.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:07 smithi039 ceph-mon[30439]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-09T05:29:07.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:07 smithi039 ceph-mon[30439]: Detected new or changed devices on smithi039 2024-05-09T05:29:07.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:07 smithi039 ceph-mon[30439]: Adjusting osd_memory_target on smithi039 to 17088M 2024-05-09T05:29:07.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:07 smithi039 ceph-mon[30439]: osd.0 [v2:172.21.15.39:6802/1056276932,v1:172.21.15.39:6803/1056276932] boot 2024-05-09T05:29:07.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:07 smithi039 ceph-mon[30439]: osdmap e8: 1 total, 1 up, 1 in 2024-05-09T05:29:07.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:07 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-09T05:29:08.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:29:08.039+0000 7fa7b0e7a700 1 -- 172.21.15.60:0/891779521 --> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fa7ac063cc0 con 0x7fa7980b2870 2024-05-09T05:29:08.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:08 smithi060 ceph-mon[34555]: osdmap e9: 1 total, 1 up, 1 in 2024-05-09T05:29:08.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:08 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T05:29:08.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:08 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T05:29:08.798 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:08 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:29:08.838 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:08 smithi100 ceph-mon[34353]: osdmap e9: 1 total, 1 up, 1 in 2024-05-09T05:29:08.838 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:08 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T05:29:08.838 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:08 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T05:29:08.839 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:08 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:29:08.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:08 smithi039 ceph-mon[30439]: osdmap e9: 1 total, 1 up, 1 in 2024-05-09T05:29:08.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:08 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T05:29:08.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:08 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T05:29:08.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:08 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:29:09.606 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:09 smithi060 ceph-mon[34555]: from='client.24146 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T05:29:09.606 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:09 smithi060 ceph-mon[34555]: pgmap v49: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-09T05:29:09.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:09 smithi039 ceph-mon[30439]: from='client.24146 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T05:29:09.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:09 smithi039 ceph-mon[30439]: pgmap v49: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-09T05:29:09.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:09 smithi100 ceph-mon[34353]: from='client.24146 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T05:29:09.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:09 smithi100 ceph-mon[34353]: pgmap v49: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-09T05:29:10.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:10 smithi039 ceph-mon[30439]: pgmap v50: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-09T05:29:10.922 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:10 smithi060 ceph-mon[34555]: pgmap v50: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-09T05:29:10.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:10 smithi100 ceph-mon[34353]: pgmap v50: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-09T05:29:11.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:11 smithi039 ceph-mon[30439]: from='client.? 172.21.15.60:0/1738915863' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ec2bd2d0-2975-402c-9df8-3469dfd6070f"}]: dispatch 2024-05-09T05:29:11.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:11 smithi039 ceph-mon[30439]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ec2bd2d0-2975-402c-9df8-3469dfd6070f"}]: dispatch 2024-05-09T05:29:11.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:11 smithi039 ceph-mon[30439]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ec2bd2d0-2975-402c-9df8-3469dfd6070f"}]': finished 2024-05-09T05:29:11.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:11 smithi039 ceph-mon[30439]: osdmap e10: 2 total, 1 up, 2 in 2024-05-09T05:29:11.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:11 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-09T05:29:11.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:11 smithi039 ceph-mon[30439]: from='client.? 172.21.15.60:0/2002668924' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap", "output-file": "/var/lib/ceph/osd/ceph-1/activate.monmap"}]: dispatch 2024-05-09T05:29:11.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:11 smithi100 ceph-mon[34353]: from='client.? 172.21.15.60:0/1738915863' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ec2bd2d0-2975-402c-9df8-3469dfd6070f"}]: dispatch 2024-05-09T05:29:11.925 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:11 smithi100 ceph-mon[34353]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ec2bd2d0-2975-402c-9df8-3469dfd6070f"}]: dispatch 2024-05-09T05:29:11.925 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:11 smithi100 ceph-mon[34353]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ec2bd2d0-2975-402c-9df8-3469dfd6070f"}]': finished 2024-05-09T05:29:11.925 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:11 smithi100 ceph-mon[34353]: osdmap e10: 2 total, 1 up, 2 in 2024-05-09T05:29:11.925 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:11 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-09T05:29:11.925 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:11 smithi100 ceph-mon[34353]: from='client.? 172.21.15.60:0/2002668924' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap", "output-file": "/var/lib/ceph/osd/ceph-1/activate.monmap"}]: dispatch 2024-05-09T05:29:12.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:11 smithi060 ceph-mon[34555]: from='client.? 172.21.15.60:0/1738915863' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ec2bd2d0-2975-402c-9df8-3469dfd6070f"}]: dispatch 2024-05-09T05:29:12.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:11 smithi060 ceph-mon[34555]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ec2bd2d0-2975-402c-9df8-3469dfd6070f"}]: dispatch 2024-05-09T05:29:12.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:11 smithi060 ceph-mon[34555]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ec2bd2d0-2975-402c-9df8-3469dfd6070f"}]': finished 2024-05-09T05:29:12.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:11 smithi060 ceph-mon[34555]: osdmap e10: 2 total, 1 up, 2 in 2024-05-09T05:29:12.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:11 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-09T05:29:12.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:11 smithi060 ceph-mon[34555]: from='client.? 172.21.15.60:0/2002668924' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap", "output-file": "/var/lib/ceph/osd/ceph-1/activate.monmap"}]: dispatch 2024-05-09T05:29:12.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:12 smithi039 ceph-mon[30439]: pgmap v52: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-09T05:29:12.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:12 smithi100 ceph-mon[34353]: pgmap v52: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-09T05:29:13.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:12 smithi060 ceph-mon[34555]: pgmap v52: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-09T05:29:15.297 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:15 smithi060 ceph-mon[34555]: pgmap v53: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-09T05:29:15.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:15 smithi039 ceph-mon[30439]: pgmap v53: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-09T05:29:15.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:15 smithi100 ceph-mon[34353]: pgmap v53: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-09T05:29:17.297 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:17 smithi060 ceph-mon[34555]: pgmap v54: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-09T05:29:17.360 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:17 smithi039 ceph-mon[30439]: pgmap v54: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-09T05:29:17.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:17 smithi100 ceph-mon[34353]: pgmap v54: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-09T05:29:18.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:18 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-09T05:29:18.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:18 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:29:18.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:18 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-09T05:29:18.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:18 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:29:18.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:18 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-09T05:29:18.612 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:18 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:29:19.297 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:19 smithi060 ceph-mon[34555]: Deploying daemon osd.1 on smithi060 2024-05-09T05:29:19.297 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:19 smithi060 ceph-mon[34555]: pgmap v55: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-09T05:29:19.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:19 smithi100 ceph-mon[34353]: Deploying daemon osd.1 on smithi060 2024-05-09T05:29:19.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:19 smithi100 ceph-mon[34353]: pgmap v55: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-09T05:29:19.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:19 smithi039 ceph-mon[30439]: Deploying daemon osd.1 on smithi060 2024-05-09T05:29:19.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:19 smithi039 ceph-mon[30439]: pgmap v55: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-09T05:29:21.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:21 smithi100 ceph-mon[34353]: pgmap v56: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-09T05:29:21.506 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:21 smithi060 ceph-mon[34555]: pgmap v56: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-09T05:29:21.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:21 smithi039 ceph-mon[30439]: pgmap v56: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-09T05:29:23.390 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:23 smithi060 ceph-mon[34555]: pgmap v57: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-09T05:29:23.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:23 smithi100 ceph-mon[34353]: pgmap v57: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-09T05:29:23.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:23 smithi039 ceph-mon[30439]: pgmap v57: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-09T05:29:24.374 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:24 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:29:24.374 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:24 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:29:24.374 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:24 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:29:24.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:24 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:29:24.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:24 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:29:24.425 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:24 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:29:24.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:24 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:29:24.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:24 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:29:24.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:24 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:29:25.733 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:25 smithi060 ceph-mon[34555]: pgmap v58: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-09T05:29:25.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:25 smithi039 ceph-mon[30439]: pgmap v58: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-09T05:29:25.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:25 smithi100 ceph-mon[34353]: pgmap v58: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-09T05:29:27.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:29:27.361+0000 7fa7a37fe700 1 -- 172.21.15.60:0/891779521 <== mgr.14152 v2:172.21.15.39:6800/3184189003 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fa7ac063cc0 con 0x7fa7980b2870 2024-05-09T05:29:27.355 INFO:teuthology.orchestra.run.smithi060.stdout:Created osd(s) 1 on host 'smithi060' 2024-05-09T05:29:27.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:29:27.363+0000 7fa7b0e7a700 1 -- 172.21.15.60:0/891779521 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fa7980b2870 msgr2=0x7fa7980b4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:29:27.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:29:27.363+0000 7fa7b0e7a700 1 --2- 172.21.15.60:0/891779521 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fa7980b2870 0x7fa7980b4d80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa7ac104270 tx=0x7fa79c00b040 comp rx=0 tx=0).stop 2024-05-09T05:29:27.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:29:27.363+0000 7fa7b0e7a700 1 -- 172.21.15.60:0/891779521 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7ac104d10 msgr2=0x7fa7ac1a1be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:29:27.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:29:27.363+0000 7fa7b0e7a700 1 --2- 172.21.15.60:0/891779521 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7ac104d10 0x7fa7ac1a1be0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa7a40059d0 tx=0x7fa7a40047b0 comp rx=0 tx=0).stop 2024-05-09T05:29:27.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:29:27.363+0000 7fa7b0e7a700 1 -- 172.21.15.60:0/891779521 shutdown_connections 2024-05-09T05:29:27.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:29:27.363+0000 7fa7b0e7a700 1 --2- 172.21.15.60:0/891779521 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fa7980b2870 0x7fa7980b4d80 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:29:27.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:29:27.363+0000 7fa7b0e7a700 1 --2- 172.21.15.60:0/891779521 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7ac104d10 0x7fa7ac1a1be0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:29:27.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:29:27.363+0000 7fa7b0e7a700 1 --2- 172.21.15.60:0/891779521 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa7ac103240 0x7fa7ac06c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:29:27.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:29:27.363+0000 7fa7b0e7a700 1 --2- 172.21.15.60:0/891779521 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa7ac104370 0x7fa7ac19f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:29:27.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:29:27.363+0000 7fa7b0e7a700 1 -- 172.21.15.60:0/891779521 >> 172.21.15.60:0/891779521 conn(0x7fa7ac0fe880 msgr2=0x7fa7ac1075a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:29:27.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:29:27.363+0000 7fa7b0e7a700 1 -- 172.21.15.60:0/891779521 shutdown_connections 2024-05-09T05:29:27.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:29:27.364+0000 7fa7b0e7a700 1 -- 172.21.15.60:0/891779521 wait complete. 2024-05-09T05:29:27.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:27 smithi060 ceph-mon[34555]: pgmap v59: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-09T05:29:27.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:27 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:29:27.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:27 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:29:27.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:27 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:29:27.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:27 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:29:27.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:27 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:29:27.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:27 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:29:27.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:27 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:29:27.548 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:27 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:29:27.548 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:27 smithi060 ceph-mon[34555]: from='osd.1 [v2:172.21.15.60:6800/4245630636,v1:172.21.15.60:6801/4245630636]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-09T05:29:27.548 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:27 smithi060 ceph-mon[34555]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-09T05:29:27.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:27 smithi100 ceph-mon[34353]: pgmap v59: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-09T05:29:27.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:27 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:29:27.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:27 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:29:27.675 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:27 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:29:27.675 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:27 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:29:27.675 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:27 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:29:27.675 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:27 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:29:27.675 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:27 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:29:27.675 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:27 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:29:27.675 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:27 smithi100 ceph-mon[34353]: from='osd.1 [v2:172.21.15.60:6800/4245630636,v1:172.21.15.60:6801/4245630636]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-09T05:29:27.675 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:27 smithi100 ceph-mon[34353]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-09T05:29:27.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:27 smithi039 ceph-mon[30439]: pgmap v59: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-09T05:29:27.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:27 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:29:27.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:27 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:29:27.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:27 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:29:27.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:27 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:29:27.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:27 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:29:27.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:27 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:29:27.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:27 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:29:27.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:27 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:29:27.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:27 smithi039 ceph-mon[30439]: from='osd.1 [v2:172.21.15.60:6800/4245630636,v1:172.21.15.60:6801/4245630636]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-09T05:29:27.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:27 smithi039 ceph-mon[30439]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-09T05:29:27.961 DEBUG:teuthology.orchestra.run.smithi060:osd.1> sudo journalctl -f -n 0 -u ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@osd.1.service 2024-05-09T05:29:27.963 INFO:tasks.cephadm:Deploying osd.2 on smithi100 with /dev/vg_nvme/lv_4... 2024-05-09T05:29:27.963 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-05-09T05:29:28.206 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.c/config 2024-05-09T05:29:29.326 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:29 smithi060 ceph-mon[34555]: pgmap v60: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-09T05:29:29.326 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:29 smithi060 ceph-mon[34555]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-05-09T05:29:29.326 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:29 smithi060 ceph-mon[34555]: from='osd.1 [v2:172.21.15.60:6800/4245630636,v1:172.21.15.60:6801/4245630636]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2024-05-09T05:29:29.326 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:29 smithi060 ceph-mon[34555]: osdmap e11: 2 total, 1 up, 2 in 2024-05-09T05:29:29.326 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:29 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-09T05:29:29.326 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:29 smithi060 ceph-mon[34555]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2024-05-09T05:29:29.556 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:29 smithi100 ceph-mon[34353]: pgmap v60: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-09T05:29:29.556 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:29 smithi100 ceph-mon[34353]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-05-09T05:29:29.556 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:29 smithi100 ceph-mon[34353]: from='osd.1 [v2:172.21.15.60:6800/4245630636,v1:172.21.15.60:6801/4245630636]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2024-05-09T05:29:29.556 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:29 smithi100 ceph-mon[34353]: osdmap e11: 2 total, 1 up, 2 in 2024-05-09T05:29:29.556 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:29 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-09T05:29:29.556 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:29 smithi100 ceph-mon[34353]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2024-05-09T05:29:29.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:29 smithi039 ceph-mon[30439]: pgmap v60: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-09T05:29:29.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:29 smithi039 ceph-mon[30439]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-05-09T05:29:29.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:29 smithi039 ceph-mon[30439]: from='osd.1 [v2:172.21.15.60:6800/4245630636,v1:172.21.15.60:6801/4245630636]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2024-05-09T05:29:29.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:29 smithi039 ceph-mon[30439]: osdmap e11: 2 total, 1 up, 2 in 2024-05-09T05:29:29.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:29 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-09T05:29:29.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:29 smithi039 ceph-mon[30439]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2024-05-09T05:29:29.797 INFO:journalctl@ceph.osd.1.smithi060.stdout:May 09 05:29:29 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-1[39153]: 2024-05-09T05:29:29.331+0000 7efe9bbf8700 -1 osd.1 0 waiting for initial osdmap 2024-05-09T05:29:29.798 INFO:journalctl@ceph.osd.1.smithi060.stdout:May 09 05:29:29 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-1[39153]: 2024-05-09T05:29:29.338+0000 7efe979ad700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T05:29:30.130 INFO:teuthology.orchestra.run.smithi100.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-05-09T05:29:30.131 INFO:teuthology.orchestra.run.smithi100.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-05-09T05:29:30.131 INFO:teuthology.orchestra.run.smithi100.stderr: stderr: 10+0 records in 2024-05-09T05:29:30.131 INFO:teuthology.orchestra.run.smithi100.stderr:10+0 records out 2024-05-09T05:29:30.131 INFO:teuthology.orchestra.run.smithi100.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0110761 s, 947 MB/s 2024-05-09T05:29:30.131 INFO:teuthology.orchestra.run.smithi100.stderr:--> Zapping successful for: 2024-05-09T05:29:30.428 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:30 smithi100 ceph-mon[34353]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2024-05-09T05:29:30.428 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:30 smithi100 ceph-mon[34353]: osdmap e12: 2 total, 1 up, 2 in 2024-05-09T05:29:30.428 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:30 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-09T05:29:30.428 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:30 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-09T05:29:30.438 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:30 smithi060 ceph-mon[34555]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2024-05-09T05:29:30.438 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:30 smithi060 ceph-mon[34555]: osdmap e12: 2 total, 1 up, 2 in 2024-05-09T05:29:30.439 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:30 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-09T05:29:30.439 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:30 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-09T05:29:30.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:30 smithi039 ceph-mon[30439]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2024-05-09T05:29:30.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:30 smithi039 ceph-mon[30439]: osdmap e12: 2 total, 1 up, 2 in 2024-05-09T05:29:30.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:30 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-09T05:29:30.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:30 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-09T05:29:30.789 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi100:vg_nvme/lv_4 2024-05-09T05:29:31.030 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.c/config 2024-05-09T05:29:31.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:31 smithi100 ceph-mon[34353]: purged_snaps scrub starts 2024-05-09T05:29:31.425 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:31 smithi100 ceph-mon[34353]: purged_snaps scrub ok 2024-05-09T05:29:31.425 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:31 smithi100 ceph-mon[34353]: pgmap v63: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-09T05:29:31.425 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:31 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-09T05:29:31.425 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:31 smithi100 ceph-mon[34353]: osd.1 [v2:172.21.15.60:6800/4245630636,v1:172.21.15.60:6801/4245630636] boot 2024-05-09T05:29:31.425 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:31 smithi100 ceph-mon[34353]: osdmap e13: 2 total, 2 up, 2 in 2024-05-09T05:29:31.425 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:31 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-09T05:29:31.425 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:31 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:29:31.425 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:31 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:29:31.425 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:31 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:29:31.425 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:31 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:29:31.425 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:31 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:29:31.425 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:31 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:29:31.425 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:31 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:29:31.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:31 smithi039 ceph-mon[30439]: purged_snaps scrub starts 2024-05-09T05:29:31.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:31 smithi039 ceph-mon[30439]: purged_snaps scrub ok 2024-05-09T05:29:31.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:31 smithi039 ceph-mon[30439]: pgmap v63: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-09T05:29:31.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:31 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-09T05:29:31.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:31 smithi039 ceph-mon[30439]: osd.1 [v2:172.21.15.60:6800/4245630636,v1:172.21.15.60:6801/4245630636] boot 2024-05-09T05:29:31.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:31 smithi039 ceph-mon[30439]: osdmap e13: 2 total, 2 up, 2 in 2024-05-09T05:29:31.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:31 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-09T05:29:31.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:31 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:29:31.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:31 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:29:31.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:31 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:29:31.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:31 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:29:31.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:31 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:29:31.612 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:31 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:29:31.612 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:31 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:29:31.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:31 smithi060 ceph-mon[34555]: purged_snaps scrub starts 2024-05-09T05:29:31.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:31 smithi060 ceph-mon[34555]: purged_snaps scrub ok 2024-05-09T05:29:31.798 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:31 smithi060 ceph-mon[34555]: pgmap v63: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-09T05:29:31.798 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:31 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-09T05:29:31.798 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:31 smithi060 ceph-mon[34555]: osd.1 [v2:172.21.15.60:6800/4245630636,v1:172.21.15.60:6801/4245630636] boot 2024-05-09T05:29:31.798 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:31 smithi060 ceph-mon[34555]: osdmap e13: 2 total, 2 up, 2 in 2024-05-09T05:29:31.798 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:31 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-09T05:29:31.798 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:31 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:29:31.798 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:31 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:29:31.798 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:31 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:29:31.798 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:31 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:29:31.799 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:31 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:29:31.799 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:31 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:29:31.799 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:31 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:29:32.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:29:32.573+0000 7f24b34de700 1 -- 172.21.15.100:0/1656504004 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24ac103830 msgr2=0x7f24ac103c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:29:32.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:29:32.573+0000 7f24b34de700 1 --2- 172.21.15.100:0/1656504004 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24ac103830 0x7f24ac103c40 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f24a8009990 tx=0x7f24a8009ca0 comp rx=0 tx=0).stop 2024-05-09T05:29:32.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:29:32.573+0000 7f24b34de700 1 -- 172.21.15.100:0/1656504004 shutdown_connections 2024-05-09T05:29:32.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:29:32.573+0000 7f24b34de700 1 --2- 172.21.15.100:0/1656504004 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f24ac105080 0x7f24ac10b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:29:32.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:29:32.573+0000 7f24b34de700 1 --2- 172.21.15.100:0/1656504004 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24ac103830 0x7f24ac103c40 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:29:32.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:29:32.573+0000 7f24b34de700 1 --2- 172.21.15.100:0/1656504004 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f24ac104730 0x7f24ac104b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:29:32.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:29:32.573+0000 7f24b34de700 1 -- 172.21.15.100:0/1656504004 >> 172.21.15.100:0/1656504004 conn(0x7f24ac0fe020 msgr2=0x7f24ac1004d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:29:32.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:29:32.573+0000 7f24b34de700 1 -- 172.21.15.100:0/1656504004 shutdown_connections 2024-05-09T05:29:32.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:29:32.573+0000 7f24b34de700 1 -- 172.21.15.100:0/1656504004 wait complete. 2024-05-09T05:29:32.569 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:32 smithi100 ceph-mon[34353]: Detected new or changed devices on smithi060 2024-05-09T05:29:32.569 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:32 smithi100 ceph-mon[34353]: Adjusting osd_memory_target on smithi060 to 17093M 2024-05-09T05:29:32.569 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:32 smithi100 ceph-mon[34353]: osdmap e14: 2 total, 2 up, 2 in 2024-05-09T05:29:32.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:29:32.574+0000 7f24b34de700 1 Processor -- start 2024-05-09T05:29:32.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:29:32.574+0000 7f24b34de700 1 -- start start 2024-05-09T05:29:32.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:29:32.574+0000 7f24b34de700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24ac103830 0x7f24ac102ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:29:32.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:29:32.574+0000 7f24b34de700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f24ac104730 0x7f24ac19f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:29:32.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:29:32.574+0000 7f24b34de700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f24ac105080 0x7f24ac1a1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:29:32.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:29:32.574+0000 7f24b34de700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f24ac10efb0 con 0x7f24ac105080 2024-05-09T05:29:32.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:29:32.574+0000 7f24b34de700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f24ac10ee30 con 0x7f24ac104730 2024-05-09T05:29:32.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:29:32.574+0000 7f24b34de700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f24ac10f130 con 0x7f24ac103830 2024-05-09T05:29:32.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:29:32.574+0000 7f24b127a700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24ac103830 0x7f24ac102ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:29:32.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:29:32.574+0000 7f24b127a700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24ac103830 0x7f24ac102ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47520/0 (socket says 172.21.15.100:47520) 2024-05-09T05:29:32.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:29:32.574+0000 7f24b127a700 1 -- 172.21.15.100:0/3992890891 learned_addr learned my addr 172.21.15.100:0/3992890891 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:29:32.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:29:32.574+0000 7f24b1a7b700 1 --2- 172.21.15.100:0/3992890891 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f24ac105080 0x7f24ac1a1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:29:32.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:29:32.574+0000 7f24b0a79700 1 --2- 172.21.15.100:0/3992890891 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f24ac104730 0x7f24ac19f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:29:32.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:29:32.574+0000 7f24b127a700 1 -- 172.21.15.100:0/3992890891 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f24ac104730 msgr2=0x7f24ac19f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:29:32.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:29:32.574+0000 7f24b127a700 1 --2- 172.21.15.100:0/3992890891 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f24ac104730 0x7f24ac19f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:29:32.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:29:32.574+0000 7f24b127a700 1 -- 172.21.15.100:0/3992890891 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f24ac105080 msgr2=0x7f24ac1a1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:29:32.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:29:32.574+0000 7f24b127a700 1 --2- 172.21.15.100:0/3992890891 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f24ac105080 0x7f24ac1a1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:29:32.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:29:32.574+0000 7f24b127a700 1 -- 172.21.15.100:0/3992890891 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24ac1a2720 con 0x7f24ac103830 2024-05-09T05:29:32.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:29:32.575+0000 7f24b127a700 1 --2- 172.21.15.100:0/3992890891 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24ac103830 0x7f24ac102ef0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f24a80047b0 tx=0x7f24a8005b00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:29:32.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:29:32.575+0000 7f24a27fc700 1 -- 172.21.15.100:0/3992890891 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24a8027070 con 0x7f24ac103830 2024-05-09T05:29:32.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:29:32.575+0000 7f24a27fc700 1 -- 172.21.15.100:0/3992890891 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f24a8004000 con 0x7f24ac103830 2024-05-09T05:29:32.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:29:32.575+0000 7f24b34de700 1 -- 172.21.15.100:0/3992890891 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24ac1a29b0 con 0x7f24ac103830 2024-05-09T05:29:32.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:29:32.575+0000 7f24a27fc700 1 -- 172.21.15.100:0/3992890891 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24a8022ce0 con 0x7f24ac103830 2024-05-09T05:29:32.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:29:32.575+0000 7f24b34de700 1 -- 172.21.15.100:0/3992890891 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24ac1a2e60 con 0x7f24ac103830 2024-05-09T05:29:32.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:29:32.576+0000 7f24b34de700 1 -- 172.21.15.100:0/3992890891 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24ac0512c0 con 0x7f24ac103830 2024-05-09T05:29:32.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:29:32.577+0000 7f24a27fc700 1 -- 172.21.15.100:0/3992890891 <== mon.1 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 15) ==== 149596+0+0 (secure 0 0 0) 0x7f24a802a070 con 0x7f24ac103830 2024-05-09T05:29:32.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:29:32.578+0000 7f24a27fc700 1 --2- 172.21.15.100:0/3992890891 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f24980b2870 0x7f24980b4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:29:32.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:29:32.578+0000 7f24a27fc700 1 -- 172.21.15.100:0/3992890891 <== mon.1 v2:172.21.15.100:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2309+0+0 (secure 0 0 0) 0x7f24a80e1840 con 0x7f24ac103830 2024-05-09T05:29:32.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:29:32.578+0000 7f24b0a79700 1 --2- 172.21.15.100:0/3992890891 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f24980b2870 0x7f24980b4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:29:32.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:29:32.579+0000 7f24b0a79700 1 --2- 172.21.15.100:0/3992890891 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f24980b2870 0x7f24980b4d80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f24ac1028a0 tx=0x7f249c009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:29:32.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:29:32.583+0000 7f24a27fc700 1 -- 172.21.15.100:0/3992890891 <== mon.1 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f24a8013070 con 0x7f24ac103830 2024-05-09T05:29:32.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:32 smithi039 ceph-mon[30439]: Detected new or changed devices on smithi060 2024-05-09T05:29:32.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:32 smithi039 ceph-mon[30439]: Adjusting osd_memory_target on smithi060 to 17093M 2024-05-09T05:29:32.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:32 smithi039 ceph-mon[30439]: osdmap e14: 2 total, 2 up, 2 in 2024-05-09T05:29:32.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:29:32.795+0000 7f24b34de700 1 -- 172.21.15.100:0/3992890891 --> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f24ac02e9d0 con 0x7f24980b2870 2024-05-09T05:29:32.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:32 smithi060 ceph-mon[34555]: Detected new or changed devices on smithi060 2024-05-09T05:29:32.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:32 smithi060 ceph-mon[34555]: Adjusting osd_memory_target on smithi060 to 17093M 2024-05-09T05:29:32.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:32 smithi060 ceph-mon[34555]: osdmap e14: 2 total, 2 up, 2 in 2024-05-09T05:29:33.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:33 smithi039 ceph-mon[30439]: pgmap v66: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-09T05:29:33.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:33 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T05:29:33.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:33 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T05:29:33.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:33 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:29:33.621 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:33 smithi100 ceph-mon[34353]: pgmap v66: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-09T05:29:33.621 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:33 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T05:29:33.621 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:33 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T05:29:33.621 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:33 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:29:33.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:33 smithi060 ceph-mon[34555]: pgmap v66: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-09T05:29:33.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:33 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T05:29:33.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:33 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T05:29:33.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:33 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:29:34.604 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:34 smithi100 ceph-mon[34353]: from='client.24175 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T05:29:34.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:34 smithi060 ceph-mon[34555]: from='client.24175 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T05:29:34.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:34 smithi039 ceph-mon[30439]: from='client.24175 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T05:29:35.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:35 smithi100 ceph-mon[34353]: pgmap v67: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-09T05:29:35.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:35 smithi060 ceph-mon[34555]: pgmap v67: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-09T05:29:35.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:35 smithi039 ceph-mon[30439]: pgmap v67: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-09T05:29:36.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:36 smithi100 ceph-mon[34353]: from='client.? 172.21.15.100:0/3547427185' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9efaf6dd-086e-4095-b92e-cbbecf738523"}]: dispatch 2024-05-09T05:29:36.675 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:36 smithi100 ceph-mon[34353]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9efaf6dd-086e-4095-b92e-cbbecf738523"}]: dispatch 2024-05-09T05:29:36.675 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:36 smithi100 ceph-mon[34353]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9efaf6dd-086e-4095-b92e-cbbecf738523"}]': finished 2024-05-09T05:29:36.675 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:36 smithi100 ceph-mon[34353]: osdmap e15: 3 total, 2 up, 3 in 2024-05-09T05:29:36.675 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:36 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-09T05:29:36.675 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:36 smithi100 ceph-mon[34353]: from='client.? 172.21.15.100:0/1458208857' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap", "output-file": "/var/lib/ceph/osd/ceph-2/activate.monmap"}]: dispatch 2024-05-09T05:29:36.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:36 smithi060 ceph-mon[34555]: from='client.? 172.21.15.100:0/3547427185' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9efaf6dd-086e-4095-b92e-cbbecf738523"}]: dispatch 2024-05-09T05:29:36.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:36 smithi060 ceph-mon[34555]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9efaf6dd-086e-4095-b92e-cbbecf738523"}]: dispatch 2024-05-09T05:29:36.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:36 smithi060 ceph-mon[34555]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9efaf6dd-086e-4095-b92e-cbbecf738523"}]': finished 2024-05-09T05:29:36.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:36 smithi060 ceph-mon[34555]: osdmap e15: 3 total, 2 up, 3 in 2024-05-09T05:29:36.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:36 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-09T05:29:36.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:36 smithi060 ceph-mon[34555]: from='client.? 172.21.15.100:0/1458208857' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap", "output-file": "/var/lib/ceph/osd/ceph-2/activate.monmap"}]: dispatch 2024-05-09T05:29:36.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:36 smithi039 ceph-mon[30439]: from='client.? 172.21.15.100:0/3547427185' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9efaf6dd-086e-4095-b92e-cbbecf738523"}]: dispatch 2024-05-09T05:29:36.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:36 smithi039 ceph-mon[30439]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9efaf6dd-086e-4095-b92e-cbbecf738523"}]: dispatch 2024-05-09T05:29:36.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:36 smithi039 ceph-mon[30439]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9efaf6dd-086e-4095-b92e-cbbecf738523"}]': finished 2024-05-09T05:29:36.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:36 smithi039 ceph-mon[30439]: osdmap e15: 3 total, 2 up, 3 in 2024-05-09T05:29:36.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:36 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-09T05:29:36.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:36 smithi039 ceph-mon[30439]: from='client.? 172.21.15.100:0/1458208857' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap", "output-file": "/var/lib/ceph/osd/ceph-2/activate.monmap"}]: dispatch 2024-05-09T05:29:37.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:37 smithi060 ceph-mon[34555]: pgmap v69: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-09T05:29:37.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:37 smithi039 ceph-mon[30439]: pgmap v69: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-09T05:29:37.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:37 smithi100 ceph-mon[34353]: pgmap v69: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-09T05:29:39.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:39 smithi100 ceph-mon[34353]: pgmap v70: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-09T05:29:39.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:39 smithi060 ceph-mon[34555]: pgmap v70: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-09T05:29:39.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:39 smithi039 ceph-mon[30439]: pgmap v70: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-09T05:29:41.607 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:41 smithi100 ceph-mon[34353]: pgmap v71: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-09T05:29:41.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:41 smithi060 ceph-mon[34555]: pgmap v71: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-09T05:29:41.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:41 smithi039 ceph-mon[30439]: pgmap v71: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-09T05:29:42.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:42 smithi060 ceph-mon[34555]: pgmap v72: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-09T05:29:42.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:42 smithi039 ceph-mon[30439]: pgmap v72: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-09T05:29:42.905 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:42 smithi100 ceph-mon[34353]: pgmap v72: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-09T05:29:43.842 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:43 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-09T05:29:43.842 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:43 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:29:43.842 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:43 smithi100 ceph-mon[34353]: Deploying daemon osd.2 on smithi100 2024-05-09T05:29:43.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:43 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-09T05:29:43.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:43 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:29:43.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:43 smithi039 ceph-mon[30439]: Deploying daemon osd.2 on smithi100 2024-05-09T05:29:44.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:43 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-09T05:29:44.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:43 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:29:44.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:43 smithi060 ceph-mon[34555]: Deploying daemon osd.2 on smithi100 2024-05-09T05:29:44.847 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:44 smithi100 ceph-mon[34353]: pgmap v73: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-09T05:29:44.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:44 smithi039 ceph-mon[30439]: pgmap v73: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-09T05:29:45.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:44 smithi060 ceph-mon[34555]: pgmap v73: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-09T05:29:47.360 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:47 smithi039 ceph-mon[30439]: pgmap v74: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-09T05:29:47.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:47 smithi100 ceph-mon[34353]: pgmap v74: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-09T05:29:47.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:47 smithi060 ceph-mon[34555]: pgmap v74: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-09T05:29:49.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:49 smithi100 ceph-mon[34353]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-09T05:29:49.675 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:49 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:29:49.675 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:49 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:29:49.675 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:49 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:29:49.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:49 smithi060 ceph-mon[34555]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-09T05:29:49.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:49 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:29:49.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:49 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:29:49.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:49 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:29:49.863 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:49 smithi039 ceph-mon[30439]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-09T05:29:49.863 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:49 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:29:49.863 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:49 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:29:49.863 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:49 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:29:51.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:51 smithi100 ceph-mon[34353]: pgmap v76: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-09T05:29:51.675 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:51 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:29:51.675 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:51 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:29:51.675 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:51 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:29:51.675 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:51 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:29:51.675 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:51 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:29:51.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:51 smithi060 ceph-mon[34555]: pgmap v76: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-09T05:29:51.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:51 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:29:51.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:51 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:29:51.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:51 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:29:51.798 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:51 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:29:51.798 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:51 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:29:51.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:51 smithi039 ceph-mon[30439]: pgmap v76: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-09T05:29:51.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:51 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:29:51.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:51 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:29:51.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:51 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:29:51.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:51 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:29:51.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:51 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:29:52.208 INFO:teuthology.orchestra.run.smithi100.stdout:Created osd(s) 2 on host 'smithi100' 2024-05-09T05:29:52.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:29:52.212+0000 7f24a27fc700 1 -- 172.21.15.100:0/3992890891 <== mgr.14152 v2:172.21.15.39:6800/3184189003 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f24ac02e9d0 con 0x7f24980b2870 2024-05-09T05:29:52.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:29:52.215+0000 7f24b34de700 1 -- 172.21.15.100:0/3992890891 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f24980b2870 msgr2=0x7f24980b4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:29:52.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:29:52.215+0000 7f24b34de700 1 --2- 172.21.15.100:0/3992890891 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f24980b2870 0x7f24980b4d80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f24ac1028a0 tx=0x7f249c009190 comp rx=0 tx=0).stop 2024-05-09T05:29:52.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:29:52.215+0000 7f24b34de700 1 -- 172.21.15.100:0/3992890891 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24ac103830 msgr2=0x7f24ac102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:29:52.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:29:52.215+0000 7f24b34de700 1 --2- 172.21.15.100:0/3992890891 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24ac103830 0x7f24ac102ef0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f24a80047b0 tx=0x7f24a8005b00 comp rx=0 tx=0).stop 2024-05-09T05:29:52.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:29:52.215+0000 7f24b34de700 1 -- 172.21.15.100:0/3992890891 shutdown_connections 2024-05-09T05:29:52.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:29:52.215+0000 7f24b34de700 1 --2- 172.21.15.100:0/3992890891 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f24980b2870 0x7f24980b4d80 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:29:52.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:29:52.215+0000 7f24b34de700 1 --2- 172.21.15.100:0/3992890891 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f24ac105080 0x7f24ac1a1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:29:52.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:29:52.215+0000 7f24b34de700 1 --2- 172.21.15.100:0/3992890891 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24ac103830 0x7f24ac102ef0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:29:52.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:29:52.215+0000 7f24b34de700 1 --2- 172.21.15.100:0/3992890891 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f24ac104730 0x7f24ac19f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:29:52.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:29:52.215+0000 7f24b34de700 1 -- 172.21.15.100:0/3992890891 >> 172.21.15.100:0/3992890891 conn(0x7f24ac0fe020 msgr2=0x7f24ac107960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:29:52.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:29:52.215+0000 7f24b34de700 1 -- 172.21.15.100:0/3992890891 shutdown_connections 2024-05-09T05:29:52.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:29:52.215+0000 7f24b34de700 1 -- 172.21.15.100:0/3992890891 wait complete. 2024-05-09T05:29:52.804 DEBUG:teuthology.orchestra.run.smithi100:osd.2> sudo journalctl -f -n 0 -u ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@osd.2.service 2024-05-09T05:29:52.806 INFO:tasks.cephadm:Deploying osd.3 on smithi039 with /dev/vg_nvme/lv_3... 2024-05-09T05:29:52.806 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-05-09T05:29:53.068 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T05:29:53.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:53 smithi100 ceph-mon[34353]: pgmap v77: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-09T05:29:53.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:53 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:29:53.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:53 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:29:53.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:53 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:29:53.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:53 smithi100 ceph-mon[34353]: from='osd.2 [v2:172.21.15.100:6800/4141597693,v1:172.21.15.100:6801/4141597693]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-09T05:29:53.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:53 smithi100 ceph-mon[34353]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-09T05:29:53.477 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:53 smithi039 ceph-mon[30439]: pgmap v77: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-09T05:29:53.477 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:53 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:29:53.477 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:53 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:29:53.477 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:53 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:29:53.477 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:53 smithi039 ceph-mon[30439]: from='osd.2 [v2:172.21.15.100:6800/4141597693,v1:172.21.15.100:6801/4141597693]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-09T05:29:53.477 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:53 smithi039 ceph-mon[30439]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-09T05:29:53.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:53 smithi060 ceph-mon[34555]: pgmap v77: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-09T05:29:53.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:53 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:29:53.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:53 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:29:53.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:53 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:29:53.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:53 smithi060 ceph-mon[34555]: from='osd.2 [v2:172.21.15.100:6800/4141597693,v1:172.21.15.100:6801/4141597693]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-09T05:29:53.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:53 smithi060 ceph-mon[34555]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-09T05:29:54.425 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:54 smithi100 ceph-mon[34353]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-05-09T05:29:54.425 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:54 smithi100 ceph-mon[34353]: osdmap e16: 3 total, 2 up, 3 in 2024-05-09T05:29:54.425 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:54 smithi100 ceph-mon[34353]: from='osd.2 [v2:172.21.15.100:6800/4141597693,v1:172.21.15.100:6801/4141597693]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-05-09T05:29:54.425 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:54 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-09T05:29:54.425 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:54 smithi100 ceph-mon[34353]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-05-09T05:29:54.425 INFO:journalctl@ceph.osd.2.smithi100.stdout:May 09 05:29:54 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-2[39491]: 2024-05-09T05:29:54.178+0000 7f77b11ba700 -1 osd.2 0 waiting for initial osdmap 2024-05-09T05:29:54.425 INFO:journalctl@ceph.osd.2.smithi100.stdout:May 09 05:29:54 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-2[39491]: 2024-05-09T05:29:54.186+0000 7f77acf6f700 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T05:29:54.499 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:54 smithi039 ceph-mon[30439]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-05-09T05:29:54.499 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:54 smithi039 ceph-mon[30439]: osdmap e16: 3 total, 2 up, 3 in 2024-05-09T05:29:54.499 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:54 smithi039 ceph-mon[30439]: from='osd.2 [v2:172.21.15.100:6800/4141597693,v1:172.21.15.100:6801/4141597693]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-05-09T05:29:54.499 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:54 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-09T05:29:54.499 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:54 smithi039 ceph-mon[30439]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-05-09T05:29:54.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:54 smithi060 ceph-mon[34555]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-05-09T05:29:54.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:54 smithi060 ceph-mon[34555]: osdmap e16: 3 total, 2 up, 3 in 2024-05-09T05:29:54.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:54 smithi060 ceph-mon[34555]: from='osd.2 [v2:172.21.15.100:6800/4141597693,v1:172.21.15.100:6801/4141597693]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-05-09T05:29:54.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:54 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-09T05:29:54.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:54 smithi060 ceph-mon[34555]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-05-09T05:29:54.984 INFO:teuthology.orchestra.run.smithi039.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-05-09T05:29:54.984 INFO:teuthology.orchestra.run.smithi039.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-05-09T05:29:54.984 INFO:teuthology.orchestra.run.smithi039.stderr: stderr: 10+0 records in 2024-05-09T05:29:54.984 INFO:teuthology.orchestra.run.smithi039.stderr:10+0 records out 2024-05-09T05:29:54.984 INFO:teuthology.orchestra.run.smithi039.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0105483 s, 994 MB/s 2024-05-09T05:29:54.984 INFO:teuthology.orchestra.run.smithi039.stderr:--> Zapping successful for: 2024-05-09T05:29:55.301 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:55 smithi100 ceph-mon[34353]: pgmap v79: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-09T05:29:55.302 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:55 smithi100 ceph-mon[34353]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2024-05-09T05:29:55.302 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:55 smithi100 ceph-mon[34353]: osdmap e17: 3 total, 2 up, 3 in 2024-05-09T05:29:55.302 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:55 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-09T05:29:55.302 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:55 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-09T05:29:55.306 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:55 smithi039 ceph-mon[30439]: pgmap v79: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-09T05:29:55.306 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:55 smithi039 ceph-mon[30439]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2024-05-09T05:29:55.306 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:55 smithi039 ceph-mon[30439]: osdmap e17: 3 total, 2 up, 3 in 2024-05-09T05:29:55.306 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:55 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-09T05:29:55.306 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:55 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-09T05:29:55.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:55 smithi060 ceph-mon[34555]: pgmap v79: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-09T05:29:55.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:55 smithi060 ceph-mon[34555]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2024-05-09T05:29:55.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:55 smithi060 ceph-mon[34555]: osdmap e17: 3 total, 2 up, 3 in 2024-05-09T05:29:55.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:55 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-09T05:29:55.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:55 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-09T05:29:55.607 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi039:vg_nvme/lv_3 2024-05-09T05:29:55.870 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T05:29:56.315 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:56 smithi039 ceph-mon[30439]: purged_snaps scrub starts 2024-05-09T05:29:56.315 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:56 smithi039 ceph-mon[30439]: purged_snaps scrub ok 2024-05-09T05:29:56.315 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:56 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-09T05:29:56.315 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:56 smithi039 ceph-mon[30439]: osd.2 [v2:172.21.15.100:6800/4141597693,v1:172.21.15.100:6801/4141597693] boot 2024-05-09T05:29:56.315 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:56 smithi039 ceph-mon[30439]: osdmap e18: 3 total, 3 up, 3 in 2024-05-09T05:29:56.315 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:56 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-09T05:29:56.315 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:56 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:29:56.315 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:56 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:29:56.315 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:56 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:29:56.315 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:56 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:29:56.315 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:56 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:29:56.315 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:56 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:29:56.316 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:56 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:29:56.316 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:56 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-05-09T05:29:56.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:56 smithi060 ceph-mon[34555]: purged_snaps scrub starts 2024-05-09T05:29:56.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:56 smithi060 ceph-mon[34555]: purged_snaps scrub ok 2024-05-09T05:29:56.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:56 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-09T05:29:56.548 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:56 smithi060 ceph-mon[34555]: osd.2 [v2:172.21.15.100:6800/4141597693,v1:172.21.15.100:6801/4141597693] boot 2024-05-09T05:29:56.548 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:56 smithi060 ceph-mon[34555]: osdmap e18: 3 total, 3 up, 3 in 2024-05-09T05:29:56.548 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:56 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-09T05:29:56.548 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:56 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:29:56.548 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:56 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:29:56.548 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:56 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:29:56.548 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:56 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:29:56.548 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:56 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:29:56.548 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:56 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:29:56.548 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:56 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:29:56.548 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:56 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-05-09T05:29:56.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:56 smithi100 ceph-mon[34353]: purged_snaps scrub starts 2024-05-09T05:29:56.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:56 smithi100 ceph-mon[34353]: purged_snaps scrub ok 2024-05-09T05:29:56.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:56 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-09T05:29:56.675 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:56 smithi100 ceph-mon[34353]: osd.2 [v2:172.21.15.100:6800/4141597693,v1:172.21.15.100:6801/4141597693] boot 2024-05-09T05:29:56.675 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:56 smithi100 ceph-mon[34353]: osdmap e18: 3 total, 3 up, 3 in 2024-05-09T05:29:56.675 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:56 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-09T05:29:56.675 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:56 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:29:56.675 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:56 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:29:56.675 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:56 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:29:56.675 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:56 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:29:56.675 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:56 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:29:56.675 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:56 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:29:56.675 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:56 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:29:56.675 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:56 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-05-09T05:29:57.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:29:57.446+0000 7f887e461700 1 -- 172.21.15.39:0/2280499415 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8878104d20 msgr2=0x7f887810b5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:29:57.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:29:57.446+0000 7f887e461700 1 --2- 172.21.15.39:0/2280499415 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8878104d20 0x7f887810b5d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f887000b0a0 tx=0x7f887000b3b0 comp rx=0 tx=0).stop 2024-05-09T05:29:57.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:29:57.446+0000 7f887e461700 1 -- 172.21.15.39:0/2280499415 shutdown_connections 2024-05-09T05:29:57.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:29:57.446+0000 7f887e461700 1 --2- 172.21.15.39:0/2280499415 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8878104d20 0x7f887810b5d0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:29:57.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:29:57.446+0000 7f887e461700 1 --2- 172.21.15.39:0/2280499415 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8878103250 0x7f8878103660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:29:57.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:29:57.446+0000 7f887e461700 1 --2- 172.21.15.39:0/2280499415 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8878104380 0x7f8878104790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:29:57.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:29:57.446+0000 7f887e461700 1 -- 172.21.15.39:0/2280499415 >> 172.21.15.39:0/2280499415 conn(0x7f88780fe890 msgr2=0x7f8878100d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:29:57.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:29:57.446+0000 7f887e461700 1 -- 172.21.15.39:0/2280499415 shutdown_connections 2024-05-09T05:29:57.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:29:57.446+0000 7f887e461700 1 -- 172.21.15.39:0/2280499415 wait complete. 2024-05-09T05:29:57.442 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:57 smithi039 ceph-mon[30439]: Detected new or changed devices on smithi100 2024-05-09T05:29:57.442 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:57 smithi039 ceph-mon[30439]: Adjusting osd_memory_target on smithi100 to 17088M 2024-05-09T05:29:57.442 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:57 smithi039 ceph-mon[30439]: pgmap v82: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-09T05:29:57.443 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:57 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-05-09T05:29:57.443 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:57 smithi039 ceph-mon[30439]: osdmap e19: 3 total, 3 up, 3 in 2024-05-09T05:29:57.443 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:57 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-05-09T05:29:57.443 INFO:journalctl@ceph.osd.0.smithi039.stdout:May 09 05:29:57 smithi039 sudo[47106]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-09T05:29:57.443 INFO:journalctl@ceph.osd.0.smithi039.stdout:May 09 05:29:57 smithi039 sudo[47106]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-09T05:29:57.443 INFO:journalctl@ceph.osd.0.smithi039.stdout:May 09 05:29:57 smithi039 sudo[47106]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-09T05:29:57.443 INFO:journalctl@ceph.osd.0.smithi039.stdout:May 09 05:29:57 smithi039 sudo[47106]: pam_unix(sudo:session): session closed for user root 2024-05-09T05:29:57.443 INFO:journalctl@ceph.osd.0.smithi039.stdout:May 09 05:29:57 smithi039 sudo[47109]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-09T05:29:57.443 INFO:journalctl@ceph.osd.0.smithi039.stdout:May 09 05:29:57 smithi039 sudo[47109]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-09T05:29:57.444 INFO:journalctl@ceph.osd.0.smithi039.stdout:May 09 05:29:57 smithi039 sudo[47109]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-09T05:29:57.444 INFO:journalctl@ceph.osd.0.smithi039.stdout:May 09 05:29:57 smithi039 sudo[47109]: pam_unix(sudo:session): session closed for user root 2024-05-09T05:29:57.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:29:57.447+0000 7f887e461700 1 Processor -- start 2024-05-09T05:29:57.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:29:57.447+0000 7f887e461700 1 -- start start 2024-05-09T05:29:57.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:29:57.447+0000 7f887e461700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8878103250 0x7f88781a1200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:29:57.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:29:57.447+0000 7f887e461700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8878104380 0x7f88781a1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:29:57.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:29:57.447+0000 7f887e461700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8878104d20 0x7f88781a8370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:29:57.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:29:57.447+0000 7f887e461700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f887810ecb0 con 0x7f8878104d20 2024-05-09T05:29:57.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:29:57.447+0000 7f887e461700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f887810eb30 con 0x7f8878103250 2024-05-09T05:29:57.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:29:57.447+0000 7f887e461700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f887810ee30 con 0x7f8878104380 2024-05-09T05:29:57.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:29:57.447+0000 7f887c9fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8878104d20 0x7f88781a8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:29:57.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:29:57.447+0000 7f887c9fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8878104d20 0x7f88781a8370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60874/0 (socket says 172.21.15.39:60874) 2024-05-09T05:29:57.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:29:57.447+0000 7f887c9fe700 1 -- 172.21.15.39:0/1557890181 learned_addr learned my addr 172.21.15.39:0/1557890181 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:29:57.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:29:57.447+0000 7f886ffff700 1 --2- 172.21.15.39:0/1557890181 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8878104380 0x7f88781a1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:29:57.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:29:57.447+0000 7f8877fff700 1 --2- 172.21.15.39:0/1557890181 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8878103250 0x7f88781a1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:29:57.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:29:57.447+0000 7f887c9fe700 1 -- 172.21.15.39:0/1557890181 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8878104380 msgr2=0x7f88781a1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:29:57.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:29:57.447+0000 7f887c9fe700 1 --2- 172.21.15.39:0/1557890181 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8878104380 0x7f88781a1740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:29:57.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:29:57.447+0000 7f887c9fe700 1 -- 172.21.15.39:0/1557890181 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8878103250 msgr2=0x7f88781a1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:29:57.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:29:57.448+0000 7f887c9fe700 1 --2- 172.21.15.39:0/1557890181 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8878103250 0x7f88781a1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:29:57.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:29:57.448+0000 7f887c9fe700 1 -- 172.21.15.39:0/1557890181 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88781a89b0 con 0x7f8878104d20 2024-05-09T05:29:57.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:29:57.448+0000 7f887c9fe700 1 --2- 172.21.15.39:0/1557890181 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8878104d20 0x7f88781a8370 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f887000b070 tx=0x7f8870004ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:29:57.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:29:57.448+0000 7f8875ffb700 1 -- 172.21.15.39:0/1557890181 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8870021070 con 0x7f8878104d20 2024-05-09T05:29:57.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:29:57.448+0000 7f887e461700 1 -- 172.21.15.39:0/1557890181 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88781a8c40 con 0x7f8878104d20 2024-05-09T05:29:57.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:29:57.448+0000 7f887e461700 1 -- 172.21.15.39:0/1557890181 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88781a9180 con 0x7f8878104d20 2024-05-09T05:29:57.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:29:57.448+0000 7f8875ffb700 1 -- 172.21.15.39:0/1557890181 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8870007b80 con 0x7f8878104d20 2024-05-09T05:29:57.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:29:57.448+0000 7f8875ffb700 1 -- 172.21.15.39:0/1557890181 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88700052a0 con 0x7f8878104d20 2024-05-09T05:29:57.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:29:57.450+0000 7f887e461700 1 -- 172.21.15.39:0/1557890181 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8858005330 con 0x7f8878104d20 2024-05-09T05:29:57.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:29:57.451+0000 7f8875ffb700 1 -- 172.21.15.39:0/1557890181 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 15) ==== 149596+0+0 (secure 0 0 0) 0x7f8870024070 con 0x7f8878104d20 2024-05-09T05:29:57.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:29:57.452+0000 7f8875ffb700 1 --2- 172.21.15.39:0/1557890181 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f88640b2870 0x7f88640b4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:29:57.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:29:57.452+0000 7f8877fff700 1 --2- 172.21.15.39:0/1557890181 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f88640b2870 0x7f88640b4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:29:57.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:29:57.452+0000 7f8875ffb700 1 -- 172.21.15.39:0/1557890181 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 3237+0+0 (secure 0 0 0) 0x7f887000f020 con 0x7f8878104d20 2024-05-09T05:29:57.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:29:57.452+0000 7f8877fff700 1 --2- 172.21.15.39:0/1557890181 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f88640b2870 0x7f88640b4d80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f88781a22d0 tx=0x7f8868009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:29:57.450 INFO:journalctl@ceph.osd.2.smithi100.stdout:May 09 05:29:57 smithi100 sudo[43548]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-09T05:29:57.450 INFO:journalctl@ceph.osd.2.smithi100.stdout:May 09 05:29:57 smithi100 sudo[43548]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-09T05:29:57.450 INFO:journalctl@ceph.osd.2.smithi100.stdout:May 09 05:29:57 smithi100 sudo[43548]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-09T05:29:57.450 INFO:journalctl@ceph.osd.2.smithi100.stdout:May 09 05:29:57 smithi100 sudo[43548]: pam_unix(sudo:session): session closed for user root 2024-05-09T05:29:57.450 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:57 smithi100 ceph-mon[34353]: Detected new or changed devices on smithi100 2024-05-09T05:29:57.450 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:57 smithi100 ceph-mon[34353]: Adjusting osd_memory_target on smithi100 to 17088M 2024-05-09T05:29:57.450 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:57 smithi100 ceph-mon[34353]: pgmap v82: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-09T05:29:57.450 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:57 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-05-09T05:29:57.451 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:57 smithi100 ceph-mon[34353]: osdmap e19: 3 total, 3 up, 3 in 2024-05-09T05:29:57.451 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:57 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-05-09T05:29:57.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:29:57.457+0000 7f8875ffb700 1 -- 172.21.15.39:0/1557890181 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f887002b020 con 0x7f8878104d20 2024-05-09T05:29:57.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:57 smithi060 ceph-mon[34555]: Detected new or changed devices on smithi100 2024-05-09T05:29:57.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:57 smithi060 ceph-mon[34555]: Adjusting osd_memory_target on smithi100 to 17088M 2024-05-09T05:29:57.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:57 smithi060 ceph-mon[34555]: pgmap v82: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-09T05:29:57.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:57 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-05-09T05:29:57.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:57 smithi060 ceph-mon[34555]: osdmap e19: 3 total, 3 up, 3 in 2024-05-09T05:29:57.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:57 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-05-09T05:29:57.548 INFO:journalctl@ceph.osd.1.smithi060.stdout:May 09 05:29:57 smithi060 sudo[42838]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-09T05:29:57.548 INFO:journalctl@ceph.osd.1.smithi060.stdout:May 09 05:29:57 smithi060 sudo[42838]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-09T05:29:57.548 INFO:journalctl@ceph.osd.1.smithi060.stdout:May 09 05:29:57 smithi060 sudo[42838]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-09T05:29:57.548 INFO:journalctl@ceph.osd.1.smithi060.stdout:May 09 05:29:57 smithi060 sudo[42838]: pam_unix(sudo:session): session closed for user root 2024-05-09T05:29:57.548 INFO:journalctl@ceph.osd.1.smithi060.stdout:May 09 05:29:57 smithi060 sudo[42841]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-09T05:29:57.548 INFO:journalctl@ceph.osd.1.smithi060.stdout:May 09 05:29:57 smithi060 sudo[42841]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-09T05:29:57.548 INFO:journalctl@ceph.osd.1.smithi060.stdout:May 09 05:29:57 smithi060 sudo[42841]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-09T05:29:57.548 INFO:journalctl@ceph.osd.1.smithi060.stdout:May 09 05:29:57 smithi060 sudo[42841]: pam_unix(sudo:session): session closed for user root 2024-05-09T05:29:57.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:29:57.691+0000 7f887e461700 1 -- 172.21.15.39:0/1557890181 --> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi039:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f8858000bc0 con 0x7f88640b2870 2024-05-09T05:29:57.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:57 smithi039 sudo[47134]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-09T05:29:57.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:57 smithi039 sudo[47134]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-09T05:29:57.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:57 smithi039 sudo[47134]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-09T05:29:57.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:57 smithi039 sudo[47134]: pam_unix(sudo:session): session closed for user root 2024-05-09T05:29:57.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:57 smithi039 sudo[47137]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-09T05:29:57.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:57 smithi039 sudo[47137]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-09T05:29:57.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:57 smithi039 sudo[47137]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-09T05:29:57.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:57 smithi039 sudo[47137]: pam_unix(sudo:session): session closed for user root 2024-05-09T05:29:57.924 INFO:journalctl@ceph.osd.2.smithi100.stdout:May 09 05:29:57 smithi100 sudo[43551]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-09T05:29:57.924 INFO:journalctl@ceph.osd.2.smithi100.stdout:May 09 05:29:57 smithi100 sudo[43551]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-09T05:29:57.924 INFO:journalctl@ceph.osd.2.smithi100.stdout:May 09 05:29:57 smithi100 sudo[43551]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-09T05:29:57.924 INFO:journalctl@ceph.osd.2.smithi100.stdout:May 09 05:29:57 smithi100 sudo[43551]: pam_unix(sudo:session): session closed for user root 2024-05-09T05:29:57.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:57 smithi100 sudo[43554]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-09T05:29:57.925 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:57 smithi100 sudo[43554]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-09T05:29:57.925 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:57 smithi100 sudo[43554]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-09T05:29:57.925 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:57 smithi100 sudo[43554]: pam_unix(sudo:session): session closed for user root 2024-05-09T05:29:57.925 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:57 smithi100 sudo[43557]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-09T05:29:57.925 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:57 smithi100 sudo[43557]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-09T05:29:57.925 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:57 smithi100 sudo[43557]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-09T05:29:57.925 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:57 smithi100 sudo[43557]: pam_unix(sudo:session): session closed for user root 2024-05-09T05:29:58.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:57 smithi060 sudo[42844]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-09T05:29:58.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:57 smithi060 sudo[42844]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-09T05:29:58.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:57 smithi060 sudo[42844]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-09T05:29:58.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:57 smithi060 sudo[42844]: pam_unix(sudo:session): session closed for user root 2024-05-09T05:29:58.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:57 smithi060 sudo[42847]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-09T05:29:58.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:57 smithi060 sudo[42847]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-09T05:29:58.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:57 smithi060 sudo[42847]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-09T05:29:58.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:57 smithi060 sudo[42847]: pam_unix(sudo:session): session closed for user root 2024-05-09T05:29:58.455 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:58 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-05-09T05:29:58.456 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:58 smithi039 ceph-mon[30439]: osdmap e20: 3 total, 3 up, 3 in 2024-05-09T05:29:58.456 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:58 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:29:58.456 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:58 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:29:58.456 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:58 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:29:58.456 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:58 smithi039 ceph-mon[30439]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-09T05:29:58.456 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:58 smithi039 ceph-mon[30439]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-09T05:29:58.456 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:58 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-09T05:29:58.456 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:58 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-09T05:29:58.456 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:58 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-09T05:29:58.456 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:58 smithi039 ceph-mon[30439]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-09T05:29:58.456 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:58 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-09T05:29:58.456 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:58 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-09T05:29:58.456 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:58 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-09T05:29:58.457 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:58 smithi039 ceph-mon[30439]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-09T05:29:58.457 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:58 smithi039 ceph-mon[30439]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-09T05:29:58.457 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:58 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-09T05:29:58.457 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:58 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-09T05:29:58.457 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:58 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-09T05:29:58.457 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:58 smithi039 ceph-mon[30439]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-09T05:29:58.457 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:58 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T05:29:58.457 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:58 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T05:29:58.457 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:58 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:29:58.487 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:29:58.492+0000 7f8875ffb700 1 -- 172.21.15.39:0/1557890181 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f88700a6f70 con 0x7f8878104d20 2024-05-09T05:29:58.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:58 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-05-09T05:29:58.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:58 smithi060 ceph-mon[34555]: osdmap e20: 3 total, 3 up, 3 in 2024-05-09T05:29:58.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:58 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:29:58.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:58 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:29:58.548 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:58 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:29:58.548 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:58 smithi060 ceph-mon[34555]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-09T05:29:58.548 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:58 smithi060 ceph-mon[34555]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-09T05:29:58.548 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:58 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-09T05:29:58.548 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:58 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-09T05:29:58.548 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:58 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-09T05:29:58.548 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:58 smithi060 ceph-mon[34555]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-09T05:29:58.548 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:58 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-09T05:29:58.548 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:58 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-09T05:29:58.548 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:58 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-09T05:29:58.548 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:58 smithi060 ceph-mon[34555]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-09T05:29:58.548 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:58 smithi060 ceph-mon[34555]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-09T05:29:58.548 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:58 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-09T05:29:58.548 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:58 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-09T05:29:58.549 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:58 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-09T05:29:58.549 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:58 smithi060 ceph-mon[34555]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-09T05:29:58.549 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:58 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T05:29:58.549 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:58 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T05:29:58.549 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:58 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:29:58.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:58 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-05-09T05:29:58.675 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:58 smithi100 ceph-mon[34353]: osdmap e20: 3 total, 3 up, 3 in 2024-05-09T05:29:58.675 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:58 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:29:58.675 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:58 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:29:58.675 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:58 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:29:58.675 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:58 smithi100 ceph-mon[34353]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-09T05:29:58.675 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:58 smithi100 ceph-mon[34353]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-09T05:29:58.675 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:58 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-09T05:29:58.675 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:58 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-09T05:29:58.675 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:58 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-09T05:29:58.675 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:58 smithi100 ceph-mon[34353]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-09T05:29:58.675 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:58 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-09T05:29:58.675 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:58 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-09T05:29:58.675 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:58 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-09T05:29:58.676 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:58 smithi100 ceph-mon[34353]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-09T05:29:58.676 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:58 smithi100 ceph-mon[34353]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-09T05:29:58.676 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:58 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-09T05:29:58.676 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:58 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-09T05:29:58.676 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:58 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-09T05:29:58.676 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:58 smithi100 ceph-mon[34353]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-09T05:29:58.676 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:58 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T05:29:58.676 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:58 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T05:29:58.676 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:58 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:29:59.360 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:59 smithi039 ceph-mon[30439]: from='client.14295 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi039:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T05:29:59.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:59 smithi039 ceph-mon[30439]: pgmap v85: 1 pgs: 1 creating+peering; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-09T05:29:59.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:59 smithi039 ceph-mon[30439]: osdmap e21: 3 total, 3 up, 3 in 2024-05-09T05:29:59.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:29:59 smithi039 ceph-mon[30439]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-05-09T05:29:59.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:59 smithi060 ceph-mon[34555]: from='client.14295 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi039:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T05:29:59.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:59 smithi060 ceph-mon[34555]: pgmap v85: 1 pgs: 1 creating+peering; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-09T05:29:59.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:59 smithi060 ceph-mon[34555]: osdmap e21: 3 total, 3 up, 3 in 2024-05-09T05:29:59.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:29:59 smithi060 ceph-mon[34555]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-05-09T05:29:59.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:59 smithi100 ceph-mon[34353]: from='client.14295 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi039:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T05:29:59.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:59 smithi100 ceph-mon[34353]: pgmap v85: 1 pgs: 1 creating+peering; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-09T05:29:59.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:59 smithi100 ceph-mon[34353]: osdmap e21: 3 total, 3 up, 3 in 2024-05-09T05:29:59.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:29:59 smithi100 ceph-mon[34353]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-05-09T05:30:00.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:00 smithi060 ceph-mon[34555]: overall HEALTH_OK 2024-05-09T05:30:00.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:00 smithi039 ceph-mon[30439]: overall HEALTH_OK 2024-05-09T05:30:00.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:00 smithi100 ceph-mon[34353]: overall HEALTH_OK 2024-05-09T05:30:01.360 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:01 smithi039 ceph-mon[30439]: pgmap v87: 1 pgs: 1 creating+peering; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-09T05:30:01.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:01 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/2689183664' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1ebe1a25-541d-4b54-bed8-4f0ec51b2432"}]: dispatch 2024-05-09T05:30:01.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:01 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/2689183664' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1ebe1a25-541d-4b54-bed8-4f0ec51b2432"}]': finished 2024-05-09T05:30:01.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:01 smithi039 ceph-mon[30439]: osdmap e22: 4 total, 3 up, 4 in 2024-05-09T05:30:01.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:01 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-09T05:30:01.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:01 smithi060 ceph-mon[34555]: pgmap v87: 1 pgs: 1 creating+peering; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-09T05:30:01.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:01 smithi060 ceph-mon[34555]: from='client.? 172.21.15.39:0/2689183664' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1ebe1a25-541d-4b54-bed8-4f0ec51b2432"}]: dispatch 2024-05-09T05:30:01.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:01 smithi060 ceph-mon[34555]: from='client.? 172.21.15.39:0/2689183664' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1ebe1a25-541d-4b54-bed8-4f0ec51b2432"}]': finished 2024-05-09T05:30:01.548 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:01 smithi060 ceph-mon[34555]: osdmap e22: 4 total, 3 up, 4 in 2024-05-09T05:30:01.548 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:01 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-09T05:30:01.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:01 smithi100 ceph-mon[34353]: pgmap v87: 1 pgs: 1 creating+peering; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-09T05:30:01.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:01 smithi100 ceph-mon[34353]: from='client.? 172.21.15.39:0/2689183664' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1ebe1a25-541d-4b54-bed8-4f0ec51b2432"}]: dispatch 2024-05-09T05:30:01.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:01 smithi100 ceph-mon[34353]: from='client.? 172.21.15.39:0/2689183664' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1ebe1a25-541d-4b54-bed8-4f0ec51b2432"}]': finished 2024-05-09T05:30:01.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:01 smithi100 ceph-mon[34353]: osdmap e22: 4 total, 3 up, 4 in 2024-05-09T05:30:01.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:01 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-09T05:30:02.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:02 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/2895196855' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap", "output-file": "/var/lib/ceph/osd/ceph-3/activate.monmap"}]: dispatch 2024-05-09T05:30:02.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:02 smithi100 ceph-mon[34353]: from='client.? 172.21.15.39:0/2895196855' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap", "output-file": "/var/lib/ceph/osd/ceph-3/activate.monmap"}]: dispatch 2024-05-09T05:30:03.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:02 smithi060 ceph-mon[34555]: from='client.? 172.21.15.39:0/2895196855' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap", "output-file": "/var/lib/ceph/osd/ceph-3/activate.monmap"}]: dispatch 2024-05-09T05:30:03.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:03 smithi039 ceph-mon[30439]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-09T05:30:03.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:03 smithi100 ceph-mon[34353]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-09T05:30:04.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:03 smithi060 ceph-mon[34555]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-09T05:30:04.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:04 smithi100 ceph-mon[34353]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-09T05:30:05.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:04 smithi060 ceph-mon[34555]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-09T05:30:05.110 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:04 smithi039 ceph-mon[30439]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-09T05:30:07.247 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:07 smithi039 ceph-mon[30439]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-09T05:30:07.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:07 smithi100 ceph-mon[34353]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-09T05:30:07.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:07 smithi060 ceph-mon[34555]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-09T05:30:09.306 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:09 smithi039 ceph-mon[30439]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-09T05:30:09.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:09 smithi100 ceph-mon[34353]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-09T05:30:09.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:09 smithi060 ceph-mon[34555]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-09T05:30:10.259 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:10 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-09T05:30:10.259 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:10 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:30:10.260 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:10 smithi039 ceph-mon[30439]: Deploying daemon osd.3 on smithi039 2024-05-09T05:30:10.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:10 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-09T05:30:10.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:10 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:30:10.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:10 smithi100 ceph-mon[34353]: Deploying daemon osd.3 on smithi039 2024-05-09T05:30:10.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:10 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-09T05:30:10.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:10 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:30:10.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:10 smithi060 ceph-mon[34555]: Deploying daemon osd.3 on smithi039 2024-05-09T05:30:11.360 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:11 smithi039 ceph-mon[30439]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-09T05:30:11.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:11 smithi100 ceph-mon[34353]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-09T05:30:11.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:11 smithi060 ceph-mon[34555]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-09T05:30:13.290 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:13 smithi039 ceph-mon[30439]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-09T05:30:13.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:13 smithi100 ceph-mon[34353]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-09T05:30:13.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:13 smithi060 ceph-mon[34555]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-09T05:30:15.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:15 smithi039 ceph-mon[30439]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-09T05:30:15.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:15 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:30:15.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:15 smithi100 ceph-mon[34353]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-09T05:30:15.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:15 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:30:15.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:15 smithi060 ceph-mon[34555]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-09T05:30:15.548 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:15 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:30:16.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:16 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:30:16.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:16 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:30:16.528 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:16 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:30:16.528 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:16 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:30:16.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:16 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:30:16.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:16 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:30:17.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:17 smithi039 ceph-mon[30439]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-09T05:30:17.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:17 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:30:17.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:17 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:30:17.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:17 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:30:17.423 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:17 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:30:17.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:17 smithi100 ceph-mon[34353]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-09T05:30:17.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:17 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:30:17.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:17 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:30:17.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:17 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:30:17.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:17 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:30:17.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:17 smithi060 ceph-mon[34555]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-09T05:30:17.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:17 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:30:17.548 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:17 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:30:17.548 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:17 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:30:17.548 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:17 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:30:18.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:18 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:30:18.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:18 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:30:18.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:18 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:30:19.053 INFO:teuthology.orchestra.run.smithi039.stdout:Created osd(s) 3 on host 'smithi039' 2024-05-09T05:30:19.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:30:19.058+0000 7f8875ffb700 1 -- 172.21.15.39:0/1557890181 <== mgr.14152 v2:172.21.15.39:6800/3184189003 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f8858000bc0 con 0x7f88640b2870 2024-05-09T05:30:19.055 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:30:19.061+0000 7f887e461700 1 -- 172.21.15.39:0/1557890181 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f88640b2870 msgr2=0x7f88640b4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:30:19.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:30:19.061+0000 7f887e461700 1 --2- 172.21.15.39:0/1557890181 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f88640b2870 0x7f88640b4d80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f88781a22d0 tx=0x7f8868009260 comp rx=0 tx=0).stop 2024-05-09T05:30:19.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:30:19.061+0000 7f887e461700 1 -- 172.21.15.39:0/1557890181 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8878104d20 msgr2=0x7f88781a8370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:30:19.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:30:19.061+0000 7f887e461700 1 --2- 172.21.15.39:0/1557890181 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8878104d20 0x7f88781a8370 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f887000b070 tx=0x7f8870004ce0 comp rx=0 tx=0).stop 2024-05-09T05:30:19.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:30:19.061+0000 7f887e461700 1 -- 172.21.15.39:0/1557890181 shutdown_connections 2024-05-09T05:30:19.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:30:19.061+0000 7f887e461700 1 --2- 172.21.15.39:0/1557890181 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f88640b2870 0x7f88640b4d80 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:30:19.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:30:19.061+0000 7f887e461700 1 --2- 172.21.15.39:0/1557890181 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8878104d20 0x7f88781a8370 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:30:19.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:30:19.061+0000 7f887e461700 1 --2- 172.21.15.39:0/1557890181 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8878103250 0x7f88781a1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:30:19.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:30:19.061+0000 7f887e461700 1 --2- 172.21.15.39:0/1557890181 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8878104380 0x7f88781a1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:30:19.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:30:19.061+0000 7f887e461700 1 -- 172.21.15.39:0/1557890181 >> 172.21.15.39:0/1557890181 conn(0x7f88780fe890 msgr2=0x7f8878100160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:30:19.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:30:19.061+0000 7f887e461700 1 -- 172.21.15.39:0/1557890181 shutdown_connections 2024-05-09T05:30:19.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:30:19.061+0000 7f887e461700 1 -- 172.21.15.39:0/1557890181 wait complete. 2024-05-09T05:30:19.360 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:19 smithi039 ceph-mon[30439]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-09T05:30:19.360 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:19 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:30:19.360 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:19 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:30:19.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:19 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:30:19.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:19 smithi039 ceph-mon[30439]: from='osd.3 [v2:172.21.15.39:6810/2254197543,v1:172.21.15.39:6811/2254197543]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-09T05:30:19.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:19 smithi060 ceph-mon[34555]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-09T05:30:19.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:19 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:30:19.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:19 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:30:19.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:19 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:30:19.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:19 smithi060 ceph-mon[34555]: from='osd.3 [v2:172.21.15.39:6810/2254197543,v1:172.21.15.39:6811/2254197543]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-09T05:30:19.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:19 smithi100 ceph-mon[34353]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-09T05:30:19.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:19 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:30:19.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:19 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:30:19.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:19 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:30:19.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:19 smithi100 ceph-mon[34353]: from='osd.3 [v2:172.21.15.39:6810/2254197543,v1:172.21.15.39:6811/2254197543]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-09T05:30:19.718 DEBUG:teuthology.orchestra.run.smithi039:osd.3> sudo journalctl -f -n 0 -u ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@osd.3.service 2024-05-09T05:30:19.720 INFO:tasks.cephadm:Deploying osd.4 on smithi060 with /dev/vg_nvme/lv_3... 2024-05-09T05:30:19.720 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-05-09T05:30:19.977 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.b/config 2024-05-09T05:30:21.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:21 smithi060 ceph-mon[34555]: from='osd.3 [v2:172.21.15.39:6810/2254197543,v1:172.21.15.39:6811/2254197543]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-05-09T05:30:21.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:21 smithi060 ceph-mon[34555]: osdmap e23: 4 total, 3 up, 4 in 2024-05-09T05:30:21.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:21 smithi060 ceph-mon[34555]: from='osd.3 [v2:172.21.15.39:6810/2254197543,v1:172.21.15.39:6811/2254197543]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]: dispatch 2024-05-09T05:30:21.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:21 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-09T05:30:21.048 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:21 smithi060 ceph-mon[34555]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-09T05:30:21.136 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:21 smithi039 ceph-mon[30439]: from='osd.3 [v2:172.21.15.39:6810/2254197543,v1:172.21.15.39:6811/2254197543]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-05-09T05:30:21.136 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:21 smithi039 ceph-mon[30439]: osdmap e23: 4 total, 3 up, 4 in 2024-05-09T05:30:21.136 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:21 smithi039 ceph-mon[30439]: from='osd.3 [v2:172.21.15.39:6810/2254197543,v1:172.21.15.39:6811/2254197543]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]: dispatch 2024-05-09T05:30:21.136 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:21 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-09T05:30:21.136 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:21 smithi039 ceph-mon[30439]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-09T05:30:21.136 INFO:journalctl@ceph.osd.3.smithi039.stdout:May 09 05:30:21 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-3[49390]: 2024-05-09T05:30:21.025+0000 7fc7709d0700 -1 osd.3 0 waiting for initial osdmap 2024-05-09T05:30:21.137 INFO:journalctl@ceph.osd.3.smithi039.stdout:May 09 05:30:21 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-3[49390]: 2024-05-09T05:30:21.036+0000 7fc76c785700 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T05:30:21.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:21 smithi100 ceph-mon[34353]: from='osd.3 [v2:172.21.15.39:6810/2254197543,v1:172.21.15.39:6811/2254197543]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-05-09T05:30:21.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:21 smithi100 ceph-mon[34353]: osdmap e23: 4 total, 3 up, 4 in 2024-05-09T05:30:21.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:21 smithi100 ceph-mon[34353]: from='osd.3 [v2:172.21.15.39:6810/2254197543,v1:172.21.15.39:6811/2254197543]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]: dispatch 2024-05-09T05:30:21.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:21 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-09T05:30:21.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:21 smithi100 ceph-mon[34353]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-09T05:30:21.989 INFO:teuthology.orchestra.run.smithi060.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-05-09T05:30:21.989 INFO:teuthology.orchestra.run.smithi060.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-05-09T05:30:21.989 INFO:teuthology.orchestra.run.smithi060.stderr: stderr: 10+0 records in 2024-05-09T05:30:21.989 INFO:teuthology.orchestra.run.smithi060.stderr:10+0 records out 2024-05-09T05:30:21.989 INFO:teuthology.orchestra.run.smithi060.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00834823 s, 1.3 GB/s 2024-05-09T05:30:21.990 INFO:teuthology.orchestra.run.smithi060.stderr: stderr: 2024-05-09T05:30:21.990 INFO:teuthology.orchestra.run.smithi060.stderr:--> Zapping successful for: 2024-05-09T05:30:22.294 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:22 smithi039 ceph-mon[30439]: from='osd.3 [v2:172.21.15.39:6810/2254197543,v1:172.21.15.39:6811/2254197543]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]': finished 2024-05-09T05:30:22.295 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:22 smithi039 ceph-mon[30439]: osdmap e24: 4 total, 3 up, 4 in 2024-05-09T05:30:22.295 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:22 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-09T05:30:22.295 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:22 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-09T05:30:22.295 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:22 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-09T05:30:22.296 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:22 smithi060 ceph-mon[34555]: from='osd.3 [v2:172.21.15.39:6810/2254197543,v1:172.21.15.39:6811/2254197543]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]': finished 2024-05-09T05:30:22.296 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:22 smithi060 ceph-mon[34555]: osdmap e24: 4 total, 3 up, 4 in 2024-05-09T05:30:22.296 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:22 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-09T05:30:22.296 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:22 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-09T05:30:22.296 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:22 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-09T05:30:22.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:22 smithi100 ceph-mon[34353]: from='osd.3 [v2:172.21.15.39:6810/2254197543,v1:172.21.15.39:6811/2254197543]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]': finished 2024-05-09T05:30:22.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:22 smithi100 ceph-mon[34353]: osdmap e24: 4 total, 3 up, 4 in 2024-05-09T05:30:22.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:22 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-09T05:30:22.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:22 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-09T05:30:22.425 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:22 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-09T05:30:22.646 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi060:vg_nvme/lv_3 2024-05-09T05:30:22.899 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.b/config 2024-05-09T05:30:23.290 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:23 smithi060 ceph-mon[34555]: purged_snaps scrub starts 2024-05-09T05:30:23.290 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:23 smithi060 ceph-mon[34555]: purged_snaps scrub ok 2024-05-09T05:30:23.290 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:23 smithi060 ceph-mon[34555]: osd.3 [v2:172.21.15.39:6810/2254197543,v1:172.21.15.39:6811/2254197543] boot 2024-05-09T05:30:23.290 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:23 smithi060 ceph-mon[34555]: osdmap e25: 4 total, 4 up, 4 in 2024-05-09T05:30:23.290 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:23 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-09T05:30:23.290 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:23 smithi060 ceph-mon[34555]: pgmap v102: 1 pgs: 1 peering; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-09T05:30:23.290 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:23 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:30:23.291 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:23 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:30:23.291 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:23 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:30:23.291 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:23 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:30:23.291 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:23 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:30:23.291 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:23 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:30:23.291 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:23 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:30:23.291 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:23 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:30:23.291 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:23 smithi060 ceph-mon[34555]: osdmap e26: 4 total, 4 up, 4 in 2024-05-09T05:30:23.360 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:23 smithi039 ceph-mon[30439]: purged_snaps scrub starts 2024-05-09T05:30:23.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:23 smithi039 ceph-mon[30439]: purged_snaps scrub ok 2024-05-09T05:30:23.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:23 smithi039 ceph-mon[30439]: osd.3 [v2:172.21.15.39:6810/2254197543,v1:172.21.15.39:6811/2254197543] boot 2024-05-09T05:30:23.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:23 smithi039 ceph-mon[30439]: osdmap e25: 4 total, 4 up, 4 in 2024-05-09T05:30:23.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:23 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-09T05:30:23.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:23 smithi039 ceph-mon[30439]: pgmap v102: 1 pgs: 1 peering; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-09T05:30:23.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:23 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:30:23.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:23 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:30:23.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:23 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:30:23.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:23 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:30:23.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:23 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:30:23.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:23 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:30:23.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:23 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:30:23.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:23 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:30:23.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:23 smithi039 ceph-mon[30439]: osdmap e26: 4 total, 4 up, 4 in 2024-05-09T05:30:23.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:23 smithi100 ceph-mon[34353]: purged_snaps scrub starts 2024-05-09T05:30:23.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:23 smithi100 ceph-mon[34353]: purged_snaps scrub ok 2024-05-09T05:30:23.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:23 smithi100 ceph-mon[34353]: osd.3 [v2:172.21.15.39:6810/2254197543,v1:172.21.15.39:6811/2254197543] boot 2024-05-09T05:30:23.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:23 smithi100 ceph-mon[34353]: osdmap e25: 4 total, 4 up, 4 in 2024-05-09T05:30:23.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:23 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-09T05:30:23.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:23 smithi100 ceph-mon[34353]: pgmap v102: 1 pgs: 1 peering; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-09T05:30:23.425 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:23 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:30:23.425 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:23 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:30:23.425 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:23 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:30:23.425 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:23 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:30:23.425 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:23 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:30:23.425 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:23 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:30:23.425 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:23 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:30:23.425 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:23 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:30:23.425 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:23 smithi100 ceph-mon[34353]: osdmap e26: 4 total, 4 up, 4 in 2024-05-09T05:30:24.297 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:24 smithi060 ceph-mon[34555]: Detected new or changed devices on smithi039 2024-05-09T05:30:24.297 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:24 smithi060 ceph-mon[34555]: Adjusting osd_memory_target on smithi039 to 8544M 2024-05-09T05:30:24.297 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:24 smithi060 ceph-mon[34555]: osdmap e27: 4 total, 4 up, 4 in 2024-05-09T05:30:24.360 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:24 smithi039 ceph-mon[30439]: Detected new or changed devices on smithi039 2024-05-09T05:30:24.360 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:24 smithi039 ceph-mon[30439]: Adjusting osd_memory_target on smithi039 to 8544M 2024-05-09T05:30:24.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:24 smithi039 ceph-mon[30439]: osdmap e27: 4 total, 4 up, 4 in 2024-05-09T05:30:24.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:24 smithi100 ceph-mon[34353]: Detected new or changed devices on smithi039 2024-05-09T05:30:24.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:24 smithi100 ceph-mon[34353]: Adjusting osd_memory_target on smithi039 to 8544M 2024-05-09T05:30:24.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:24 smithi100 ceph-mon[34353]: osdmap e27: 4 total, 4 up, 4 in 2024-05-09T05:30:24.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:30:24.611+0000 7fbef7ca4700 1 -- 172.21.15.60:0/2276757568 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbef01059b0 msgr2=0x7fbef0105dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:30:24.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:30:24.611+0000 7fbef7ca4700 1 --2- 172.21.15.60:0/2276757568 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbef01059b0 0x7fbef0105dc0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fbeec009990 tx=0x7fbeec009ca0 comp rx=0 tx=0).stop 2024-05-09T05:30:24.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:30:24.611+0000 7fbef7ca4700 1 -- 172.21.15.60:0/2276757568 shutdown_connections 2024-05-09T05:30:24.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:30:24.611+0000 7fbef7ca4700 1 --2- 172.21.15.60:0/2276757568 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbef01049e0 0x7fbef010c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:30:24.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:30:24.611+0000 7fbef7ca4700 1 --2- 172.21.15.60:0/2276757568 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbef01059b0 0x7fbef0105dc0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:30:24.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:30:24.611+0000 7fbef7ca4700 1 --2- 172.21.15.60:0/2276757568 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbef0103f60 0x7fbef0104370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:30:24.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:30:24.611+0000 7fbef7ca4700 1 -- 172.21.15.60:0/2276757568 >> 172.21.15.60:0/2276757568 conn(0x7fbef00ff9d0 msgr2=0x7fbef0101e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:30:24.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:30:24.611+0000 7fbef7ca4700 1 -- 172.21.15.60:0/2276757568 shutdown_connections 2024-05-09T05:30:24.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:30:24.611+0000 7fbef7ca4700 1 -- 172.21.15.60:0/2276757568 wait complete. 2024-05-09T05:30:24.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:30:24.611+0000 7fbef7ca4700 1 Processor -- start 2024-05-09T05:30:24.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:30:24.612+0000 7fbef7ca4700 1 -- start start 2024-05-09T05:30:24.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:30:24.612+0000 7fbef7ca4700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbef0103f60 0x7fbef019aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:30:24.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:30:24.612+0000 7fbef7ca4700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbef01049e0 0x7fbef019af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:30:24.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:30:24.612+0000 7fbef7ca4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbef01059b0 0x7fbef01a1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:30:24.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:30:24.612+0000 7fbef7ca4700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fbef010fed0 con 0x7fbef0103f60 2024-05-09T05:30:24.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:30:24.612+0000 7fbef7ca4700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fbef010fd50 con 0x7fbef01059b0 2024-05-09T05:30:24.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:30:24.612+0000 7fbef7ca4700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbef0110050 con 0x7fbef01049e0 2024-05-09T05:30:24.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:30:24.612+0000 7fbef6241700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbef01059b0 0x7fbef01a1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:30:24.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:30:24.612+0000 7fbef6241700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbef01059b0 0x7fbef01a1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59728/0 (socket says 172.21.15.60:59728) 2024-05-09T05:30:24.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:30:24.612+0000 7fbef6241700 1 -- 172.21.15.60:0/418734272 learned_addr learned my addr 172.21.15.60:0/418734272 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-05-09T05:30:24.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:30:24.612+0000 7fbef523f700 1 --2- 172.21.15.60:0/418734272 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbef01049e0 0x7fbef019af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:30:24.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:30:24.612+0000 7fbef5a40700 1 --2- 172.21.15.60:0/418734272 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbef0103f60 0x7fbef019aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:30:24.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:30:24.612+0000 7fbef6241700 1 -- 172.21.15.60:0/418734272 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbef01049e0 msgr2=0x7fbef019af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:30:24.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:30:24.612+0000 7fbef6241700 1 --2- 172.21.15.60:0/418734272 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbef01049e0 0x7fbef019af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:30:24.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:30:24.612+0000 7fbef6241700 1 -- 172.21.15.60:0/418734272 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbef0103f60 msgr2=0x7fbef019aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:30:24.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:30:24.612+0000 7fbef6241700 1 --2- 172.21.15.60:0/418734272 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbef0103f60 0x7fbef019aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:30:24.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:30:24.612+0000 7fbef6241700 1 -- 172.21.15.60:0/418734272 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbef01a2570 con 0x7fbef01059b0 2024-05-09T05:30:24.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:30:24.612+0000 7fbef5a40700 1 --2- 172.21.15.60:0/418734272 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbef0103f60 0x7fbef019aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T05:30:24.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:30:24.612+0000 7fbef6241700 1 --2- 172.21.15.60:0/418734272 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbef01059b0 0x7fbef01a1ef0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fbee8007ee0 tx=0x7fbee800d3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:30:24.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:30:24.613+0000 7fbee6ffd700 1 -- 172.21.15.60:0/418734272 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbee800dbd0 con 0x7fbef01059b0 2024-05-09T05:30:24.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:30:24.613+0000 7fbee6ffd700 1 -- 172.21.15.60:0/418734272 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbee800dd70 con 0x7fbef01059b0 2024-05-09T05:30:24.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:30:24.613+0000 7fbef7ca4700 1 -- 172.21.15.60:0/418734272 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbef01a2860 con 0x7fbef01059b0 2024-05-09T05:30:24.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:30:24.613+0000 7fbee6ffd700 1 -- 172.21.15.60:0/418734272 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbee8005990 con 0x7fbef01059b0 2024-05-09T05:30:24.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:30:24.613+0000 7fbef7ca4700 1 -- 172.21.15.60:0/418734272 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbef01a2d50 con 0x7fbef01059b0 2024-05-09T05:30:24.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:30:24.614+0000 7fbef7ca4700 1 -- 172.21.15.60:0/418734272 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbef00512c0 con 0x7fbef01059b0 2024-05-09T05:30:24.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:30:24.615+0000 7fbee6ffd700 1 -- 172.21.15.60:0/418734272 <== mon.2 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fbee801a020 con 0x7fbef01059b0 2024-05-09T05:30:24.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:30:24.616+0000 7fbee6ffd700 1 --2- 172.21.15.60:0/418734272 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fbedc0b2900 0x7fbedc0b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:30:24.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:30:24.616+0000 7fbee6ffd700 1 -- 172.21.15.60:0/418734272 <== mon.2 v2:172.21.15.60:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 3669+0+0 (secure 0 0 0) 0x7fbee80e0fc0 con 0x7fbef01059b0 2024-05-09T05:30:24.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:30:24.616+0000 7fbef5a40700 1 --2- 172.21.15.60:0/418734272 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fbedc0b2900 0x7fbedc0b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:30:24.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:30:24.617+0000 7fbef5a40700 1 --2- 172.21.15.60:0/418734272 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fbedc0b2900 0x7fbedc0b4e10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fbeec0038a0 tx=0x7fbeec01a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:30:24.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:30:24.620+0000 7fbee6ffd700 1 -- 172.21.15.60:0/418734272 <== mon.2 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fbee8010070 con 0x7fbef01059b0 2024-05-09T05:30:24.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:30:24.844+0000 7fbef7ca4700 1 -- 172.21.15.60:0/418734272 --> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fbef002e9c0 con 0x7fbedc0b2900 2024-05-09T05:30:25.360 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:25 smithi039 ceph-mon[30439]: pgmap v105: 1 pgs: 1 peering; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-05-09T05:30:25.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:25 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T05:30:25.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:25 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T05:30:25.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:25 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:30:25.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:25 smithi100 ceph-mon[34353]: pgmap v105: 1 pgs: 1 peering; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-05-09T05:30:25.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:25 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T05:30:25.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:25 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T05:30:25.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:25 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:30:25.479 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:25 smithi060 ceph-mon[34555]: pgmap v105: 1 pgs: 1 peering; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-05-09T05:30:25.479 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:25 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T05:30:25.479 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:25 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T05:30:25.479 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:25 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:30:26.360 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:26 smithi039 ceph-mon[30439]: from='client.24233 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T05:30:26.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:26 smithi100 ceph-mon[34353]: from='client.24233 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T05:30:26.550 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:26 smithi060 ceph-mon[34555]: from='client.24233 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T05:30:27.297 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:27 smithi060 ceph-mon[34555]: pgmap v106: 1 pgs: 1 peering; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-05-09T05:30:27.360 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:27 smithi039 ceph-mon[30439]: pgmap v106: 1 pgs: 1 peering; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-05-09T05:30:27.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:27 smithi100 ceph-mon[34353]: pgmap v106: 1 pgs: 1 peering; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-05-09T05:30:28.360 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:28 smithi039 ceph-mon[30439]: from='client.? 172.21.15.60:0/3327704589' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d52450a3-8a97-4746-a857-35aec69aac44"}]: dispatch 2024-05-09T05:30:28.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:28 smithi039 ceph-mon[30439]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d52450a3-8a97-4746-a857-35aec69aac44"}]: dispatch 2024-05-09T05:30:28.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:28 smithi039 ceph-mon[30439]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d52450a3-8a97-4746-a857-35aec69aac44"}]': finished 2024-05-09T05:30:28.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:28 smithi039 ceph-mon[30439]: osdmap e28: 5 total, 4 up, 5 in 2024-05-09T05:30:28.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:28 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-09T05:30:28.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:28 smithi100 ceph-mon[34353]: from='client.? 172.21.15.60:0/3327704589' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d52450a3-8a97-4746-a857-35aec69aac44"}]: dispatch 2024-05-09T05:30:28.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:28 smithi100 ceph-mon[34353]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d52450a3-8a97-4746-a857-35aec69aac44"}]: dispatch 2024-05-09T05:30:28.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:28 smithi100 ceph-mon[34353]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d52450a3-8a97-4746-a857-35aec69aac44"}]': finished 2024-05-09T05:30:28.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:28 smithi100 ceph-mon[34353]: osdmap e28: 5 total, 4 up, 5 in 2024-05-09T05:30:28.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:28 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-09T05:30:28.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:28 smithi060 ceph-mon[34555]: from='client.? 172.21.15.60:0/3327704589' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d52450a3-8a97-4746-a857-35aec69aac44"}]: dispatch 2024-05-09T05:30:28.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:28 smithi060 ceph-mon[34555]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d52450a3-8a97-4746-a857-35aec69aac44"}]: dispatch 2024-05-09T05:30:28.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:28 smithi060 ceph-mon[34555]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d52450a3-8a97-4746-a857-35aec69aac44"}]': finished 2024-05-09T05:30:28.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:28 smithi060 ceph-mon[34555]: osdmap e28: 5 total, 4 up, 5 in 2024-05-09T05:30:28.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:28 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-09T05:30:29.360 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:29 smithi039 ceph-mon[30439]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-09T05:30:29.360 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:29 smithi039 ceph-mon[30439]: from='client.? 172.21.15.60:0/1200450826' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap", "output-file": "/var/lib/ceph/osd/ceph-4/activate.monmap"}]: dispatch 2024-05-09T05:30:29.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:29 smithi100 ceph-mon[34353]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-09T05:30:29.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:29 smithi100 ceph-mon[34353]: from='client.? 172.21.15.60:0/1200450826' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap", "output-file": "/var/lib/ceph/osd/ceph-4/activate.monmap"}]: dispatch 2024-05-09T05:30:29.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:29 smithi060 ceph-mon[34555]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-09T05:30:29.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:29 smithi060 ceph-mon[34555]: from='client.? 172.21.15.60:0/1200450826' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap", "output-file": "/var/lib/ceph/osd/ceph-4/activate.monmap"}]: dispatch 2024-05-09T05:30:31.360 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:31 smithi039 ceph-mon[30439]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-05-09T05:30:31.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:31 smithi100 ceph-mon[34353]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-05-09T05:30:31.511 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:31 smithi060 ceph-mon[34555]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-05-09T05:30:33.297 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:33 smithi060 ceph-mon[34555]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-09T05:30:33.360 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:33 smithi039 ceph-mon[30439]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-09T05:30:33.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:33 smithi100 ceph-mon[34353]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-09T05:30:35.297 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:35 smithi060 ceph-mon[34555]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-09T05:30:35.360 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:35 smithi039 ceph-mon[30439]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-09T05:30:35.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:35 smithi100 ceph-mon[34353]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-09T05:30:36.297 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:36 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-09T05:30:36.297 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:36 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:30:36.297 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:36 smithi060 ceph-mon[34555]: Deploying daemon osd.4 on smithi060 2024-05-09T05:30:36.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:36 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-09T05:30:36.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:36 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:30:36.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:36 smithi039 ceph-mon[30439]: Deploying daemon osd.4 on smithi060 2024-05-09T05:30:36.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:36 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-09T05:30:36.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:36 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:30:36.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:36 smithi100 ceph-mon[34353]: Deploying daemon osd.4 on smithi060 2024-05-09T05:30:37.297 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:37 smithi060 ceph-mon[34555]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-09T05:30:37.360 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:37 smithi039 ceph-mon[30439]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-09T05:30:37.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:37 smithi100 ceph-mon[34353]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-09T05:30:39.297 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:39 smithi060 ceph-mon[34555]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-05-09T05:30:39.360 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:39 smithi039 ceph-mon[30439]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-05-09T05:30:39.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:39 smithi100 ceph-mon[34353]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-05-09T05:30:41.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:41 smithi100 ceph-mon[34353]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-05-09T05:30:41.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:41 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:30:41.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:41 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:30:41.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:41 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:30:41.436 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:41 smithi060 ceph-mon[34555]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-05-09T05:30:41.436 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:41 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:30:41.436 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:41 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:30:41.437 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:41 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:30:41.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:41 smithi039 ceph-mon[30439]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-05-09T05:30:41.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:41 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:30:41.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:41 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:30:41.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:41 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:30:43.297 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:43 smithi060 ceph-mon[34555]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-05-09T05:30:43.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:43 smithi100 ceph-mon[34353]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-05-09T05:30:43.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:43 smithi039 ceph-mon[30439]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-05-09T05:30:44.106 INFO:teuthology.orchestra.run.smithi060.stdout:Created osd(s) 4 on host 'smithi060' 2024-05-09T05:30:44.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:30:44.111+0000 7fbee6ffd700 1 -- 172.21.15.60:0/418734272 <== mgr.14152 v2:172.21.15.39:6800/3184189003 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fbef002e9c0 con 0x7fbedc0b2900 2024-05-09T05:30:44.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:30:44.114+0000 7fbef7ca4700 1 -- 172.21.15.60:0/418734272 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fbedc0b2900 msgr2=0x7fbedc0b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:30:44.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:30:44.114+0000 7fbef7ca4700 1 --2- 172.21.15.60:0/418734272 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fbedc0b2900 0x7fbedc0b4e10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fbeec0038a0 tx=0x7fbeec01a040 comp rx=0 tx=0).stop 2024-05-09T05:30:44.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:30:44.114+0000 7fbef7ca4700 1 -- 172.21.15.60:0/418734272 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbef01059b0 msgr2=0x7fbef01a1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:30:44.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:30:44.114+0000 7fbef7ca4700 1 --2- 172.21.15.60:0/418734272 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbef01059b0 0x7fbef01a1ef0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fbee8007ee0 tx=0x7fbee800d3b0 comp rx=0 tx=0).stop 2024-05-09T05:30:44.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:30:44.114+0000 7fbef7ca4700 1 -- 172.21.15.60:0/418734272 shutdown_connections 2024-05-09T05:30:44.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:30:44.114+0000 7fbef7ca4700 1 --2- 172.21.15.60:0/418734272 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fbedc0b2900 0x7fbedc0b4e10 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:30:44.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:30:44.114+0000 7fbef7ca4700 1 --2- 172.21.15.60:0/418734272 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbef01059b0 0x7fbef01a1ef0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:30:44.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:30:44.114+0000 7fbef7ca4700 1 --2- 172.21.15.60:0/418734272 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbef0103f60 0x7fbef019aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:30:44.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:30:44.114+0000 7fbef7ca4700 1 --2- 172.21.15.60:0/418734272 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbef01049e0 0x7fbef019af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:30:44.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:30:44.114+0000 7fbef7ca4700 1 -- 172.21.15.60:0/418734272 >> 172.21.15.60:0/418734272 conn(0x7fbef00ff9d0 msgr2=0x7fbef01086d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:30:44.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:30:44.114+0000 7fbef7ca4700 1 -- 172.21.15.60:0/418734272 shutdown_connections 2024-05-09T05:30:44.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:30:44.114+0000 7fbef7ca4700 1 -- 172.21.15.60:0/418734272 wait complete. 2024-05-09T05:30:44.742 DEBUG:teuthology.orchestra.run.smithi060:osd.4> sudo journalctl -f -n 0 -u ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@osd.4.service 2024-05-09T05:30:44.744 INFO:tasks.cephadm:Deploying osd.5 on smithi100 with /dev/vg_nvme/lv_3... 2024-05-09T05:30:44.744 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-05-09T05:30:44.992 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.c/config 2024-05-09T05:30:45.030 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:44 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:30:45.030 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:44 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:30:45.030 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:44 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:30:45.030 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:44 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:30:45.030 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:44 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:30:45.030 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:44 smithi060 ceph-mon[34555]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-05-09T05:30:45.030 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:44 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:30:45.030 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:44 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:30:45.030 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:44 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:30:45.030 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:44 smithi060 ceph-mon[34555]: from='osd.4 [v2:172.21.15.60:6808/649037162,v1:172.21.15.60:6809/649037162]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-09T05:30:45.030 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:44 smithi060 ceph-mon[34555]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-09T05:30:45.110 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:44 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:30:45.110 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:44 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:30:45.110 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:44 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:30:45.111 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:44 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:30:45.111 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:44 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:30:45.111 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:44 smithi039 ceph-mon[30439]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-05-09T05:30:45.111 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:44 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:30:45.111 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:44 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:30:45.111 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:44 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:30:45.111 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:44 smithi039 ceph-mon[30439]: from='osd.4 [v2:172.21.15.60:6808/649037162,v1:172.21.15.60:6809/649037162]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-09T05:30:45.111 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:44 smithi039 ceph-mon[30439]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-09T05:30:45.115 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:44 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:30:45.115 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:44 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:30:45.115 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:44 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:30:45.115 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:44 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:30:45.115 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:44 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:30:45.115 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:44 smithi100 ceph-mon[34353]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-05-09T05:30:45.115 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:44 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:30:45.115 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:44 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:30:45.115 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:44 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:30:45.116 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:44 smithi100 ceph-mon[34353]: from='osd.4 [v2:172.21.15.60:6808/649037162,v1:172.21.15.60:6809/649037162]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-09T05:30:45.116 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:44 smithi100 ceph-mon[34353]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-09T05:30:46.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:46 smithi039 ceph-mon[30439]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-05-09T05:30:46.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:46 smithi039 ceph-mon[30439]: from='osd.4 [v2:172.21.15.60:6808/649037162,v1:172.21.15.60:6809/649037162]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2024-05-09T05:30:46.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:46 smithi039 ceph-mon[30439]: osdmap e29: 5 total, 4 up, 5 in 2024-05-09T05:30:46.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:46 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-09T05:30:46.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:46 smithi039 ceph-mon[30439]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2024-05-09T05:30:46.372 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:46 smithi100 ceph-mon[34353]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-05-09T05:30:46.372 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:46 smithi100 ceph-mon[34353]: from='osd.4 [v2:172.21.15.60:6808/649037162,v1:172.21.15.60:6809/649037162]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2024-05-09T05:30:46.372 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:46 smithi100 ceph-mon[34353]: osdmap e29: 5 total, 4 up, 5 in 2024-05-09T05:30:46.372 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:46 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-09T05:30:46.372 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:46 smithi100 ceph-mon[34353]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2024-05-09T05:30:46.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:46 smithi060 ceph-mon[34555]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-05-09T05:30:46.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:46 smithi060 ceph-mon[34555]: from='osd.4 [v2:172.21.15.60:6808/649037162,v1:172.21.15.60:6809/649037162]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2024-05-09T05:30:46.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:46 smithi060 ceph-mon[34555]: osdmap e29: 5 total, 4 up, 5 in 2024-05-09T05:30:46.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:46 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-09T05:30:46.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:46 smithi060 ceph-mon[34555]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2024-05-09T05:30:46.548 INFO:journalctl@ceph.osd.4.smithi060.stdout:May 09 05:30:46 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-4[45677]: 2024-05-09T05:30:46.108+0000 7fb15d471700 -1 osd.4 0 waiting for initial osdmap 2024-05-09T05:30:46.548 INFO:journalctl@ceph.osd.4.smithi060.stdout:May 09 05:30:46 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-4[45677]: 2024-05-09T05:30:46.117+0000 7fb159226700 -1 osd.4 30 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T05:30:46.942 INFO:teuthology.orchestra.run.smithi100.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-05-09T05:30:46.942 INFO:teuthology.orchestra.run.smithi100.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-05-09T05:30:46.943 INFO:teuthology.orchestra.run.smithi100.stderr: stderr: 10+0 records in 2024-05-09T05:30:46.943 INFO:teuthology.orchestra.run.smithi100.stderr:10+0 records out 2024-05-09T05:30:46.943 INFO:teuthology.orchestra.run.smithi100.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0179758 s, 583 MB/s 2024-05-09T05:30:46.943 INFO:teuthology.orchestra.run.smithi100.stderr:--> Zapping successful for: 2024-05-09T05:30:47.277 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:47 smithi060 ceph-mon[34555]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-05-09T05:30:47.277 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:47 smithi060 ceph-mon[34555]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2024-05-09T05:30:47.277 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:47 smithi060 ceph-mon[34555]: osdmap e30: 5 total, 4 up, 5 in 2024-05-09T05:30:47.277 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:47 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-09T05:30:47.277 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:47 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-09T05:30:47.311 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:47 smithi100 ceph-mon[34353]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-05-09T05:30:47.311 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:47 smithi100 ceph-mon[34353]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2024-05-09T05:30:47.311 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:47 smithi100 ceph-mon[34353]: osdmap e30: 5 total, 4 up, 5 in 2024-05-09T05:30:47.311 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:47 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-09T05:30:47.311 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:47 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-09T05:30:47.360 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:47 smithi039 ceph-mon[30439]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-05-09T05:30:47.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:47 smithi039 ceph-mon[30439]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2024-05-09T05:30:47.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:47 smithi039 ceph-mon[30439]: osdmap e30: 5 total, 4 up, 5 in 2024-05-09T05:30:47.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:47 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-09T05:30:47.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:47 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-09T05:30:47.656 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi100:vg_nvme/lv_3 2024-05-09T05:30:47.904 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.c/config 2024-05-09T05:30:48.265 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:48 smithi100 ceph-mon[34353]: purged_snaps scrub starts 2024-05-09T05:30:48.265 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:48 smithi100 ceph-mon[34353]: purged_snaps scrub ok 2024-05-09T05:30:48.265 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:48 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-09T05:30:48.265 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:48 smithi100 ceph-mon[34353]: osd.4 [v2:172.21.15.60:6808/649037162,v1:172.21.15.60:6809/649037162] boot 2024-05-09T05:30:48.265 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:48 smithi100 ceph-mon[34353]: osdmap e31: 5 total, 5 up, 5 in 2024-05-09T05:30:48.265 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:48 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-09T05:30:48.265 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:48 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:30:48.265 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:48 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:30:48.265 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:48 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:30:48.266 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:48 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:30:48.266 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:48 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:30:48.266 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:48 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:30:48.266 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:48 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:30:48.266 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:48 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:30:48.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:48 smithi060 ceph-mon[34555]: purged_snaps scrub starts 2024-05-09T05:30:48.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:48 smithi060 ceph-mon[34555]: purged_snaps scrub ok 2024-05-09T05:30:48.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:48 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-09T05:30:48.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:48 smithi060 ceph-mon[34555]: osd.4 [v2:172.21.15.60:6808/649037162,v1:172.21.15.60:6809/649037162] boot 2024-05-09T05:30:48.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:48 smithi060 ceph-mon[34555]: osdmap e31: 5 total, 5 up, 5 in 2024-05-09T05:30:48.548 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:48 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-09T05:30:48.548 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:48 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:30:48.548 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:48 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:30:48.548 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:48 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:30:48.548 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:48 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:30:48.548 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:48 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:30:48.548 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:48 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:30:48.548 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:48 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:30:48.548 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:48 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:30:48.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:48 smithi039 ceph-mon[30439]: purged_snaps scrub starts 2024-05-09T05:30:48.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:48 smithi039 ceph-mon[30439]: purged_snaps scrub ok 2024-05-09T05:30:48.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:48 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-09T05:30:48.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:48 smithi039 ceph-mon[30439]: osd.4 [v2:172.21.15.60:6808/649037162,v1:172.21.15.60:6809/649037162] boot 2024-05-09T05:30:48.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:48 smithi039 ceph-mon[30439]: osdmap e31: 5 total, 5 up, 5 in 2024-05-09T05:30:48.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:48 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-09T05:30:48.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:48 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:30:48.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:48 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:30:48.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:48 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:30:48.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:48 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:30:48.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:48 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:30:48.612 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:48 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:30:48.612 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:48 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:30:48.612 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:48 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:30:49.309 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:49 smithi100 ceph-mon[34353]: Detected new or changed devices on smithi060 2024-05-09T05:30:49.309 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:49 smithi100 ceph-mon[34353]: Adjusting osd_memory_target on smithi060 to 8546M 2024-05-09T05:30:49.309 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:49 smithi100 ceph-mon[34353]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-05-09T05:30:49.309 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:49 smithi100 ceph-mon[34353]: osdmap e32: 5 total, 5 up, 5 in 2024-05-09T05:30:49.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:30:49.522+0000 7f9a1a0f1700 1 -- 172.21.15.100:0/3615107264 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a14102350 msgr2=0x7f9a14102760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:30:49.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:30:49.522+0000 7f9a1a0f1700 1 --2- 172.21.15.100:0/3615107264 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a14102350 0x7f9a14102760 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f99fc009990 tx=0x7f99fc009ca0 comp rx=0 tx=0).stop 2024-05-09T05:30:49.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:30:49.522+0000 7f9a1a0f1700 1 -- 172.21.15.100:0/3615107264 shutdown_connections 2024-05-09T05:30:49.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:30:49.522+0000 7f9a1a0f1700 1 --2- 172.21.15.100:0/3615107264 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a14102ca0 0x7f9a1410c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:30:49.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:30:49.522+0000 7f9a1a0f1700 1 --2- 172.21.15.100:0/3615107264 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9a14105900 0x7f9a14105d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:30:49.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:30:49.522+0000 7f9a1a0f1700 1 --2- 172.21.15.100:0/3615107264 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a14102350 0x7f9a14102760 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:30:49.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:30:49.522+0000 7f9a1a0f1700 1 -- 172.21.15.100:0/3615107264 >> 172.21.15.100:0/3615107264 conn(0x7f9a140fe020 msgr2=0x7f9a141004d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:30:49.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:30:49.523+0000 7f9a1a0f1700 1 -- 172.21.15.100:0/3615107264 shutdown_connections 2024-05-09T05:30:49.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:30:49.523+0000 7f9a1a0f1700 1 -- 172.21.15.100:0/3615107264 wait complete. 2024-05-09T05:30:49.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:30:49.523+0000 7f9a1a0f1700 1 Processor -- start 2024-05-09T05:30:49.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:30:49.523+0000 7f9a1a0f1700 1 -- start start 2024-05-09T05:30:49.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:30:49.523+0000 7f9a1a0f1700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9a14102350 0x7f9a1419a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:30:49.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:30:49.523+0000 7f9a1a0f1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a14102ca0 0x7f9a1419ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:30:49.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:30:49.523+0000 7f9a1a0f1700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a14105900 0x7f9a141a1de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:30:49.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:30:49.524+0000 7f9a1a0f1700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f9a1410fdc0 con 0x7f9a14102350 2024-05-09T05:30:49.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:30:49.524+0000 7f9a1a0f1700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f9a1410fc40 con 0x7f9a14102ca0 2024-05-09T05:30:49.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:30:49.524+0000 7f9a1a0f1700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f9a1410ff40 con 0x7f9a14105900 2024-05-09T05:30:49.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:30:49.524+0000 7f9a13fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a14105900 0x7f9a141a1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:30:49.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:30:49.524+0000 7f9a13fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a14105900 0x7f9a141a1de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40862/0 (socket says 172.21.15.100:40862) 2024-05-09T05:30:49.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:30:49.524+0000 7f9a137fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9a14102350 0x7f9a1419a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:30:49.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:30:49.524+0000 7f9a13fff700 1 -- 172.21.15.100:0/1540839020 learned_addr learned my addr 172.21.15.100:0/1540839020 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:30:49.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:30:49.524+0000 7f9a0affd700 1 --2- 172.21.15.100:0/1540839020 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a14102ca0 0x7f9a1419ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:30:49.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:30:49.524+0000 7f9a13fff700 1 -- 172.21.15.100:0/1540839020 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a14102ca0 msgr2=0x7f9a1419ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:30:49.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:30:49.524+0000 7f9a13fff700 1 --2- 172.21.15.100:0/1540839020 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a14102ca0 0x7f9a1419ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:30:49.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:30:49.524+0000 7f9a13fff700 1 -- 172.21.15.100:0/1540839020 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9a14102350 msgr2=0x7f9a1419a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:30:49.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:30:49.524+0000 7f9a13fff700 1 --2- 172.21.15.100:0/1540839020 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9a14102350 0x7f9a1419a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:30:49.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:30:49.524+0000 7f9a13fff700 1 -- 172.21.15.100:0/1540839020 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a141a2460 con 0x7f9a14105900 2024-05-09T05:30:49.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:30:49.524+0000 7f9a0affd700 1 --2- 172.21.15.100:0/1540839020 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a14102ca0 0x7f9a1419ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:30:49.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:30:49.524+0000 7f9a137fe700 1 --2- 172.21.15.100:0/1540839020 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9a14102350 0x7f9a1419a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T05:30:49.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:30:49.524+0000 7f9a13fff700 1 --2- 172.21.15.100:0/1540839020 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a14105900 0x7f9a141a1de0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c00ada0 tx=0x7f9a0c00c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:30:49.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:30:49.524+0000 7f9a117fa700 1 -- 172.21.15.100:0/1540839020 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a0c017020 con 0x7f9a14105900 2024-05-09T05:30:49.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:30:49.524+0000 7f9a117fa700 1 -- 172.21.15.100:0/1540839020 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9a0c00ce30 con 0x7f9a14105900 2024-05-09T05:30:49.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:30:49.524+0000 7f9a1a0f1700 1 -- 172.21.15.100:0/1540839020 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a141a2750 con 0x7f9a14105900 2024-05-09T05:30:49.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:30:49.524+0000 7f9a117fa700 1 -- 172.21.15.100:0/1540839020 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a0c005350 con 0x7f9a14105900 2024-05-09T05:30:49.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:30:49.524+0000 7f9a1a0f1700 1 -- 172.21.15.100:0/1540839020 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a141a2c40 con 0x7f9a14105900 2024-05-09T05:30:49.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:30:49.525+0000 7f9a1a0f1700 1 -- 172.21.15.100:0/1540839020 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a140512c0 con 0x7f9a14105900 2024-05-09T05:30:49.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:30:49.527+0000 7f9a117fa700 1 -- 172.21.15.100:0/1540839020 <== mon.1 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f9a0c00c980 con 0x7f9a14105900 2024-05-09T05:30:49.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:30:49.527+0000 7f9a117fa700 1 --2- 172.21.15.100:0/1540839020 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f9a000b2880 0x7f9a000b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:30:49.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:30:49.527+0000 7f9a117fa700 1 -- 172.21.15.100:0/1540839020 <== mon.1 v2:172.21.15.100:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 4101+0+0 (secure 0 0 0) 0x7f9a0c0e0e90 con 0x7f9a14105900 2024-05-09T05:30:49.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:30:49.528+0000 7f9a137fe700 1 --2- 172.21.15.100:0/1540839020 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f9a000b2880 0x7f9a000b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:30:49.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:30:49.528+0000 7f9a137fe700 1 --2- 172.21.15.100:0/1540839020 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f9a000b2880 0x7f9a000b4d90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9a1406c080 tx=0x7f9a04009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:30:49.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:30:49.531+0000 7f9a117fa700 1 -- 172.21.15.100:0/1540839020 <== mon.1 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f9a0c021020 con 0x7f9a14105900 2024-05-09T05:30:49.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:49 smithi060 ceph-mon[34555]: Detected new or changed devices on smithi060 2024-05-09T05:30:49.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:49 smithi060 ceph-mon[34555]: Adjusting osd_memory_target on smithi060 to 8546M 2024-05-09T05:30:49.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:49 smithi060 ceph-mon[34555]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-05-09T05:30:49.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:49 smithi060 ceph-mon[34555]: osdmap e32: 5 total, 5 up, 5 in 2024-05-09T05:30:49.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:49 smithi039 ceph-mon[30439]: Detected new or changed devices on smithi060 2024-05-09T05:30:49.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:49 smithi039 ceph-mon[30439]: Adjusting osd_memory_target on smithi060 to 8546M 2024-05-09T05:30:49.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:49 smithi039 ceph-mon[30439]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-05-09T05:30:49.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:49 smithi039 ceph-mon[30439]: osdmap e32: 5 total, 5 up, 5 in 2024-05-09T05:30:49.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:30:49.741+0000 7f9a1a0f1700 1 -- 172.21.15.100:0/1540839020 --> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f9a14063c00 con 0x7f9a000b2880 2024-05-09T05:30:50.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:50 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T05:30:50.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:50 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T05:30:50.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:50 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:30:50.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:50 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T05:30:50.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:50 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T05:30:50.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:50 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:30:50.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:50 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T05:30:50.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:50 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T05:30:50.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:50 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:30:51.285 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:51 smithi100 ceph-mon[34353]: from='client.24244 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T05:30:51.285 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:51 smithi100 ceph-mon[34353]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-05-09T05:30:51.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:51 smithi060 ceph-mon[34555]: from='client.24244 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T05:30:51.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:51 smithi060 ceph-mon[34555]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-05-09T05:30:51.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:51 smithi039 ceph-mon[30439]: from='client.24244 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T05:30:51.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:51 smithi039 ceph-mon[30439]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-05-09T05:30:53.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:53 smithi100 ceph-mon[34353]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-05-09T05:30:53.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:53 smithi100 ceph-mon[34353]: from='client.? 172.21.15.100:0/225428189' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b35bf704-898d-40f7-b575-90267764a5b2"}]: dispatch 2024-05-09T05:30:53.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:53 smithi100 ceph-mon[34353]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b35bf704-898d-40f7-b575-90267764a5b2"}]: dispatch 2024-05-09T05:30:53.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:53 smithi100 ceph-mon[34353]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b35bf704-898d-40f7-b575-90267764a5b2"}]': finished 2024-05-09T05:30:53.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:53 smithi100 ceph-mon[34353]: osdmap e33: 6 total, 5 up, 6 in 2024-05-09T05:30:53.425 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:53 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-09T05:30:53.425 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:53 smithi100 ceph-mon[34353]: from='client.? 172.21.15.100:0/2006089481' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap", "output-file": "/var/lib/ceph/osd/ceph-5/activate.monmap"}]: dispatch 2024-05-09T05:30:53.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:53 smithi060 ceph-mon[34555]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-05-09T05:30:53.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:53 smithi060 ceph-mon[34555]: from='client.? 172.21.15.100:0/225428189' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b35bf704-898d-40f7-b575-90267764a5b2"}]: dispatch 2024-05-09T05:30:53.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:53 smithi060 ceph-mon[34555]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b35bf704-898d-40f7-b575-90267764a5b2"}]: dispatch 2024-05-09T05:30:53.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:53 smithi060 ceph-mon[34555]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b35bf704-898d-40f7-b575-90267764a5b2"}]': finished 2024-05-09T05:30:53.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:53 smithi060 ceph-mon[34555]: osdmap e33: 6 total, 5 up, 6 in 2024-05-09T05:30:53.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:53 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-09T05:30:53.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:53 smithi060 ceph-mon[34555]: from='client.? 172.21.15.100:0/2006089481' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap", "output-file": "/var/lib/ceph/osd/ceph-5/activate.monmap"}]: dispatch 2024-05-09T05:30:53.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:53 smithi039 ceph-mon[30439]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-05-09T05:30:53.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:53 smithi039 ceph-mon[30439]: from='client.? 172.21.15.100:0/225428189' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b35bf704-898d-40f7-b575-90267764a5b2"}]: dispatch 2024-05-09T05:30:53.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:53 smithi039 ceph-mon[30439]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b35bf704-898d-40f7-b575-90267764a5b2"}]: dispatch 2024-05-09T05:30:53.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:53 smithi039 ceph-mon[30439]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b35bf704-898d-40f7-b575-90267764a5b2"}]': finished 2024-05-09T05:30:53.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:53 smithi039 ceph-mon[30439]: osdmap e33: 6 total, 5 up, 6 in 2024-05-09T05:30:53.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:53 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-09T05:30:53.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:53 smithi039 ceph-mon[30439]: from='client.? 172.21.15.100:0/2006089481' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap", "output-file": "/var/lib/ceph/osd/ceph-5/activate.monmap"}]: dispatch 2024-05-09T05:30:55.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:55 smithi100 ceph-mon[34353]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-05-09T05:30:55.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:55 smithi060 ceph-mon[34555]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-05-09T05:30:55.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:55 smithi039 ceph-mon[30439]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-05-09T05:30:57.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:57 smithi100 ceph-mon[34353]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-05-09T05:30:57.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:57 smithi060 ceph-mon[34555]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-05-09T05:30:57.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:57 smithi039 ceph-mon[30439]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-05-09T05:30:59.333 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:30:59 smithi100 ceph-mon[34353]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-05-09T05:30:59.412 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:30:59 smithi039 ceph-mon[30439]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-05-09T05:30:59.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:30:59 smithi060 ceph-mon[34555]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-05-09T05:31:00.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:00 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-09T05:31:00.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:00 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:31:00.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:00 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-09T05:31:00.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:00 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:31:00.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:00 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-09T05:31:00.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:00 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:31:01.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:01 smithi100 ceph-mon[34353]: Deploying daemon osd.5 on smithi100 2024-05-09T05:31:01.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:01 smithi100 ceph-mon[34353]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-05-09T05:31:01.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:01 smithi060 ceph-mon[34555]: Deploying daemon osd.5 on smithi100 2024-05-09T05:31:01.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:01 smithi060 ceph-mon[34555]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-05-09T05:31:01.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:01 smithi039 ceph-mon[30439]: Deploying daemon osd.5 on smithi100 2024-05-09T05:31:01.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:01 smithi039 ceph-mon[30439]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-05-09T05:31:03.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:03 smithi100 ceph-mon[34353]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-05-09T05:31:03.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:03 smithi060 ceph-mon[34555]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-05-09T05:31:03.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:03 smithi039 ceph-mon[30439]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-05-09T05:31:05.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:05 smithi060 ceph-mon[34555]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-05-09T05:31:05.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:05 smithi039 ceph-mon[30439]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-05-09T05:31:05.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:05 smithi100 ceph-mon[34353]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-05-09T05:31:06.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:06 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:31:06.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:06 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:31:06.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:06 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:31:06.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:06 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:31:06.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:06 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:31:06.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:06 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:31:06.887 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:06 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:31:06.887 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:06 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:31:06.887 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:06 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:31:07.734 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:07 smithi100 ceph-mon[34353]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-05-09T05:31:07.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:07 smithi060 ceph-mon[34555]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-05-09T05:31:07.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:07 smithi039 ceph-mon[30439]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-05-09T05:31:09.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:31:09.064+0000 7f9a117fa700 1 -- 172.21.15.100:0/1540839020 <== mgr.14152 v2:172.21.15.39:6800/3184189003 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f9a14063c00 con 0x7f9a000b2880 2024-05-09T05:31:09.059 INFO:teuthology.orchestra.run.smithi100.stdout:Created osd(s) 5 on host 'smithi100' 2024-05-09T05:31:09.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:31:09.067+0000 7f9a1a0f1700 1 -- 172.21.15.100:0/1540839020 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f9a000b2880 msgr2=0x7f9a000b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:31:09.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:31:09.067+0000 7f9a1a0f1700 1 --2- 172.21.15.100:0/1540839020 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f9a000b2880 0x7f9a000b4d90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9a1406c080 tx=0x7f9a04009260 comp rx=0 tx=0).stop 2024-05-09T05:31:09.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:31:09.067+0000 7f9a1a0f1700 1 -- 172.21.15.100:0/1540839020 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a14105900 msgr2=0x7f9a141a1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:31:09.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:31:09.067+0000 7f9a1a0f1700 1 --2- 172.21.15.100:0/1540839020 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a14105900 0x7f9a141a1de0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c00ada0 tx=0x7f9a0c00c330 comp rx=0 tx=0).stop 2024-05-09T05:31:09.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:31:09.067+0000 7f9a1a0f1700 1 -- 172.21.15.100:0/1540839020 shutdown_connections 2024-05-09T05:31:09.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:31:09.067+0000 7f9a1a0f1700 1 --2- 172.21.15.100:0/1540839020 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f9a000b2880 0x7f9a000b4d90 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:31:09.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:31:09.067+0000 7f9a1a0f1700 1 --2- 172.21.15.100:0/1540839020 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a14105900 0x7f9a141a1de0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:31:09.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:31:09.067+0000 7f9a1a0f1700 1 --2- 172.21.15.100:0/1540839020 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9a14102350 0x7f9a1419a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:31:09.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:31:09.067+0000 7f9a1a0f1700 1 --2- 172.21.15.100:0/1540839020 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a14102ca0 0x7f9a1419ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:31:09.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:31:09.067+0000 7f9a1a0f1700 1 -- 172.21.15.100:0/1540839020 >> 172.21.15.100:0/1540839020 conn(0x7f9a140fe020 msgr2=0x7f9a141088a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:31:09.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:31:09.067+0000 7f9a1a0f1700 1 -- 172.21.15.100:0/1540839020 shutdown_connections 2024-05-09T05:31:09.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:31:09.067+0000 7f9a1a0f1700 1 -- 172.21.15.100:0/1540839020 wait complete. 2024-05-09T05:31:09.669 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:09 smithi100 ceph-mon[34353]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-05-09T05:31:09.669 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:09 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:31:09.669 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:09 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:31:09.669 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:09 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:31:09.669 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:09 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:31:09.669 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:09 smithi100 ceph-mon[34353]: from='osd.5 [v2:172.21.15.100:6808/658409226,v1:172.21.15.100:6809/658409226]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-09T05:31:09.669 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:09 smithi100 ceph-mon[34353]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-09T05:31:09.703 DEBUG:teuthology.orchestra.run.smithi100:osd.5> sudo journalctl -f -n 0 -u ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@osd.5.service 2024-05-09T05:31:09.705 INFO:tasks.cephadm:Deploying osd.6 on smithi039 with /dev/vg_nvme/lv_2... 2024-05-09T05:31:09.705 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-05-09T05:31:09.734 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:09 smithi039 ceph-mon[30439]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-05-09T05:31:09.734 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:09 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:31:09.735 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:09 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:31:09.735 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:09 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:31:09.735 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:09 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:31:09.735 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:09 smithi039 ceph-mon[30439]: from='osd.5 [v2:172.21.15.100:6808/658409226,v1:172.21.15.100:6809/658409226]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-09T05:31:09.735 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:09 smithi039 ceph-mon[30439]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-09T05:31:09.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:09 smithi060 ceph-mon[34555]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-05-09T05:31:09.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:09 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:31:09.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:09 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:31:09.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:09 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:31:09.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:09 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:31:09.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:09 smithi060 ceph-mon[34555]: from='osd.5 [v2:172.21.15.100:6808/658409226,v1:172.21.15.100:6809/658409226]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-09T05:31:09.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:09 smithi060 ceph-mon[34555]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-09T05:31:09.966 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T05:31:11.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:11 smithi039 ceph-mon[30439]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-05-09T05:31:11.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:11 smithi039 ceph-mon[30439]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-05-09T05:31:11.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:11 smithi039 ceph-mon[30439]: osdmap e34: 6 total, 5 up, 6 in 2024-05-09T05:31:11.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:11 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-09T05:31:11.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:11 smithi039 ceph-mon[30439]: from='osd.5 [v2:172.21.15.100:6808/658409226,v1:172.21.15.100:6809/658409226]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-05-09T05:31:11.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:11 smithi039 ceph-mon[30439]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-05-09T05:31:11.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:11 smithi100 ceph-mon[34353]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-05-09T05:31:11.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:11 smithi100 ceph-mon[34353]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-05-09T05:31:11.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:11 smithi100 ceph-mon[34353]: osdmap e34: 6 total, 5 up, 6 in 2024-05-09T05:31:11.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:11 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-09T05:31:11.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:11 smithi100 ceph-mon[34353]: from='osd.5 [v2:172.21.15.100:6808/658409226,v1:172.21.15.100:6809/658409226]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-05-09T05:31:11.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:11 smithi100 ceph-mon[34353]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-05-09T05:31:11.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:11 smithi060 ceph-mon[34555]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-05-09T05:31:11.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:11 smithi060 ceph-mon[34555]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-05-09T05:31:11.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:11 smithi060 ceph-mon[34555]: osdmap e34: 6 total, 5 up, 6 in 2024-05-09T05:31:11.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:11 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-09T05:31:11.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:11 smithi060 ceph-mon[34555]: from='osd.5 [v2:172.21.15.100:6808/658409226,v1:172.21.15.100:6809/658409226]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-05-09T05:31:11.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:11 smithi060 ceph-mon[34555]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-05-09T05:31:12.022 INFO:teuthology.orchestra.run.smithi039.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-05-09T05:31:12.022 INFO:teuthology.orchestra.run.smithi039.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-05-09T05:31:12.022 INFO:teuthology.orchestra.run.smithi039.stderr: stderr: 10+0 records in 2024-05-09T05:31:12.022 INFO:teuthology.orchestra.run.smithi039.stderr:10+0 records out 2024-05-09T05:31:12.022 INFO:teuthology.orchestra.run.smithi039.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0102196 s, 1.0 GB/s 2024-05-09T05:31:12.023 INFO:teuthology.orchestra.run.smithi039.stderr:--> Zapping successful for: 2024-05-09T05:31:12.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:12 smithi100 ceph-mon[34353]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2024-05-09T05:31:12.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:12 smithi100 ceph-mon[34353]: osdmap e35: 6 total, 5 up, 6 in 2024-05-09T05:31:12.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:12 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-09T05:31:12.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:12 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-09T05:31:12.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:12 smithi100 ceph-mon[34353]: from='osd.5 ' entity='osd.5' 2024-05-09T05:31:12.425 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:12 smithi100 ceph-mon[34353]: osdmap e36: 6 total, 5 up, 6 in 2024-05-09T05:31:12.425 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:12 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-09T05:31:12.425 INFO:journalctl@ceph.osd.5.smithi100.stdout:May 09 05:31:12 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-5[46447]: 2024-05-09T05:31:12.049+0000 7f9c89462700 -1 osd.5 0 waiting for initial osdmap 2024-05-09T05:31:12.425 INFO:journalctl@ceph.osd.5.smithi100.stdout:May 09 05:31:12 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-5[46447]: 2024-05-09T05:31:12.184+0000 7f9c8120f700 -1 osd.5 35 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T05:31:12.523 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:12 smithi039 ceph-mon[30439]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2024-05-09T05:31:12.523 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:12 smithi039 ceph-mon[30439]: osdmap e35: 6 total, 5 up, 6 in 2024-05-09T05:31:12.523 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:12 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-09T05:31:12.523 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:12 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-09T05:31:12.524 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:12 smithi039 ceph-mon[30439]: from='osd.5 ' entity='osd.5' 2024-05-09T05:31:12.524 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:12 smithi039 ceph-mon[30439]: osdmap e36: 6 total, 5 up, 6 in 2024-05-09T05:31:12.524 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:12 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-09T05:31:12.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:12 smithi060 ceph-mon[34555]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2024-05-09T05:31:12.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:12 smithi060 ceph-mon[34555]: osdmap e35: 6 total, 5 up, 6 in 2024-05-09T05:31:12.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:12 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-09T05:31:12.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:12 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-09T05:31:12.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:12 smithi060 ceph-mon[34555]: from='osd.5 ' entity='osd.5' 2024-05-09T05:31:12.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:12 smithi060 ceph-mon[34555]: osdmap e36: 6 total, 5 up, 6 in 2024-05-09T05:31:12.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:12 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-09T05:31:12.708 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi039:vg_nvme/lv_2 2024-05-09T05:31:13.012 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T05:31:13.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:13 smithi100 ceph-mon[34353]: purged_snaps scrub starts 2024-05-09T05:31:13.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:13 smithi100 ceph-mon[34353]: purged_snaps scrub ok 2024-05-09T05:31:13.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:13 smithi100 ceph-mon[34353]: pgmap v137: 1 pgs: 1 peering; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-05-09T05:31:13.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:13 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:31:13.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:13 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:31:13.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:13 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:31:13.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:13 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:31:13.425 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:13 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:31:13.425 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:13 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:31:13.425 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:13 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:31:13.425 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:13 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:31:13.425 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:13 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:31:13.425 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:13 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:31:13.425 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:13 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:31:13.425 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:13 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:31:13.425 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:13 smithi100 ceph-mon[34353]: osd.5 [v2:172.21.15.100:6808/658409226,v1:172.21.15.100:6809/658409226] boot 2024-05-09T05:31:13.425 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:13 smithi100 ceph-mon[34353]: osdmap e37: 6 total, 6 up, 6 in 2024-05-09T05:31:13.425 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:13 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-09T05:31:13.457 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:13 smithi039 ceph-mon[30439]: purged_snaps scrub starts 2024-05-09T05:31:13.457 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:13 smithi039 ceph-mon[30439]: purged_snaps scrub ok 2024-05-09T05:31:13.457 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:13 smithi039 ceph-mon[30439]: pgmap v137: 1 pgs: 1 peering; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-05-09T05:31:13.457 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:13 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:31:13.457 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:13 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:31:13.457 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:13 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:31:13.458 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:13 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:31:13.458 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:13 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:31:13.458 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:13 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:31:13.458 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:13 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:31:13.458 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:13 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:31:13.458 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:13 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:31:13.458 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:13 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:31:13.458 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:13 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:31:13.458 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:13 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:31:13.458 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:13 smithi039 ceph-mon[30439]: osd.5 [v2:172.21.15.100:6808/658409226,v1:172.21.15.100:6809/658409226] boot 2024-05-09T05:31:13.458 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:13 smithi039 ceph-mon[30439]: osdmap e37: 6 total, 6 up, 6 in 2024-05-09T05:31:13.458 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:13 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-09T05:31:13.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:13 smithi060 ceph-mon[34555]: purged_snaps scrub starts 2024-05-09T05:31:13.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:13 smithi060 ceph-mon[34555]: purged_snaps scrub ok 2024-05-09T05:31:13.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:13 smithi060 ceph-mon[34555]: pgmap v137: 1 pgs: 1 peering; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-05-09T05:31:13.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:13 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:31:13.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:13 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:31:13.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:13 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:31:13.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:13 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:31:13.548 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:13 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:31:13.548 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:13 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:31:13.548 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:13 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:31:13.548 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:13 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:31:13.548 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:13 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:31:13.548 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:13 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:31:13.548 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:13 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:31:13.548 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:13 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:31:13.548 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:13 smithi060 ceph-mon[34555]: osd.5 [v2:172.21.15.100:6808/658409226,v1:172.21.15.100:6809/658409226] boot 2024-05-09T05:31:13.548 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:13 smithi060 ceph-mon[34555]: osdmap e37: 6 total, 6 up, 6 in 2024-05-09T05:31:13.548 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:13 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-09T05:31:14.324 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:14 smithi039 ceph-mon[30439]: Detected new or changed devices on smithi100 2024-05-09T05:31:14.324 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:14 smithi039 ceph-mon[30439]: Adjusting osd_memory_target on smithi100 to 8544M 2024-05-09T05:31:14.325 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:14 smithi039 ceph-mon[30439]: osdmap e38: 6 total, 6 up, 6 in 2024-05-09T05:31:14.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:14 smithi060 ceph-mon[34555]: Detected new or changed devices on smithi100 2024-05-09T05:31:14.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:14 smithi060 ceph-mon[34555]: Adjusting osd_memory_target on smithi100 to 8544M 2024-05-09T05:31:14.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:14 smithi060 ceph-mon[34555]: osdmap e38: 6 total, 6 up, 6 in 2024-05-09T05:31:14.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:31:14.557+0000 7f37b2c49700 1 -- 172.21.15.39:0/147596056 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f37ac1054a0 msgr2=0x7f37ac1058b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:31:14.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:31:14.557+0000 7f37b2c49700 1 --2- 172.21.15.39:0/147596056 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f37ac1054a0 0x7f37ac1058b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3798009990 tx=0x7f3798009ca0 comp rx=0 tx=0).stop 2024-05-09T05:31:14.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:31:14.557+0000 7f37b2c49700 1 -- 172.21.15.39:0/147596056 shutdown_connections 2024-05-09T05:31:14.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:31:14.557+0000 7f37b2c49700 1 --2- 172.21.15.39:0/147596056 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37ac105e40 0x7f37ac10c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:31:14.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:31:14.557+0000 7f37b2c49700 1 --2- 172.21.15.39:0/147596056 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37ac104370 0x7f37ac104780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:31:14.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:31:14.557+0000 7f37b2c49700 1 --2- 172.21.15.39:0/147596056 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f37ac1054a0 0x7f37ac1058b0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:31:14.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:31:14.557+0000 7f37b2c49700 1 -- 172.21.15.39:0/147596056 >> 172.21.15.39:0/147596056 conn(0x7f37ac0ff9d0 msgr2=0x7f37ac101e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:31:14.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:31:14.557+0000 7f37b2c49700 1 -- 172.21.15.39:0/147596056 shutdown_connections 2024-05-09T05:31:14.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:31:14.557+0000 7f37b2c49700 1 -- 172.21.15.39:0/147596056 wait complete. 2024-05-09T05:31:14.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:31:14.558+0000 7f37b2c49700 1 Processor -- start 2024-05-09T05:31:14.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:31:14.558+0000 7f37b2c49700 1 -- start start 2024-05-09T05:31:14.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:31:14.558+0000 7f37b2c49700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37ac104370 0x7f37ac078570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:31:14.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:31:14.558+0000 7f37b2c49700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f37ac1054a0 0x7f37ac076c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:31:14.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:31:14.558+0000 7f37b2c49700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37ac105e40 0x7f37ac077160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:31:14.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:31:14.558+0000 7f37b2c49700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f37ac10fdf0 con 0x7f37ac1054a0 2024-05-09T05:31:14.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:31:14.558+0000 7f37b2c49700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f37ac10fc70 con 0x7f37ac105e40 2024-05-09T05:31:14.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:31:14.558+0000 7f37b2c49700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f37ac10ff70 con 0x7f37ac104370 2024-05-09T05:31:14.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:31:14.558+0000 7f37abfff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f37ac1054a0 0x7f37ac076c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:31:14.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:31:14.558+0000 7f37abfff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f37ac1054a0 0x7f37ac076c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34994/0 (socket says 172.21.15.39:34994) 2024-05-09T05:31:14.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:31:14.558+0000 7f37abfff700 1 -- 172.21.15.39:0/1488186510 learned_addr learned my addr 172.21.15.39:0/1488186510 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:31:14.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:31:14.558+0000 7f37b11e6700 1 --2- 172.21.15.39:0/1488186510 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37ac105e40 0x7f37ac077160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:31:14.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:31:14.558+0000 7f37b09e5700 1 --2- 172.21.15.39:0/1488186510 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37ac104370 0x7f37ac078570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:31:14.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:31:14.559+0000 7f37abfff700 1 -- 172.21.15.39:0/1488186510 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37ac104370 msgr2=0x7f37ac078570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:31:14.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:31:14.559+0000 7f37abfff700 1 --2- 172.21.15.39:0/1488186510 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37ac104370 0x7f37ac078570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:31:14.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:31:14.559+0000 7f37abfff700 1 -- 172.21.15.39:0/1488186510 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37ac105e40 msgr2=0x7f37ac077160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:31:14.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:31:14.559+0000 7f37abfff700 1 --2- 172.21.15.39:0/1488186510 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37ac105e40 0x7f37ac077160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:31:14.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:31:14.559+0000 7f37abfff700 1 -- 172.21.15.39:0/1488186510 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37ac0778c0 con 0x7f37ac1054a0 2024-05-09T05:31:14.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:31:14.559+0000 7f37abfff700 1 --2- 172.21.15.39:0/1488186510 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f37ac1054a0 0x7f37ac076c20 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3798006010 tx=0x7f37980047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:31:14.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:31:14.559+0000 7f37a9ffb700 1 -- 172.21.15.39:0/1488186510 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3798027070 con 0x7f37ac1054a0 2024-05-09T05:31:14.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:31:14.559+0000 7f37a9ffb700 1 -- 172.21.15.39:0/1488186510 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f37980040c0 con 0x7f37ac1054a0 2024-05-09T05:31:14.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:31:14.559+0000 7f37a9ffb700 1 -- 172.21.15.39:0/1488186510 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3798022d90 con 0x7f37ac1054a0 2024-05-09T05:31:14.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:31:14.559+0000 7f37b2c49700 1 -- 172.21.15.39:0/1488186510 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37ac1a4a10 con 0x7f37ac1054a0 2024-05-09T05:31:14.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:31:14.559+0000 7f37b2c49700 1 -- 172.21.15.39:0/1488186510 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37ac1a4db0 con 0x7f37ac1054a0 2024-05-09T05:31:14.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:31:14.560+0000 7f37b2c49700 1 -- 172.21.15.39:0/1488186510 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37ac0512c0 con 0x7f37ac1054a0 2024-05-09T05:31:14.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:31:14.562+0000 7f37a9ffb700 1 -- 172.21.15.39:0/1488186510 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f379802a070 con 0x7f37ac1054a0 2024-05-09T05:31:14.557 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:31:14.563+0000 7f37a9ffb700 1 --2- 172.21.15.39:0/1488186510 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f379c0b2900 0x7f379c0b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:31:14.557 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:31:14.563+0000 7f37b09e5700 1 --2- 172.21.15.39:0/1488186510 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f379c0b2900 0x7f379c0b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:31:14.557 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:31:14.563+0000 7f37a9ffb700 1 -- 172.21.15.39:0/1488186510 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4533+0+0 (secure 0 0 0) 0x7f37980e23f0 con 0x7f37ac1054a0 2024-05-09T05:31:14.557 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:31:14.563+0000 7f37b09e5700 1 --2- 172.21.15.39:0/1488186510 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f379c0b2900 0x7f379c0b4e10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f37a0005950 tx=0x7f37a00058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:31:14.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:31:14.566+0000 7f37a9ffb700 1 -- 172.21.15.39:0/1488186510 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f3798013070 con 0x7f37ac1054a0 2024-05-09T05:31:14.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:14 smithi100 ceph-mon[34353]: Detected new or changed devices on smithi100 2024-05-09T05:31:14.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:14 smithi100 ceph-mon[34353]: Adjusting osd_memory_target on smithi100 to 8544M 2024-05-09T05:31:14.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:14 smithi100 ceph-mon[34353]: osdmap e38: 6 total, 6 up, 6 in 2024-05-09T05:31:14.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:31:14.793+0000 7f37b2c49700 1 -- 172.21.15.39:0/1488186510 --> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi039:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f37ac063cc0 con 0x7f379c0b2900 2024-05-09T05:31:15.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:15 smithi060 ceph-mon[34555]: pgmap v141: 1 pgs: 1 peering; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-09T05:31:15.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:15 smithi060 ceph-mon[34555]: osdmap e39: 6 total, 6 up, 6 in 2024-05-09T05:31:15.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:15 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T05:31:15.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:15 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T05:31:15.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:15 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:31:15.578 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:15 smithi039 ceph-mon[30439]: pgmap v141: 1 pgs: 1 peering; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-09T05:31:15.578 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:15 smithi039 ceph-mon[30439]: osdmap e39: 6 total, 6 up, 6 in 2024-05-09T05:31:15.578 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:15 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T05:31:15.578 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:15 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T05:31:15.578 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:15 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:31:15.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:15 smithi100 ceph-mon[34353]: pgmap v141: 1 pgs: 1 peering; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-09T05:31:15.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:15 smithi100 ceph-mon[34353]: osdmap e39: 6 total, 6 up, 6 in 2024-05-09T05:31:15.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:15 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T05:31:15.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:15 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T05:31:15.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:15 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:31:16.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:16 smithi060 ceph-mon[34555]: from='client.14361 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi039:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T05:31:16.580 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:16 smithi039 ceph-mon[30439]: from='client.14361 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi039:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T05:31:16.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:16 smithi100 ceph-mon[34353]: from='client.14361 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi039:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T05:31:17.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:17 smithi060 ceph-mon[34555]: pgmap v143: 1 pgs: 1 peering; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-09T05:31:17.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:17 smithi039 ceph-mon[30439]: pgmap v143: 1 pgs: 1 peering; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-09T05:31:17.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:17 smithi100 ceph-mon[34353]: pgmap v143: 1 pgs: 1 peering; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-09T05:31:18.360 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:18 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/3882301375' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "49eae2f5-1dad-4c2c-89f4-efa1dd1faefb"}]: dispatch 2024-05-09T05:31:18.360 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:18 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/3882301375' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "49eae2f5-1dad-4c2c-89f4-efa1dd1faefb"}]': finished 2024-05-09T05:31:18.360 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:18 smithi039 ceph-mon[30439]: osdmap e40: 7 total, 6 up, 7 in 2024-05-09T05:31:18.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:18 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-09T05:31:18.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:18 smithi060 ceph-mon[34555]: from='client.? 172.21.15.39:0/3882301375' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "49eae2f5-1dad-4c2c-89f4-efa1dd1faefb"}]: dispatch 2024-05-09T05:31:18.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:18 smithi060 ceph-mon[34555]: from='client.? 172.21.15.39:0/3882301375' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "49eae2f5-1dad-4c2c-89f4-efa1dd1faefb"}]': finished 2024-05-09T05:31:18.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:18 smithi060 ceph-mon[34555]: osdmap e40: 7 total, 6 up, 7 in 2024-05-09T05:31:18.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:18 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-09T05:31:18.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:18 smithi100 ceph-mon[34353]: from='client.? 172.21.15.39:0/3882301375' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "49eae2f5-1dad-4c2c-89f4-efa1dd1faefb"}]: dispatch 2024-05-09T05:31:18.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:18 smithi100 ceph-mon[34353]: from='client.? 172.21.15.39:0/3882301375' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "49eae2f5-1dad-4c2c-89f4-efa1dd1faefb"}]': finished 2024-05-09T05:31:18.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:18 smithi100 ceph-mon[34353]: osdmap e40: 7 total, 6 up, 7 in 2024-05-09T05:31:18.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:18 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-09T05:31:19.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:19 smithi060 ceph-mon[34555]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 117 KiB/s, 0 objects/s recovering 2024-05-09T05:31:19.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:19 smithi060 ceph-mon[34555]: from='client.? 172.21.15.39:0/15783880' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap", "output-file": "/var/lib/ceph/osd/ceph-6/activate.monmap"}]: dispatch 2024-05-09T05:31:19.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:19 smithi039 ceph-mon[30439]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 117 KiB/s, 0 objects/s recovering 2024-05-09T05:31:19.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:19 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/15783880' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap", "output-file": "/var/lib/ceph/osd/ceph-6/activate.monmap"}]: dispatch 2024-05-09T05:31:19.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:19 smithi100 ceph-mon[34353]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 117 KiB/s, 0 objects/s recovering 2024-05-09T05:31:19.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:19 smithi100 ceph-mon[34353]: from='client.? 172.21.15.39:0/15783880' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap", "output-file": "/var/lib/ceph/osd/ceph-6/activate.monmap"}]: dispatch 2024-05-09T05:31:21.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:21 smithi060 ceph-mon[34555]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-05-09T05:31:21.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:21 smithi039 ceph-mon[30439]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-05-09T05:31:21.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:21 smithi100 ceph-mon[34353]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-05-09T05:31:23.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:23 smithi060 ceph-mon[34555]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-09T05:31:23.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:23 smithi039 ceph-mon[30439]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-09T05:31:23.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:23 smithi100 ceph-mon[34353]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-09T05:31:25.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:25 smithi060 ceph-mon[34555]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-09T05:31:25.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:25 smithi039 ceph-mon[30439]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-09T05:31:25.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:25 smithi100 ceph-mon[34353]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-09T05:31:27.581 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:27 smithi039 ceph-mon[30439]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-09T05:31:27.581 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:27 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-05-09T05:31:27.581 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:27 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:31:27.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:27 smithi060 ceph-mon[34555]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-09T05:31:27.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:27 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-05-09T05:31:27.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:27 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:31:27.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:27 smithi100 ceph-mon[34353]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-09T05:31:27.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:27 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-05-09T05:31:27.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:27 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:31:28.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:28 smithi039 ceph-mon[30439]: Deploying daemon osd.6 on smithi039 2024-05-09T05:31:28.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:28 smithi060 ceph-mon[34555]: Deploying daemon osd.6 on smithi039 2024-05-09T05:31:28.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:28 smithi100 ceph-mon[34353]: Deploying daemon osd.6 on smithi039 2024-05-09T05:31:29.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:29 smithi039 ceph-mon[30439]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-09T05:31:29.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:29 smithi060 ceph-mon[34555]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-09T05:31:29.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:29 smithi100 ceph-mon[34353]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-09T05:31:31.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:31 smithi039 ceph-mon[30439]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-09T05:31:31.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:31 smithi060 ceph-mon[34555]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-09T05:31:31.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:31 smithi100 ceph-mon[34353]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-09T05:31:33.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:33 smithi039 ceph-mon[30439]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-09T05:31:33.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:33 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:31:33.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:33 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:31:33.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:33 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:31:33.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:33 smithi060 ceph-mon[34555]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-09T05:31:33.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:33 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:31:33.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:33 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:31:33.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:33 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:31:33.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:33 smithi100 ceph-mon[34353]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-09T05:31:33.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:33 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:31:33.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:33 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:31:33.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:33 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:31:35.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:35 smithi060 ceph-mon[34555]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-09T05:31:35.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:35 smithi039 ceph-mon[30439]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-09T05:31:35.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:35 smithi100 ceph-mon[34353]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-09T05:31:36.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:31:36.264+0000 7f37a9ffb700 1 -- 172.21.15.39:0/1488186510 <== mgr.14152 v2:172.21.15.39:6800/3184189003 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f37ac063cc0 con 0x7f379c0b2900 2024-05-09T05:31:36.259 INFO:teuthology.orchestra.run.smithi039.stdout:Created osd(s) 6 on host 'smithi039' 2024-05-09T05:31:36.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:31:36.267+0000 7f37b2c49700 1 -- 172.21.15.39:0/1488186510 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f379c0b2900 msgr2=0x7f379c0b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:31:36.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:31:36.267+0000 7f37b2c49700 1 --2- 172.21.15.39:0/1488186510 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f379c0b2900 0x7f379c0b4e10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f37a0005950 tx=0x7f37a00058e0 comp rx=0 tx=0).stop 2024-05-09T05:31:36.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:31:36.267+0000 7f37b2c49700 1 -- 172.21.15.39:0/1488186510 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f37ac1054a0 msgr2=0x7f37ac076c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:31:36.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:31:36.267+0000 7f37b2c49700 1 --2- 172.21.15.39:0/1488186510 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f37ac1054a0 0x7f37ac076c20 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3798006010 tx=0x7f37980047b0 comp rx=0 tx=0).stop 2024-05-09T05:31:36.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:31:36.267+0000 7f37b2c49700 1 -- 172.21.15.39:0/1488186510 shutdown_connections 2024-05-09T05:31:36.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:31:36.267+0000 7f37b2c49700 1 --2- 172.21.15.39:0/1488186510 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f379c0b2900 0x7f379c0b4e10 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:31:36.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:31:36.267+0000 7f37b2c49700 1 --2- 172.21.15.39:0/1488186510 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37ac105e40 0x7f37ac077160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:31:36.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:31:36.267+0000 7f37b2c49700 1 --2- 172.21.15.39:0/1488186510 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37ac104370 0x7f37ac078570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:31:36.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:31:36.267+0000 7f37b2c49700 1 --2- 172.21.15.39:0/1488186510 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f37ac1054a0 0x7f37ac076c20 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:31:36.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:31:36.267+0000 7f37b2c49700 1 -- 172.21.15.39:0/1488186510 >> 172.21.15.39:0/1488186510 conn(0x7f37ac0ff9d0 msgr2=0x7f37ac1086d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:31:36.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:31:36.267+0000 7f37b2c49700 1 -- 172.21.15.39:0/1488186510 shutdown_connections 2024-05-09T05:31:36.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:31:36.267+0000 7f37b2c49700 1 -- 172.21.15.39:0/1488186510 wait complete. 2024-05-09T05:31:36.988 DEBUG:teuthology.orchestra.run.smithi039:osd.6> sudo journalctl -f -n 0 -u ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@osd.6.service 2024-05-09T05:31:36.990 INFO:tasks.cephadm:Deploying osd.7 on smithi060 with /dev/vg_nvme/lv_2... 2024-05-09T05:31:36.990 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-05-09T05:31:37.247 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.b/config 2024-05-09T05:31:37.282 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:37 smithi039 ceph-mon[30439]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-09T05:31:37.282 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:37 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:31:37.282 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:37 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:31:37.282 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:37 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:31:37.283 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:37 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:31:37.283 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:37 smithi039 ceph-mon[30439]: from='osd.6 [v2:172.21.15.39:6818/237628491,v1:172.21.15.39:6819/237628491]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-05-09T05:31:37.296 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:37 smithi060 ceph-mon[34555]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-09T05:31:37.297 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:37 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:31:37.297 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:37 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:31:37.297 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:37 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:31:37.297 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:37 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:31:37.297 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:37 smithi060 ceph-mon[34555]: from='osd.6 [v2:172.21.15.39:6818/237628491,v1:172.21.15.39:6819/237628491]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-05-09T05:31:37.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:37 smithi100 ceph-mon[34353]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-09T05:31:37.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:37 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:31:37.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:37 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:31:37.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:37 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:31:37.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:37 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:31:37.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:37 smithi100 ceph-mon[34353]: from='osd.6 [v2:172.21.15.39:6818/237628491,v1:172.21.15.39:6819/237628491]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-05-09T05:31:38.621 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:38 smithi060 ceph-mon[34555]: from='osd.6 [v2:172.21.15.39:6818/237628491,v1:172.21.15.39:6819/237628491]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-05-09T05:31:38.621 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:38 smithi060 ceph-mon[34555]: osdmap e41: 7 total, 6 up, 7 in 2024-05-09T05:31:38.621 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:38 smithi060 ceph-mon[34555]: from='osd.6 [v2:172.21.15.39:6818/237628491,v1:172.21.15.39:6819/237628491]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]: dispatch 2024-05-09T05:31:38.621 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:38 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-09T05:31:38.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:38 smithi039 ceph-mon[30439]: from='osd.6 [v2:172.21.15.39:6818/237628491,v1:172.21.15.39:6819/237628491]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-05-09T05:31:38.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:38 smithi039 ceph-mon[30439]: osdmap e41: 7 total, 6 up, 7 in 2024-05-09T05:31:38.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:38 smithi039 ceph-mon[30439]: from='osd.6 [v2:172.21.15.39:6818/237628491,v1:172.21.15.39:6819/237628491]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]: dispatch 2024-05-09T05:31:38.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:38 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-09T05:31:38.861 INFO:journalctl@ceph.osd.6.smithi039.stdout:May 09 05:31:38 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-6[56339]: 2024-05-09T05:31:38.537+0000 7fc2cc992700 -1 osd.6 0 waiting for initial osdmap 2024-05-09T05:31:38.861 INFO:journalctl@ceph.osd.6.smithi039.stdout:May 09 05:31:38 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-6[56339]: 2024-05-09T05:31:38.554+0000 7fc2c8747700 -1 osd.6 42 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T05:31:38.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:38 smithi100 ceph-mon[34353]: from='osd.6 [v2:172.21.15.39:6818/237628491,v1:172.21.15.39:6819/237628491]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-05-09T05:31:38.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:38 smithi100 ceph-mon[34353]: osdmap e41: 7 total, 6 up, 7 in 2024-05-09T05:31:38.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:38 smithi100 ceph-mon[34353]: from='osd.6 [v2:172.21.15.39:6818/237628491,v1:172.21.15.39:6819/237628491]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]: dispatch 2024-05-09T05:31:38.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:38 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-09T05:31:39.190 INFO:teuthology.orchestra.run.smithi060.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-05-09T05:31:39.190 INFO:teuthology.orchestra.run.smithi060.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-05-09T05:31:39.190 INFO:teuthology.orchestra.run.smithi060.stderr: stderr: 10+0 records in 2024-05-09T05:31:39.190 INFO:teuthology.orchestra.run.smithi060.stderr:10+0 records out 2024-05-09T05:31:39.190 INFO:teuthology.orchestra.run.smithi060.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00836409 s, 1.3 GB/s 2024-05-09T05:31:39.191 INFO:teuthology.orchestra.run.smithi060.stderr:--> Zapping successful for: 2024-05-09T05:31:39.752 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:39 smithi039 ceph-mon[30439]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-09T05:31:39.752 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:39 smithi039 ceph-mon[30439]: from='osd.6 [v2:172.21.15.39:6818/237628491,v1:172.21.15.39:6819/237628491]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]': finished 2024-05-09T05:31:39.752 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:39 smithi039 ceph-mon[30439]: osdmap e42: 7 total, 6 up, 7 in 2024-05-09T05:31:39.752 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:39 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-09T05:31:39.752 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:39 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-09T05:31:39.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:39 smithi060 ceph-mon[34555]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-09T05:31:39.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:39 smithi060 ceph-mon[34555]: from='osd.6 [v2:172.21.15.39:6818/237628491,v1:172.21.15.39:6819/237628491]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]': finished 2024-05-09T05:31:39.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:39 smithi060 ceph-mon[34555]: osdmap e42: 7 total, 6 up, 7 in 2024-05-09T05:31:39.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:39 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-09T05:31:39.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:39 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-09T05:31:39.842 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi060:vg_nvme/lv_2 2024-05-09T05:31:39.877 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:39 smithi100 ceph-mon[34353]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-09T05:31:39.877 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:39 smithi100 ceph-mon[34353]: from='osd.6 [v2:172.21.15.39:6818/237628491,v1:172.21.15.39:6819/237628491]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]': finished 2024-05-09T05:31:39.877 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:39 smithi100 ceph-mon[34353]: osdmap e42: 7 total, 6 up, 7 in 2024-05-09T05:31:39.877 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:39 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-09T05:31:39.877 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:39 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-09T05:31:40.092 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.b/config 2024-05-09T05:31:40.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:40 smithi060 ceph-mon[34555]: purged_snaps scrub starts 2024-05-09T05:31:40.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:40 smithi060 ceph-mon[34555]: purged_snaps scrub ok 2024-05-09T05:31:40.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:40 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-09T05:31:40.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:40 smithi060 ceph-mon[34555]: osd.6 [v2:172.21.15.39:6818/237628491,v1:172.21.15.39:6819/237628491] boot 2024-05-09T05:31:40.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:40 smithi060 ceph-mon[34555]: osdmap e43: 7 total, 7 up, 7 in 2024-05-09T05:31:40.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:40 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-09T05:31:40.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:40 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:31:40.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:40 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:31:40.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:40 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:31:40.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:40 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:31:40.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:40 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:31:40.798 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:40 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:31:40.798 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:40 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:31:40.798 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:40 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:31:40.798 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:40 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:31:40.798 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:40 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:31:40.798 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:40 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:31:40.798 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:40 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:31:40.798 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:40 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:31:40.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:40 smithi039 ceph-mon[30439]: purged_snaps scrub starts 2024-05-09T05:31:40.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:40 smithi039 ceph-mon[30439]: purged_snaps scrub ok 2024-05-09T05:31:40.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:40 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-09T05:31:40.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:40 smithi039 ceph-mon[30439]: osd.6 [v2:172.21.15.39:6818/237628491,v1:172.21.15.39:6819/237628491] boot 2024-05-09T05:31:40.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:40 smithi039 ceph-mon[30439]: osdmap e43: 7 total, 7 up, 7 in 2024-05-09T05:31:40.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:40 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-09T05:31:40.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:40 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:31:40.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:40 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:31:40.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:40 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:31:40.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:40 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:31:40.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:40 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:31:40.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:40 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:31:40.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:40 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:31:40.862 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:40 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:31:40.862 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:40 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:31:40.862 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:40 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:31:40.862 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:40 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:31:40.862 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:40 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:31:40.862 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:40 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:31:40.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:40 smithi100 ceph-mon[34353]: purged_snaps scrub starts 2024-05-09T05:31:40.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:40 smithi100 ceph-mon[34353]: purged_snaps scrub ok 2024-05-09T05:31:40.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:40 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-09T05:31:40.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:40 smithi100 ceph-mon[34353]: osd.6 [v2:172.21.15.39:6818/237628491,v1:172.21.15.39:6819/237628491] boot 2024-05-09T05:31:40.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:40 smithi100 ceph-mon[34353]: osdmap e43: 7 total, 7 up, 7 in 2024-05-09T05:31:40.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:40 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-09T05:31:40.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:40 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:31:40.925 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:40 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:31:40.925 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:40 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:31:40.925 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:40 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:31:40.925 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:40 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:31:40.925 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:40 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:31:40.925 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:40 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:31:40.925 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:40 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:31:40.925 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:40 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:31:40.925 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:40 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:31:40.925 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:40 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:31:40.925 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:40 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:31:40.925 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:40 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:31:41.623 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:41 smithi060 ceph-mon[34555]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-09T05:31:41.623 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:41 smithi060 ceph-mon[34555]: Detected new or changed devices on smithi039 2024-05-09T05:31:41.623 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:41 smithi060 ceph-mon[34555]: Adjusting osd_memory_target on smithi039 to 5696M 2024-05-09T05:31:41.623 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:41 smithi060 ceph-mon[34555]: osdmap e44: 7 total, 7 up, 7 in 2024-05-09T05:31:41.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:31:41.666+0000 7f19c1fb1700 1 -- 172.21.15.60:0/2719729667 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19bc103f60 msgr2=0x7f19bc104370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:31:41.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:31:41.666+0000 7f19c1fb1700 1 --2- 172.21.15.60:0/2719729667 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19bc103f60 0x7f19bc104370 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f19b0009990 tx=0x7f19b0009ca0 comp rx=0 tx=0).stop 2024-05-09T05:31:41.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:31:41.666+0000 7f19c1fb1700 1 -- 172.21.15.60:0/2719729667 shutdown_connections 2024-05-09T05:31:41.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:31:41.667+0000 7f19c1fb1700 1 --2- 172.21.15.60:0/2719729667 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19bc1049e0 0x7f19bc10c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:31:41.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:31:41.667+0000 7f19c1fb1700 1 --2- 172.21.15.60:0/2719729667 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f19bc1059b0 0x7f19bc105dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:31:41.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:31:41.667+0000 7f19c1fb1700 1 --2- 172.21.15.60:0/2719729667 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19bc103f60 0x7f19bc104370 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:31:41.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:31:41.667+0000 7f19c1fb1700 1 -- 172.21.15.60:0/2719729667 >> 172.21.15.60:0/2719729667 conn(0x7f19bc0ff9d0 msgr2=0x7f19bc101e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:31:41.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:31:41.667+0000 7f19c1fb1700 1 -- 172.21.15.60:0/2719729667 shutdown_connections 2024-05-09T05:31:41.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:31:41.667+0000 7f19c1fb1700 1 -- 172.21.15.60:0/2719729667 wait complete. 2024-05-09T05:31:41.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:31:41.667+0000 7f19c1fb1700 1 Processor -- start 2024-05-09T05:31:41.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:31:41.667+0000 7f19c1fb1700 1 -- start start 2024-05-09T05:31:41.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:31:41.668+0000 7f19c1fb1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19bc103f60 0x7f19bc078570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:31:41.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:31:41.668+0000 7f19c1fb1700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f19bc1049e0 0x7f19bc076c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:31:41.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:31:41.668+0000 7f19c1fb1700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19bc1059b0 0x7f19bc077160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:31:41.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:31:41.668+0000 7f19c1fb1700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f19bc10fef0 con 0x7f19bc1049e0 2024-05-09T05:31:41.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:31:41.668+0000 7f19c1fb1700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f19bc10fd70 con 0x7f19bc103f60 2024-05-09T05:31:41.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:31:41.668+0000 7f19c1fb1700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f19bc110070 con 0x7f19bc1059b0 2024-05-09T05:31:41.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:31:41.668+0000 7f19bb7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19bc103f60 0x7f19bc078570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:31:41.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:31:41.668+0000 7f19bb7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19bc103f60 0x7f19bc078570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60520/0 (socket says 172.21.15.60:60520) 2024-05-09T05:31:41.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:31:41.668+0000 7f19bb7fe700 1 -- 172.21.15.60:0/2158794197 learned_addr learned my addr 172.21.15.60:0/2158794197 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-05-09T05:31:41.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:31:41.668+0000 7f19baffd700 1 --2- 172.21.15.60:0/2158794197 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f19bc1049e0 0x7f19bc076c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:31:41.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:31:41.668+0000 7f19bbfff700 1 --2- 172.21.15.60:0/2158794197 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19bc1059b0 0x7f19bc077160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:31:41.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:31:41.668+0000 7f19bb7fe700 1 -- 172.21.15.60:0/2158794197 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19bc1059b0 msgr2=0x7f19bc077160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:31:41.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:31:41.668+0000 7f19bb7fe700 1 --2- 172.21.15.60:0/2158794197 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19bc1059b0 0x7f19bc077160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:31:41.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:31:41.668+0000 7f19bb7fe700 1 -- 172.21.15.60:0/2158794197 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f19bc1049e0 msgr2=0x7f19bc076c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:31:41.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:31:41.668+0000 7f19bb7fe700 1 --2- 172.21.15.60:0/2158794197 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f19bc1049e0 0x7f19bc076c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:31:41.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:31:41.668+0000 7f19bb7fe700 1 -- 172.21.15.60:0/2158794197 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19bc0778c0 con 0x7f19bc103f60 2024-05-09T05:31:41.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:31:41.668+0000 7f19bbfff700 1 --2- 172.21.15.60:0/2158794197 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19bc1059b0 0x7f19bc077160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T05:31:41.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:31:41.668+0000 7f19baffd700 1 --2- 172.21.15.60:0/2158794197 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f19bc1049e0 0x7f19bc076c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T05:31:41.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:31:41.668+0000 7f19bb7fe700 1 --2- 172.21.15.60:0/2158794197 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19bc103f60 0x7f19bc078570 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f19ac00d950 tx=0x7f19ac00dc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:31:41.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:31:41.669+0000 7f19b8ff9700 1 -- 172.21.15.60:0/2158794197 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19ac016070 con 0x7f19bc103f60 2024-05-09T05:31:41.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:31:41.669+0000 7f19c1fb1700 1 -- 172.21.15.60:0/2158794197 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19bc1a4ae0 con 0x7f19bc103f60 2024-05-09T05:31:41.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:31:41.669+0000 7f19b8ff9700 1 -- 172.21.15.60:0/2158794197 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f19ac00be00 con 0x7f19bc103f60 2024-05-09T05:31:41.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:31:41.669+0000 7f19b8ff9700 1 -- 172.21.15.60:0/2158794197 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19ac00f3c0 con 0x7f19bc103f60 2024-05-09T05:31:41.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:31:41.669+0000 7f19c1fb1700 1 -- 172.21.15.60:0/2158794197 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19bc1a5010 con 0x7f19bc103f60 2024-05-09T05:31:41.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:31:41.670+0000 7f19c1fb1700 1 -- 172.21.15.60:0/2158794197 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19bc0512c0 con 0x7f19bc103f60 2024-05-09T05:31:41.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:31:41.671+0000 7f19b8ff9700 1 -- 172.21.15.60:0/2158794197 <== mon.2 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f19ac019070 con 0x7f19bc103f60 2024-05-09T05:31:41.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:31:41.672+0000 7f19b8ff9700 1 --2- 172.21.15.60:0/2158794197 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f19a40b2900 0x7f19a40b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:31:41.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:31:41.672+0000 7f19b8ff9700 1 -- 172.21.15.60:0/2158794197 <== mon.2 v2:172.21.15.60:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 4965+0+0 (secure 0 0 0) 0x7f19ac0e1980 con 0x7f19bc103f60 2024-05-09T05:31:41.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:31:41.672+0000 7f19baffd700 1 --2- 172.21.15.60:0/2158794197 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f19a40b2900 0x7f19a40b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:31:41.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:31:41.673+0000 7f19baffd700 1 --2- 172.21.15.60:0/2158794197 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f19a40b2900 0x7f19a40b4e10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f19b00038a0 tx=0x7f19b001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:31:41.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:31:41.676+0000 7f19b8ff9700 1 -- 172.21.15.60:0/2158794197 <== mon.2 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f19ac020020 con 0x7f19bc103f60 2024-05-09T05:31:41.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:41 smithi039 ceph-mon[30439]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-09T05:31:41.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:41 smithi039 ceph-mon[30439]: Detected new or changed devices on smithi039 2024-05-09T05:31:41.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:41 smithi039 ceph-mon[30439]: Adjusting osd_memory_target on smithi039 to 5696M 2024-05-09T05:31:41.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:41 smithi039 ceph-mon[30439]: osdmap e44: 7 total, 7 up, 7 in 2024-05-09T05:31:41.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:31:41.902+0000 7f19c1fb1700 1 -- 172.21.15.60:0/2158794197 --> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f19bc02ea10 con 0x7f19a40b2900 2024-05-09T05:31:41.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:41 smithi100 ceph-mon[34353]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-05-09T05:31:41.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:41 smithi100 ceph-mon[34353]: Detected new or changed devices on smithi039 2024-05-09T05:31:41.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:41 smithi100 ceph-mon[34353]: Adjusting osd_memory_target on smithi039 to 5696M 2024-05-09T05:31:41.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:41 smithi100 ceph-mon[34353]: osdmap e44: 7 total, 7 up, 7 in 2024-05-09T05:31:42.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:42 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T05:31:42.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:42 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T05:31:42.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:42 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:31:42.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:42 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T05:31:42.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:42 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T05:31:42.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:42 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:31:42.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:42 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T05:31:42.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:42 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T05:31:42.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:42 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:31:43.643 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:43 smithi060 ceph-mon[34555]: from='client.24296 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T05:31:43.643 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:43 smithi060 ceph-mon[34555]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-05-09T05:31:43.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:43 smithi039 ceph-mon[30439]: from='client.24296 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T05:31:43.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:43 smithi039 ceph-mon[30439]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-05-09T05:31:43.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:43 smithi100 ceph-mon[34353]: from='client.24296 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T05:31:43.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:43 smithi100 ceph-mon[34353]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-05-09T05:31:44.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:44 smithi039 ceph-mon[30439]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-05-09T05:31:44.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:44 smithi100 ceph-mon[34353]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-05-09T05:31:44.950 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:44 smithi060 ceph-mon[34555]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-05-09T05:31:45.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:45 smithi039 ceph-mon[30439]: from='client.? 172.21.15.60:0/3887647090' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "60ccae54-535c-4a13-98d0-881c00b5e870"}]: dispatch 2024-05-09T05:31:45.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:45 smithi039 ceph-mon[30439]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "60ccae54-535c-4a13-98d0-881c00b5e870"}]: dispatch 2024-05-09T05:31:45.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:45 smithi039 ceph-mon[30439]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "60ccae54-535c-4a13-98d0-881c00b5e870"}]': finished 2024-05-09T05:31:45.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:45 smithi039 ceph-mon[30439]: osdmap e45: 8 total, 7 up, 8 in 2024-05-09T05:31:45.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:45 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-09T05:31:45.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:45 smithi039 ceph-mon[30439]: from='client.? 172.21.15.60:0/623243048' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap", "output-file": "/var/lib/ceph/osd/ceph-7/activate.monmap"}]: dispatch 2024-05-09T05:31:45.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:45 smithi100 ceph-mon[34353]: from='client.? 172.21.15.60:0/3887647090' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "60ccae54-535c-4a13-98d0-881c00b5e870"}]: dispatch 2024-05-09T05:31:45.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:45 smithi100 ceph-mon[34353]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "60ccae54-535c-4a13-98d0-881c00b5e870"}]: dispatch 2024-05-09T05:31:45.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:45 smithi100 ceph-mon[34353]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "60ccae54-535c-4a13-98d0-881c00b5e870"}]': finished 2024-05-09T05:31:45.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:45 smithi100 ceph-mon[34353]: osdmap e45: 8 total, 7 up, 8 in 2024-05-09T05:31:45.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:45 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-09T05:31:45.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:45 smithi100 ceph-mon[34353]: from='client.? 172.21.15.60:0/623243048' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap", "output-file": "/var/lib/ceph/osd/ceph-7/activate.monmap"}]: dispatch 2024-05-09T05:31:46.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:45 smithi060 ceph-mon[34555]: from='client.? 172.21.15.60:0/3887647090' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "60ccae54-535c-4a13-98d0-881c00b5e870"}]: dispatch 2024-05-09T05:31:46.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:45 smithi060 ceph-mon[34555]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "60ccae54-535c-4a13-98d0-881c00b5e870"}]: dispatch 2024-05-09T05:31:46.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:45 smithi060 ceph-mon[34555]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "60ccae54-535c-4a13-98d0-881c00b5e870"}]': finished 2024-05-09T05:31:46.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:45 smithi060 ceph-mon[34555]: osdmap e45: 8 total, 7 up, 8 in 2024-05-09T05:31:46.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:45 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-09T05:31:46.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:45 smithi060 ceph-mon[34555]: from='client.? 172.21.15.60:0/623243048' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap", "output-file": "/var/lib/ceph/osd/ceph-7/activate.monmap"}]: dispatch 2024-05-09T05:31:46.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:46 smithi039 ceph-mon[30439]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-05-09T05:31:46.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:46 smithi100 ceph-mon[34353]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-05-09T05:31:47.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:46 smithi060 ceph-mon[34555]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-05-09T05:31:49.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:49 smithi100 ceph-mon[34353]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-05-09T05:31:49.539 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:49 smithi060 ceph-mon[34555]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-05-09T05:31:49.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:49 smithi039 ceph-mon[30439]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-05-09T05:31:51.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:51 smithi100 ceph-mon[34353]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-05-09T05:31:51.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:51 smithi060 ceph-mon[34555]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-05-09T05:31:51.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:51 smithi039 ceph-mon[30439]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-05-09T05:31:52.423 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:52 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-05-09T05:31:52.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:52 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:31:52.540 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:52 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-05-09T05:31:52.540 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:52 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:31:52.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:52 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-05-09T05:31:52.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:52 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:31:53.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:53 smithi060 ceph-mon[34555]: Deploying daemon osd.7 on smithi060 2024-05-09T05:31:53.408 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:53 smithi060 ceph-mon[34555]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-05-09T05:31:53.423 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:53 smithi100 ceph-mon[34353]: Deploying daemon osd.7 on smithi060 2024-05-09T05:31:53.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:53 smithi100 ceph-mon[34353]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-05-09T05:31:53.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:53 smithi039 ceph-mon[30439]: Deploying daemon osd.7 on smithi060 2024-05-09T05:31:53.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:53 smithi039 ceph-mon[30439]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-05-09T05:31:55.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:55 smithi100 ceph-mon[34353]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-05-09T05:31:55.449 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:55 smithi060 ceph-mon[34555]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-05-09T05:31:55.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:55 smithi039 ceph-mon[30439]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-05-09T05:31:57.546 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:57 smithi060 ceph-mon[34555]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-05-09T05:31:57.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:57 smithi039 ceph-mon[30439]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-05-09T05:31:57.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:57 smithi100 ceph-mon[34353]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-05-09T05:31:58.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:58 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:31:58.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:58 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:31:58.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:58 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:31:58.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:58 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:31:58.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:58 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:31:58.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:58 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:31:58.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:58 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:31:58.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:58 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:31:58.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:58 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:31:59.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:31:59 smithi060 ceph-mon[34555]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-05-09T05:31:59.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:31:59 smithi100 ceph-mon[34353]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-05-09T05:31:59.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:31:59 smithi039 ceph-mon[30439]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-05-09T05:32:01.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:32:01.221+0000 7f19b8ff9700 1 -- 172.21.15.60:0/2158794197 <== mgr.14152 v2:172.21.15.39:6800/3184189003 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f19bc02ea10 con 0x7f19a40b2900 2024-05-09T05:32:01.215 INFO:teuthology.orchestra.run.smithi060.stdout:Created osd(s) 7 on host 'smithi060' 2024-05-09T05:32:01.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:32:01.223+0000 7f19c1fb1700 1 -- 172.21.15.60:0/2158794197 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f19a40b2900 msgr2=0x7f19a40b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:32:01.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:32:01.223+0000 7f19c1fb1700 1 --2- 172.21.15.60:0/2158794197 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f19a40b2900 0x7f19a40b4e10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f19b00038a0 tx=0x7f19b001a040 comp rx=0 tx=0).stop 2024-05-09T05:32:01.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:32:01.223+0000 7f19c1fb1700 1 -- 172.21.15.60:0/2158794197 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19bc103f60 msgr2=0x7f19bc078570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:32:01.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:32:01.223+0000 7f19c1fb1700 1 --2- 172.21.15.60:0/2158794197 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19bc103f60 0x7f19bc078570 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f19ac00d950 tx=0x7f19ac00dc60 comp rx=0 tx=0).stop 2024-05-09T05:32:01.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:32:01.223+0000 7f19c1fb1700 1 -- 172.21.15.60:0/2158794197 shutdown_connections 2024-05-09T05:32:01.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:32:01.223+0000 7f19c1fb1700 1 --2- 172.21.15.60:0/2158794197 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f19a40b2900 0x7f19a40b4e10 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:32:01.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:32:01.223+0000 7f19c1fb1700 1 --2- 172.21.15.60:0/2158794197 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19bc1059b0 0x7f19bc077160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:32:01.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:32:01.223+0000 7f19c1fb1700 1 --2- 172.21.15.60:0/2158794197 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19bc103f60 0x7f19bc078570 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:32:01.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:32:01.223+0000 7f19c1fb1700 1 --2- 172.21.15.60:0/2158794197 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f19bc1049e0 0x7f19bc076c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:32:01.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:32:01.223+0000 7f19c1fb1700 1 -- 172.21.15.60:0/2158794197 >> 172.21.15.60:0/2158794197 conn(0x7f19bc0ff9d0 msgr2=0x7f19bc1086d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:32:01.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:32:01.224+0000 7f19c1fb1700 1 -- 172.21.15.60:0/2158794197 shutdown_connections 2024-05-09T05:32:01.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:32:01.224+0000 7f19c1fb1700 1 -- 172.21.15.60:0/2158794197 wait complete. 2024-05-09T05:32:01.530 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:01 smithi060 ceph-mon[34555]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-05-09T05:32:01.530 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:01 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:32:01.530 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:01 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:32:01.530 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:01 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:32:01.530 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:01 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:32:01.530 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:01 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:32:01.530 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:01 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:32:01.530 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:01 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:32:01.530 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:01 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:32:01.530 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:01 smithi060 ceph-mon[34555]: from='osd.7 [v2:172.21.15.60:6816/2718201647,v1:172.21.15.60:6817/2718201647]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-09T05:32:01.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:01 smithi039 ceph-mon[30439]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-05-09T05:32:01.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:01 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:32:01.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:01 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:32:01.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:01 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:32:01.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:01 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:32:01.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:01 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:32:01.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:01 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:32:01.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:01 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:32:01.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:01 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:32:01.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:01 smithi039 ceph-mon[30439]: from='osd.7 [v2:172.21.15.60:6816/2718201647,v1:172.21.15.60:6817/2718201647]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-09T05:32:01.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:01 smithi100 ceph-mon[34353]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-05-09T05:32:01.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:01 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:32:01.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:01 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:32:01.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:01 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:32:01.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:01 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:32:01.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:01 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:32:01.675 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:01 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:32:01.675 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:01 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:32:01.675 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:01 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:32:01.675 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:01 smithi100 ceph-mon[34353]: from='osd.7 [v2:172.21.15.60:6816/2718201647,v1:172.21.15.60:6817/2718201647]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-09T05:32:01.875 DEBUG:teuthology.orchestra.run.smithi060:osd.7> sudo journalctl -f -n 0 -u ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@osd.7.service 2024-05-09T05:32:01.877 INFO:tasks.cephadm:Deploying osd.8 on smithi100 with /dev/vg_nvme/lv_2... 2024-05-09T05:32:01.877 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-05-09T05:32:02.122 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.c/config 2024-05-09T05:32:03.453 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:03 smithi100 ceph-mon[34353]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-05-09T05:32:03.453 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:03 smithi100 ceph-mon[34353]: from='osd.7 [v2:172.21.15.60:6816/2718201647,v1:172.21.15.60:6817/2718201647]' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-05-09T05:32:03.453 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:03 smithi100 ceph-mon[34353]: osdmap e46: 8 total, 7 up, 8 in 2024-05-09T05:32:03.453 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:03 smithi100 ceph-mon[34353]: from='osd.7 [v2:172.21.15.60:6816/2718201647,v1:172.21.15.60:6817/2718201647]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2024-05-09T05:32:03.453 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:03 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-09T05:32:03.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:03 smithi060 ceph-mon[34555]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-05-09T05:32:03.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:03 smithi060 ceph-mon[34555]: from='osd.7 [v2:172.21.15.60:6816/2718201647,v1:172.21.15.60:6817/2718201647]' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-05-09T05:32:03.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:03 smithi060 ceph-mon[34555]: osdmap e46: 8 total, 7 up, 8 in 2024-05-09T05:32:03.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:03 smithi060 ceph-mon[34555]: from='osd.7 [v2:172.21.15.60:6816/2718201647,v1:172.21.15.60:6817/2718201647]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2024-05-09T05:32:03.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:03 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-09T05:32:03.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:03 smithi039 ceph-mon[30439]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-05-09T05:32:03.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:03 smithi039 ceph-mon[30439]: from='osd.7 [v2:172.21.15.60:6816/2718201647,v1:172.21.15.60:6817/2718201647]' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-05-09T05:32:03.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:03 smithi039 ceph-mon[30439]: osdmap e46: 8 total, 7 up, 8 in 2024-05-09T05:32:03.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:03 smithi039 ceph-mon[30439]: from='osd.7 [v2:172.21.15.60:6816/2718201647,v1:172.21.15.60:6817/2718201647]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2024-05-09T05:32:03.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:03 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-09T05:32:04.142 INFO:teuthology.orchestra.run.smithi100.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-05-09T05:32:04.142 INFO:teuthology.orchestra.run.smithi100.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-05-09T05:32:04.143 INFO:teuthology.orchestra.run.smithi100.stderr: stderr: 10+0 records in 2024-05-09T05:32:04.143 INFO:teuthology.orchestra.run.smithi100.stderr:10+0 records out 2024-05-09T05:32:04.143 INFO:teuthology.orchestra.run.smithi100.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0127118 s, 825 MB/s 2024-05-09T05:32:04.143 INFO:teuthology.orchestra.run.smithi100.stderr: stderr: 2024-05-09T05:32:04.143 INFO:teuthology.orchestra.run.smithi100.stderr:--> Zapping successful for: 2024-05-09T05:32:04.197 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:04 smithi060 ceph-mon[34555]: from='osd.7 [v2:172.21.15.60:6816/2718201647,v1:172.21.15.60:6817/2718201647]' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2024-05-09T05:32:04.197 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:04 smithi060 ceph-mon[34555]: osdmap e47: 8 total, 7 up, 8 in 2024-05-09T05:32:04.197 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:04 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-09T05:32:04.198 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 09 05:32:03 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-7[52683]: 2024-05-09T05:32:03.947+0000 7f4678bab700 -1 osd.7 0 waiting for initial osdmap 2024-05-09T05:32:04.198 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 09 05:32:03 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-7[52683]: 2024-05-09T05:32:03.961+0000 7f4670157700 -1 osd.7 48 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T05:32:04.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:04 smithi100 ceph-mon[34353]: from='osd.7 [v2:172.21.15.60:6816/2718201647,v1:172.21.15.60:6817/2718201647]' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2024-05-09T05:32:04.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:04 smithi100 ceph-mon[34353]: osdmap e47: 8 total, 7 up, 8 in 2024-05-09T05:32:04.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:04 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-09T05:32:04.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:04 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-09T05:32:04.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:04 smithi100 ceph-mon[34353]: osdmap e48: 8 total, 7 up, 8 in 2024-05-09T05:32:04.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:04 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-09T05:32:04.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:04 smithi100 ceph-mon[34353]: from='osd.7 [v2:172.21.15.60:6816/2718201647,v1:172.21.15.60:6817/2718201647]' entity='osd.7' 2024-05-09T05:32:04.502 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:04 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-09T05:32:04.502 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:04 smithi060 ceph-mon[34555]: osdmap e48: 8 total, 7 up, 8 in 2024-05-09T05:32:04.502 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:04 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-09T05:32:04.503 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:04 smithi060 ceph-mon[34555]: from='osd.7 [v2:172.21.15.60:6816/2718201647,v1:172.21.15.60:6817/2718201647]' entity='osd.7' 2024-05-09T05:32:04.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:04 smithi039 ceph-mon[30439]: from='osd.7 [v2:172.21.15.60:6816/2718201647,v1:172.21.15.60:6817/2718201647]' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2024-05-09T05:32:04.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:04 smithi039 ceph-mon[30439]: osdmap e47: 8 total, 7 up, 8 in 2024-05-09T05:32:04.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:04 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-09T05:32:04.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:04 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-09T05:32:04.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:04 smithi039 ceph-mon[30439]: osdmap e48: 8 total, 7 up, 8 in 2024-05-09T05:32:04.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:04 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-09T05:32:04.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:04 smithi039 ceph-mon[30439]: from='osd.7 [v2:172.21.15.60:6816/2718201647,v1:172.21.15.60:6817/2718201647]' entity='osd.7' 2024-05-09T05:32:04.788 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi100:vg_nvme/lv_2 2024-05-09T05:32:05.031 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.c/config 2024-05-09T05:32:05.412 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:05 smithi100 ceph-mon[34353]: purged_snaps scrub starts 2024-05-09T05:32:05.412 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:05 smithi100 ceph-mon[34353]: purged_snaps scrub ok 2024-05-09T05:32:05.412 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:05 smithi100 ceph-mon[34353]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-05-09T05:32:05.412 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:05 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-09T05:32:05.413 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:05 smithi100 ceph-mon[34353]: osd.7 [v2:172.21.15.60:6816/2718201647,v1:172.21.15.60:6817/2718201647] boot 2024-05-09T05:32:05.413 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:05 smithi100 ceph-mon[34353]: osdmap e49: 8 total, 8 up, 8 in 2024-05-09T05:32:05.413 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:05 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-09T05:32:05.413 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:05 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:32:05.413 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:05 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:32:05.413 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:05 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:32:05.413 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:05 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:32:05.413 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:05 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:32:05.413 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:05 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:32:05.413 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:05 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:32:05.413 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:05 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:32:05.413 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:05 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:32:05.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:05 smithi060 ceph-mon[34555]: purged_snaps scrub starts 2024-05-09T05:32:05.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:05 smithi060 ceph-mon[34555]: purged_snaps scrub ok 2024-05-09T05:32:05.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:05 smithi060 ceph-mon[34555]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-05-09T05:32:05.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:05 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-09T05:32:05.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:05 smithi060 ceph-mon[34555]: osd.7 [v2:172.21.15.60:6816/2718201647,v1:172.21.15.60:6817/2718201647] boot 2024-05-09T05:32:05.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:05 smithi060 ceph-mon[34555]: osdmap e49: 8 total, 8 up, 8 in 2024-05-09T05:32:05.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:05 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-09T05:32:05.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:05 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:32:05.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:05 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:32:05.548 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:05 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:32:05.548 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:05 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:32:05.548 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:05 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:32:05.548 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:05 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:32:05.548 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:05 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:32:05.548 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:05 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:32:05.548 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:05 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:32:05.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:05 smithi039 ceph-mon[30439]: purged_snaps scrub starts 2024-05-09T05:32:05.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:05 smithi039 ceph-mon[30439]: purged_snaps scrub ok 2024-05-09T05:32:05.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:05 smithi039 ceph-mon[30439]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 197 MiB used, 626 GiB / 626 GiB avail 2024-05-09T05:32:05.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:05 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-09T05:32:05.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:05 smithi039 ceph-mon[30439]: osd.7 [v2:172.21.15.60:6816/2718201647,v1:172.21.15.60:6817/2718201647] boot 2024-05-09T05:32:05.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:05 smithi039 ceph-mon[30439]: osdmap e49: 8 total, 8 up, 8 in 2024-05-09T05:32:05.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:05 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-09T05:32:05.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:05 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:32:05.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:05 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:32:05.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:05 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:32:05.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:05 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:32:05.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:05 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:32:05.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:05 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:32:05.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:05 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:32:05.612 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:05 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:32:05.612 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:05 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:32:06.493 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:06 smithi100 ceph-mon[34353]: Detected new or changed devices on smithi060 2024-05-09T05:32:06.493 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:06 smithi100 ceph-mon[34353]: Adjusting osd_memory_target on smithi060 to 5697M 2024-05-09T05:32:06.494 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:06 smithi100 ceph-mon[34353]: osdmap e50: 8 total, 8 up, 8 in 2024-05-09T05:32:06.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:06 smithi060 ceph-mon[34555]: Detected new or changed devices on smithi060 2024-05-09T05:32:06.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:06 smithi060 ceph-mon[34555]: Adjusting osd_memory_target on smithi060 to 5697M 2024-05-09T05:32:06.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:06 smithi060 ceph-mon[34555]: osdmap e50: 8 total, 8 up, 8 in 2024-05-09T05:32:06.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:06 smithi039 ceph-mon[30439]: Detected new or changed devices on smithi060 2024-05-09T05:32:06.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:06 smithi039 ceph-mon[30439]: Adjusting osd_memory_target on smithi060 to 5697M 2024-05-09T05:32:06.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:06 smithi039 ceph-mon[30439]: osdmap e50: 8 total, 8 up, 8 in 2024-05-09T05:32:06.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:32:06.740+0000 7f14c9e1e700 1 -- 172.21.15.100:0/2502216137 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14c4104e50 msgr2=0x7f14c4107270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:32:06.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:32:06.740+0000 7f14c9e1e700 1 --2- 172.21.15.100:0/2502216137 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14c4104e50 0x7f14c4107270 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f14b4009990 tx=0x7f14b4009ca0 comp rx=0 tx=0).stop 2024-05-09T05:32:06.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:32:06.740+0000 7f14c9e1e700 1 -- 172.21.15.100:0/2502216137 shutdown_connections 2024-05-09T05:32:06.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:32:06.740+0000 7f14c9e1e700 1 --2- 172.21.15.100:0/2502216137 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f14c410a110 0x7f14c410c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:32:06.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:32:06.740+0000 7f14c9e1e700 1 --2- 172.21.15.100:0/2502216137 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14c4104e50 0x7f14c4107270 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:32:06.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:32:06.740+0000 7f14c9e1e700 1 --2- 172.21.15.100:0/2502216137 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14c41077b0 0x7f14c4109bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:32:06.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:32:06.740+0000 7f14c9e1e700 1 -- 172.21.15.100:0/2502216137 >> 172.21.15.100:0/2502216137 conn(0x7f14c40fe890 msgr2=0x7f14c4100d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:32:06.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:32:06.740+0000 7f14c9e1e700 1 -- 172.21.15.100:0/2502216137 shutdown_connections 2024-05-09T05:32:06.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:32:06.740+0000 7f14c9e1e700 1 -- 172.21.15.100:0/2502216137 wait complete. 2024-05-09T05:32:06.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:32:06.741+0000 7f14c9e1e700 1 Processor -- start 2024-05-09T05:32:06.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:32:06.741+0000 7f14c9e1e700 1 -- start start 2024-05-09T05:32:06.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:32:06.741+0000 7f14c9e1e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f14c4104e50 0x7f14c41046b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:32:06.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:32:06.741+0000 7f14c9e1e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14c41077b0 0x7f14c4102d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:32:06.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:32:06.741+0000 7f14c9e1e700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14c410a110 0x7f14c41032a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:32:06.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:32:06.741+0000 7f14c9e1e700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f14c410fe50 con 0x7f14c4104e50 2024-05-09T05:32:06.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:32:06.741+0000 7f14c9e1e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f14c410fcd0 con 0x7f14c41077b0 2024-05-09T05:32:06.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:32:06.741+0000 7f14c9e1e700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f14c410ffd0 con 0x7f14c410a110 2024-05-09T05:32:06.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:32:06.741+0000 7f14c3fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14c410a110 0x7f14c41032a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:32:06.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:32:06.741+0000 7f14c3fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14c410a110 0x7f14c41032a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34104/0 (socket says 172.21.15.100:34104) 2024-05-09T05:32:06.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:32:06.741+0000 7f14c3fff700 1 -- 172.21.15.100:0/1763131096 learned_addr learned my addr 172.21.15.100:0/1763131096 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:32:06.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:32:06.742+0000 7f14c37fe700 1 --2- 172.21.15.100:0/1763131096 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f14c4104e50 0x7f14c41046b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:32:06.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:32:06.742+0000 7f14c2ffd700 1 --2- 172.21.15.100:0/1763131096 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14c41077b0 0x7f14c4102d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:32:06.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:32:06.742+0000 7f14c3fff700 1 -- 172.21.15.100:0/1763131096 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14c41077b0 msgr2=0x7f14c4102d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:32:06.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:32:06.742+0000 7f14c3fff700 1 --2- 172.21.15.100:0/1763131096 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14c41077b0 0x7f14c4102d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:32:06.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:32:06.742+0000 7f14c3fff700 1 -- 172.21.15.100:0/1763131096 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f14c4104e50 msgr2=0x7f14c41046b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:32:06.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:32:06.742+0000 7f14c3fff700 1 --2- 172.21.15.100:0/1763131096 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f14c4104e50 0x7f14c41046b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:32:06.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:32:06.742+0000 7f14c3fff700 1 -- 172.21.15.100:0/1763131096 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14c4103970 con 0x7f14c410a110 2024-05-09T05:32:06.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:32:06.742+0000 7f14c2ffd700 1 --2- 172.21.15.100:0/1763131096 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14c41077b0 0x7f14c4102d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:32:06.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:32:06.742+0000 7f14c3fff700 1 --2- 172.21.15.100:0/1763131096 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14c410a110 0x7f14c41032a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f14bc007d70 tx=0x7f14bc00a340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:32:06.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:32:06.742+0000 7f14c0ff9700 1 -- 172.21.15.100:0/1763131096 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14bc016020 con 0x7f14c410a110 2024-05-09T05:32:06.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:32:06.742+0000 7f14c9e1e700 1 -- 172.21.15.100:0/1763131096 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14c41a4a60 con 0x7f14c410a110 2024-05-09T05:32:06.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:32:06.742+0000 7f14c0ff9700 1 -- 172.21.15.100:0/1763131096 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f14bc00ad40 con 0x7f14c410a110 2024-05-09T05:32:06.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:32:06.742+0000 7f14c0ff9700 1 -- 172.21.15.100:0/1763131096 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14bc0115e0 con 0x7f14c410a110 2024-05-09T05:32:06.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:32:06.742+0000 7f14c9e1e700 1 -- 172.21.15.100:0/1763131096 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14c41a4f30 con 0x7f14c410a110 2024-05-09T05:32:06.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:32:06.743+0000 7f14c9e1e700 1 -- 172.21.15.100:0/1763131096 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14c40512c0 con 0x7f14c410a110 2024-05-09T05:32:06.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:32:06.745+0000 7f14c0ff9700 1 -- 172.21.15.100:0/1763131096 <== mon.1 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f14bc019020 con 0x7f14c410a110 2024-05-09T05:32:06.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:32:06.745+0000 7f14c0ff9700 1 --2- 172.21.15.100:0/1763131096 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f14ac0b2880 0x7f14ac0b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:32:06.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:32:06.745+0000 7f14c0ff9700 1 -- 172.21.15.100:0/1763131096 <== mon.1 v2:172.21.15.100:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5397+0+0 (secure 0 0 0) 0x7f14bc0e1b10 con 0x7f14c410a110 2024-05-09T05:32:06.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:32:06.746+0000 7f14c37fe700 1 --2- 172.21.15.100:0/1763131096 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f14ac0b2880 0x7f14ac0b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:32:06.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:32:06.746+0000 7f14c37fe700 1 --2- 172.21.15.100:0/1763131096 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f14ac0b2880 0x7f14ac0b4d90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f14b40038a0 tx=0x7f14b401a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:32:06.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:32:06.749+0000 7f14c0ff9700 1 -- 172.21.15.100:0/1763131096 <== mon.1 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f14bc020020 con 0x7f14c410a110 2024-05-09T05:32:06.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:32:06.960+0000 7f14c9e1e700 1 -- 172.21.15.100:0/1763131096 --> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f14c4103b40 con 0x7f14ac0b2880 2024-05-09T05:32:07.546 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:07 smithi060 ceph-mon[34555]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-05-09T05:32:07.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:07 smithi060 ceph-mon[34555]: osdmap e51: 8 total, 8 up, 8 in 2024-05-09T05:32:07.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:07 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T05:32:07.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:07 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T05:32:07.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:07 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:32:07.566 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:07 smithi100 ceph-mon[34353]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-05-09T05:32:07.567 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:07 smithi100 ceph-mon[34353]: osdmap e51: 8 total, 8 up, 8 in 2024-05-09T05:32:07.567 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:07 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T05:32:07.567 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:07 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T05:32:07.567 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:07 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:32:07.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:07 smithi039 ceph-mon[30439]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-05-09T05:32:07.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:07 smithi039 ceph-mon[30439]: osdmap e51: 8 total, 8 up, 8 in 2024-05-09T05:32:07.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:07 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T05:32:07.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:07 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T05:32:07.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:07 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:32:08.534 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:08 smithi100 ceph-mon[34353]: from='client.24307 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T05:32:08.546 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:08 smithi060 ceph-mon[34555]: from='client.24307 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T05:32:08.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:08 smithi039 ceph-mon[30439]: from='client.24307 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T05:32:09.546 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:09 smithi060 ceph-mon[34555]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-09T05:32:09.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:09 smithi039 ceph-mon[30439]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-09T05:32:09.675 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:09 smithi100 ceph-mon[34353]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-09T05:32:10.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:10 smithi100 ceph-mon[34353]: from='client.? 172.21.15.100:0/1822928880' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "edd52a21-0066-429f-9e98-15d1a74c53b2"}]: dispatch 2024-05-09T05:32:10.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:10 smithi100 ceph-mon[34353]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "edd52a21-0066-429f-9e98-15d1a74c53b2"}]: dispatch 2024-05-09T05:32:10.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:10 smithi100 ceph-mon[34353]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "edd52a21-0066-429f-9e98-15d1a74c53b2"}]': finished 2024-05-09T05:32:10.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:10 smithi100 ceph-mon[34353]: osdmap e52: 9 total, 8 up, 9 in 2024-05-09T05:32:10.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:10 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-09T05:32:10.546 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:10 smithi060 ceph-mon[34555]: from='client.? 172.21.15.100:0/1822928880' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "edd52a21-0066-429f-9e98-15d1a74c53b2"}]: dispatch 2024-05-09T05:32:10.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:10 smithi060 ceph-mon[34555]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "edd52a21-0066-429f-9e98-15d1a74c53b2"}]: dispatch 2024-05-09T05:32:10.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:10 smithi060 ceph-mon[34555]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "edd52a21-0066-429f-9e98-15d1a74c53b2"}]': finished 2024-05-09T05:32:10.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:10 smithi060 ceph-mon[34555]: osdmap e52: 9 total, 8 up, 9 in 2024-05-09T05:32:10.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:10 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-09T05:32:10.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:10 smithi039 ceph-mon[30439]: from='client.? 172.21.15.100:0/1822928880' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "edd52a21-0066-429f-9e98-15d1a74c53b2"}]: dispatch 2024-05-09T05:32:10.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:10 smithi039 ceph-mon[30439]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "edd52a21-0066-429f-9e98-15d1a74c53b2"}]: dispatch 2024-05-09T05:32:10.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:10 smithi039 ceph-mon[30439]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "edd52a21-0066-429f-9e98-15d1a74c53b2"}]': finished 2024-05-09T05:32:10.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:10 smithi039 ceph-mon[30439]: osdmap e52: 9 total, 8 up, 9 in 2024-05-09T05:32:10.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:10 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-09T05:32:11.546 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:11 smithi060 ceph-mon[34555]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-09T05:32:11.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:11 smithi060 ceph-mon[34555]: from='client.? 172.21.15.100:0/4291415721' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap", "output-file": "/var/lib/ceph/osd/ceph-8/activate.monmap"}]: dispatch 2024-05-09T05:32:11.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:11 smithi039 ceph-mon[30439]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-09T05:32:11.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:11 smithi039 ceph-mon[30439]: from='client.? 172.21.15.100:0/4291415721' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap", "output-file": "/var/lib/ceph/osd/ceph-8/activate.monmap"}]: dispatch 2024-05-09T05:32:11.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:11 smithi100 ceph-mon[34353]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-09T05:32:11.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:11 smithi100 ceph-mon[34353]: from='client.? 172.21.15.100:0/4291415721' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap", "output-file": "/var/lib/ceph/osd/ceph-8/activate.monmap"}]: dispatch 2024-05-09T05:32:13.546 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:13 smithi060 ceph-mon[34555]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-05-09T05:32:13.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:13 smithi039 ceph-mon[30439]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-05-09T05:32:13.641 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:13 smithi100 ceph-mon[34353]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-05-09T05:32:15.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:15 smithi060 ceph-mon[34555]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-09T05:32:15.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:15 smithi039 ceph-mon[30439]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-09T05:32:15.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:15 smithi100 ceph-mon[34353]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-09T05:32:17.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:17 smithi060 ceph-mon[34555]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-05-09T05:32:17.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:17 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-05-09T05:32:17.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:17 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:32:17.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:17 smithi039 ceph-mon[30439]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-05-09T05:32:17.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:17 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-05-09T05:32:17.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:17 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:32:17.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:17 smithi100 ceph-mon[34353]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-05-09T05:32:17.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:17 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-05-09T05:32:17.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:17 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:32:18.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:18 smithi100 ceph-mon[34353]: Deploying daemon osd.8 on smithi100 2024-05-09T05:32:18.546 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:18 smithi060 ceph-mon[34555]: Deploying daemon osd.8 on smithi100 2024-05-09T05:32:18.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:18 smithi039 ceph-mon[30439]: Deploying daemon osd.8 on smithi100 2024-05-09T05:32:19.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:19 smithi100 ceph-mon[34353]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-09T05:32:19.546 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:19 smithi060 ceph-mon[34555]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-09T05:32:19.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:19 smithi039 ceph-mon[30439]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-09T05:32:21.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:21 smithi100 ceph-mon[34353]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-05-09T05:32:21.546 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:21 smithi060 ceph-mon[34555]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-05-09T05:32:21.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:21 smithi039 ceph-mon[30439]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-05-09T05:32:23.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:23 smithi100 ceph-mon[34353]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-05-09T05:32:23.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:23 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:32:23.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:23 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:32:23.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:23 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:32:23.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:23 smithi060 ceph-mon[34555]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-05-09T05:32:23.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:23 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:32:23.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:23 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:32:23.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:23 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:32:23.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:23 smithi039 ceph-mon[30439]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-05-09T05:32:23.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:23 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:32:23.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:23 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:32:23.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:23 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:32:25.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:25 smithi100 ceph-mon[34353]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-09T05:32:25.546 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:25 smithi060 ceph-mon[34555]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-09T05:32:25.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:25 smithi039 ceph-mon[30439]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-09T05:32:26.180 INFO:teuthology.orchestra.run.smithi100.stdout:Created osd(s) 8 on host 'smithi100' 2024-05-09T05:32:26.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:32:26.185+0000 7f14c0ff9700 1 -- 172.21.15.100:0/1763131096 <== mgr.14152 v2:172.21.15.39:6800/3184189003 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f14c4103b40 con 0x7f14ac0b2880 2024-05-09T05:32:26.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:32:26.187+0000 7f14c9e1e700 1 -- 172.21.15.100:0/1763131096 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f14ac0b2880 msgr2=0x7f14ac0b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:32:26.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:32:26.187+0000 7f14c9e1e700 1 --2- 172.21.15.100:0/1763131096 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f14ac0b2880 0x7f14ac0b4d90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f14b40038a0 tx=0x7f14b401a040 comp rx=0 tx=0).stop 2024-05-09T05:32:26.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:32:26.187+0000 7f14c9e1e700 1 -- 172.21.15.100:0/1763131096 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14c410a110 msgr2=0x7f14c41032a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:32:26.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:32:26.187+0000 7f14c9e1e700 1 --2- 172.21.15.100:0/1763131096 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14c410a110 0x7f14c41032a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f14bc007d70 tx=0x7f14bc00a340 comp rx=0 tx=0).stop 2024-05-09T05:32:26.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:32:26.187+0000 7f14c9e1e700 1 -- 172.21.15.100:0/1763131096 shutdown_connections 2024-05-09T05:32:26.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:32:26.187+0000 7f14c9e1e700 1 --2- 172.21.15.100:0/1763131096 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f14ac0b2880 0x7f14ac0b4d90 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:32:26.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:32:26.187+0000 7f14c9e1e700 1 --2- 172.21.15.100:0/1763131096 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14c410a110 0x7f14c41032a0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:32:26.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:32:26.187+0000 7f14c9e1e700 1 --2- 172.21.15.100:0/1763131096 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f14c4104e50 0x7f14c41046b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:32:26.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:32:26.187+0000 7f14c9e1e700 1 --2- 172.21.15.100:0/1763131096 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14c41077b0 0x7f14c4102d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:32:26.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:32:26.187+0000 7f14c9e1e700 1 -- 172.21.15.100:0/1763131096 >> 172.21.15.100:0/1763131096 conn(0x7f14c40fe890 msgr2=0x7f14c4105980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:32:26.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:32:26.187+0000 7f14c9e1e700 1 -- 172.21.15.100:0/1763131096 shutdown_connections 2024-05-09T05:32:26.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:32:26.187+0000 7f14c9e1e700 1 -- 172.21.15.100:0/1763131096 wait complete. 2024-05-09T05:32:26.829 DEBUG:teuthology.orchestra.run.smithi100:osd.8> sudo journalctl -f -n 0 -u ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@osd.8.service 2024-05-09T05:32:26.831 INFO:tasks.cephadm:Deploying osd.9 on smithi039 with /dev/vg_nvme/lv_1... 2024-05-09T05:32:26.832 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-05-09T05:32:27.097 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T05:32:27.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:27 smithi100 ceph-mon[34353]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-09T05:32:27.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:27 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:32:27.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:27 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:32:27.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:27 smithi100 ceph-mon[34353]: from='osd.8 [v2:172.21.15.100:6816/1757558317,v1:172.21.15.100:6817/1757558317]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-09T05:32:27.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:27 smithi100 ceph-mon[34353]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-09T05:32:27.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:27 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:32:27.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:27 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:32:27.446 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:27 smithi039 ceph-mon[30439]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-09T05:32:27.446 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:27 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:32:27.446 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:27 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:32:27.446 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:27 smithi039 ceph-mon[30439]: from='osd.8 [v2:172.21.15.100:6816/1757558317,v1:172.21.15.100:6817/1757558317]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-09T05:32:27.446 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:27 smithi039 ceph-mon[30439]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-09T05:32:27.446 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:27 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:32:27.446 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:27 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:32:27.546 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:27 smithi060 ceph-mon[34555]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-09T05:32:27.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:27 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:32:27.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:27 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:32:27.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:27 smithi060 ceph-mon[34555]: from='osd.8 [v2:172.21.15.100:6816/1757558317,v1:172.21.15.100:6817/1757558317]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-09T05:32:27.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:27 smithi060 ceph-mon[34555]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-09T05:32:27.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:27 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:32:27.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:27 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:32:28.558 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:28 smithi100 ceph-mon[34353]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-05-09T05:32:28.558 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:28 smithi100 ceph-mon[34353]: osdmap e53: 9 total, 8 up, 9 in 2024-05-09T05:32:28.558 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:28 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-09T05:32:28.558 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:28 smithi100 ceph-mon[34353]: from='osd.8 [v2:172.21.15.100:6816/1757558317,v1:172.21.15.100:6817/1757558317]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-05-09T05:32:28.558 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:28 smithi100 ceph-mon[34353]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-05-09T05:32:28.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:28 smithi039 ceph-mon[30439]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-05-09T05:32:28.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:28 smithi039 ceph-mon[30439]: osdmap e53: 9 total, 8 up, 9 in 2024-05-09T05:32:28.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:28 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-09T05:32:28.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:28 smithi039 ceph-mon[30439]: from='osd.8 [v2:172.21.15.100:6816/1757558317,v1:172.21.15.100:6817/1757558317]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-05-09T05:32:28.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:28 smithi039 ceph-mon[30439]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-05-09T05:32:28.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:28 smithi060 ceph-mon[34555]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-05-09T05:32:28.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:28 smithi060 ceph-mon[34555]: osdmap e53: 9 total, 8 up, 9 in 2024-05-09T05:32:28.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:28 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-09T05:32:28.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:28 smithi060 ceph-mon[34555]: from='osd.8 [v2:172.21.15.100:6816/1757558317,v1:172.21.15.100:6817/1757558317]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-05-09T05:32:28.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:28 smithi060 ceph-mon[34555]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-05-09T05:32:29.347 INFO:teuthology.orchestra.run.smithi039.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-05-09T05:32:29.347 INFO:teuthology.orchestra.run.smithi039.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-05-09T05:32:29.347 INFO:teuthology.orchestra.run.smithi039.stderr: stderr: 10+0 records in 2024-05-09T05:32:29.347 INFO:teuthology.orchestra.run.smithi039.stderr:10+0 records out 2024-05-09T05:32:29.347 INFO:teuthology.orchestra.run.smithi039.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0112179 s, 935 MB/s 2024-05-09T05:32:29.347 INFO:teuthology.orchestra.run.smithi039.stderr:--> Zapping successful for: 2024-05-09T05:32:29.579 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:29 smithi100 ceph-mon[34353]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-09T05:32:29.579 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:29 smithi100 ceph-mon[34353]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2024-05-09T05:32:29.579 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:29 smithi100 ceph-mon[34353]: osdmap e54: 9 total, 8 up, 9 in 2024-05-09T05:32:29.580 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:29 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-09T05:32:29.580 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:29 smithi100 ceph-mon[34353]: from='osd.8 ' entity='osd.8' 2024-05-09T05:32:29.580 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 05:32:29 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-8[53004]: 2024-05-09T05:32:29.264+0000 7f47fa2eb700 -1 osd.8 0 waiting for initial osdmap 2024-05-09T05:32:29.580 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 05:32:29 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-8[53004]: 2024-05-09T05:32:29.464+0000 7f47f2098700 -1 osd.8 55 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T05:32:29.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:29 smithi039 ceph-mon[30439]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-09T05:32:29.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:29 smithi039 ceph-mon[30439]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2024-05-09T05:32:29.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:29 smithi039 ceph-mon[30439]: osdmap e54: 9 total, 8 up, 9 in 2024-05-09T05:32:29.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:29 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-09T05:32:29.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:29 smithi039 ceph-mon[30439]: from='osd.8 ' entity='osd.8' 2024-05-09T05:32:29.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:29 smithi060 ceph-mon[34555]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-09T05:32:29.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:29 smithi060 ceph-mon[34555]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2024-05-09T05:32:29.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:29 smithi060 ceph-mon[34555]: osdmap e54: 9 total, 8 up, 9 in 2024-05-09T05:32:29.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:29 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-09T05:32:29.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:29 smithi060 ceph-mon[34555]: from='osd.8 ' entity='osd.8' 2024-05-09T05:32:30.169 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi039:vg_nvme/lv_1 2024-05-09T05:32:30.434 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T05:32:30.557 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:30 smithi039 ceph-mon[30439]: purged_snaps scrub starts 2024-05-09T05:32:30.557 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:30 smithi039 ceph-mon[30439]: purged_snaps scrub ok 2024-05-09T05:32:30.557 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:30 smithi039 ceph-mon[30439]: osdmap e55: 9 total, 8 up, 9 in 2024-05-09T05:32:30.557 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:30 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-09T05:32:30.558 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:30 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-09T05:32:30.558 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:30 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:32:30.558 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:30 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:32:30.558 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:30 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:32:30.558 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:30 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:32:30.558 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:30 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:32:30.558 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:30 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:32:30.558 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:30 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:32:30.558 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:30 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:32:30.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:30 smithi100 ceph-mon[34353]: purged_snaps scrub starts 2024-05-09T05:32:30.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:30 smithi100 ceph-mon[34353]: purged_snaps scrub ok 2024-05-09T05:32:30.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:30 smithi100 ceph-mon[34353]: osdmap e55: 9 total, 8 up, 9 in 2024-05-09T05:32:30.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:30 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-09T05:32:30.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:30 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-09T05:32:30.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:30 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:32:30.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:30 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:32:30.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:30 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:32:30.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:30 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:32:30.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:30 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:32:30.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:30 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:32:30.675 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:30 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:32:30.675 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:30 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:32:30.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:30 smithi060 ceph-mon[34555]: purged_snaps scrub starts 2024-05-09T05:32:30.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:30 smithi060 ceph-mon[34555]: purged_snaps scrub ok 2024-05-09T05:32:30.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:30 smithi060 ceph-mon[34555]: osdmap e55: 9 total, 8 up, 9 in 2024-05-09T05:32:30.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:30 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-09T05:32:30.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:30 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-09T05:32:30.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:30 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:32:30.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:30 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:32:30.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:30 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:32:30.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:30 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:32:30.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:30 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:32:30.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:30 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:32:30.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:30 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:32:30.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:30 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:32:31.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:31 smithi039 ceph-mon[30439]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-09T05:32:31.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:31 smithi039 ceph-mon[30439]: Detected new or changed devices on smithi100 2024-05-09T05:32:31.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:31 smithi039 ceph-mon[30439]: Adjusting osd_memory_target on smithi100 to 5696M 2024-05-09T05:32:31.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:31 smithi039 ceph-mon[30439]: osd.8 [v2:172.21.15.100:6816/1757558317,v1:172.21.15.100:6817/1757558317] boot 2024-05-09T05:32:31.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:31 smithi039 ceph-mon[30439]: osdmap e56: 9 total, 9 up, 9 in 2024-05-09T05:32:31.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:31 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-09T05:32:31.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:31 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:32:31.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:31 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:32:31.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:31 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:32:31.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:31 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:32:31.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:31 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:32:31.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:31 smithi039 ceph-mon[30439]: osdmap e57: 9 total, 9 up, 9 in 2024-05-09T05:32:31.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:31 smithi100 ceph-mon[34353]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-09T05:32:31.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:31 smithi100 ceph-mon[34353]: Detected new or changed devices on smithi100 2024-05-09T05:32:31.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:31 smithi100 ceph-mon[34353]: Adjusting osd_memory_target on smithi100 to 5696M 2024-05-09T05:32:31.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:31 smithi100 ceph-mon[34353]: osd.8 [v2:172.21.15.100:6816/1757558317,v1:172.21.15.100:6817/1757558317] boot 2024-05-09T05:32:31.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:31 smithi100 ceph-mon[34353]: osdmap e56: 9 total, 9 up, 9 in 2024-05-09T05:32:31.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:31 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-09T05:32:31.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:31 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:32:31.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:31 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:32:31.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:31 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:32:31.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:31 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:32:31.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:31 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:32:31.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:31 smithi100 ceph-mon[34353]: osdmap e57: 9 total, 9 up, 9 in 2024-05-09T05:32:31.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:31 smithi060 ceph-mon[34555]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-05-09T05:32:31.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:31 smithi060 ceph-mon[34555]: Detected new or changed devices on smithi100 2024-05-09T05:32:31.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:31 smithi060 ceph-mon[34555]: Adjusting osd_memory_target on smithi100 to 5696M 2024-05-09T05:32:31.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:31 smithi060 ceph-mon[34555]: osd.8 [v2:172.21.15.100:6816/1757558317,v1:172.21.15.100:6817/1757558317] boot 2024-05-09T05:32:31.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:31 smithi060 ceph-mon[34555]: osdmap e56: 9 total, 9 up, 9 in 2024-05-09T05:32:31.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:31 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-09T05:32:31.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:31 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:32:31.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:31 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:32:31.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:31 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:32:31.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:31 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:32:31.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:31 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:32:31.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:31 smithi060 ceph-mon[34555]: osdmap e57: 9 total, 9 up, 9 in 2024-05-09T05:32:32.176 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:32:32.182+0000 7f7ec4e39700 1 -- 172.21.15.39:0/3864116820 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ec0104d00 msgr2=0x7f7ec010b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:32:32.176 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:32:32.182+0000 7f7ec4e39700 1 --2- 172.21.15.39:0/3864116820 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ec0104d00 0x7f7ec010b5b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7eb800b0a0 tx=0x7f7eb800b3b0 comp rx=0 tx=0).stop 2024-05-09T05:32:32.177 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:32:32.182+0000 7f7ec4e39700 1 -- 172.21.15.39:0/3864116820 shutdown_connections 2024-05-09T05:32:32.177 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:32:32.182+0000 7f7ec4e39700 1 --2- 172.21.15.39:0/3864116820 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ec0104d00 0x7f7ec010b5b0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:32:32.177 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:32:32.182+0000 7f7ec4e39700 1 --2- 172.21.15.39:0/3864116820 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ec0103230 0x7f7ec0103640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:32:32.177 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:32:32.182+0000 7f7ec4e39700 1 --2- 172.21.15.39:0/3864116820 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ec0104360 0x7f7ec0104770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:32:32.177 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:32:32.182+0000 7f7ec4e39700 1 -- 172.21.15.39:0/3864116820 >> 172.21.15.39:0/3864116820 conn(0x7f7ec00fe870 msgr2=0x7f7ec0100d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:32:32.177 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:32:32.182+0000 7f7ec4e39700 1 -- 172.21.15.39:0/3864116820 shutdown_connections 2024-05-09T05:32:32.177 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:32:32.182+0000 7f7ec4e39700 1 -- 172.21.15.39:0/3864116820 wait complete. 2024-05-09T05:32:32.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:32:32.183+0000 7f7ec4e39700 1 Processor -- start 2024-05-09T05:32:32.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:32:32.183+0000 7f7ec4e39700 1 -- start start 2024-05-09T05:32:32.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:32:32.183+0000 7f7ec4e39700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ec0103230 0x7f7ec019a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:32:32.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:32:32.183+0000 7f7ec4e39700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ec0104360 0x7f7ec019ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:32:32.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:32:32.183+0000 7f7ec4e39700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ec0104d00 0x7f7ec01a1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:32:32.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:32:32.183+0000 7f7ec4e39700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f7ec010ec90 con 0x7f7ec0104360 2024-05-09T05:32:32.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:32:32.183+0000 7f7ec4e39700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f7ec010eb10 con 0x7f7ec0103230 2024-05-09T05:32:32.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:32:32.183+0000 7f7ec4e39700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7ec010ee10 con 0x7f7ec0104d00 2024-05-09T05:32:32.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:32:32.183+0000 7f7ebdd9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ec0104360 0x7f7ec019ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:32:32.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:32:32.183+0000 7f7ebdd9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ec0104360 0x7f7ec019ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:51468/0 (socket says 172.21.15.39:51468) 2024-05-09T05:32:32.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:32:32.183+0000 7f7ebdd9b700 1 -- 172.21.15.39:0/3239546199 learned_addr learned my addr 172.21.15.39:0/3239546199 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:32:32.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:32:32.183+0000 7f7ebed9d700 1 --2- 172.21.15.39:0/3239546199 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ec0104d00 0x7f7ec01a1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:32:32.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:32:32.183+0000 7f7ebe59c700 1 --2- 172.21.15.39:0/3239546199 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ec0103230 0x7f7ec019a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:32:32.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:32:32.184+0000 7f7ebdd9b700 1 -- 172.21.15.39:0/3239546199 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ec0104d00 msgr2=0x7f7ec01a1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:32:32.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:32:32.184+0000 7f7ebdd9b700 1 --2- 172.21.15.39:0/3239546199 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ec0104d00 0x7f7ec01a1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:32:32.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:32:32.184+0000 7f7ebdd9b700 1 -- 172.21.15.39:0/3239546199 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ec0103230 msgr2=0x7f7ec019a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:32:32.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:32:32.184+0000 7f7ebdd9b700 1 --2- 172.21.15.39:0/3239546199 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ec0103230 0x7f7ec019a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:32:32.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:32:32.184+0000 7f7ebdd9b700 1 -- 172.21.15.39:0/3239546199 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ec01a2370 con 0x7f7ec0104360 2024-05-09T05:32:32.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:32:32.184+0000 7f7ebdd9b700 1 --2- 172.21.15.39:0/3239546199 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ec0104360 0x7f7ec019ade0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7eb400c9b0 tx=0x7f7eb400ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:32:32.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:32:32.184+0000 7f7eaf7fe700 1 -- 172.21.15.39:0/3239546199 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eb4007b00 con 0x7f7ec0104360 2024-05-09T05:32:32.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:32:32.184+0000 7f7eaf7fe700 1 -- 172.21.15.39:0/3239546199 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7eb400ce50 con 0x7f7ec0104360 2024-05-09T05:32:32.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:32:32.184+0000 7f7ec4e39700 1 -- 172.21.15.39:0/3239546199 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ec01a2660 con 0x7f7ec0104360 2024-05-09T05:32:32.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:32:32.184+0000 7f7eaf7fe700 1 -- 172.21.15.39:0/3239546199 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eb4018660 con 0x7f7ec0104360 2024-05-09T05:32:32.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:32:32.184+0000 7f7ec4e39700 1 -- 172.21.15.39:0/3239546199 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ec01a2bf0 con 0x7f7ec0104360 2024-05-09T05:32:32.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:32:32.185+0000 7f7ec4e39700 1 -- 172.21.15.39:0/3239546199 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ec00512c0 con 0x7f7ec0104360 2024-05-09T05:32:32.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:32:32.187+0000 7f7eaf7fe700 1 -- 172.21.15.39:0/3239546199 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f7eb400f450 con 0x7f7ec0104360 2024-05-09T05:32:32.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:32:32.187+0000 7f7eaf7fe700 1 --2- 172.21.15.39:0/3239546199 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f7ea80b2900 0x7f7ea80b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:32:32.182 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:32:32.188+0000 7f7ebe59c700 1 --2- 172.21.15.39:0/3239546199 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f7ea80b2900 0x7f7ea80b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:32:32.182 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:32:32.188+0000 7f7eaf7fe700 1 -- 172.21.15.39:0/3239546199 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5829+0+0 (secure 0 0 0) 0x7f7eb40e1990 con 0x7f7ec0104360 2024-05-09T05:32:32.182 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:32:32.188+0000 7f7ebe59c700 1 --2- 172.21.15.39:0/3239546199 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f7ea80b2900 0x7f7ea80b4e10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7ec0104260 tx=0x7f7eb000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:32:32.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:32:32.191+0000 7f7eaf7fe700 1 -- 172.21.15.39:0/3239546199 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f7eb4014030 con 0x7f7ec0104360 2024-05-09T05:32:32.412 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:32:32.419+0000 7f7ec4e39700 1 -- 172.21.15.39:0/3239546199 --> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi039:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f7ec01a2f00 con 0x7f7ea80b2900 2024-05-09T05:32:33.595 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:33 smithi039 ceph-mon[30439]: pgmap v199: 1 pgs: 1 remapped+peering; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-05-09T05:32:33.595 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:33 smithi039 ceph-mon[30439]: osdmap e58: 9 total, 9 up, 9 in 2024-05-09T05:32:33.596 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:33 smithi039 ceph-mon[30439]: from='client.14424 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi039:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T05:32:33.596 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:33 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T05:32:33.596 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:33 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T05:32:33.596 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:33 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:32:33.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:33 smithi100 ceph-mon[34353]: pgmap v199: 1 pgs: 1 remapped+peering; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-05-09T05:32:33.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:33 smithi100 ceph-mon[34353]: osdmap e58: 9 total, 9 up, 9 in 2024-05-09T05:32:33.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:33 smithi100 ceph-mon[34353]: from='client.14424 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi039:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T05:32:33.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:33 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T05:32:33.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:33 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T05:32:33.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:33 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:32:33.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:33 smithi060 ceph-mon[34555]: pgmap v199: 1 pgs: 1 remapped+peering; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-05-09T05:32:33.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:33 smithi060 ceph-mon[34555]: osdmap e58: 9 total, 9 up, 9 in 2024-05-09T05:32:33.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:33 smithi060 ceph-mon[34555]: from='client.14424 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi039:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T05:32:33.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:33 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T05:32:33.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:33 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T05:32:33.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:33 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:32:35.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:35 smithi039 ceph-mon[30439]: pgmap v201: 1 pgs: 1 remapped+peering; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-05-09T05:32:35.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:35 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/1226549750' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "03fb7543-3386-49a4-b165-1007f07d88d0"}]: dispatch 2024-05-09T05:32:35.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:35 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/1226549750' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "03fb7543-3386-49a4-b165-1007f07d88d0"}]': finished 2024-05-09T05:32:35.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:35 smithi039 ceph-mon[30439]: osdmap e59: 10 total, 9 up, 10 in 2024-05-09T05:32:35.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:35 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-09T05:32:35.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:35 smithi100 ceph-mon[34353]: pgmap v201: 1 pgs: 1 remapped+peering; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-05-09T05:32:35.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:35 smithi100 ceph-mon[34353]: from='client.? 172.21.15.39:0/1226549750' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "03fb7543-3386-49a4-b165-1007f07d88d0"}]: dispatch 2024-05-09T05:32:35.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:35 smithi100 ceph-mon[34353]: from='client.? 172.21.15.39:0/1226549750' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "03fb7543-3386-49a4-b165-1007f07d88d0"}]': finished 2024-05-09T05:32:35.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:35 smithi100 ceph-mon[34353]: osdmap e59: 10 total, 9 up, 10 in 2024-05-09T05:32:35.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:35 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-09T05:32:35.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:35 smithi060 ceph-mon[34555]: pgmap v201: 1 pgs: 1 remapped+peering; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-05-09T05:32:35.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:35 smithi060 ceph-mon[34555]: from='client.? 172.21.15.39:0/1226549750' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "03fb7543-3386-49a4-b165-1007f07d88d0"}]: dispatch 2024-05-09T05:32:35.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:35 smithi060 ceph-mon[34555]: from='client.? 172.21.15.39:0/1226549750' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "03fb7543-3386-49a4-b165-1007f07d88d0"}]': finished 2024-05-09T05:32:35.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:35 smithi060 ceph-mon[34555]: osdmap e59: 10 total, 9 up, 10 in 2024-05-09T05:32:35.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:35 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-09T05:32:37.046 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:36 smithi060 ceph-mon[34555]: from='client.? 172.21.15.39:0/1051008032' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap", "output-file": "/var/lib/ceph/osd/ceph-9/activate.monmap"}]: dispatch 2024-05-09T05:32:37.110 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:36 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/1051008032' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap", "output-file": "/var/lib/ceph/osd/ceph-9/activate.monmap"}]: dispatch 2024-05-09T05:32:37.174 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:36 smithi100 ceph-mon[34353]: from='client.? 172.21.15.39:0/1051008032' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap", "output-file": "/var/lib/ceph/osd/ceph-9/activate.monmap"}]: dispatch 2024-05-09T05:32:38.046 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:37 smithi060 ceph-mon[34555]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail; 100 KiB/s, 0 objects/s recovering 2024-05-09T05:32:38.110 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:37 smithi039 ceph-mon[30439]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail; 100 KiB/s, 0 objects/s recovering 2024-05-09T05:32:38.173 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:37 smithi100 ceph-mon[34353]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail; 100 KiB/s, 0 objects/s recovering 2024-05-09T05:32:39.046 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:38 smithi060 ceph-mon[34555]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 85 KiB/s, 0 objects/s recovering 2024-05-09T05:32:39.110 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:38 smithi039 ceph-mon[30439]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 85 KiB/s, 0 objects/s recovering 2024-05-09T05:32:39.173 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:38 smithi100 ceph-mon[34353]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 85 KiB/s, 0 objects/s recovering 2024-05-09T05:32:41.423 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:41 smithi100 ceph-mon[34353]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-09T05:32:41.546 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:41 smithi060 ceph-mon[34555]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-09T05:32:41.593 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:41 smithi039 ceph-mon[30439]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-09T05:32:43.423 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:43 smithi100 ceph-mon[34353]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-05-09T05:32:43.546 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:43 smithi060 ceph-mon[34555]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-05-09T05:32:43.603 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:43 smithi039 ceph-mon[30439]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-05-09T05:32:44.423 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:44 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-05-09T05:32:44.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:44 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:32:44.456 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:44 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-05-09T05:32:44.457 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:44 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:32:44.546 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:44 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-05-09T05:32:44.546 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:44 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:32:45.360 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:45 smithi039 ceph-mon[30439]: Deploying daemon osd.9 on smithi039 2024-05-09T05:32:45.360 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:45 smithi039 ceph-mon[30439]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-09T05:32:45.546 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:45 smithi060 ceph-mon[34555]: Deploying daemon osd.9 on smithi039 2024-05-09T05:32:45.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:45 smithi060 ceph-mon[34555]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-09T05:32:45.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:45 smithi100 ceph-mon[34353]: Deploying daemon osd.9 on smithi039 2024-05-09T05:32:45.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:45 smithi100 ceph-mon[34353]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-09T05:32:47.360 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:47 smithi039 ceph-mon[30439]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-05-09T05:32:47.546 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:47 smithi060 ceph-mon[34555]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-05-09T05:32:47.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:47 smithi100 ceph-mon[34353]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-05-09T05:32:49.274 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:49 smithi039 ceph-mon[30439]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-05-09T05:32:49.546 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:49 smithi060 ceph-mon[34555]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-05-09T05:32:49.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:49 smithi100 ceph-mon[34353]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-05-09T05:32:50.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:50 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:32:50.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:50 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:32:50.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:50 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:32:50.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:50 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:32:50.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:50 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:32:50.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:50 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:32:51.046 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:50 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:32:51.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:50 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:32:51.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:50 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:32:51.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:51 smithi039 ceph-mon[30439]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-05-09T05:32:51.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:51 smithi100 ceph-mon[34353]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-05-09T05:32:52.046 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:51 smithi060 ceph-mon[34555]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-05-09T05:32:53.788 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:32:53.794+0000 7f7eaf7fe700 1 -- 172.21.15.39:0/3239546199 <== mgr.14152 v2:172.21.15.39:6800/3184189003 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f7ec01a2f00 con 0x7f7ea80b2900 2024-05-09T05:32:53.788 INFO:teuthology.orchestra.run.smithi039.stdout:Created osd(s) 9 on host 'smithi039' 2024-05-09T05:32:53.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:32:53.796+0000 7f7ec4e39700 1 -- 172.21.15.39:0/3239546199 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f7ea80b2900 msgr2=0x7f7ea80b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:32:53.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:32:53.796+0000 7f7ec4e39700 1 --2- 172.21.15.39:0/3239546199 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f7ea80b2900 0x7f7ea80b4e10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7ec0104260 tx=0x7f7eb000b410 comp rx=0 tx=0).stop 2024-05-09T05:32:53.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:32:53.796+0000 7f7ec4e39700 1 -- 172.21.15.39:0/3239546199 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ec0104360 msgr2=0x7f7ec019ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:32:53.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:32:53.796+0000 7f7ec4e39700 1 --2- 172.21.15.39:0/3239546199 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ec0104360 0x7f7ec019ade0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7eb400c9b0 tx=0x7f7eb400ccc0 comp rx=0 tx=0).stop 2024-05-09T05:32:53.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:32:53.796+0000 7f7ec4e39700 1 -- 172.21.15.39:0/3239546199 shutdown_connections 2024-05-09T05:32:53.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:32:53.796+0000 7f7ec4e39700 1 --2- 172.21.15.39:0/3239546199 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f7ea80b2900 0x7f7ea80b4e10 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:32:53.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:32:53.796+0000 7f7ec4e39700 1 --2- 172.21.15.39:0/3239546199 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ec0104d00 0x7f7ec01a1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:32:53.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:32:53.796+0000 7f7ec4e39700 1 --2- 172.21.15.39:0/3239546199 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ec0103230 0x7f7ec019a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:32:53.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:32:53.796+0000 7f7ec4e39700 1 --2- 172.21.15.39:0/3239546199 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ec0104360 0x7f7ec019ade0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:32:53.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:32:53.796+0000 7f7ec4e39700 1 -- 172.21.15.39:0/3239546199 >> 172.21.15.39:0/3239546199 conn(0x7f7ec00fe870 msgr2=0x7f7ec01001a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:32:53.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:32:53.797+0000 7f7ec4e39700 1 -- 172.21.15.39:0/3239546199 shutdown_connections 2024-05-09T05:32:53.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:32:53.797+0000 7f7ec4e39700 1 -- 172.21.15.39:0/3239546199 wait complete. 2024-05-09T05:32:53.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:53 smithi039 ceph-mon[30439]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-05-09T05:32:53.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:53 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:32:53.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:53 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:32:53.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:53 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:32:53.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:53 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:32:53.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:53 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:32:53.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:53 smithi039 ceph-mon[30439]: from='osd.9 [v2:172.21.15.39:6826/2944584368,v1:172.21.15.39:6827/2944584368]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-05-09T05:32:53.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:53 smithi100 ceph-mon[34353]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-05-09T05:32:53.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:53 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:32:53.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:53 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:32:53.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:53 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:32:53.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:53 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:32:53.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:53 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:32:53.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:53 smithi100 ceph-mon[34353]: from='osd.9 [v2:172.21.15.39:6826/2944584368,v1:172.21.15.39:6827/2944584368]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-05-09T05:32:54.046 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:53 smithi060 ceph-mon[34555]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-05-09T05:32:54.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:53 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:32:54.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:53 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:32:54.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:53 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:32:54.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:53 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:32:54.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:53 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:32:54.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:53 smithi060 ceph-mon[34555]: from='osd.9 [v2:172.21.15.39:6826/2944584368,v1:172.21.15.39:6827/2944584368]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-05-09T05:32:54.563 DEBUG:teuthology.orchestra.run.smithi039:osd.9> sudo journalctl -f -n 0 -u ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@osd.9.service 2024-05-09T05:32:54.566 INFO:tasks.cephadm:Deploying osd.10 on smithi060 with /dev/vg_nvme/lv_1... 2024-05-09T05:32:54.566 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-05-09T05:32:54.825 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.b/config 2024-05-09T05:32:54.832 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:54 smithi039 ceph-mon[30439]: from='osd.9 [v2:172.21.15.39:6826/2944584368,v1:172.21.15.39:6827/2944584368]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-05-09T05:32:54.833 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:54 smithi039 ceph-mon[30439]: osdmap e60: 10 total, 9 up, 10 in 2024-05-09T05:32:54.833 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:54 smithi039 ceph-mon[30439]: from='osd.9 [v2:172.21.15.39:6826/2944584368,v1:172.21.15.39:6827/2944584368]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]: dispatch 2024-05-09T05:32:54.833 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:54 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-09T05:32:54.833 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:54 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:32:54.833 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:54 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:32:54.833 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:54 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:32:54.833 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:54 smithi039 ceph-mon[30439]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-05-09T05:32:54.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:54 smithi100 ceph-mon[34353]: from='osd.9 [v2:172.21.15.39:6826/2944584368,v1:172.21.15.39:6827/2944584368]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-05-09T05:32:54.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:54 smithi100 ceph-mon[34353]: osdmap e60: 10 total, 9 up, 10 in 2024-05-09T05:32:54.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:54 smithi100 ceph-mon[34353]: from='osd.9 [v2:172.21.15.39:6826/2944584368,v1:172.21.15.39:6827/2944584368]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]: dispatch 2024-05-09T05:32:54.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:54 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-09T05:32:54.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:54 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:32:54.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:54 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:32:54.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:54 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:32:54.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:54 smithi100 ceph-mon[34353]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-05-09T05:32:54.948 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:54 smithi060 ceph-mon[34555]: from='osd.9 [v2:172.21.15.39:6826/2944584368,v1:172.21.15.39:6827/2944584368]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-05-09T05:32:54.948 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:54 smithi060 ceph-mon[34555]: osdmap e60: 10 total, 9 up, 10 in 2024-05-09T05:32:54.948 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:54 smithi060 ceph-mon[34555]: from='osd.9 [v2:172.21.15.39:6826/2944584368,v1:172.21.15.39:6827/2944584368]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]: dispatch 2024-05-09T05:32:54.949 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:54 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-09T05:32:54.949 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:54 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:32:54.949 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:54 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:32:54.949 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:54 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:32:54.949 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:54 smithi060 ceph-mon[34555]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-05-09T05:32:55.718 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:55 smithi039 ceph-mon[30439]: from='osd.9 [v2:172.21.15.39:6826/2944584368,v1:172.21.15.39:6827/2944584368]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]': finished 2024-05-09T05:32:55.718 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:55 smithi039 ceph-mon[30439]: osdmap e61: 10 total, 9 up, 10 in 2024-05-09T05:32:55.718 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:55 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-09T05:32:55.718 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:55 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-09T05:32:55.718 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:55 smithi039 ceph-mon[30439]: from='osd.9 [v2:172.21.15.39:6826/2944584368,v1:172.21.15.39:6827/2944584368]' entity='osd.9' 2024-05-09T05:32:55.719 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 05:32:55 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T05:32:55.446+0000 7fbb0977a700 -1 osd.9 0 waiting for initial osdmap 2024-05-09T05:32:55.719 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 05:32:55 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T05:32:55.471+0000 7fbb00d26700 -1 osd.9 61 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T05:32:55.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:55 smithi100 ceph-mon[34353]: from='osd.9 [v2:172.21.15.39:6826/2944584368,v1:172.21.15.39:6827/2944584368]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]': finished 2024-05-09T05:32:55.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:55 smithi100 ceph-mon[34353]: osdmap e61: 10 total, 9 up, 10 in 2024-05-09T05:32:55.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:55 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-09T05:32:55.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:55 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-09T05:32:55.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:55 smithi100 ceph-mon[34353]: from='osd.9 [v2:172.21.15.39:6826/2944584368,v1:172.21.15.39:6827/2944584368]' entity='osd.9' 2024-05-09T05:32:56.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:55 smithi060 ceph-mon[34555]: from='osd.9 [v2:172.21.15.39:6826/2944584368,v1:172.21.15.39:6827/2944584368]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi039", "root=default"]}]': finished 2024-05-09T05:32:56.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:55 smithi060 ceph-mon[34555]: osdmap e61: 10 total, 9 up, 10 in 2024-05-09T05:32:56.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:55 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-09T05:32:56.048 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:55 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-09T05:32:56.048 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:55 smithi060 ceph-mon[34555]: from='osd.9 [v2:172.21.15.39:6826/2944584368,v1:172.21.15.39:6827/2944584368]' entity='osd.9' 2024-05-09T05:32:56.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:56 smithi060 ceph-mon[34555]: purged_snaps scrub starts 2024-05-09T05:32:56.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:56 smithi060 ceph-mon[34555]: purged_snaps scrub ok 2024-05-09T05:32:56.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:56 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-09T05:32:56.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:56 smithi060 ceph-mon[34555]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-05-09T05:32:56.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:56 smithi060 ceph-mon[34555]: osd.9 [v2:172.21.15.39:6826/2944584368,v1:172.21.15.39:6827/2944584368] boot 2024-05-09T05:32:56.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:56 smithi060 ceph-mon[34555]: osdmap e62: 10 total, 10 up, 10 in 2024-05-09T05:32:56.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:56 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-09T05:32:56.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:56 smithi039 ceph-mon[30439]: purged_snaps scrub starts 2024-05-09T05:32:56.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:56 smithi039 ceph-mon[30439]: purged_snaps scrub ok 2024-05-09T05:32:56.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:56 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-09T05:32:56.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:56 smithi039 ceph-mon[30439]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-05-09T05:32:56.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:56 smithi039 ceph-mon[30439]: osd.9 [v2:172.21.15.39:6826/2944584368,v1:172.21.15.39:6827/2944584368] boot 2024-05-09T05:32:56.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:56 smithi039 ceph-mon[30439]: osdmap e62: 10 total, 10 up, 10 in 2024-05-09T05:32:56.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:56 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-09T05:32:56.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:56 smithi100 ceph-mon[34353]: purged_snaps scrub starts 2024-05-09T05:32:56.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:56 smithi100 ceph-mon[34353]: purged_snaps scrub ok 2024-05-09T05:32:56.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:56 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-09T05:32:56.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:56 smithi100 ceph-mon[34353]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-05-09T05:32:56.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:56 smithi100 ceph-mon[34353]: osd.9 [v2:172.21.15.39:6826/2944584368,v1:172.21.15.39:6827/2944584368] boot 2024-05-09T05:32:56.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:56 smithi100 ceph-mon[34353]: osdmap e62: 10 total, 10 up, 10 in 2024-05-09T05:32:56.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:56 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-09T05:32:56.991 INFO:teuthology.orchestra.run.smithi060.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-05-09T05:32:56.991 INFO:teuthology.orchestra.run.smithi060.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-05-09T05:32:56.991 INFO:teuthology.orchestra.run.smithi060.stderr: stderr: 10+0 records in 2024-05-09T05:32:56.991 INFO:teuthology.orchestra.run.smithi060.stderr:10+0 records out 2024-05-09T05:32:56.991 INFO:teuthology.orchestra.run.smithi060.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00851922 s, 1.2 GB/s 2024-05-09T05:32:56.991 INFO:teuthology.orchestra.run.smithi060.stderr:--> Zapping successful for: 2024-05-09T05:32:57.613 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi060:vg_nvme/lv_1 2024-05-09T05:32:57.870 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.b/config 2024-05-09T05:32:58.698 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:58 smithi060 ceph-mon[34555]: Detected new or changed devices on smithi039 2024-05-09T05:32:58.699 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:58 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:32:58.699 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:58 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:32:58.699 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:58 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:32:58.699 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:58 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:32:58.699 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:58 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:32:58.699 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:58 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:32:58.699 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:58 smithi060 ceph-mon[34555]: Adjusting osd_memory_target on smithi039 to 4272M 2024-05-09T05:32:58.699 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:58 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:32:58.699 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:58 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:32:58.699 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:58 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:32:58.699 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:58 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:32:58.699 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:58 smithi060 ceph-mon[34555]: osdmap e63: 10 total, 10 up, 10 in 2024-05-09T05:32:58.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:58 smithi039 ceph-mon[30439]: Detected new or changed devices on smithi039 2024-05-09T05:32:58.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:58 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:32:58.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:58 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:32:58.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:58 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:32:58.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:58 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:32:58.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:58 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:32:58.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:58 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:32:58.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:58 smithi039 ceph-mon[30439]: Adjusting osd_memory_target on smithi039 to 4272M 2024-05-09T05:32:58.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:58 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:32:58.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:58 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:32:58.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:58 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:32:58.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:58 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:32:58.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:58 smithi039 ceph-mon[30439]: osdmap e63: 10 total, 10 up, 10 in 2024-05-09T05:32:58.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:58 smithi100 ceph-mon[34353]: Detected new or changed devices on smithi039 2024-05-09T05:32:58.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:58 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:32:58.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:58 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:32:58.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:58 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:32:58.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:58 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:32:58.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:58 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:32:58.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:58 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:32:58.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:58 smithi100 ceph-mon[34353]: Adjusting osd_memory_target on smithi039 to 4272M 2024-05-09T05:32:58.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:58 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:32:58.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:58 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:32:58.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:58 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:32:58.925 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:58 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:32:58.925 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:58 smithi100 ceph-mon[34353]: osdmap e63: 10 total, 10 up, 10 in 2024-05-09T05:32:59.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:32:59.522+0000 7f219674c700 1 -- 172.21.15.60:0/1039867262 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2190104d20 msgr2=0x7f219010b5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:32:59.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:32:59.522+0000 7f219674c700 1 --2- 172.21.15.60:0/1039867262 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2190104d20 0x7f219010b5d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f218800b0a0 tx=0x7f218800b3b0 comp rx=0 tx=0).stop 2024-05-09T05:32:59.517 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:32:59.522+0000 7f219674c700 1 -- 172.21.15.60:0/1039867262 shutdown_connections 2024-05-09T05:32:59.517 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:32:59.522+0000 7f219674c700 1 --2- 172.21.15.60:0/1039867262 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2190104d20 0x7f219010b5d0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:32:59.517 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:32:59.522+0000 7f219674c700 1 --2- 172.21.15.60:0/1039867262 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2190103250 0x7f2190103660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:32:59.517 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:32:59.522+0000 7f219674c700 1 --2- 172.21.15.60:0/1039867262 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2190104380 0x7f2190104790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:32:59.517 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:32:59.522+0000 7f219674c700 1 -- 172.21.15.60:0/1039867262 >> 172.21.15.60:0/1039867262 conn(0x7f21900fe890 msgr2=0x7f2190100d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:32:59.517 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:32:59.522+0000 7f219674c700 1 -- 172.21.15.60:0/1039867262 shutdown_connections 2024-05-09T05:32:59.517 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:32:59.522+0000 7f219674c700 1 -- 172.21.15.60:0/1039867262 wait complete. 2024-05-09T05:32:59.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:32:59.523+0000 7f219674c700 1 Processor -- start 2024-05-09T05:32:59.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:32:59.523+0000 7f219674c700 1 -- start start 2024-05-09T05:32:59.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:32:59.523+0000 7f219674c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2190103250 0x7f219019a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:32:59.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:32:59.523+0000 7f219674c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2190104380 0x7f219019ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:32:59.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:32:59.523+0000 7f219674c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2190104d20 0x7f21901a1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:32:59.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:32:59.523+0000 7f219674c700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f219010ecb0 con 0x7f2190104380 2024-05-09T05:32:59.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:32:59.523+0000 7f219674c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f219010eb30 con 0x7f2190103250 2024-05-09T05:32:59.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:32:59.523+0000 7f219674c700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f219010ee30 con 0x7f2190104d20 2024-05-09T05:32:59.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:32:59.523+0000 7f218ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2190103250 0x7f219019a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:32:59.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:32:59.523+0000 7f218ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2190103250 0x7f219019a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37822/0 (socket says 172.21.15.60:37822) 2024-05-09T05:32:59.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:32:59.523+0000 7f218ffff700 1 -- 172.21.15.60:0/2741823524 learned_addr learned my addr 172.21.15.60:0/2741823524 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-05-09T05:32:59.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:32:59.524+0000 7f218f7fe700 1 --2- 172.21.15.60:0/2741823524 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2190104380 0x7f219019ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:32:59.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:32:59.524+0000 7f2194ce9700 1 --2- 172.21.15.60:0/2741823524 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2190104d20 0x7f21901a1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:32:59.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:32:59.524+0000 7f218ffff700 1 -- 172.21.15.60:0/2741823524 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2190104d20 msgr2=0x7f21901a1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:32:59.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:32:59.524+0000 7f218ffff700 1 --2- 172.21.15.60:0/2741823524 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2190104d20 0x7f21901a1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:32:59.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:32:59.524+0000 7f218ffff700 1 -- 172.21.15.60:0/2741823524 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2190104380 msgr2=0x7f219019ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:32:59.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:32:59.524+0000 7f218ffff700 1 --2- 172.21.15.60:0/2741823524 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2190104380 0x7f219019ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:32:59.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:32:59.524+0000 7f218ffff700 1 -- 172.21.15.60:0/2741823524 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21901a2440 con 0x7f2190103250 2024-05-09T05:32:59.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:32:59.524+0000 7f218ffff700 1 --2- 172.21.15.60:0/2741823524 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2190103250 0x7f219019a8e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f218000d950 tx=0x7f218000dc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:32:59.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:32:59.524+0000 7f218d7fa700 1 -- 172.21.15.60:0/2741823524 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2180016070 con 0x7f2190103250 2024-05-09T05:32:59.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:32:59.524+0000 7f218d7fa700 1 -- 172.21.15.60:0/2741823524 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f218000be00 con 0x7f2190103250 2024-05-09T05:32:59.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:32:59.524+0000 7f218d7fa700 1 -- 172.21.15.60:0/2741823524 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f218000f3c0 con 0x7f2190103250 2024-05-09T05:32:59.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:32:59.524+0000 7f219674c700 1 -- 172.21.15.60:0/2741823524 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21901a2730 con 0x7f2190103250 2024-05-09T05:32:59.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:32:59.524+0000 7f219674c700 1 -- 172.21.15.60:0/2741823524 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21901a2cc0 con 0x7f2190103250 2024-05-09T05:32:59.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:32:59.525+0000 7f219674c700 1 -- 172.21.15.60:0/2741823524 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21900512c0 con 0x7f2190103250 2024-05-09T05:32:59.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:32:59.527+0000 7f218d7fa700 1 -- 172.21.15.60:0/2741823524 <== mon.2 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f2180019070 con 0x7f2190103250 2024-05-09T05:32:59.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:32:59.528+0000 7f218d7fa700 1 --2- 172.21.15.60:0/2741823524 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f21780b2900 0x7f21780b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:32:59.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:32:59.528+0000 7f218d7fa700 1 -- 172.21.15.60:0/2741823524 <== mon.2 v2:172.21.15.60:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6261+0+0 (secure 0 0 0) 0x7f21800e1e20 con 0x7f2190103250 2024-05-09T05:32:59.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:32:59.528+0000 7f218f7fe700 1 --2- 172.21.15.60:0/2741823524 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f21780b2900 0x7f21780b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:32:59.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:32:59.529+0000 7f218f7fe700 1 --2- 172.21.15.60:0/2741823524 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f21780b2900 0x7f21780b4e10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f219019b990 tx=0x7f218400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:32:59.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:32:59.531+0000 7f218d7fa700 1 -- 172.21.15.60:0/2741823524 <== mon.2 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f2180020020 con 0x7f2190103250 2024-05-09T05:32:59.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:32:59.754+0000 7f219674c700 1 -- 172.21.15.60:0/2741823524 --> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f21901a2fe0 con 0x7f21780b2900 2024-05-09T05:32:59.748 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:32:59 smithi060 ceph-mon[34555]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-05-09T05:32:59.761 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:32:59 smithi039 ceph-mon[30439]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-05-09T05:32:59.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:32:59 smithi100 ceph-mon[34353]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-05-09T05:33:00.655 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:00 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T05:33:00.656 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:00 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T05:33:00.656 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:00 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:33:00.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:00 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T05:33:00.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:00 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T05:33:00.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:00 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:33:00.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:00 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T05:33:00.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:00 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T05:33:00.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:00 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:33:01.695 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:01 smithi060 ceph-mon[34555]: from='client.24353 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T05:33:01.695 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:01 smithi060 ceph-mon[34555]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-05-09T05:33:01.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:01 smithi039 ceph-mon[30439]: from='client.24353 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T05:33:01.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:01 smithi039 ceph-mon[30439]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-05-09T05:33:01.926 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:01 smithi100 ceph-mon[34353]: from='client.24353 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T05:33:01.926 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:01 smithi100 ceph-mon[34353]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-05-09T05:33:03.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:03 smithi060 ceph-mon[34555]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-05-09T05:33:03.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:03 smithi060 ceph-mon[34555]: from='client.? 172.21.15.60:0/2122507669' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c1cadd6c-fcc4-4d76-b07e-0f392066a8d8"}]: dispatch 2024-05-09T05:33:03.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:03 smithi060 ceph-mon[34555]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c1cadd6c-fcc4-4d76-b07e-0f392066a8d8"}]: dispatch 2024-05-09T05:33:03.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:03 smithi060 ceph-mon[34555]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c1cadd6c-fcc4-4d76-b07e-0f392066a8d8"}]': finished 2024-05-09T05:33:03.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:03 smithi060 ceph-mon[34555]: osdmap e64: 11 total, 10 up, 11 in 2024-05-09T05:33:03.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:03 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-09T05:33:03.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:03 smithi060 ceph-mon[34555]: from='client.? 172.21.15.60:0/2724245204' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap", "output-file": "/var/lib/ceph/osd/ceph-10/activate.monmap"}]: dispatch 2024-05-09T05:33:03.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:03 smithi039 ceph-mon[30439]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-05-09T05:33:03.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:03 smithi039 ceph-mon[30439]: from='client.? 172.21.15.60:0/2122507669' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c1cadd6c-fcc4-4d76-b07e-0f392066a8d8"}]: dispatch 2024-05-09T05:33:03.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:03 smithi039 ceph-mon[30439]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c1cadd6c-fcc4-4d76-b07e-0f392066a8d8"}]: dispatch 2024-05-09T05:33:03.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:03 smithi039 ceph-mon[30439]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c1cadd6c-fcc4-4d76-b07e-0f392066a8d8"}]': finished 2024-05-09T05:33:03.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:03 smithi039 ceph-mon[30439]: osdmap e64: 11 total, 10 up, 11 in 2024-05-09T05:33:03.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:03 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-09T05:33:03.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:03 smithi039 ceph-mon[30439]: from='client.? 172.21.15.60:0/2724245204' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap", "output-file": "/var/lib/ceph/osd/ceph-10/activate.monmap"}]: dispatch 2024-05-09T05:33:03.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:03 smithi100 ceph-mon[34353]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-05-09T05:33:03.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:03 smithi100 ceph-mon[34353]: from='client.? 172.21.15.60:0/2122507669' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c1cadd6c-fcc4-4d76-b07e-0f392066a8d8"}]: dispatch 2024-05-09T05:33:03.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:03 smithi100 ceph-mon[34353]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c1cadd6c-fcc4-4d76-b07e-0f392066a8d8"}]: dispatch 2024-05-09T05:33:03.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:03 smithi100 ceph-mon[34353]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c1cadd6c-fcc4-4d76-b07e-0f392066a8d8"}]': finished 2024-05-09T05:33:03.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:03 smithi100 ceph-mon[34353]: osdmap e64: 11 total, 10 up, 11 in 2024-05-09T05:33:03.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:03 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-09T05:33:03.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:03 smithi100 ceph-mon[34353]: from='client.? 172.21.15.60:0/2724245204' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap", "output-file": "/var/lib/ceph/osd/ceph-10/activate.monmap"}]: dispatch 2024-05-09T05:33:05.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:05 smithi060 ceph-mon[34555]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-05-09T05:33:05.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:05 smithi039 ceph-mon[30439]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-05-09T05:33:05.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:05 smithi100 ceph-mon[34353]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-05-09T05:33:07.764 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:07 smithi060 ceph-mon[34555]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-05-09T05:33:07.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:07 smithi039 ceph-mon[30439]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-05-09T05:33:07.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:07 smithi100 ceph-mon[34353]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-05-09T05:33:09.691 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:09 smithi060 ceph-mon[34555]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-05-09T05:33:09.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:09 smithi039 ceph-mon[30439]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-05-09T05:33:09.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:09 smithi100 ceph-mon[34353]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-05-09T05:33:10.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:10 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-05-09T05:33:10.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:10 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:33:10.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:10 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-05-09T05:33:10.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:10 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:33:10.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:10 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-05-09T05:33:10.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:10 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:33:11.705 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:11 smithi060 ceph-mon[34555]: Deploying daemon osd.10 on smithi060 2024-05-09T05:33:11.705 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:11 smithi060 ceph-mon[34555]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-05-09T05:33:11.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:11 smithi039 ceph-mon[30439]: Deploying daemon osd.10 on smithi060 2024-05-09T05:33:11.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:11 smithi039 ceph-mon[30439]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-05-09T05:33:11.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:11 smithi100 ceph-mon[34353]: Deploying daemon osd.10 on smithi060 2024-05-09T05:33:11.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:11 smithi100 ceph-mon[34353]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-05-09T05:33:13.594 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:13 smithi060 ceph-mon[34555]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-05-09T05:33:13.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:13 smithi039 ceph-mon[30439]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-05-09T05:33:13.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:13 smithi100 ceph-mon[34353]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-05-09T05:33:15.782 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:15 smithi060 ceph-mon[34555]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-05-09T05:33:15.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:15 smithi039 ceph-mon[30439]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-05-09T05:33:15.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:15 smithi100 ceph-mon[34353]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-05-09T05:33:17.110 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:16 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:33:17.110 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:16 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:33:17.110 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:16 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:33:17.111 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:16 smithi039 ceph-mon[30439]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-05-09T05:33:17.174 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:16 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:33:17.174 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:16 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:33:17.174 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:16 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:33:17.174 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:16 smithi100 ceph-mon[34353]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-05-09T05:33:17.181 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:16 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:33:17.181 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:16 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:33:17.181 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:16 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:33:17.181 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:16 smithi060 ceph-mon[34555]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-05-09T05:33:19.258 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:19 smithi060 ceph-mon[34555]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-05-09T05:33:19.258 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:19 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:33:19.258 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:19 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:33:19.258 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:19 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:33:19.258 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:19 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:33:19.258 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:19 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:33:19.423 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:19 smithi100 ceph-mon[34353]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-05-09T05:33:19.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:19 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:33:19.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:19 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:33:19.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:19 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:33:19.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:19 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:33:19.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:19 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:33:19.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:19 smithi039 ceph-mon[30439]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-05-09T05:33:19.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:19 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:33:19.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:19 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:33:19.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:19 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:33:19.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:19 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:33:19.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:19 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:33:19.666 INFO:teuthology.orchestra.run.smithi060.stdout:Created osd(s) 10 on host 'smithi060' 2024-05-09T05:33:19.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:33:19.672+0000 7f218d7fa700 1 -- 172.21.15.60:0/2741823524 <== mgr.14152 v2:172.21.15.39:6800/3184189003 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f21901a2fe0 con 0x7f21780b2900 2024-05-09T05:33:19.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:33:19.675+0000 7f219674c700 1 -- 172.21.15.60:0/2741823524 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f21780b2900 msgr2=0x7f21780b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:33:19.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:33:19.675+0000 7f219674c700 1 --2- 172.21.15.60:0/2741823524 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f21780b2900 0x7f21780b4e10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f219019b990 tx=0x7f218400b410 comp rx=0 tx=0).stop 2024-05-09T05:33:19.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:33:19.675+0000 7f219674c700 1 -- 172.21.15.60:0/2741823524 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2190103250 msgr2=0x7f219019a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:33:19.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:33:19.675+0000 7f219674c700 1 --2- 172.21.15.60:0/2741823524 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2190103250 0x7f219019a8e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f218000d950 tx=0x7f218000dc60 comp rx=0 tx=0).stop 2024-05-09T05:33:19.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:33:19.676+0000 7f219674c700 1 -- 172.21.15.60:0/2741823524 shutdown_connections 2024-05-09T05:33:19.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:33:19.676+0000 7f219674c700 1 --2- 172.21.15.60:0/2741823524 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f21780b2900 0x7f21780b4e10 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:33:19.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:33:19.676+0000 7f219674c700 1 --2- 172.21.15.60:0/2741823524 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2190104d20 0x7f21901a1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:33:19.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:33:19.676+0000 7f219674c700 1 --2- 172.21.15.60:0/2741823524 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2190103250 0x7f219019a8e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:33:19.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:33:19.676+0000 7f219674c700 1 --2- 172.21.15.60:0/2741823524 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2190104380 0x7f219019ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:33:19.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:33:19.676+0000 7f219674c700 1 -- 172.21.15.60:0/2741823524 >> 172.21.15.60:0/2741823524 conn(0x7f21900fe890 msgr2=0x7f2190100190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:33:19.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:33:19.676+0000 7f219674c700 1 -- 172.21.15.60:0/2741823524 shutdown_connections 2024-05-09T05:33:19.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-09T05:33:19.676+0000 7f219674c700 1 -- 172.21.15.60:0/2741823524 wait complete. 2024-05-09T05:33:20.425 DEBUG:teuthology.orchestra.run.smithi060:osd.10> sudo journalctl -f -n 0 -u ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@osd.10.service 2024-05-09T05:33:20.427 INFO:tasks.cephadm:Deploying osd.11 on smithi100 with /dev/vg_nvme/lv_1... 2024-05-09T05:33:20.427 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-05-09T05:33:20.674 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.c/config 2024-05-09T05:33:20.749 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:20 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:33:20.749 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:20 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:33:20.749 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:20 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:33:20.749 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:20 smithi060 ceph-mon[34555]: from='osd.10 [v2:172.21.15.60:6824/1940670367,v1:172.21.15.60:6825/1940670367]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-09T05:33:20.749 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:20 smithi060 ceph-mon[34555]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-09T05:33:20.750 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:20 smithi060 ceph-mon[34555]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-05-09T05:33:20.796 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:20 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:33:20.796 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:20 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:33:20.796 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:20 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:33:20.796 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:20 smithi100 ceph-mon[34353]: from='osd.10 [v2:172.21.15.60:6824/1940670367,v1:172.21.15.60:6825/1940670367]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-09T05:33:20.796 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:20 smithi100 ceph-mon[34353]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-09T05:33:20.796 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:20 smithi100 ceph-mon[34353]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-05-09T05:33:21.110 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:20 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:33:21.110 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:20 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:33:21.110 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:20 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:33:21.110 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:20 smithi039 ceph-mon[30439]: from='osd.10 [v2:172.21.15.60:6824/1940670367,v1:172.21.15.60:6825/1940670367]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-09T05:33:21.110 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:20 smithi039 ceph-mon[30439]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-09T05:33:21.110 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:20 smithi039 ceph-mon[30439]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-05-09T05:33:21.907 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:21 smithi060 ceph-mon[34555]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-05-09T05:33:21.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:21 smithi060 ceph-mon[34555]: from='osd.10 [v2:172.21.15.60:6824/1940670367,v1:172.21.15.60:6825/1940670367]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2024-05-09T05:33:21.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:21 smithi060 ceph-mon[34555]: osdmap e65: 11 total, 10 up, 11 in 2024-05-09T05:33:21.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:21 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-09T05:33:21.908 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:21 smithi060 ceph-mon[34555]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2024-05-09T05:33:21.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:21 smithi100 ceph-mon[34353]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-05-09T05:33:21.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:21 smithi100 ceph-mon[34353]: from='osd.10 [v2:172.21.15.60:6824/1940670367,v1:172.21.15.60:6825/1940670367]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2024-05-09T05:33:21.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:21 smithi100 ceph-mon[34353]: osdmap e65: 11 total, 10 up, 11 in 2024-05-09T05:33:21.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:21 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-09T05:33:21.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:21 smithi100 ceph-mon[34353]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2024-05-09T05:33:22.110 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:21 smithi039 ceph-mon[30439]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-05-09T05:33:22.110 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:21 smithi039 ceph-mon[30439]: from='osd.10 [v2:172.21.15.60:6824/1940670367,v1:172.21.15.60:6825/1940670367]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2024-05-09T05:33:22.110 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:21 smithi039 ceph-mon[30439]: osdmap e65: 11 total, 10 up, 11 in 2024-05-09T05:33:22.110 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:21 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-09T05:33:22.110 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:21 smithi039 ceph-mon[30439]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2024-05-09T05:33:22.678 INFO:teuthology.orchestra.run.smithi100.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-05-09T05:33:22.678 INFO:teuthology.orchestra.run.smithi100.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-05-09T05:33:22.678 INFO:teuthology.orchestra.run.smithi100.stderr: stderr: 10+0 records in 2024-05-09T05:33:22.678 INFO:teuthology.orchestra.run.smithi100.stderr:10+0 records out 2024-05-09T05:33:22.678 INFO:teuthology.orchestra.run.smithi100.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0114547 s, 915 MB/s 2024-05-09T05:33:22.679 INFO:teuthology.orchestra.run.smithi100.stderr:--> Zapping successful for: 2024-05-09T05:33:22.794 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:22 smithi060 ceph-mon[34555]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2024-05-09T05:33:22.794 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:22 smithi060 ceph-mon[34555]: osdmap e66: 11 total, 10 up, 11 in 2024-05-09T05:33:22.794 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:22 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-09T05:33:22.794 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:22 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-09T05:33:22.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:22 smithi060 ceph-mon[34555]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-05-09T05:33:22.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:22 smithi060 ceph-mon[34555]: from='osd.10 ' entity='osd.10' 2024-05-09T05:33:22.795 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 05:33:22 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T05:33:22.531+0000 7f09c2d1a700 -1 osd.10 0 waiting for initial osdmap 2024-05-09T05:33:22.795 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 05:33:22 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T05:33:22.546+0000 7f09baac7700 -1 osd.10 66 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T05:33:22.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:22 smithi100 ceph-mon[34353]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2024-05-09T05:33:22.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:22 smithi100 ceph-mon[34353]: osdmap e66: 11 total, 10 up, 11 in 2024-05-09T05:33:22.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:22 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-09T05:33:22.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:22 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-09T05:33:22.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:22 smithi100 ceph-mon[34353]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-05-09T05:33:22.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:22 smithi100 ceph-mon[34353]: from='osd.10 ' entity='osd.10' 2024-05-09T05:33:23.110 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:22 smithi039 ceph-mon[30439]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2024-05-09T05:33:23.110 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:22 smithi039 ceph-mon[30439]: osdmap e66: 11 total, 10 up, 11 in 2024-05-09T05:33:23.111 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:22 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-09T05:33:23.111 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:22 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-09T05:33:23.111 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:22 smithi039 ceph-mon[30439]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-05-09T05:33:23.111 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:22 smithi039 ceph-mon[30439]: from='osd.10 ' entity='osd.10' 2024-05-09T05:33:23.339 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi100:vg_nvme/lv_1 2024-05-09T05:33:23.584 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.c/config 2024-05-09T05:33:23.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:23 smithi100 ceph-mon[34353]: purged_snaps scrub starts 2024-05-09T05:33:23.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:23 smithi100 ceph-mon[34353]: purged_snaps scrub ok 2024-05-09T05:33:23.925 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:23 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-09T05:33:23.925 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:23 smithi100 ceph-mon[34353]: osd.10 [v2:172.21.15.60:6824/1940670367,v1:172.21.15.60:6825/1940670367] boot 2024-05-09T05:33:23.925 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:23 smithi100 ceph-mon[34353]: osdmap e67: 11 total, 11 up, 11 in 2024-05-09T05:33:23.925 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:23 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-09T05:33:23.925 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:23 smithi100 ceph-mon[34353]: osdmap e68: 11 total, 11 up, 11 in 2024-05-09T05:33:23.925 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:23 smithi100 ceph-mon[34353]: Detected new or changed devices on smithi060 2024-05-09T05:33:23.925 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:23 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:33:23.925 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:23 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:33:23.925 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:23 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:33:23.925 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:23 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:33:23.925 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:23 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:33:23.925 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:23 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:33:23.926 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:23 smithi100 ceph-mon[34353]: Adjusting osd_memory_target on smithi060 to 4273M 2024-05-09T05:33:23.926 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:23 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:33:23.926 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:23 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:33:23.926 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:23 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:33:23.926 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:23 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:33:24.046 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:23 smithi060 ceph-mon[34555]: purged_snaps scrub starts 2024-05-09T05:33:24.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:23 smithi060 ceph-mon[34555]: purged_snaps scrub ok 2024-05-09T05:33:24.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:23 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-09T05:33:24.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:23 smithi060 ceph-mon[34555]: osd.10 [v2:172.21.15.60:6824/1940670367,v1:172.21.15.60:6825/1940670367] boot 2024-05-09T05:33:24.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:23 smithi060 ceph-mon[34555]: osdmap e67: 11 total, 11 up, 11 in 2024-05-09T05:33:24.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:23 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-09T05:33:24.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:23 smithi060 ceph-mon[34555]: osdmap e68: 11 total, 11 up, 11 in 2024-05-09T05:33:24.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:23 smithi060 ceph-mon[34555]: Detected new or changed devices on smithi060 2024-05-09T05:33:24.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:23 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:33:24.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:23 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:33:24.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:23 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:33:24.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:23 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:33:24.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:23 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:33:24.048 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:23 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:33:24.048 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:23 smithi060 ceph-mon[34555]: Adjusting osd_memory_target on smithi060 to 4273M 2024-05-09T05:33:24.048 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:23 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:33:24.048 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:23 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:33:24.048 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:23 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:33:24.048 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:23 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:33:24.110 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:23 smithi039 ceph-mon[30439]: purged_snaps scrub starts 2024-05-09T05:33:24.110 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:23 smithi039 ceph-mon[30439]: purged_snaps scrub ok 2024-05-09T05:33:24.110 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:23 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-09T05:33:24.110 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:23 smithi039 ceph-mon[30439]: osd.10 [v2:172.21.15.60:6824/1940670367,v1:172.21.15.60:6825/1940670367] boot 2024-05-09T05:33:24.111 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:23 smithi039 ceph-mon[30439]: osdmap e67: 11 total, 11 up, 11 in 2024-05-09T05:33:24.111 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:23 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-09T05:33:24.111 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:23 smithi039 ceph-mon[30439]: osdmap e68: 11 total, 11 up, 11 in 2024-05-09T05:33:24.111 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:23 smithi039 ceph-mon[30439]: Detected new or changed devices on smithi060 2024-05-09T05:33:24.111 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:23 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:33:24.111 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:23 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:33:24.111 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:23 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:33:24.111 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:23 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:33:24.111 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:23 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:33:24.111 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:23 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:33:24.111 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:23 smithi039 ceph-mon[30439]: Adjusting osd_memory_target on smithi060 to 4273M 2024-05-09T05:33:24.111 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:23 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:33:24.111 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:23 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:33:24.111 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:23 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:33:24.111 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:23 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:33:25.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:33:25.166+0000 7f48bb3e5700 1 -- 172.21.15.100:0/3132152947 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f48b4102ca0 msgr2=0x7f48b410c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:33:25.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:33:25.166+0000 7f48bb3e5700 1 --2- 172.21.15.100:0/3132152947 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f48b4102ca0 0x7f48b410c8c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f48ac00b0a0 tx=0x7f48ac00b3b0 comp rx=0 tx=0).stop 2024-05-09T05:33:25.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:33:25.166+0000 7f48bb3e5700 1 -- 172.21.15.100:0/3132152947 shutdown_connections 2024-05-09T05:33:25.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:33:25.166+0000 7f48bb3e5700 1 --2- 172.21.15.100:0/3132152947 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f48b4102ca0 0x7f48b410c8c0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:33:25.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:33:25.166+0000 7f48bb3e5700 1 --2- 172.21.15.100:0/3132152947 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48b4105900 0x7f48b4105d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:33:25.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:33:25.166+0000 7f48bb3e5700 1 --2- 172.21.15.100:0/3132152947 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f48b4102350 0x7f48b4102760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:33:25.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:33:25.166+0000 7f48bb3e5700 1 -- 172.21.15.100:0/3132152947 >> 172.21.15.100:0/3132152947 conn(0x7f48b40fe020 msgr2=0x7f48b41004d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:33:25.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:33:25.166+0000 7f48bb3e5700 1 -- 172.21.15.100:0/3132152947 shutdown_connections 2024-05-09T05:33:25.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:33:25.166+0000 7f48bb3e5700 1 -- 172.21.15.100:0/3132152947 wait complete. 2024-05-09T05:33:25.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:33:25.166+0000 7f48bb3e5700 1 Processor -- start 2024-05-09T05:33:25.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:33:25.166+0000 7f48bb3e5700 1 -- start start 2024-05-09T05:33:25.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:33:25.167+0000 7f48bb3e5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48b4102350 0x7f48b4104ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:33:25.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:33:25.167+0000 7f48bb3e5700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f48b4102ca0 0x7f48b4103580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:33:25.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:33:25.167+0000 7f48bb3e5700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f48b4105900 0x7f48b4103ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:33:25.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:33:25.167+0000 7f48bb3e5700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f48b410fdc0 con 0x7f48b4105900 2024-05-09T05:33:25.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:33:25.167+0000 7f48bb3e5700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f48b410fc40 con 0x7f48b4102350 2024-05-09T05:33:25.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:33:25.167+0000 7f48bb3e5700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f48b410ff40 con 0x7f48b4102ca0 2024-05-09T05:33:25.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:33:25.167+0000 7f48b8980700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f48b4102ca0 0x7f48b4103580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:33:25.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:33:25.167+0000 7f48b8980700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f48b4102ca0 0x7f48b4103580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:51372/0 (socket says 172.21.15.100:51372) 2024-05-09T05:33:25.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:33:25.167+0000 7f48b8980700 1 -- 172.21.15.100:0/747277075 learned_addr learned my addr 172.21.15.100:0/747277075 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:33:25.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:33:25.167+0000 7f48b9181700 1 --2- 172.21.15.100:0/747277075 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48b4102350 0x7f48b4104ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:33:25.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:33:25.167+0000 7f48b8980700 1 -- 172.21.15.100:0/747277075 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48b4102350 msgr2=0x7f48b4104ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:33:25.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:33:25.167+0000 7f48b8980700 1 --2- 172.21.15.100:0/747277075 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48b4102350 0x7f48b4104ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:33:25.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:33:25.167+0000 7f48b9982700 1 --2- 172.21.15.100:0/747277075 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f48b4105900 0x7f48b4103ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:33:25.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:33:25.167+0000 7f48b8980700 1 -- 172.21.15.100:0/747277075 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f48b4105900 msgr2=0x7f48b4103ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:33:25.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:33:25.167+0000 7f48b8980700 1 --2- 172.21.15.100:0/747277075 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f48b4105900 0x7f48b4103ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:33:25.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:33:25.167+0000 7f48b8980700 1 -- 172.21.15.100:0/747277075 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48b4104220 con 0x7f48b4102ca0 2024-05-09T05:33:25.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:33:25.167+0000 7f48b8980700 1 --2- 172.21.15.100:0/747277075 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f48b4102ca0 0x7f48b4103580 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f48b000c920 tx=0x7f48b000cc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:33:25.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:33:25.167+0000 7f48aa7fc700 1 -- 172.21.15.100:0/747277075 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48b0007b00 con 0x7f48b4102ca0 2024-05-09T05:33:25.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:33:25.167+0000 7f48aa7fc700 1 -- 172.21.15.100:0/747277075 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f48b0004ce0 con 0x7f48b4102ca0 2024-05-09T05:33:25.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:33:25.167+0000 7f48bb3e5700 1 -- 172.21.15.100:0/747277075 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48b41a4910 con 0x7f48b4102ca0 2024-05-09T05:33:25.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:33:25.167+0000 7f48aa7fc700 1 -- 172.21.15.100:0/747277075 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48b0005550 con 0x7f48b4102ca0 2024-05-09T05:33:25.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:33:25.167+0000 7f48bb3e5700 1 -- 172.21.15.100:0/747277075 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48b41a4df0 con 0x7f48b4102ca0 2024-05-09T05:33:25.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:33:25.168+0000 7f48bb3e5700 1 -- 172.21.15.100:0/747277075 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48b40512c0 con 0x7f48b4102ca0 2024-05-09T05:33:25.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:33:25.170+0000 7f48aa7fc700 1 -- 172.21.15.100:0/747277075 <== mon.1 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f48b0007ca0 con 0x7f48b4102ca0 2024-05-09T05:33:25.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:33:25.170+0000 7f48aa7fc700 1 --2- 172.21.15.100:0/747277075 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f48a00b2880 0x7f48a00b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:33:25.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:33:25.171+0000 7f48aa7fc700 1 -- 172.21.15.100:0/747277075 <== mon.1 v2:172.21.15.100:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 6694+0+0 (secure 0 0 0) 0x7f48b00e1b30 con 0x7f48b4102ca0 2024-05-09T05:33:25.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:33:25.171+0000 7f48b9181700 1 --2- 172.21.15.100:0/747277075 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f48a00b2880 0x7f48a00b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:33:25.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:33:25.171+0000 7f48b9181700 1 --2- 172.21.15.100:0/747277075 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f48a00b2880 0x7f48a00b4d90 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f48b406c0a0 tx=0x7f48a400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:33:25.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:33:25.174+0000 7f48aa7fc700 1 -- 172.21.15.100:0/747277075 <== mon.1 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f48b0014030 con 0x7f48b4102ca0 2024-05-09T05:33:25.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:33:25.389+0000 7f48bb3e5700 1 -- 172.21.15.100:0/747277075 --> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f48b4063c00 con 0x7f48a00b2880 2024-05-09T05:33:25.384 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:25 smithi100 ceph-mon[34353]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-05-09T05:33:25.384 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:25 smithi100 ceph-mon[34353]: osdmap e69: 11 total, 11 up, 11 in 2024-05-09T05:33:25.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:25 smithi060 ceph-mon[34555]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-05-09T05:33:25.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:25 smithi060 ceph-mon[34555]: osdmap e69: 11 total, 11 up, 11 in 2024-05-09T05:33:25.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:25 smithi039 ceph-mon[30439]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-05-09T05:33:25.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:25 smithi039 ceph-mon[30439]: osdmap e69: 11 total, 11 up, 11 in 2024-05-09T05:33:26.546 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:26 smithi060 ceph-mon[34555]: from='client.24373 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T05:33:26.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:26 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T05:33:26.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:26 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T05:33:26.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:26 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:33:26.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:26 smithi039 ceph-mon[30439]: from='client.24373 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T05:33:26.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:26 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T05:33:26.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:26 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T05:33:26.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:26 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:33:26.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:26 smithi100 ceph-mon[34353]: from='client.24373 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T05:33:26.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:26 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T05:33:26.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:26 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T05:33:26.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:26 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:33:27.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:27 smithi060 ceph-mon[34555]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 130 KiB/s, 0 objects/s recovering 2024-05-09T05:33:27.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:27 smithi039 ceph-mon[30439]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 130 KiB/s, 0 objects/s recovering 2024-05-09T05:33:27.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:27 smithi100 ceph-mon[34353]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 130 KiB/s, 0 objects/s recovering 2024-05-09T05:33:28.546 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:28 smithi060 ceph-mon[34555]: from='client.? 172.21.15.100:0/4124991419' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "56806877-9ce2-41e2-9506-ce67897fa09b"}]: dispatch 2024-05-09T05:33:28.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:28 smithi060 ceph-mon[34555]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "56806877-9ce2-41e2-9506-ce67897fa09b"}]: dispatch 2024-05-09T05:33:28.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:28 smithi060 ceph-mon[34555]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "56806877-9ce2-41e2-9506-ce67897fa09b"}]': finished 2024-05-09T05:33:28.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:28 smithi060 ceph-mon[34555]: osdmap e70: 12 total, 11 up, 12 in 2024-05-09T05:33:28.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:28 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-09T05:33:28.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:28 smithi039 ceph-mon[30439]: from='client.? 172.21.15.100:0/4124991419' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "56806877-9ce2-41e2-9506-ce67897fa09b"}]: dispatch 2024-05-09T05:33:28.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:28 smithi039 ceph-mon[30439]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "56806877-9ce2-41e2-9506-ce67897fa09b"}]: dispatch 2024-05-09T05:33:28.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:28 smithi039 ceph-mon[30439]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "56806877-9ce2-41e2-9506-ce67897fa09b"}]': finished 2024-05-09T05:33:28.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:28 smithi039 ceph-mon[30439]: osdmap e70: 12 total, 11 up, 12 in 2024-05-09T05:33:28.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:28 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-09T05:33:28.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:28 smithi100 ceph-mon[34353]: from='client.? 172.21.15.100:0/4124991419' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "56806877-9ce2-41e2-9506-ce67897fa09b"}]: dispatch 2024-05-09T05:33:28.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:28 smithi100 ceph-mon[34353]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "56806877-9ce2-41e2-9506-ce67897fa09b"}]: dispatch 2024-05-09T05:33:28.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:28 smithi100 ceph-mon[34353]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "56806877-9ce2-41e2-9506-ce67897fa09b"}]': finished 2024-05-09T05:33:28.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:28 smithi100 ceph-mon[34353]: osdmap e70: 12 total, 11 up, 12 in 2024-05-09T05:33:28.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:28 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-09T05:33:29.511 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:29 smithi039 ceph-mon[30439]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-09T05:33:29.512 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:29 smithi039 ceph-mon[30439]: from='client.? 172.21.15.100:0/4184764806' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap", "output-file": "/var/lib/ceph/osd/ceph-11/activate.monmap"}]: dispatch 2024-05-09T05:33:29.546 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:29 smithi060 ceph-mon[34555]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-09T05:33:29.546 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:29 smithi060 ceph-mon[34555]: from='client.? 172.21.15.100:0/4184764806' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap", "output-file": "/var/lib/ceph/osd/ceph-11/activate.monmap"}]: dispatch 2024-05-09T05:33:29.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:29 smithi100 ceph-mon[34353]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 331 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-09T05:33:29.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:29 smithi100 ceph-mon[34353]: from='client.? 172.21.15.100:0/4184764806' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap", "output-file": "/var/lib/ceph/osd/ceph-11/activate.monmap"}]: dispatch 2024-05-09T05:33:31.546 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:31 smithi060 ceph-mon[34555]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-05-09T05:33:31.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:31 smithi039 ceph-mon[30439]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-05-09T05:33:31.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:31 smithi100 ceph-mon[34353]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-05-09T05:33:33.543 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:33 smithi100 ceph-mon[34353]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-09T05:33:33.546 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:33 smithi060 ceph-mon[34555]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-09T05:33:33.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:33 smithi039 ceph-mon[30439]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-09T05:33:35.546 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:35 smithi060 ceph-mon[34555]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-09T05:33:35.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:35 smithi039 ceph-mon[30439]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-09T05:33:35.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:35 smithi100 ceph-mon[34353]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-09T05:33:36.546 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:36 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-05-09T05:33:36.546 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:36 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:33:36.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:36 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-05-09T05:33:36.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:36 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:33:36.671 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:36 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-05-09T05:33:36.671 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:36 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:33:37.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:37 smithi060 ceph-mon[34555]: Deploying daemon osd.11 on smithi100 2024-05-09T05:33:37.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:37 smithi060 ceph-mon[34555]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-05-09T05:33:37.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:37 smithi039 ceph-mon[30439]: Deploying daemon osd.11 on smithi100 2024-05-09T05:33:37.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:37 smithi039 ceph-mon[30439]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-05-09T05:33:37.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:37 smithi100 ceph-mon[34353]: Deploying daemon osd.11 on smithi100 2024-05-09T05:33:37.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:37 smithi100 ceph-mon[34353]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-05-09T05:33:39.546 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:39 smithi060 ceph-mon[34555]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-05-09T05:33:39.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:39 smithi039 ceph-mon[30439]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-05-09T05:33:39.664 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:39 smithi100 ceph-mon[34353]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-05-09T05:33:41.606 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:41 smithi100 ceph-mon[34353]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-05-09T05:33:41.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:41 smithi039 ceph-mon[30439]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-05-09T05:33:41.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:41 smithi060 ceph-mon[34555]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-05-09T05:33:43.046 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:42 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:33:43.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:42 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:33:43.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:42 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:33:43.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:42 smithi060 ceph-mon[34555]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-05-09T05:33:43.174 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:42 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:33:43.174 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:42 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:33:43.174 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:42 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:33:43.174 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:42 smithi100 ceph-mon[34353]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-05-09T05:33:43.360 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:42 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:33:43.360 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:42 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:33:43.360 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:42 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:33:43.360 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:42 smithi039 ceph-mon[30439]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-05-09T05:33:45.364 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:45 smithi100 ceph-mon[34353]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-05-09T05:33:45.364 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:45 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:33:45.365 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:45 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:33:45.365 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:45 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:33:45.365 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:45 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:33:45.365 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:45 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:33:45.546 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:45 smithi060 ceph-mon[34555]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-05-09T05:33:45.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:45 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:33:45.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:45 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:33:45.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:45 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:33:45.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:45 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:33:45.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:45 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:33:45.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:45 smithi039 ceph-mon[30439]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-05-09T05:33:45.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:45 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:33:45.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:45 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:33:45.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:45 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:33:45.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:45 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:33:45.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:45 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:33:45.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:33:45.809+0000 7f48aa7fc700 1 -- 172.21.15.100:0/747277075 <== mgr.14152 v2:172.21.15.39:6800/3184189003 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f48b4063c00 con 0x7f48a00b2880 2024-05-09T05:33:45.804 INFO:teuthology.orchestra.run.smithi100.stdout:Created osd(s) 11 on host 'smithi100' 2024-05-09T05:33:45.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:33:45.812+0000 7f48bb3e5700 1 -- 172.21.15.100:0/747277075 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f48a00b2880 msgr2=0x7f48a00b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:33:45.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:33:45.812+0000 7f48bb3e5700 1 --2- 172.21.15.100:0/747277075 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f48a00b2880 0x7f48a00b4d90 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f48b406c0a0 tx=0x7f48a400b410 comp rx=0 tx=0).stop 2024-05-09T05:33:45.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:33:45.812+0000 7f48bb3e5700 1 -- 172.21.15.100:0/747277075 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f48b4102ca0 msgr2=0x7f48b4103580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:33:45.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:33:45.812+0000 7f48bb3e5700 1 --2- 172.21.15.100:0/747277075 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f48b4102ca0 0x7f48b4103580 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f48b000c920 tx=0x7f48b000cc30 comp rx=0 tx=0).stop 2024-05-09T05:33:45.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:33:45.812+0000 7f48bb3e5700 1 -- 172.21.15.100:0/747277075 shutdown_connections 2024-05-09T05:33:45.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:33:45.812+0000 7f48bb3e5700 1 --2- 172.21.15.100:0/747277075 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f48a00b2880 0x7f48a00b4d90 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:33:45.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:33:45.812+0000 7f48bb3e5700 1 --2- 172.21.15.100:0/747277075 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f48b4105900 0x7f48b4103ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:33:45.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:33:45.812+0000 7f48bb3e5700 1 --2- 172.21.15.100:0/747277075 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48b4102350 0x7f48b4104ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:33:45.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:33:45.812+0000 7f48bb3e5700 1 --2- 172.21.15.100:0/747277075 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f48b4102ca0 0x7f48b4103580 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:33:45.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:33:45.812+0000 7f48bb3e5700 1 -- 172.21.15.100:0/747277075 >> 172.21.15.100:0/747277075 conn(0x7f48b40fe020 msgr2=0x7f48b41088a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:33:45.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:33:45.813+0000 7f48bb3e5700 1 -- 172.21.15.100:0/747277075 shutdown_connections 2024-05-09T05:33:45.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:33:45.813+0000 7f48bb3e5700 1 -- 172.21.15.100:0/747277075 wait complete. 2024-05-09T05:33:46.406 DEBUG:teuthology.orchestra.run.smithi100:osd.11> sudo journalctl -f -n 0 -u ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@osd.11.service 2024-05-09T05:33:46.408 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-05-09T05:33:46.408 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph osd stat -f json 2024-05-09T05:33:46.675 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T05:33:47.005 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:46 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:33:47.005 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:46 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:33:47.005 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:46 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:33:47.005 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:46 smithi039 ceph-mon[30439]: from='osd.11 [v2:172.21.15.100:6824/3318561029,v1:172.21.15.100:6825/3318561029]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-09T05:33:47.005 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:46 smithi039 ceph-mon[30439]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-09T05:33:47.005 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:46 smithi039 ceph-mon[30439]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-05-09T05:33:47.046 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:46 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:33:47.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:46 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:33:47.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:46 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:33:47.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:46 smithi060 ceph-mon[34555]: from='osd.11 [v2:172.21.15.100:6824/3318561029,v1:172.21.15.100:6825/3318561029]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-09T05:33:47.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:46 smithi060 ceph-mon[34555]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-09T05:33:47.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:46 smithi060 ceph-mon[34555]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-05-09T05:33:47.173 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:46 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:33:47.173 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:46 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:33:47.174 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:46 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:33:47.174 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:46 smithi100 ceph-mon[34353]: from='osd.11 [v2:172.21.15.100:6824/3318561029,v1:172.21.15.100:6825/3318561029]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-09T05:33:47.174 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:46 smithi100 ceph-mon[34353]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-09T05:33:47.174 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:46 smithi100 ceph-mon[34353]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-05-09T05:33:47.872 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:47 smithi100 ceph-mon[34353]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-05-09T05:33:47.872 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:47 smithi100 ceph-mon[34353]: osdmap e71: 12 total, 11 up, 12 in 2024-05-09T05:33:47.872 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:47 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-09T05:33:47.872 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:47 smithi100 ceph-mon[34353]: from='osd.11 [v2:172.21.15.100:6824/3318561029,v1:172.21.15.100:6825/3318561029]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-05-09T05:33:47.873 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:47 smithi100 ceph-mon[34353]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-05-09T05:33:47.873 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 05:33:47 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T05:33:47.778+0000 7fa469afe700 -1 osd.11 0 waiting for initial osdmap 2024-05-09T05:33:47.873 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 05:33:47 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T05:33:47.793+0000 7fa4658b3700 -1 osd.11 72 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T05:33:48.046 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:47 smithi060 ceph-mon[34555]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-05-09T05:33:48.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:47 smithi060 ceph-mon[34555]: osdmap e71: 12 total, 11 up, 12 in 2024-05-09T05:33:48.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:47 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-09T05:33:48.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:47 smithi060 ceph-mon[34555]: from='osd.11 [v2:172.21.15.100:6824/3318561029,v1:172.21.15.100:6825/3318561029]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-05-09T05:33:48.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:47 smithi060 ceph-mon[34555]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-05-09T05:33:48.071 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:47 smithi039 ceph-mon[30439]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-05-09T05:33:48.071 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:47 smithi039 ceph-mon[30439]: osdmap e71: 12 total, 11 up, 12 in 2024-05-09T05:33:48.071 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:47 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-09T05:33:48.071 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:47 smithi039 ceph-mon[30439]: from='osd.11 [v2:172.21.15.100:6824/3318561029,v1:172.21.15.100:6825/3318561029]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-05-09T05:33:48.071 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:47 smithi039 ceph-mon[30439]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-05-09T05:33:48.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:48.334+0000 7f3c53f40700 1 -- 172.21.15.39:0/1054244980 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3c4c104d00 msgr2=0x7f3c4c10b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:33:48.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:48.334+0000 7f3c53f40700 1 --2- 172.21.15.39:0/1054244980 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3c4c104d00 0x7f3c4c10b5b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3c4400b0a0 tx=0x7f3c4400b3b0 comp rx=0 tx=0).stop 2024-05-09T05:33:48.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:48.334+0000 7f3c53f40700 1 -- 172.21.15.39:0/1054244980 shutdown_connections 2024-05-09T05:33:48.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:48.334+0000 7f3c53f40700 1 --2- 172.21.15.39:0/1054244980 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3c4c104d00 0x7f3c4c10b5b0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:33:48.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:48.334+0000 7f3c53f40700 1 --2- 172.21.15.39:0/1054244980 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c4c103230 0x7f3c4c103640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:33:48.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:48.334+0000 7f3c53f40700 1 --2- 172.21.15.39:0/1054244980 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c4c104360 0x7f3c4c104770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:33:48.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:48.334+0000 7f3c53f40700 1 -- 172.21.15.39:0/1054244980 >> 172.21.15.39:0/1054244980 conn(0x7f3c4c0fe870 msgr2=0x7f3c4c100d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:33:48.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:48.334+0000 7f3c53f40700 1 -- 172.21.15.39:0/1054244980 shutdown_connections 2024-05-09T05:33:48.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:48.334+0000 7f3c53f40700 1 -- 172.21.15.39:0/1054244980 wait complete. 2024-05-09T05:33:48.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:48.335+0000 7f3c53f40700 1 Processor -- start 2024-05-09T05:33:48.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:48.335+0000 7f3c53f40700 1 -- start start 2024-05-09T05:33:48.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:48.336+0000 7f3c53f40700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3c4c103230 0x7f3c4c06cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:33:48.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:48.336+0000 7f3c53f40700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c4c104360 0x7f3c4c19f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:33:48.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:48.336+0000 7f3c53f40700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c4c104d00 0x7f3c4c1a1c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:33:48.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:48.336+0000 7f3c53f40700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f3c4c10ed10 con 0x7f3c4c103230 2024-05-09T05:33:48.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:48.336+0000 7f3c53f40700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f3c4c10eb90 con 0x7f3c4c104d00 2024-05-09T05:33:48.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:48.336+0000 7f3c53f40700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3c4c10ee90 con 0x7f3c4c104360 2024-05-09T05:33:48.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:48.336+0000 7f3c51cdc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3c4c103230 0x7f3c4c06cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:33:48.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:48.336+0000 7f3c51cdc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3c4c103230 0x7f3c4c06cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:46444/0 (socket says 172.21.15.39:46444) 2024-05-09T05:33:48.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:48.336+0000 7f3c514db700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c4c104360 0x7f3c4c19f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:33:48.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:48.336+0000 7f3c51cdc700 1 -- 172.21.15.39:0/63975778 learned_addr learned my addr 172.21.15.39:0/63975778 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:33:48.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:48.336+0000 7f3c524dd700 1 --2- 172.21.15.39:0/63975778 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c4c104d00 0x7f3c4c1a1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:33:48.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:48.336+0000 7f3c51cdc700 1 -- 172.21.15.39:0/63975778 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c4c104360 msgr2=0x7f3c4c19f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:33:48.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:48.336+0000 7f3c51cdc700 1 --2- 172.21.15.39:0/63975778 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c4c104360 0x7f3c4c19f690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:33:48.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:48.336+0000 7f3c51cdc700 1 -- 172.21.15.39:0/63975778 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c4c104d00 msgr2=0x7f3c4c1a1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:33:48.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:48.336+0000 7f3c51cdc700 1 --2- 172.21.15.39:0/63975778 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c4c104d00 0x7f3c4c1a1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:33:48.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:48.336+0000 7f3c51cdc700 1 -- 172.21.15.39:0/63975778 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c4c1a2450 con 0x7f3c4c103230 2024-05-09T05:33:48.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:48.336+0000 7f3c51cdc700 1 --2- 172.21.15.39:0/63975778 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3c4c103230 0x7f3c4c06cac0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3c4800b4d0 tx=0x7f3c4800b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:33:48.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:48.337+0000 7f3c42ffd700 1 -- 172.21.15.39:0/63975778 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c48015020 con 0x7f3c4c103230 2024-05-09T05:33:48.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:48.337+0000 7f3c42ffd700 1 -- 172.21.15.39:0/63975778 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3c48011ce0 con 0x7f3c4c103230 2024-05-09T05:33:48.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:48.337+0000 7f3c42ffd700 1 -- 172.21.15.39:0/63975778 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c48010c40 con 0x7f3c4c103230 2024-05-09T05:33:48.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:48.337+0000 7f3c53f40700 1 -- 172.21.15.39:0/63975778 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c4c1a2740 con 0x7f3c4c103230 2024-05-09T05:33:48.334 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:48.337+0000 7f3c53f40700 1 -- 172.21.15.39:0/63975778 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c4c1a2c30 con 0x7f3c4c103230 2024-05-09T05:33:48.334 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:48.338+0000 7f3c53f40700 1 -- 172.21.15.39:0/63975778 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c4c0512c0 con 0x7f3c4c103230 2024-05-09T05:33:48.334 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:48.339+0000 7f3c42ffd700 1 -- 172.21.15.39:0/63975778 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f3c48018020 con 0x7f3c4c103230 2024-05-09T05:33:48.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:48.340+0000 7f3c42ffd700 1 --2- 172.21.15.39:0/63975778 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f3c380b2900 0x7f3c380b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:33:48.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:48.340+0000 7f3c514db700 1 --2- 172.21.15.39:0/63975778 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f3c380b2900 0x7f3c380b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:33:48.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:48.340+0000 7f3c42ffd700 1 -- 172.21.15.39:0/63975778 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6847+0+0 (secure 0 0 0) 0x7f3c480e1820 con 0x7f3c4c103230 2024-05-09T05:33:48.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:48.341+0000 7f3c514db700 1 --2- 172.21.15.39:0/63975778 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f3c380b2900 0x7f3c380b4e10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c06c470 tx=0x7f3c3c0073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:33:48.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:48.344+0000 7f3c42ffd700 1 -- 172.21.15.39:0/63975778 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f3c4801f020 con 0x7f3c4c103230 2024-05-09T05:33:48.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:48.559+0000 7f3c53f40700 1 -- 172.21.15.39:0/63975778 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f3c4c02e5f0 con 0x7f3c4c103230 2024-05-09T05:33:48.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:48.560+0000 7f3c42ffd700 1 -- 172.21.15.39:0/63975778 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v72) ==== 74+0+133 (secure 0 0 0) 0x7f3c480a9b00 con 0x7f3c4c103230 2024-05-09T05:33:48.554 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-09T05:33:48.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:48.562+0000 7f3c53f40700 1 -- 172.21.15.39:0/63975778 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f3c380b2900 msgr2=0x7f3c380b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:33:48.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:48.562+0000 7f3c53f40700 1 --2- 172.21.15.39:0/63975778 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f3c380b2900 0x7f3c380b4e10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c06c470 tx=0x7f3c3c0073d0 comp rx=0 tx=0).stop 2024-05-09T05:33:48.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:48.562+0000 7f3c53f40700 1 -- 172.21.15.39:0/63975778 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3c4c103230 msgr2=0x7f3c4c06cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:33:48.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:48.562+0000 7f3c53f40700 1 --2- 172.21.15.39:0/63975778 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3c4c103230 0x7f3c4c06cac0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3c4800b4d0 tx=0x7f3c4800b7e0 comp rx=0 tx=0).stop 2024-05-09T05:33:48.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:48.562+0000 7f3c53f40700 1 -- 172.21.15.39:0/63975778 shutdown_connections 2024-05-09T05:33:48.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:48.562+0000 7f3c53f40700 1 --2- 172.21.15.39:0/63975778 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f3c380b2900 0x7f3c380b4e10 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:33:48.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:48.562+0000 7f3c53f40700 1 --2- 172.21.15.39:0/63975778 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c4c104d00 0x7f3c4c1a1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:33:48.557 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:48.562+0000 7f3c53f40700 1 --2- 172.21.15.39:0/63975778 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3c4c103230 0x7f3c4c06cac0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:33:48.557 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:48.562+0000 7f3c53f40700 1 --2- 172.21.15.39:0/63975778 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c4c104360 0x7f3c4c19f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:33:48.557 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:48.562+0000 7f3c53f40700 1 -- 172.21.15.39:0/63975778 >> 172.21.15.39:0/63975778 conn(0x7f3c4c0fe870 msgr2=0x7f3c4c107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:33:48.557 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:48.562+0000 7f3c53f40700 1 -- 172.21.15.39:0/63975778 shutdown_connections 2024-05-09T05:33:48.557 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:48.562+0000 7f3c53f40700 1 -- 172.21.15.39:0/63975778 wait complete. 2024-05-09T05:33:48.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:48 smithi100 ceph-mon[34353]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2024-05-09T05:33:48.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:48 smithi100 ceph-mon[34353]: osdmap e72: 12 total, 11 up, 12 in 2024-05-09T05:33:48.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:48 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-09T05:33:48.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:48 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-09T05:33:48.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:48 smithi100 ceph-mon[34353]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-05-09T05:33:48.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:48 smithi100 ceph-mon[34353]: from='client.? 172.21.15.39:0/63975778' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-09T05:33:49.046 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:48 smithi060 ceph-mon[34555]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2024-05-09T05:33:49.046 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:48 smithi060 ceph-mon[34555]: osdmap e72: 12 total, 11 up, 12 in 2024-05-09T05:33:49.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:48 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-09T05:33:49.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:48 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-09T05:33:49.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:48 smithi060 ceph-mon[34555]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-05-09T05:33:49.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:48 smithi060 ceph-mon[34555]: from='client.? 172.21.15.39:0/63975778' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-09T05:33:49.110 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:48 smithi039 ceph-mon[30439]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2024-05-09T05:33:49.110 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:48 smithi039 ceph-mon[30439]: osdmap e72: 12 total, 11 up, 12 in 2024-05-09T05:33:49.110 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:48 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-09T05:33:49.110 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:48 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-09T05:33:49.110 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:48 smithi039 ceph-mon[30439]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-05-09T05:33:49.110 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:48 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/63975778' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-09T05:33:49.315 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":72,"num_osds":12,"num_up_osds":11,"osd_up_since":1715232802,"num_in_osds":12,"osd_in_since":1715232808,"num_remapped_pgs":0} 2024-05-09T05:33:49.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:49 smithi039 ceph-mon[30439]: purged_snaps scrub starts 2024-05-09T05:33:49.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:49 smithi039 ceph-mon[30439]: purged_snaps scrub ok 2024-05-09T05:33:49.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:49 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-09T05:33:49.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:49 smithi039 ceph-mon[30439]: osd.11 [v2:172.21.15.100:6824/3318561029,v1:172.21.15.100:6825/3318561029] boot 2024-05-09T05:33:49.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:49 smithi039 ceph-mon[30439]: osdmap e73: 12 total, 12 up, 12 in 2024-05-09T05:33:49.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:49 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-09T05:33:49.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:49 smithi039 ceph-mon[30439]: Detected new or changed devices on smithi100 2024-05-09T05:33:49.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:49 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:33:49.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:49 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:33:49.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:49 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:33:49.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:49 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:33:49.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:49 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:33:49.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:49 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:33:49.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:49 smithi039 ceph-mon[30439]: Adjusting osd_memory_target on smithi100 to 4272M 2024-05-09T05:33:49.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:49 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:33:49.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:49 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:33:49.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:49 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:33:49.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:49 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:33:50.046 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:49 smithi060 ceph-mon[34555]: purged_snaps scrub starts 2024-05-09T05:33:50.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:49 smithi060 ceph-mon[34555]: purged_snaps scrub ok 2024-05-09T05:33:50.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:49 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-09T05:33:50.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:49 smithi060 ceph-mon[34555]: osd.11 [v2:172.21.15.100:6824/3318561029,v1:172.21.15.100:6825/3318561029] boot 2024-05-09T05:33:50.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:49 smithi060 ceph-mon[34555]: osdmap e73: 12 total, 12 up, 12 in 2024-05-09T05:33:50.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:49 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-09T05:33:50.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:49 smithi060 ceph-mon[34555]: Detected new or changed devices on smithi100 2024-05-09T05:33:50.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:49 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:33:50.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:49 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:33:50.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:49 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:33:50.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:49 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:33:50.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:49 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:33:50.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:49 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:33:50.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:49 smithi060 ceph-mon[34555]: Adjusting osd_memory_target on smithi100 to 4272M 2024-05-09T05:33:50.048 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:49 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:33:50.048 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:49 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:33:50.048 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:49 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:33:50.048 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:49 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:33:50.173 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:49 smithi100 ceph-mon[34353]: purged_snaps scrub starts 2024-05-09T05:33:50.174 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:49 smithi100 ceph-mon[34353]: purged_snaps scrub ok 2024-05-09T05:33:50.174 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:49 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-09T05:33:50.174 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:49 smithi100 ceph-mon[34353]: osd.11 [v2:172.21.15.100:6824/3318561029,v1:172.21.15.100:6825/3318561029] boot 2024-05-09T05:33:50.174 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:49 smithi100 ceph-mon[34353]: osdmap e73: 12 total, 12 up, 12 in 2024-05-09T05:33:50.174 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:49 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-09T05:33:50.174 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:49 smithi100 ceph-mon[34353]: Detected new or changed devices on smithi100 2024-05-09T05:33:50.174 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:49 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:33:50.174 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:49 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:33:50.174 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:49 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:33:50.174 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:49 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:33:50.174 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:49 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:33:50.174 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:49 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:33:50.175 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:49 smithi100 ceph-mon[34353]: Adjusting osd_memory_target on smithi100 to 4272M 2024-05-09T05:33:50.175 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:49 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:33:50.175 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:49 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:33:50.175 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:49 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:33:50.175 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:49 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:33:50.316 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph osd stat -f json 2024-05-09T05:33:50.573 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T05:33:50.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:50 smithi039 ceph-mon[30439]: osdmap e74: 12 total, 12 up, 12 in 2024-05-09T05:33:50.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:50 smithi039 ceph-mon[30439]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T05:33:51.046 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:50 smithi060 ceph-mon[34555]: osdmap e74: 12 total, 12 up, 12 in 2024-05-09T05:33:51.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:50 smithi060 ceph-mon[34555]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T05:33:51.173 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:50 smithi100 ceph-mon[34353]: osdmap e74: 12 total, 12 up, 12 in 2024-05-09T05:33:51.173 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:50 smithi100 ceph-mon[34353]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T05:33:52.300 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:52.304+0000 7fcc475f5700 1 -- 172.21.15.39:0/2642136402 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcc40104380 msgr2=0x7fcc40104790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:33:52.300 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:52.304+0000 7fcc475f5700 1 --2- 172.21.15.39:0/2642136402 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcc40104380 0x7fcc40104790 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c009990 tx=0x7fcc3c009ca0 comp rx=0 tx=0).stop 2024-05-09T05:33:52.300 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:52.304+0000 7fcc475f5700 1 -- 172.21.15.39:0/2642136402 shutdown_connections 2024-05-09T05:33:52.300 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:52.304+0000 7fcc475f5700 1 --2- 172.21.15.39:0/2642136402 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc40104d20 0x7fcc4010b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:33:52.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:52.304+0000 7fcc475f5700 1 --2- 172.21.15.39:0/2642136402 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc40103250 0x7fcc40103660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:33:52.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:52.304+0000 7fcc475f5700 1 --2- 172.21.15.39:0/2642136402 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcc40104380 0x7fcc40104790 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:33:52.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:52.304+0000 7fcc475f5700 1 -- 172.21.15.39:0/2642136402 >> 172.21.15.39:0/2642136402 conn(0x7fcc400fe890 msgr2=0x7fcc40100d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:33:52.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:52.304+0000 7fcc475f5700 1 -- 172.21.15.39:0/2642136402 shutdown_connections 2024-05-09T05:33:52.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:52.304+0000 7fcc475f5700 1 -- 172.21.15.39:0/2642136402 wait complete. 2024-05-09T05:33:52.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:52.305+0000 7fcc475f5700 1 Processor -- start 2024-05-09T05:33:52.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:52.305+0000 7fcc475f5700 1 -- start start 2024-05-09T05:33:52.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:52.305+0000 7fcc475f5700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc40103250 0x7fcc40076450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:33:52.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:52.305+0000 7fcc475f5700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcc40104380 0x7fcc4019f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:33:52.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:52.305+0000 7fcc475f5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc40104d20 0x7fcc401a1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:33:52.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:52.305+0000 7fcc475f5700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fcc4010ecb0 con 0x7fcc40104380 2024-05-09T05:33:52.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:52.305+0000 7fcc475f5700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fcc4010eb30 con 0x7fcc40104d20 2024-05-09T05:33:52.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:52.305+0000 7fcc475f5700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fcc4010ee30 con 0x7fcc40103250 2024-05-09T05:33:52.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:52.305+0000 7fcc44b90700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcc40104380 0x7fcc4019f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:33:52.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:52.305+0000 7fcc44b90700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcc40104380 0x7fcc4019f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:46466/0 (socket says 172.21.15.39:46466) 2024-05-09T05:33:52.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:52.305+0000 7fcc44b90700 1 -- 172.21.15.39:0/346532709 learned_addr learned my addr 172.21.15.39:0/346532709 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:33:52.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:52.305+0000 7fcc45391700 1 --2- 172.21.15.39:0/346532709 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc40103250 0x7fcc40076450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:33:52.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:52.305+0000 7fcc45b92700 1 --2- 172.21.15.39:0/346532709 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc40104d20 0x7fcc401a1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:33:52.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:52.306+0000 7fcc44b90700 1 -- 172.21.15.39:0/346532709 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc40103250 msgr2=0x7fcc40076450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:33:52.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:52.306+0000 7fcc44b90700 1 --2- 172.21.15.39:0/346532709 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc40103250 0x7fcc40076450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:33:52.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:52.306+0000 7fcc44b90700 1 -- 172.21.15.39:0/346532709 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc40104d20 msgr2=0x7fcc401a1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:33:52.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:52.306+0000 7fcc44b90700 1 --2- 172.21.15.39:0/346532709 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc40104d20 0x7fcc401a1c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:33:52.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:52.306+0000 7fcc44b90700 1 -- 172.21.15.39:0/346532709 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc401a2460 con 0x7fcc40104380 2024-05-09T05:33:52.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:52.306+0000 7fcc44b90700 1 --2- 172.21.15.39:0/346532709 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcc40104380 0x7fcc4019f6c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c006010 tx=0x7fcc3c0047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:33:52.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:52.306+0000 7fcc327fc700 1 -- 172.21.15.39:0/346532709 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc3c027070 con 0x7fcc40104380 2024-05-09T05:33:52.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:52.306+0000 7fcc475f5700 1 -- 172.21.15.39:0/346532709 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc401a26f0 con 0x7fcc40104380 2024-05-09T05:33:52.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:52.306+0000 7fcc327fc700 1 -- 172.21.15.39:0/346532709 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcc3c004140 con 0x7fcc40104380 2024-05-09T05:33:52.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:52.306+0000 7fcc327fc700 1 -- 172.21.15.39:0/346532709 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc3c00f460 con 0x7fcc40104380 2024-05-09T05:33:52.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:52.306+0000 7fcc475f5700 1 -- 172.21.15.39:0/346532709 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc401a2ba0 con 0x7fcc40104380 2024-05-09T05:33:52.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:52.307+0000 7fcc475f5700 1 -- 172.21.15.39:0/346532709 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc400512c0 con 0x7fcc40104380 2024-05-09T05:33:52.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:52.309+0000 7fcc327fc700 1 -- 172.21.15.39:0/346532709 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fcc3c02a070 con 0x7fcc40104380 2024-05-09T05:33:52.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:52.310+0000 7fcc327fc700 1 --2- 172.21.15.39:0/346532709 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fcc2c0b2900 0x7fcc2c0b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:33:52.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:52.310+0000 7fcc45391700 1 --2- 172.21.15.39:0/346532709 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fcc2c0b2900 0x7fcc2c0b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:33:52.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:52.310+0000 7fcc327fc700 1 -- 172.21.15.39:0/346532709 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7fcc3c0e2f40 con 0x7fcc40104380 2024-05-09T05:33:52.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:52.310+0000 7fcc45391700 1 --2- 172.21.15.39:0/346532709 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fcc2c0b2900 0x7fcc2c0b4e10 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fcc40104280 tx=0x7fcc3400b5b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:33:52.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:52.314+0000 7fcc327fc700 1 -- 172.21.15.39:0/346532709 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fcc3c013070 con 0x7fcc40104380 2024-05-09T05:33:52.524 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:52.530+0000 7fcc475f5700 1 -- 172.21.15.39:0/346532709 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fcc4002e5f0 con 0x7fcc40104380 2024-05-09T05:33:52.524 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:52.530+0000 7fcc327fc700 1 -- 172.21.15.39:0/346532709 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v74) ==== 74+0+133 (secure 0 0 0) 0x7fcc3c0ab170 con 0x7fcc40104380 2024-05-09T05:33:52.525 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-09T05:33:52.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:52.533+0000 7fcc475f5700 1 -- 172.21.15.39:0/346532709 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fcc2c0b2900 msgr2=0x7fcc2c0b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:33:52.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:52.533+0000 7fcc475f5700 1 --2- 172.21.15.39:0/346532709 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fcc2c0b2900 0x7fcc2c0b4e10 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fcc40104280 tx=0x7fcc3400b5b0 comp rx=0 tx=0).stop 2024-05-09T05:33:52.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:52.533+0000 7fcc475f5700 1 -- 172.21.15.39:0/346532709 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcc40104380 msgr2=0x7fcc4019f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:33:52.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:52.533+0000 7fcc475f5700 1 --2- 172.21.15.39:0/346532709 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcc40104380 0x7fcc4019f6c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c006010 tx=0x7fcc3c0047b0 comp rx=0 tx=0).stop 2024-05-09T05:33:52.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:52.533+0000 7fcc475f5700 1 -- 172.21.15.39:0/346532709 shutdown_connections 2024-05-09T05:33:52.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:52.533+0000 7fcc475f5700 1 --2- 172.21.15.39:0/346532709 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fcc2c0b2900 0x7fcc2c0b4e10 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:33:52.529 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:52.533+0000 7fcc475f5700 1 --2- 172.21.15.39:0/346532709 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc40104d20 0x7fcc401a1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:33:52.529 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:52.533+0000 7fcc475f5700 1 --2- 172.21.15.39:0/346532709 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc40103250 0x7fcc40076450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:33:52.529 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:52.533+0000 7fcc475f5700 1 --2- 172.21.15.39:0/346532709 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcc40104380 0x7fcc4019f6c0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:33:52.529 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:52.533+0000 7fcc475f5700 1 -- 172.21.15.39:0/346532709 >> 172.21.15.39:0/346532709 conn(0x7fcc400fe890 msgr2=0x7fcc401075b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:33:52.529 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:52.533+0000 7fcc475f5700 1 -- 172.21.15.39:0/346532709 shutdown_connections 2024-05-09T05:33:52.529 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:52.533+0000 7fcc475f5700 1 -- 172.21.15.39:0/346532709 wait complete. 2024-05-09T05:33:53.204 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":74,"num_osds":12,"num_up_osds":12,"osd_up_since":1715232828,"num_in_osds":12,"osd_in_since":1715232808,"num_remapped_pgs":0} 2024-05-09T05:33:53.205 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-09T05:33:53.360 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:53 smithi039 ceph-mon[30439]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T05:33:53.360 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:53 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/346532709' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-09T05:33:53.423 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:53 smithi100 ceph-mon[34353]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T05:33:53.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:53 smithi100 ceph-mon[34353]: from='client.? 172.21.15.39:0/346532709' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-09T05:33:53.452 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T05:33:53.546 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:53 smithi060 ceph-mon[34555]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T05:33:53.546 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:53 smithi060 ceph-mon[34555]: from='client.? 172.21.15.39:0/346532709' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-09T05:33:55.158 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:55.163+0000 7ff654f67700 1 -- 172.21.15.39:0/523456345 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff65010e900 msgr2=0x7ff650110de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:33:55.158 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:55.163+0000 7ff654f67700 1 --2- 172.21.15.39:0/523456345 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff65010e900 0x7ff650110de0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff648009990 tx=0x7ff648009ca0 comp rx=0 tx=0).stop 2024-05-09T05:33:55.158 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:55.163+0000 7ff654f67700 1 -- 172.21.15.39:0/523456345 shutdown_connections 2024-05-09T05:33:55.158 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:55.163+0000 7ff654f67700 1 --2- 172.21.15.39:0/523456345 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff65010e900 0x7ff650110de0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:33:55.158 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:55.163+0000 7ff654f67700 1 --2- 172.21.15.39:0/523456345 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff650105520 0x7ff650105930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:33:55.158 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:55.163+0000 7ff654f67700 1 --2- 172.21.15.39:0/523456345 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff650105e70 0x7ff65010e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:33:55.158 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:55.163+0000 7ff654f67700 1 -- 172.21.15.39:0/523456345 >> 172.21.15.39:0/523456345 conn(0x7ff6500fef30 msgr2=0x7ff650101350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:33:55.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:55.164+0000 7ff654f67700 1 -- 172.21.15.39:0/523456345 shutdown_connections 2024-05-09T05:33:55.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:55.164+0000 7ff654f67700 1 -- 172.21.15.39:0/523456345 wait complete. 2024-05-09T05:33:55.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:55.164+0000 7ff654f67700 1 Processor -- start 2024-05-09T05:33:55.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:55.164+0000 7ff654f67700 1 -- start start 2024-05-09T05:33:55.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:55.165+0000 7ff654f67700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff650105520 0x7ff65019ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:33:55.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:55.165+0000 7ff654f67700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff650105e70 0x7ff65019b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:33:55.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:55.165+0000 7ff654f67700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff65010e900 0x7ff65019f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:33:55.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:55.165+0000 7ff654f67700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7ff650114460 con 0x7ff650105520 2024-05-09T05:33:55.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:55.165+0000 7ff654f67700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff6501142e0 con 0x7ff65010e900 2024-05-09T05:33:55.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:55.165+0000 7ff654f67700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff6501145e0 con 0x7ff650105e70 2024-05-09T05:33:55.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:55.165+0000 7ff64e59c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff650105520 0x7ff65019ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:33:55.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:55.165+0000 7ff64e59c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff650105520 0x7ff65019ae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:46484/0 (socket says 172.21.15.39:46484) 2024-05-09T05:33:55.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:55.165+0000 7ff64e59c700 1 -- 172.21.15.39:0/422921172 learned_addr learned my addr 172.21.15.39:0/422921172 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:33:55.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:55.165+0000 7ff64dd9b700 1 --2- 172.21.15.39:0/422921172 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff650105e70 0x7ff65019b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:33:55.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:55.165+0000 7ff64ed9d700 1 --2- 172.21.15.39:0/422921172 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff65010e900 0x7ff65019f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:33:55.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:55.165+0000 7ff64e59c700 1 -- 172.21.15.39:0/422921172 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff650105e70 msgr2=0x7ff65019b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:33:55.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:55.165+0000 7ff64e59c700 1 --2- 172.21.15.39:0/422921172 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff650105e70 0x7ff65019b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:33:55.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:55.165+0000 7ff64e59c700 1 -- 172.21.15.39:0/422921172 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff65010e900 msgr2=0x7ff65019f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:33:55.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:55.165+0000 7ff64e59c700 1 --2- 172.21.15.39:0/422921172 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff65010e900 0x7ff65019f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:33:55.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:55.165+0000 7ff64e59c700 1 -- 172.21.15.39:0/422921172 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff65019fd00 con 0x7ff650105520 2024-05-09T05:33:55.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:55.165+0000 7ff64dd9b700 1 --2- 172.21.15.39:0/422921172 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff650105e70 0x7ff65019b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T05:33:55.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:55.165+0000 7ff64ed9d700 1 --2- 172.21.15.39:0/422921172 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff65010e900 0x7ff65019f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:33:55.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:55.165+0000 7ff64e59c700 1 --2- 172.21.15.39:0/422921172 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff650105520 0x7ff65019ae30 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff6400060b0 tx=0x7ff640007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:33:55.163 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:55.166+0000 7ff6477fe700 1 -- 172.21.15.39:0/422921172 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff64001a070 con 0x7ff650105520 2024-05-09T05:33:55.163 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:55.166+0000 7ff654f67700 1 -- 172.21.15.39:0/422921172 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff65019fff0 con 0x7ff650105520 2024-05-09T05:33:55.163 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:55.166+0000 7ff6477fe700 1 -- 172.21.15.39:0/422921172 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff64000de20 con 0x7ff650105520 2024-05-09T05:33:55.163 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:55.166+0000 7ff6477fe700 1 -- 172.21.15.39:0/422921172 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff640014720 con 0x7ff650105520 2024-05-09T05:33:55.163 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:55.166+0000 7ff654f67700 1 -- 172.21.15.39:0/422921172 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6501a7910 con 0x7ff650105520 2024-05-09T05:33:55.163 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:55.167+0000 7ff654f67700 1 -- 172.21.15.39:0/422921172 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6500512c0 con 0x7ff650105520 2024-05-09T05:33:55.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:55.168+0000 7ff6477fe700 1 -- 172.21.15.39:0/422921172 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7ff64001d070 con 0x7ff650105520 2024-05-09T05:33:55.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:55.169+0000 7ff6477fe700 1 --2- 172.21.15.39:0/422921172 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7ff63c0b2880 0x7ff63c0b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:33:55.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:55.169+0000 7ff64dd9b700 1 --2- 172.21.15.39:0/422921172 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7ff63c0b2880 0x7ff63c0b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:33:55.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:55.169+0000 7ff6477fe700 1 -- 172.21.15.39:0/422921172 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7ff6400e1690 con 0x7ff650105520 2024-05-09T05:33:55.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:55.170+0000 7ff64dd9b700 1 --2- 172.21.15.39:0/422921172 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7ff63c0b2880 0x7ff63c0b4d90 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff650102400 tx=0x7ff638009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:33:55.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:55.174+0000 7ff6477fe700 1 -- 172.21.15.39:0/422921172 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7ff640010070 con 0x7ff650105520 2024-05-09T05:33:55.360 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:55 smithi039 ceph-mon[30439]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T05:33:55.387 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:55.393+0000 7ff654f67700 1 -- 172.21.15.39:0/422921172 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff65019c190 con 0x7ff650105520 2024-05-09T05:33:55.388 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:55.394+0000 7ff6477fe700 1 -- 172.21.15.39:0/422921172 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+18406 (secure 0 0 0) 0x7ff6400a9850 con 0x7ff650105520 2024-05-09T05:33:55.389 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-09T05:33:55.389 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":74,"fsid":"86d4cc60-0dc4-11ef-bc97-c7b262605968","created":"2024-05-09T05:26:33.514203+0000","modified":"2024-05-09T05:33:49.785299+0000","last_up_change":"2024-05-09T05:33:48.776015+0000","last_in_change":"2024-05-09T05:33:28.117875+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T05:29:56.122407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3491bbda-3a9b-40d2-8627-87d15660f864","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":1056276932},{"type":"v1","addr":"172.21.15.39:6803","nonce":1056276932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":1056276932},{"type":"v1","addr":"172.21.15.39:6805","nonce":1056276932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":1056276932},{"type":"v1","addr":"172.21.15.39:6809","nonce":1056276932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":1056276932},{"type":"v1","addr":"172.21.15.39:6807","nonce":1056276932}]},"public_addr":"172.21.15.39:6803/1056276932","cluster_addr":"172.21.15.39:6805/1056276932","heartbeat_back_addr":"172.21.15.39:6809/1056276932","heartbeat_front_addr":"172.21.15.39:6807/1056276932","state":["exists","up"]},{"osd":1,"uuid":"ec2bd2d0-2975-402c-9df8-3469dfd6070f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":4245630636},{"type":"v1","addr":"172.21.15.60:6801","nonce":4245630636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":4245630636},{"type":"v1","addr":"172.21.15.60:6803","nonce":4245630636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":4245630636},{"type":"v1","addr":"172.21.15.60:6807","nonce":4245630636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":4245630636},{"type":"v1","addr":"172.21.15.60:6805","nonce":4245630636}]},"public_addr":"172.21.15.60:6801/4245630636","cluster_addr":"172.21.15.60:6803/4245630636","heartbeat_back_addr":"172.21.15.60:6807/4245630636","heartbeat_front_addr":"172.21.15.60:6805/4245630636","state":["exists","up"]},{"osd":2,"uuid":"9efaf6dd-086e-4095-b92e-cbbecf738523","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":4141597693},{"type":"v1","addr":"172.21.15.100:6801","nonce":4141597693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":4141597693},{"type":"v1","addr":"172.21.15.100:6803","nonce":4141597693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":4141597693},{"type":"v1","addr":"172.21.15.100:6807","nonce":4141597693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":4141597693},{"type":"v1","addr":"172.21.15.100:6805","nonce":4141597693}]},"public_addr":"172.21.15.100:6801/4141597693","cluster_addr":"172.21.15.100:6803/4141597693","heartbeat_back_addr":"172.21.15.100:6807/4141597693","heartbeat_front_addr":"172.21.15.100:6805/4141597693","state":["exists","up"]},{"osd":3,"uuid":"1ebe1a25-541d-4b54-bed8-4f0ec51b2432","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":2254197543},{"type":"v1","addr":"172.21.15.39:6811","nonce":2254197543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":2254197543},{"type":"v1","addr":"172.21.15.39:6813","nonce":2254197543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2254197543},{"type":"v1","addr":"172.21.15.39:6817","nonce":2254197543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":2254197543},{"type":"v1","addr":"172.21.15.39:6815","nonce":2254197543}]},"public_addr":"172.21.15.39:6811/2254197543","cluster_addr":"172.21.15.39:6813/2254197543","heartbeat_back_addr":"172.21.15.39:6817/2254197543","heartbeat_front_addr":"172.21.15.39:6815/2254197543","state":["exists","up"]},{"osd":4,"uuid":"d52450a3-8a97-4746-a857-35aec69aac44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":649037162},{"type":"v1","addr":"172.21.15.60:6809","nonce":649037162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":649037162},{"type":"v1","addr":"172.21.15.60:6811","nonce":649037162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":649037162},{"type":"v1","addr":"172.21.15.60:6815","nonce":649037162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":649037162},{"type":"v1","addr":"172.21.15.60:6813","nonce":649037162}]},"public_addr":"172.21.15.60:6809/649037162","cluster_addr":"172.21.15.60:6811/649037162","heartbeat_back_addr":"172.21.15.60:6815/649037162","heartbeat_front_addr":"172.21.15.60:6813/649037162","state":["exists","up"]},{"osd":5,"uuid":"b35bf704-898d-40f7-b575-90267764a5b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":658409226},{"type":"v1","addr":"172.21.15.100:6809","nonce":658409226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":658409226},{"type":"v1","addr":"172.21.15.100:6811","nonce":658409226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":658409226},{"type":"v1","addr":"172.21.15.100:6815","nonce":658409226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":658409226},{"type":"v1","addr":"172.21.15.100:6813","nonce":658409226}]},"public_addr":"172.21.15.100:6809/658409226","cluster_addr":"172.21.15.100:6811/658409226","heartbeat_back_addr":"172.21.15.100:6815/658409226","heartbeat_front_addr":"172.21.15.100:6813/658409226","state":["exists","up"]},{"osd":6,"uuid":"49eae2f5-1dad-4c2c-89f4-efa1dd1faefb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":237628491},{"type":"v1","addr":"172.21.15.39:6819","nonce":237628491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":237628491},{"type":"v1","addr":"172.21.15.39:6821","nonce":237628491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":237628491},{"type":"v1","addr":"172.21.15.39:6825","nonce":237628491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":237628491},{"type":"v1","addr":"172.21.15.39:6823","nonce":237628491}]},"public_addr":"172.21.15.39:6819/237628491","cluster_addr":"172.21.15.39:6821/237628491","heartbeat_back_addr":"172.21.15.39:6825/237628491","heartbeat_front_addr":"172.21.15.39:6823/237628491","state":["exists","up"]},{"osd":7,"uuid":"60ccae54-535c-4a13-98d0-881c00b5e870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":2718201647},{"type":"v1","addr":"172.21.15.60:6817","nonce":2718201647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":2718201647},{"type":"v1","addr":"172.21.15.60:6819","nonce":2718201647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":2718201647},{"type":"v1","addr":"172.21.15.60:6823","nonce":2718201647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":2718201647},{"type":"v1","addr":"172.21.15.60:6821","nonce":2718201647}]},"public_addr":"172.21.15.60:6817/2718201647","cluster_addr":"172.21.15.60:6819/2718201647","heartbeat_back_addr":"172.21.15.60:6823/2718201647","heartbeat_front_addr":"172.21.15.60:6821/2718201647","state":["exists","up"]},{"osd":8,"uuid":"edd52a21-0066-429f-9e98-15d1a74c53b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":1757558317},{"type":"v1","addr":"172.21.15.100:6817","nonce":1757558317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":1757558317},{"type":"v1","addr":"172.21.15.100:6819","nonce":1757558317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":1757558317},{"type":"v1","addr":"172.21.15.100:6823","nonce":1757558317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":1757558317},{"type":"v1","addr":"172.21.15.100:6821","nonce":1757558317}]},"public_addr":"172.21.15.100:6817/1757558317","cluster_addr":"172.21.15.100:6819/1757558317","heartbeat_back_addr":"172.21.15.100:6823/1757558317","heartbeat_front_addr":"172.21.15.100:6821/1757558317","state":["exists","up"]},{"osd":9,"uuid":"03fb7543-3386-49a4-b165-1007f07d88d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":2944584368},{"type":"v1","addr":"172.21.15.39:6827","nonce":2944584368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":2944584368},{"type":"v1","addr":"172.21.15.39:6829","nonce":2944584368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":2944584368},{"type":"v1","addr":"172.21.15.39:6833","nonce":2944584368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":2944584368},{"type":"v1","addr":"172.21.15.39:6831","nonce":2944584368}]},"public_addr":"172.21.15.39:6827/2944584368","cluster_addr":"172.21.15.39:6829/2944584368","heartbeat_back_addr":"172.21.15.39:6833/2944584368","heartbeat_front_addr":"172.21.15.39:6831/2944584368","state":["exists","up"]},{"osd":10,"uuid":"c1cadd6c-fcc4-4d76-b07e-0f392066a8d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1940670367},{"type":"v1","addr":"172.21.15.60:6825","nonce":1940670367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":1940670367},{"type":"v1","addr":"172.21.15.60:6827","nonce":1940670367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":1940670367},{"type":"v1","addr":"172.21.15.60:6831","nonce":1940670367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":1940670367},{"type":"v1","addr":"172.21.15.60:6829","nonce":1940670367}]},"public_addr":"172.21.15.60:6825/1940670367","cluster_addr":"172.21.15.60:6827/1940670367","heartbeat_back_addr":"172.21.15.60:6831/1940670367","heartbeat_front_addr":"172.21.15.60:6829/1940670367","state":["exists","up"]},{"osd":11,"uuid":"56806877-9ce2-41e2-9506-ce67897fa09b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":3318561029},{"type":"v1","addr":"172.21.15.100:6825","nonce":3318561029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":3318561029},{"type":"v1","addr":"172.21.15.100:6827","nonce":3318561029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":3318561029},{"type":"v1","addr":"172.21.15.100:6831","nonce":3318561029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":3318561029},{"type":"v1","addr":"172.21.15.100:6829","nonce":3318561029}]},"public_addr":"172.21.15.100:6825/3318561029","cluster_addr":"172.21.15.100:6827/3318561029","heartbeat_back_addr":"172.21.15.100:6831/3318561029","heartbeat_front_addr":"172.21.15.100:6829/3318561029","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:29:03.565705+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:29:28.380764+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:29:53.300224+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:30:20.046517+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:30:45.557983+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:31:10.397933+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:31:37.644428+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:32:02.325329+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:32:27.699044+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:32:54.436305+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:33:20.691300+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:33:46.806146+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.39:6801/4091500272":"2024-05-10T05:27:28.034010+0000","172.21.15.39:6800/4091500272":"2024-05-10T05:27:28.034010+0000","172.21.15.39:0/782312916":"2024-05-10T05:27:28.034010+0000","172.21.15.39:0/1899316433":"2024-05-10T05:27:28.034010+0000","172.21.15.39:0/1613215795":"2024-05-10T05:27:00.650123+0000","172.21.15.39:0/2870431271":"2024-05-10T05:27:00.650123+0000","172.21.15.39:0/438945726":"2024-05-10T05:27:00.650123+0000","172.21.15.39:6800/499609328":"2024-05-10T05:27:00.650123+0000","172.21.15.39:6801/499609328":"2024-05-10T05:27:00.650123+0000","172.21.15.39:0/1698165886":"2024-05-10T05:27:28.034010+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T05:33:55.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:55.397+0000 7ff654f67700 1 -- 172.21.15.39:0/422921172 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7ff63c0b2880 msgr2=0x7ff63c0b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:33:55.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:55.397+0000 7ff654f67700 1 --2- 172.21.15.39:0/422921172 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7ff63c0b2880 0x7ff63c0b4d90 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff650102400 tx=0x7ff638009260 comp rx=0 tx=0).stop 2024-05-09T05:33:55.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:55.397+0000 7ff654f67700 1 -- 172.21.15.39:0/422921172 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff650105520 msgr2=0x7ff65019ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:33:55.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:55.397+0000 7ff654f67700 1 --2- 172.21.15.39:0/422921172 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff650105520 0x7ff65019ae30 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff6400060b0 tx=0x7ff640007f90 comp rx=0 tx=0).stop 2024-05-09T05:33:55.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:55.397+0000 7ff654f67700 1 -- 172.21.15.39:0/422921172 shutdown_connections 2024-05-09T05:33:55.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:55.397+0000 7ff654f67700 1 --2- 172.21.15.39:0/422921172 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7ff63c0b2880 0x7ff63c0b4d90 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:33:55.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:55.397+0000 7ff654f67700 1 --2- 172.21.15.39:0/422921172 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff65010e900 0x7ff65019f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:33:55.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:55.397+0000 7ff654f67700 1 --2- 172.21.15.39:0/422921172 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff650105520 0x7ff65019ae30 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:33:55.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:55.397+0000 7ff654f67700 1 --2- 172.21.15.39:0/422921172 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff650105e70 0x7ff65019b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:33:55.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:55.397+0000 7ff654f67700 1 -- 172.21.15.39:0/422921172 >> 172.21.15.39:0/422921172 conn(0x7ff6500fef30 msgr2=0x7ff6500ff520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:33:55.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:55.397+0000 7ff654f67700 1 -- 172.21.15.39:0/422921172 shutdown_connections 2024-05-09T05:33:55.392 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:55.397+0000 7ff654f67700 1 -- 172.21.15.39:0/422921172 wait complete. 2024-05-09T05:33:55.423 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:55 smithi100 ceph-mon[34353]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T05:33:55.546 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:55 smithi060 ceph-mon[34555]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T05:33:56.072 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-09T05:29:56.122407+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-09T05:33:56.072 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-05-09T05:33:56.328 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T05:33:56.360 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:56 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/422921172' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T05:33:56.546 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:56 smithi060 ceph-mon[34555]: from='client.? 172.21.15.39:0/422921172' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T05:33:56.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:56 smithi100 ceph-mon[34353]: from='client.? 172.21.15.39:0/422921172' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T05:33:57.470 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:57 smithi039 ceph-mon[30439]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T05:33:57.546 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:57 smithi060 ceph-mon[34555]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T05:33:57.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:57 smithi100 ceph-mon[34353]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T05:33:57.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:57.978+0000 7f29a2462700 1 -- 172.21.15.39:0/3582064767 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f299c108780 msgr2=0x7f299c1100e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:33:57.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:57.978+0000 7f29a2462700 1 --2- 172.21.15.39:0/3582064767 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f299c108780 0x7f299c1100e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f299400b0d0 tx=0x7f299400b3e0 comp rx=0 tx=0).stop 2024-05-09T05:33:57.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:57.978+0000 7f29a2462700 1 -- 172.21.15.39:0/3582064767 shutdown_connections 2024-05-09T05:33:57.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:57.978+0000 7f29a2462700 1 --2- 172.21.15.39:0/3582064767 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f299c108780 0x7f299c1100e0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:33:57.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:57.978+0000 7f29a2462700 1 --2- 172.21.15.39:0/3582064767 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f299c103550 0x7f299c103960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:33:57.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:57.978+0000 7f29a2462700 1 --2- 172.21.15.39:0/3582064767 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f299c107e30 0x7f299c108240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:33:57.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:57.978+0000 7f29a2462700 1 -- 172.21.15.39:0/3582064767 >> 172.21.15.39:0/3582064767 conn(0x7f299c078e00 msgr2=0x7f299c079240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:33:57.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:57.978+0000 7f29a2462700 1 -- 172.21.15.39:0/3582064767 shutdown_connections 2024-05-09T05:33:57.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:57.978+0000 7f29a2462700 1 -- 172.21.15.39:0/3582064767 wait complete. 2024-05-09T05:33:57.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:57.979+0000 7f29a2462700 1 Processor -- start 2024-05-09T05:33:57.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:57.979+0000 7f29a2462700 1 -- start start 2024-05-09T05:33:57.975 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:57.979+0000 7f29a2462700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f299c103550 0x7f299c19bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:33:57.976 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:57.979+0000 7f29a2462700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f299c107e30 0x7f299c19c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:33:57.976 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:57.979+0000 7f29a2462700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f299c108780 0x7f299c19c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:33:57.976 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:57.979+0000 7f29a2462700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f299c1133b0 con 0x7f299c108780 2024-05-09T05:33:57.976 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:57.979+0000 7f29a2462700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f299c113230 con 0x7f299c107e30 2024-05-09T05:33:57.976 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:57.979+0000 7f29a2462700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f299c113530 con 0x7f299c103550 2024-05-09T05:33:57.976 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:57.979+0000 7f29a09ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f299c108780 0x7f299c19c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:33:57.976 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:57.979+0000 7f299bfff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f299c103550 0x7f299c19bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:33:57.976 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:57.979+0000 7f29a09ff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f299c108780 0x7f299c19c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:49250/0 (socket says 172.21.15.39:49250) 2024-05-09T05:33:57.976 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:57.979+0000 7f29a09ff700 1 -- 172.21.15.39:0/1796280749 learned_addr learned my addr 172.21.15.39:0/1796280749 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:33:57.976 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:57.980+0000 7f299b7fe700 1 --2- 172.21.15.39:0/1796280749 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f299c107e30 0x7f299c19c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:33:57.976 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:57.980+0000 7f29a09ff700 1 -- 172.21.15.39:0/1796280749 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f299c103550 msgr2=0x7f299c19bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:33:57.977 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:57.980+0000 7f29a09ff700 1 --2- 172.21.15.39:0/1796280749 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f299c103550 0x7f299c19bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:33:57.977 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:57.980+0000 7f29a09ff700 1 -- 172.21.15.39:0/1796280749 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f299c107e30 msgr2=0x7f299c19c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:33:57.977 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:57.980+0000 7f29a09ff700 1 --2- 172.21.15.39:0/1796280749 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f299c107e30 0x7f299c19c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:33:57.977 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:57.980+0000 7f29a09ff700 1 -- 172.21.15.39:0/1796280749 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f299c1a6f10 con 0x7f299c108780 2024-05-09T05:33:57.977 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:57.980+0000 7f299b7fe700 1 --2- 172.21.15.39:0/1796280749 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f299c107e30 0x7f299c19c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T05:33:57.977 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:57.980+0000 7f299bfff700 1 --2- 172.21.15.39:0/1796280749 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f299c103550 0x7f299c19bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T05:33:57.977 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:57.980+0000 7f29a09ff700 1 --2- 172.21.15.39:0/1796280749 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f299c108780 0x7f299c19c6f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f29940095c0 tx=0x7f2994007a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:33:57.977 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:57.980+0000 7f29997fa700 1 -- 172.21.15.39:0/1796280749 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f299401f070 con 0x7f299c108780 2024-05-09T05:33:57.977 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:57.980+0000 7f29997fa700 1 -- 172.21.15.39:0/1796280749 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2994003c00 con 0x7f299c108780 2024-05-09T05:33:57.977 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:57.980+0000 7f29a2462700 1 -- 172.21.15.39:0/1796280749 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f299c1a71a0 con 0x7f299c108780 2024-05-09T05:33:57.977 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:57.980+0000 7f29997fa700 1 -- 172.21.15.39:0/1796280749 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f299401b6a0 con 0x7f299c108780 2024-05-09T05:33:57.977 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:57.980+0000 7f29a2462700 1 -- 172.21.15.39:0/1796280749 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f299c1a75f0 con 0x7f299c108780 2024-05-09T05:33:57.977 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:57.981+0000 7f29a2462700 1 -- 172.21.15.39:0/1796280749 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f299c0512c0 con 0x7f299c108780 2024-05-09T05:33:57.978 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:57.983+0000 7f29997fa700 1 -- 172.21.15.39:0/1796280749 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f2994022070 con 0x7f299c108780 2024-05-09T05:33:57.978 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:57.984+0000 7f29997fa700 1 --2- 172.21.15.39:0/1796280749 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f29840b2880 0x7f29840b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:33:57.979 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:57.984+0000 7f299bfff700 1 --2- 172.21.15.39:0/1796280749 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f29840b2880 0x7f29840b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:33:57.979 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:57.984+0000 7f29997fa700 1 -- 172.21.15.39:0/1796280749 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f299400f020 con 0x7f299c108780 2024-05-09T05:33:57.979 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:57.984+0000 7f299bfff700 1 --2- 172.21.15.39:0/1796280749 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f29840b2880 0x7f29840b4d90 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f298c00afd0 tx=0x7f298c00a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:33:57.982 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:57.988+0000 7f29997fa700 1 -- 172.21.15.39:0/1796280749 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f2994029020 con 0x7f299c108780 2024-05-09T05:33:58.195 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:58.200+0000 7f29a2462700 1 -- 172.21.15.39:0/1796280749 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f299c1a79e0 con 0x7f299c108780 2024-05-09T05:33:58.195 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:58.201+0000 7f29997fa700 1 -- 172.21.15.39:0/1796280749 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v74) ==== 93+0+10 (secure 0 0 0) 0x7f29940ab260 con 0x7f299c108780 2024-05-09T05:33:58.195 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 1 2024-05-09T05:33:58.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:58.203+0000 7f29a2462700 1 -- 172.21.15.39:0/1796280749 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f29840b2880 msgr2=0x7f29840b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:33:58.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:58.203+0000 7f29a2462700 1 --2- 172.21.15.39:0/1796280749 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f29840b2880 0x7f29840b4d90 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f298c00afd0 tx=0x7f298c00a380 comp rx=0 tx=0).stop 2024-05-09T05:33:58.198 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:58.203+0000 7f29a2462700 1 -- 172.21.15.39:0/1796280749 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f299c108780 msgr2=0x7f299c19c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:33:58.198 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:58.203+0000 7f29a2462700 1 --2- 172.21.15.39:0/1796280749 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f299c108780 0x7f299c19c6f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f29940095c0 tx=0x7f2994007a20 comp rx=0 tx=0).stop 2024-05-09T05:33:58.198 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:58.203+0000 7f29a2462700 1 -- 172.21.15.39:0/1796280749 shutdown_connections 2024-05-09T05:33:58.198 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:58.203+0000 7f29a2462700 1 --2- 172.21.15.39:0/1796280749 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f29840b2880 0x7f29840b4d90 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:33:58.198 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:58.203+0000 7f29a2462700 1 --2- 172.21.15.39:0/1796280749 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f299c108780 0x7f299c19c6f0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:33:58.198 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:58.203+0000 7f29a2462700 1 --2- 172.21.15.39:0/1796280749 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f299c103550 0x7f299c19bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:33:58.198 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:58.203+0000 7f29a2462700 1 --2- 172.21.15.39:0/1796280749 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f299c107e30 0x7f299c19c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:33:58.198 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:58.203+0000 7f29a2462700 1 -- 172.21.15.39:0/1796280749 >> 172.21.15.39:0/1796280749 conn(0x7f299c078e00 msgr2=0x7f299c100cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:33:58.198 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:58.203+0000 7f29a2462700 1 -- 172.21.15.39:0/1796280749 shutdown_connections 2024-05-09T05:33:58.198 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:33:58.203+0000 7f29a2462700 1 -- 172.21.15.39:0/1796280749 wait complete. 2024-05-09T05:33:58.846 INFO:tasks.cephadm:Adding mds.a on smithi039 2024-05-09T05:33:58.846 INFO:tasks.cephadm:Adding mds.d on smithi039 2024-05-09T05:33:58.846 INFO:tasks.cephadm:Adding mds.g on smithi039 2024-05-09T05:33:58.846 INFO:tasks.cephadm:Adding mds.j on smithi039 2024-05-09T05:33:58.847 INFO:tasks.cephadm:Adding mds.b on smithi060 2024-05-09T05:33:58.847 INFO:tasks.cephadm:Adding mds.e on smithi060 2024-05-09T05:33:58.847 INFO:tasks.cephadm:Adding mds.h on smithi060 2024-05-09T05:33:58.847 INFO:tasks.cephadm:Adding mds.k on smithi060 2024-05-09T05:33:58.847 INFO:tasks.cephadm:Adding mds.c on smithi100 2024-05-09T05:33:58.847 INFO:tasks.cephadm:Adding mds.f on smithi100 2024-05-09T05:33:58.847 INFO:tasks.cephadm:Adding mds.i on smithi100 2024-05-09T05:33:58.847 INFO:tasks.cephadm:Adding mds.l on smithi100 2024-05-09T05:33:58.847 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph orch apply mds all '12;smithi039=a;smithi039=d;smithi039=g;smithi039=j;smithi060=b;smithi060=e;smithi060=h;smithi060=k;smithi100=c;smithi100=f;smithi100=i;smithi100=l' 2024-05-09T05:33:59.096 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.c/config 2024-05-09T05:33:59.462 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:59 smithi100 ceph-mon[34353]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T05:33:59.462 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:33:59 smithi100 ceph-mon[34353]: from='client.? 172.21.15.39:0/1796280749' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-09T05:33:59.546 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:59 smithi060 ceph-mon[34555]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T05:33:59.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:33:59 smithi060 ceph-mon[34555]: from='client.? 172.21.15.39:0/1796280749' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-09T05:33:59.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:59 smithi039 ceph-mon[30439]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T05:33:59.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:33:59 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/1796280749' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-09T05:34:00.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:34:00.677+0000 7fb9e057c700 1 -- 172.21.15.100:0/300686317 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9d8104e40 msgr2=0x7fb9d8107260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:34:00.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:34:00.677+0000 7fb9e057c700 1 --2- 172.21.15.100:0/300686317 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9d8104e40 0x7fb9d8107260 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb9d4009990 tx=0x7fb9d4009ca0 comp rx=0 tx=0).stop 2024-05-09T05:34:00.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:34:00.677+0000 7fb9e057c700 1 -- 172.21.15.100:0/300686317 shutdown_connections 2024-05-09T05:34:00.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:34:00.677+0000 7fb9e057c700 1 --2- 172.21.15.100:0/300686317 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb9d810a100 0x7fb9d810c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:00.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:34:00.677+0000 7fb9e057c700 1 --2- 172.21.15.100:0/300686317 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9d8104e40 0x7fb9d8107260 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:00.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:34:00.677+0000 7fb9e057c700 1 --2- 172.21.15.100:0/300686317 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb9d81077a0 0x7fb9d8109bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:00.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:34:00.677+0000 7fb9e057c700 1 -- 172.21.15.100:0/300686317 >> 172.21.15.100:0/300686317 conn(0x7fb9d80fe880 msgr2=0x7fb9d8100d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:34:00.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:34:00.677+0000 7fb9e057c700 1 -- 172.21.15.100:0/300686317 shutdown_connections 2024-05-09T05:34:00.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:34:00.677+0000 7fb9e057c700 1 -- 172.21.15.100:0/300686317 wait complete. 2024-05-09T05:34:00.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:34:00.678+0000 7fb9e057c700 1 Processor -- start 2024-05-09T05:34:00.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:34:00.678+0000 7fb9e057c700 1 -- start start 2024-05-09T05:34:00.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:34:00.678+0000 7fb9e057c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9d8104e40 0x7fb9d819a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:34:00.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:34:00.678+0000 7fb9e057c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb9d81077a0 0x7fb9d819ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:34:00.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:34:00.678+0000 7fb9e057c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb9d810a100 0x7fb9d81a1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:34:00.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:34:00.678+0000 7fb9e057c700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fb9d810fdc0 con 0x7fb9d81077a0 2024-05-09T05:34:00.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:34:00.678+0000 7fb9e057c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb9d810fc40 con 0x7fb9d810a100 2024-05-09T05:34:00.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:34:00.678+0000 7fb9e057c700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb9d810ff40 con 0x7fb9d8104e40 2024-05-09T05:34:00.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:34:00.678+0000 7fb9de318700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9d8104e40 0x7fb9d819a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:34:00.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:34:00.678+0000 7fb9de318700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9d8104e40 0x7fb9d819a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48154/0 (socket says 172.21.15.100:48154) 2024-05-09T05:34:00.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:34:00.678+0000 7fb9de318700 1 -- 172.21.15.100:0/3989913784 learned_addr learned my addr 172.21.15.100:0/3989913784 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-05-09T05:34:00.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:34:00.678+0000 7fb9ddb17700 1 --2- 172.21.15.100:0/3989913784 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb9d81077a0 0x7fb9d819ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:34:00.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:34:00.679+0000 7fb9deb19700 1 --2- 172.21.15.100:0/3989913784 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb9d810a100 0x7fb9d81a1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:34:00.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:34:00.679+0000 7fb9de318700 1 -- 172.21.15.100:0/3989913784 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb9d810a100 msgr2=0x7fb9d81a1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:34:00.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:34:00.679+0000 7fb9de318700 1 --2- 172.21.15.100:0/3989913784 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb9d810a100 0x7fb9d81a1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:00.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:34:00.679+0000 7fb9de318700 1 -- 172.21.15.100:0/3989913784 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb9d81077a0 msgr2=0x7fb9d819ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:34:00.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:34:00.679+0000 7fb9de318700 1 --2- 172.21.15.100:0/3989913784 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb9d81077a0 0x7fb9d819ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:00.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:34:00.679+0000 7fb9de318700 1 -- 172.21.15.100:0/3989913784 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9d81a2400 con 0x7fb9d8104e40 2024-05-09T05:34:00.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:34:00.679+0000 7fb9deb19700 1 --2- 172.21.15.100:0/3989913784 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb9d810a100 0x7fb9d81a1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T05:34:00.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:34:00.679+0000 7fb9de318700 1 --2- 172.21.15.100:0/3989913784 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9d8104e40 0x7fb9d819a930 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb9d40098e0 tx=0x7fb9d40057a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:34:00.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:34:00.679+0000 7fb9cf7fe700 1 -- 172.21.15.100:0/3989913784 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d4026070 con 0x7fb9d8104e40 2024-05-09T05:34:00.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:34:00.679+0000 7fb9cf7fe700 1 -- 172.21.15.100:0/3989913784 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb9d400fbd0 con 0x7fb9d8104e40 2024-05-09T05:34:00.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:34:00.679+0000 7fb9cf7fe700 1 -- 172.21.15.100:0/3989913784 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d4017650 con 0x7fb9d8104e40 2024-05-09T05:34:00.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:34:00.679+0000 7fb9e057c700 1 -- 172.21.15.100:0/3989913784 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9d81a2690 con 0x7fb9d8104e40 2024-05-09T05:34:00.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:34:00.679+0000 7fb9e057c700 1 -- 172.21.15.100:0/3989913784 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9d81a2b40 con 0x7fb9d8104e40 2024-05-09T05:34:00.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:34:00.680+0000 7fb9e057c700 1 -- 172.21.15.100:0/3989913784 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9d80512c0 con 0x7fb9d8104e40 2024-05-09T05:34:00.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:34:00.682+0000 7fb9cf7fe700 1 -- 172.21.15.100:0/3989913784 <== mon.1 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fb9d4029070 con 0x7fb9d8104e40 2024-05-09T05:34:00.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:34:00.683+0000 7fb9cf7fe700 1 --2- 172.21.15.100:0/3989913784 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fb9c40b2900 0x7fb9c40b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:34:00.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:34:00.683+0000 7fb9ddb17700 1 --2- 172.21.15.100:0/3989913784 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fb9c40b2900 0x7fb9c40b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:34:00.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:34:00.683+0000 7fb9cf7fe700 1 -- 172.21.15.100:0/3989913784 <== mon.1 v2:172.21.15.100:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7fb9d40e2f30 con 0x7fb9d8104e40 2024-05-09T05:34:00.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:34:00.683+0000 7fb9ddb17700 1 --2- 172.21.15.100:0/3989913784 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fb9c40b2900 0x7fb9c40b4e10 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb9d819b9e0 tx=0x7fb9c800a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:34:00.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:34:00.687+0000 7fb9cf7fe700 1 -- 172.21.15.100:0/3989913784 <== mon.1 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fb9d4013070 con 0x7fb9d8104e40 2024-05-09T05:34:00.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:34:00.898+0000 7fb9e057c700 1 -- 172.21.15.100:0/3989913784 --> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi039=a;smithi039=d;smithi039=g;smithi039=j;smithi060=b;smithi060=e;smithi060=h;smithi060=k;smithi100=c;smithi100=f;smithi100=i;smithi100=l", "target": ["mon-mgr", ""]}) -- 0x7fb9d8063e00 con 0x7fb9c40b2900 2024-05-09T05:34:00.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:34:00.905+0000 7fb9cf7fe700 1 -- 172.21.15.100:0/3989913784 <== mgr.14152 v2:172.21.15.39:6800/3184189003 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7fb9d8063e00 con 0x7fb9c40b2900 2024-05-09T05:34:00.899 INFO:teuthology.orchestra.run.smithi100.stdout:Scheduled mds.all update... 2024-05-09T05:34:00.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:34:00.907+0000 7fb9e057c700 1 -- 172.21.15.100:0/3989913784 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fb9c40b2900 msgr2=0x7fb9c40b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:34:00.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:34:00.907+0000 7fb9e057c700 1 --2- 172.21.15.100:0/3989913784 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fb9c40b2900 0x7fb9c40b4e10 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb9d819b9e0 tx=0x7fb9c800a380 comp rx=0 tx=0).stop 2024-05-09T05:34:00.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:34:00.907+0000 7fb9e057c700 1 -- 172.21.15.100:0/3989913784 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9d8104e40 msgr2=0x7fb9d819a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:34:00.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:34:00.907+0000 7fb9e057c700 1 --2- 172.21.15.100:0/3989913784 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9d8104e40 0x7fb9d819a930 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb9d40098e0 tx=0x7fb9d40057a0 comp rx=0 tx=0).stop 2024-05-09T05:34:00.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:34:00.907+0000 7fb9e057c700 1 -- 172.21.15.100:0/3989913784 shutdown_connections 2024-05-09T05:34:00.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:34:00.907+0000 7fb9e057c700 1 --2- 172.21.15.100:0/3989913784 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fb9c40b2900 0x7fb9c40b4e10 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:00.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:34:00.907+0000 7fb9e057c700 1 --2- 172.21.15.100:0/3989913784 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb9d810a100 0x7fb9d81a1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:00.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:34:00.907+0000 7fb9e057c700 1 --2- 172.21.15.100:0/3989913784 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9d8104e40 0x7fb9d819a930 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:00.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:34:00.907+0000 7fb9e057c700 1 --2- 172.21.15.100:0/3989913784 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb9d81077a0 0x7fb9d819ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:00.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:34:00.907+0000 7fb9e057c700 1 -- 172.21.15.100:0/3989913784 >> 172.21.15.100:0/3989913784 conn(0x7fb9d80fe880 msgr2=0x7fb9d8105d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:34:00.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:34:00.907+0000 7fb9e057c700 1 -- 172.21.15.100:0/3989913784 shutdown_connections 2024-05-09T05:34:00.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-05-09T05:34:00.907+0000 7fb9e057c700 1 -- 172.21.15.100:0/3989913784 wait complete. 2024-05-09T05:34:01.503 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:01 smithi100 ceph-mon[34353]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T05:34:01.503 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:01 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:01.503 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:01 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:34:01.529 DEBUG:teuthology.orchestra.run.smithi039:mds.a> sudo journalctl -f -n 0 -u ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@mds.a.service 2024-05-09T05:34:01.532 DEBUG:teuthology.orchestra.run.smithi039:mds.d> sudo journalctl -f -n 0 -u ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@mds.d.service 2024-05-09T05:34:01.546 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:01 smithi060 ceph-mon[34555]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T05:34:01.546 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:01 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:01.546 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:01 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:34:01.556 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:01 smithi039 ceph-mon[30439]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T05:34:01.556 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:01 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:01.556 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:01 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:34:01.557 DEBUG:teuthology.orchestra.run.smithi039:mds.g> sudo journalctl -f -n 0 -u ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@mds.g.service 2024-05-09T05:34:01.599 DEBUG:teuthology.orchestra.run.smithi039:mds.j> sudo journalctl -f -n 0 -u ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@mds.j.service 2024-05-09T05:34:01.642 DEBUG:teuthology.orchestra.run.smithi060:mds.b> sudo journalctl -f -n 0 -u ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@mds.b.service 2024-05-09T05:34:01.645 DEBUG:teuthology.orchestra.run.smithi060:mds.e> sudo journalctl -f -n 0 -u ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@mds.e.service 2024-05-09T05:34:01.688 DEBUG:teuthology.orchestra.run.smithi060:mds.h> sudo journalctl -f -n 0 -u ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@mds.h.service 2024-05-09T05:34:01.731 DEBUG:teuthology.orchestra.run.smithi060:mds.k> sudo journalctl -f -n 0 -u ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@mds.k.service 2024-05-09T05:34:01.774 DEBUG:teuthology.orchestra.run.smithi100:mds.c> sudo journalctl -f -n 0 -u ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@mds.c.service 2024-05-09T05:34:01.776 DEBUG:teuthology.orchestra.run.smithi100:mds.f> sudo journalctl -f -n 0 -u ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@mds.f.service 2024-05-09T05:34:01.819 DEBUG:teuthology.orchestra.run.smithi100:mds.i> sudo journalctl -f -n 0 -u ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@mds.i.service 2024-05-09T05:34:01.862 DEBUG:teuthology.orchestra.run.smithi100:mds.l> sudo journalctl -f -n 0 -u ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@mds.l.service 2024-05-09T05:34:01.905 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-05-09T05:34:01.905 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-09T05:34:02.153 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T05:34:02.485 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:02 smithi100 ceph-mon[34353]: from='client.24421 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi039=a;smithi039=d;smithi039=g;smithi039=j;smithi060=b;smithi060=e;smithi060=h;smithi060=k;smithi100=c;smithi100=f;smithi100=i;smithi100=l", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T05:34:02.485 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:02 smithi100 ceph-mon[34353]: Saving service mds.all spec with placement smithi039=a;smithi039=d;smithi039=g;smithi039=j;smithi060=b;smithi060=e;smithi060=h;smithi060=k;smithi100=c;smithi100=f;smithi100=i;smithi100=l;count:12 2024-05-09T05:34:02.485 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:02 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:34:02.485 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:02 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:34:02.485 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:02 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:02.486 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:02 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T05:34:02.486 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:02 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T05:34:02.486 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:02 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:34:02.518 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:02 smithi039 ceph-mon[30439]: from='client.24421 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi039=a;smithi039=d;smithi039=g;smithi039=j;smithi060=b;smithi060=e;smithi060=h;smithi060=k;smithi100=c;smithi100=f;smithi100=i;smithi100=l", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T05:34:02.518 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:02 smithi039 ceph-mon[30439]: Saving service mds.all spec with placement smithi039=a;smithi039=d;smithi039=g;smithi039=j;smithi060=b;smithi060=e;smithi060=h;smithi060=k;smithi100=c;smithi100=f;smithi100=i;smithi100=l;count:12 2024-05-09T05:34:02.518 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:02 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:34:02.518 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:02 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:34:02.518 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:02 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:02.518 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:02 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T05:34:02.518 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:02 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T05:34:02.518 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:02 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:34:02.546 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:02 smithi060 ceph-mon[34555]: from='client.24421 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi039=a;smithi039=d;smithi039=g;smithi039=j;smithi060=b;smithi060=e;smithi060=h;smithi060=k;smithi100=c;smithi100=f;smithi100=i;smithi100=l", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T05:34:02.546 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:02 smithi060 ceph-mon[34555]: Saving service mds.all spec with placement smithi039=a;smithi039=d;smithi039=g;smithi039=j;smithi060=b;smithi060=e;smithi060=h;smithi060=k;smithi100=c;smithi100=f;smithi100=i;smithi100=l;count:12 2024-05-09T05:34:02.546 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:02 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:34:02.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:02 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:34:02.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:02 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:02.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:02 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T05:34:02.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:02 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T05:34:02.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:02 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:34:03.523 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:03 smithi039 ceph-mon[30439]: Deploying daemon mds.l on smithi100 2024-05-09T05:34:03.523 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:03 smithi039 ceph-mon[30439]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T05:34:03.546 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:03 smithi060 ceph-mon[34555]: Deploying daemon mds.l on smithi100 2024-05-09T05:34:03.546 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:03 smithi060 ceph-mon[34555]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T05:34:03.592 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:03 smithi100 ceph-mon[34353]: Deploying daemon mds.l on smithi100 2024-05-09T05:34:03.592 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:03 smithi100 ceph-mon[34353]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T05:34:03.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:03.909+0000 7fe2c89f0700 1 -- 172.21.15.39:0/3431221803 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe2c4108020 msgr2=0x7fe2c4108430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:34:03.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:03.909+0000 7fe2c89f0700 1 --2- 172.21.15.39:0/3431221803 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe2c4108020 0x7fe2c4108430 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac0099c0 tx=0x7fe2ac009cd0 comp rx=0 tx=0).stop 2024-05-09T05:34:03.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:03.910+0000 7fe2c89f0700 1 -- 172.21.15.39:0/3431221803 shutdown_connections 2024-05-09T05:34:03.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:03.910+0000 7fe2c89f0700 1 --2- 172.21.15.39:0/3431221803 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2c4108970 0x7fe2c41102d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:03.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:03.910+0000 7fe2c89f0700 1 --2- 172.21.15.39:0/3431221803 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe2c4103c10 0x7fe2c4104020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:03.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:03.910+0000 7fe2c89f0700 1 --2- 172.21.15.39:0/3431221803 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe2c4108020 0x7fe2c4108430 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:03.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:03.910+0000 7fe2c89f0700 1 -- 172.21.15.39:0/3431221803 >> 172.21.15.39:0/3431221803 conn(0x7fe2c40fe520 msgr2=0x7fe2c4100970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:34:03.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:03.910+0000 7fe2c89f0700 1 -- 172.21.15.39:0/3431221803 shutdown_connections 2024-05-09T05:34:03.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:03.910+0000 7fe2c89f0700 1 -- 172.21.15.39:0/3431221803 wait complete. 2024-05-09T05:34:03.907 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:03.911+0000 7fe2c89f0700 1 Processor -- start 2024-05-09T05:34:03.907 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:03.911+0000 7fe2c89f0700 1 -- start start 2024-05-09T05:34:03.907 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:03.911+0000 7fe2c89f0700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe2c4103c10 0x7fe2c419be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:34:03.907 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:03.911+0000 7fe2c89f0700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2c4108020 0x7fe2c419c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:34:03.907 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:03.911+0000 7fe2c89f0700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe2c4108970 0x7fe2c419c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:34:03.907 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:03.911+0000 7fe2c89f0700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fe2c4113580 con 0x7fe2c4108970 2024-05-09T05:34:03.907 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:03.911+0000 7fe2c89f0700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe2c4113400 con 0x7fe2c4108020 2024-05-09T05:34:03.907 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:03.911+0000 7fe2c89f0700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe2c4113700 con 0x7fe2c4103c10 2024-05-09T05:34:03.907 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:03.911+0000 7fe2c2d9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe2c4108970 0x7fe2c419c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:34:03.907 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:03.911+0000 7fe2c2d9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe2c4108970 0x7fe2c419c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:49270/0 (socket says 172.21.15.39:49270) 2024-05-09T05:34:03.907 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:03.911+0000 7fe2c2d9d700 1 -- 172.21.15.39:0/3579381257 learned_addr learned my addr 172.21.15.39:0/3579381257 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:34:03.907 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:03.911+0000 7fe2c259c700 1 --2- 172.21.15.39:0/3579381257 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe2c4103c10 0x7fe2c419be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:34:03.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:03.911+0000 7fe2c1d9b700 1 --2- 172.21.15.39:0/3579381257 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2c4108020 0x7fe2c419c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:34:03.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:03.911+0000 7fe2c259c700 1 -- 172.21.15.39:0/3579381257 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2c4108020 msgr2=0x7fe2c419c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:34:03.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:03.911+0000 7fe2c259c700 1 --2- 172.21.15.39:0/3579381257 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2c4108020 0x7fe2c419c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:03.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:03.911+0000 7fe2c259c700 1 -- 172.21.15.39:0/3579381257 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe2c4108970 msgr2=0x7fe2c419c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:34:03.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:03.911+0000 7fe2c259c700 1 --2- 172.21.15.39:0/3579381257 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe2c4108970 0x7fe2c419c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:03.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:03.911+0000 7fe2c259c700 1 -- 172.21.15.39:0/3579381257 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2c41a7140 con 0x7fe2c4103c10 2024-05-09T05:34:03.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:03.911+0000 7fe2c2d9d700 1 --2- 172.21.15.39:0/3579381257 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe2c4108970 0x7fe2c419c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T05:34:03.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:03.912+0000 7fe2c259c700 1 --2- 172.21.15.39:0/3579381257 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe2c4103c10 0x7fe2c419be60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe2b400ef10 tx=0x7fe2b400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:34:03.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:03.912+0000 7fe2bb7fe700 1 -- 172.21.15.39:0/3579381257 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2b400c9c0 con 0x7fe2c4103c10 2024-05-09T05:34:03.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:03.912+0000 7fe2c89f0700 1 -- 172.21.15.39:0/3579381257 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2c41a73d0 con 0x7fe2c4103c10 2024-05-09T05:34:03.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:03.912+0000 7fe2bb7fe700 1 -- 172.21.15.39:0/3579381257 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe2b4019070 con 0x7fe2c4103c10 2024-05-09T05:34:03.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:03.912+0000 7fe2bb7fe700 1 -- 172.21.15.39:0/3579381257 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2b4014480 con 0x7fe2c4103c10 2024-05-09T05:34:03.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:03.912+0000 7fe2c89f0700 1 -- 172.21.15.39:0/3579381257 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2c41a7930 con 0x7fe2c4103c10 2024-05-09T05:34:03.909 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:03.913+0000 7fe2c89f0700 1 -- 172.21.15.39:0/3579381257 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2c40512c0 con 0x7fe2c4103c10 2024-05-09T05:34:03.909 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:03.915+0000 7fe2bb7fe700 1 -- 172.21.15.39:0/3579381257 <== mon.1 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fe2b4012050 con 0x7fe2c4103c10 2024-05-09T05:34:03.909 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:03.916+0000 7fe2bb7fe700 1 --2- 172.21.15.39:0/3579381257 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fe2b00b2880 0x7fe2b00b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:34:03.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:03.916+0000 7fe2c1d9b700 1 --2- 172.21.15.39:0/3579381257 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fe2b00b2880 0x7fe2b00b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:34:03.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:03.916+0000 7fe2bb7fe700 1 -- 172.21.15.39:0/3579381257 <== mon.1 v2:172.21.15.100:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7fe2b40e23a0 con 0x7fe2c4103c10 2024-05-09T05:34:03.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:03.916+0000 7fe2c1d9b700 1 --2- 172.21.15.39:0/3579381257 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fe2b00b2880 0x7fe2b00b4d90 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac000c00 tx=0x7fe2ac01a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:34:03.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:03.919+0000 7fe2bb7fe700 1 -- 172.21.15.39:0/3579381257 <== mon.1 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fe2b4010040 con 0x7fe2c4103c10 2024-05-09T05:34:03.923 INFO:journalctl@ceph.mds.l.smithi100.stdout:May 09 05:34:03 smithi100 systemd[1]: Starting Ceph mds.l for 86d4cc60-0dc4-11ef-bc97-c7b262605968... 2024-05-09T05:34:04.175 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:04.181+0000 7fe2c89f0700 1 -- 172.21.15.39:0/3579381257 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe2c406c0c0 con 0x7fe2c4103c10 2024-05-09T05:34:04.176 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:04.182+0000 7fe2bb7fe700 1 -- 172.21.15.39:0/3579381257 <== mon.1 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+569 (secure 0 0 0) 0x7fe2b40aa540 con 0x7fe2c4103c10 2024-05-09T05:34:04.176 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-09T05:34:04.176 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-05-09T05:34:04.178 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:04.184+0000 7fe2c89f0700 1 -- 172.21.15.39:0/3579381257 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fe2b00b2880 msgr2=0x7fe2b00b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:34:04.178 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:04.184+0000 7fe2c89f0700 1 --2- 172.21.15.39:0/3579381257 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fe2b00b2880 0x7fe2b00b4d90 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac000c00 tx=0x7fe2ac01a040 comp rx=0 tx=0).stop 2024-05-09T05:34:04.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:04.184+0000 7fe2c89f0700 1 -- 172.21.15.39:0/3579381257 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe2c4103c10 msgr2=0x7fe2c419be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:34:04.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:04.184+0000 7fe2c89f0700 1 --2- 172.21.15.39:0/3579381257 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe2c4103c10 0x7fe2c419be60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe2b400ef10 tx=0x7fe2b400c3a0 comp rx=0 tx=0).stop 2024-05-09T05:34:04.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:04.185+0000 7fe2c89f0700 1 -- 172.21.15.39:0/3579381257 shutdown_connections 2024-05-09T05:34:04.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:04.185+0000 7fe2c89f0700 1 --2- 172.21.15.39:0/3579381257 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fe2b00b2880 0x7fe2b00b4d90 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:04.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:04.185+0000 7fe2c89f0700 1 --2- 172.21.15.39:0/3579381257 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe2c4108970 0x7fe2c419c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:04.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:04.185+0000 7fe2c89f0700 1 --2- 172.21.15.39:0/3579381257 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe2c4103c10 0x7fe2c419be60 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:04.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:04.185+0000 7fe2c89f0700 1 --2- 172.21.15.39:0/3579381257 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2c4108020 0x7fe2c419c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:04.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:04.185+0000 7fe2c89f0700 1 -- 172.21.15.39:0/3579381257 >> 172.21.15.39:0/3579381257 conn(0x7fe2c40fe520 msgr2=0x7fe2c4107800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:34:04.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:04.185+0000 7fe2c89f0700 1 -- 172.21.15.39:0/3579381257 shutdown_connections 2024-05-09T05:34:04.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:04.185+0000 7fe2c89f0700 1 -- 172.21.15.39:0/3579381257 wait complete. 2024-05-09T05:34:04.180 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 1 2024-05-09T05:34:04.241 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:04 smithi100 ceph-mon[34353]: from='client.? 172.21.15.39:0/3579381257' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T05:34:04.242 INFO:journalctl@ceph.mds.l.smithi100.stdout:May 09 05:34:03 smithi100 podman[64612]: 2024-05-09 05:34:03.898094786 +0000 UTC m=+0.018112732 image pull db794d706f492c144ccc8f2c5bbc1870e116f5c4f3309dfab4416b39d099f8d7 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584 2024-05-09T05:34:04.242 INFO:journalctl@ceph.mds.l.smithi100.stdout:May 09 05:34:04 smithi100 podman[64612]: 2024-05-09 05:34:04.011645143 +0000 UTC m=+0.131663064 container create 18ebd9304fb6e4f9170dcedca2818f997f71f9e43fe2cbada55b07a542b5753d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-l, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, GIT_CLEAN=True) 2024-05-09T05:34:04.242 INFO:journalctl@ceph.mds.l.smithi100.stdout:May 09 05:34:04 smithi100 podman[64612]: 2024-05-09 05:34:04.213887975 +0000 UTC m=+0.333905896 container init 18ebd9304fb6e4f9170dcedca2818f997f71f9e43fe2cbada55b07a542b5753d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-l, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-05-09T05:34:04.242 INFO:journalctl@ceph.mds.l.smithi100.stdout:May 09 05:34:04 smithi100 podman[64612]: 2024-05-09 05:34:04.216533002 +0000 UTC m=+0.336550926 container start 18ebd9304fb6e4f9170dcedca2818f997f71f9e43fe2cbada55b07a542b5753d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-l, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-09T05:34:04.512 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:04 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/3579381257' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T05:34:04.546 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:04 smithi060 ceph-mon[34555]: from='client.? 172.21.15.39:0/3579381257' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T05:34:04.673 INFO:journalctl@ceph.mds.l.smithi100.stdout:May 09 05:34:04 smithi100 ceph-mds[64631]: -- 172.21.15.100:0/2028678678 <== mon.1 v2:172.21.15.100:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559e1d165a40 con 0x559e1d1ada80 2024-05-09T05:34:04.674 INFO:journalctl@ceph.mds.l.smithi100.stdout:May 09 05:34:04 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-l[64627]: starting mds.l at 2024-05-09T05:34:04.674 INFO:journalctl@ceph.mds.l.smithi100.stdout:May 09 05:34:04 smithi100 bash[64612]: 18ebd9304fb6e4f9170dcedca2818f997f71f9e43fe2cbada55b07a542b5753d 2024-05-09T05:34:04.674 INFO:journalctl@ceph.mds.l.smithi100.stdout:May 09 05:34:04 smithi100 systemd[1]: Started Ceph mds.l for 86d4cc60-0dc4-11ef-bc97-c7b262605968. 2024-05-09T05:34:05.430 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:05 smithi060 ceph-mon[34555]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T05:34:05.430 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:05 smithi060 ceph-mon[34555]: mds.? [v2:172.21.15.100:6832/1308189973,v1:172.21.15.100:6833/1308189973] up:boot 2024-05-09T05:34:05.430 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:05 smithi060 ceph-mon[34555]: fsmap 1 up:standby 2024-05-09T05:34:05.430 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:05 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-09T05:34:05.430 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:05 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:05.431 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:05 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:05.431 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:05 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:05.431 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:05 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T05:34:05.431 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:05 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T05:34:05.431 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:05 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:34:05.431 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:05 smithi060 ceph-mon[34555]: Deploying daemon mds.k on smithi060 2024-05-09T05:34:05.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:05 smithi039 ceph-mon[30439]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T05:34:05.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:05 smithi039 ceph-mon[30439]: mds.? [v2:172.21.15.100:6832/1308189973,v1:172.21.15.100:6833/1308189973] up:boot 2024-05-09T05:34:05.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:05 smithi039 ceph-mon[30439]: fsmap 1 up:standby 2024-05-09T05:34:05.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:05 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-09T05:34:05.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:05 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:05.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:05 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:05.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:05 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:05.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:05 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T05:34:05.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:05 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T05:34:05.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:05 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:34:05.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:05 smithi039 ceph-mon[30439]: Deploying daemon mds.k on smithi060 2024-05-09T05:34:05.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:05 smithi100 ceph-mon[34353]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T05:34:05.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:05 smithi100 ceph-mon[34353]: mds.? [v2:172.21.15.100:6832/1308189973,v1:172.21.15.100:6833/1308189973] up:boot 2024-05-09T05:34:05.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:05 smithi100 ceph-mon[34353]: fsmap 1 up:standby 2024-05-09T05:34:05.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:05 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-09T05:34:05.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:05 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:05.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:05 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:05.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:05 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:05.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:05 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T05:34:05.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:05 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T05:34:05.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:05 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:34:05.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:05 smithi100 ceph-mon[34353]: Deploying daemon mds.k on smithi060 2024-05-09T05:34:06.796 INFO:journalctl@ceph.mds.k.smithi060.stdout:May 09 05:34:06 smithi060 systemd[1]: Starting Ceph mds.k for 86d4cc60-0dc4-11ef-bc97-c7b262605968... 2024-05-09T05:34:06.884 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-09T05:34:07.097 INFO:journalctl@ceph.mds.k.smithi060.stdout:May 09 05:34:06 smithi060 podman[63842]: 2024-05-09 05:34:06.752307251 +0000 UTC m=+0.018654168 image pull db794d706f492c144ccc8f2c5bbc1870e116f5c4f3309dfab4416b39d099f8d7 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584 2024-05-09T05:34:07.097 INFO:journalctl@ceph.mds.k.smithi060.stdout:May 09 05:34:06 smithi060 podman[63842]: 2024-05-09 05:34:06.876982665 +0000 UTC m=+0.143329555 container create af347e184d3292cc764784ee97f3e39a51e637299d6ca2022801eed007549984 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-k, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240507, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-05-09T05:34:07.098 INFO:journalctl@ceph.mds.k.smithi060.stdout:May 09 05:34:07 smithi060 podman[63842]: 2024-05-09 05:34:07.104379375 +0000 UTC m=+0.370726272 container init af347e184d3292cc764784ee97f3e39a51e637299d6ca2022801eed007549984 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-k, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, io.buildah.version=1.33.5) 2024-05-09T05:34:07.150 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T05:34:07.546 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:07 smithi060 ceph-mon[34555]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T05:34:07.547 INFO:journalctl@ceph.mds.k.smithi060.stdout:May 09 05:34:07 smithi060 podman[63842]: 2024-05-09 05:34:07.107191827 +0000 UTC m=+0.373538717 container start af347e184d3292cc764784ee97f3e39a51e637299d6ca2022801eed007549984 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-k, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-05-09T05:34:07.547 INFO:journalctl@ceph.mds.k.smithi060.stdout:May 09 05:34:07 smithi060 ceph-mds[63862]: -- 172.21.15.60:0/247540432 <== mon.2 v2:172.21.15.60:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55bd1046fa40 con 0x55bd104b7180 2024-05-09T05:34:07.547 INFO:journalctl@ceph.mds.k.smithi060.stdout:May 09 05:34:07 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-k[63858]: starting mds.k at 2024-05-09T05:34:07.547 INFO:journalctl@ceph.mds.k.smithi060.stdout:May 09 05:34:07 smithi060 bash[63842]: af347e184d3292cc764784ee97f3e39a51e637299d6ca2022801eed007549984 2024-05-09T05:34:07.547 INFO:journalctl@ceph.mds.k.smithi060.stdout:May 09 05:34:07 smithi060 systemd[1]: Started Ceph mds.k for 86d4cc60-0dc4-11ef-bc97-c7b262605968. 2024-05-09T05:34:07.582 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:07 smithi039 ceph-mon[30439]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T05:34:07.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:07 smithi100 ceph-mon[34353]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T05:34:08.541 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:08 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:08.541 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:08 smithi060 ceph-mon[34555]: mds.? [v2:172.21.15.60:6832/2789974692,v1:172.21.15.60:6833/2789974692] up:boot 2024-05-09T05:34:08.542 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:08 smithi060 ceph-mon[34555]: fsmap 2 up:standby 2024-05-09T05:34:08.542 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:08 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-09T05:34:08.542 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:08 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:08.542 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:08 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:08.542 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:08 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T05:34:08.543 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:08 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T05:34:08.543 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:08 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:34:08.543 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:08 smithi060 ceph-mon[34555]: Deploying daemon mds.j on smithi039 2024-05-09T05:34:08.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:08 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:08.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:08 smithi039 ceph-mon[30439]: mds.? [v2:172.21.15.60:6832/2789974692,v1:172.21.15.60:6833/2789974692] up:boot 2024-05-09T05:34:08.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:08 smithi039 ceph-mon[30439]: fsmap 2 up:standby 2024-05-09T05:34:08.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:08 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-09T05:34:08.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:08 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:08.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:08 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:08.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:08 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T05:34:08.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:08 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T05:34:08.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:08 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:34:08.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:08 smithi039 ceph-mon[30439]: Deploying daemon mds.j on smithi039 2024-05-09T05:34:08.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:08 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:08.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:08 smithi100 ceph-mon[34353]: mds.? [v2:172.21.15.60:6832/2789974692,v1:172.21.15.60:6833/2789974692] up:boot 2024-05-09T05:34:08.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:08 smithi100 ceph-mon[34353]: fsmap 2 up:standby 2024-05-09T05:34:08.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:08 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-09T05:34:08.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:08 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:08.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:08 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:08.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:08 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T05:34:08.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:08 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T05:34:08.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:08 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:34:08.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:08 smithi100 ceph-mon[34353]: Deploying daemon mds.j on smithi039 2024-05-09T05:34:09.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:09 smithi039 ceph-mon[30439]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T05:34:09.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:09 smithi100 ceph-mon[34353]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T05:34:09.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:09 smithi060 ceph-mon[34555]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T05:34:10.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:10.074+0000 7f8df0f12700 1 -- 172.21.15.39:0/3422286093 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8dec107e10 msgr2=0x7f8dec108220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:34:10.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:10.074+0000 7f8df0f12700 1 --2- 172.21.15.39:0/3422286093 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8dec107e10 0x7f8dec108220 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8de00099c0 tx=0x7f8de0009cd0 comp rx=0 tx=0).stop 2024-05-09T05:34:10.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:10.074+0000 7f8df0f12700 1 -- 172.21.15.39:0/3422286093 shutdown_connections 2024-05-09T05:34:10.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:10.074+0000 7f8df0f12700 1 --2- 172.21.15.39:0/3422286093 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8dec108760 0x7f8dec1100c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:10.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:10.074+0000 7f8df0f12700 1 --2- 172.21.15.39:0/3422286093 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8dec1034e0 0x7f8dec1038f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:10.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:10.074+0000 7f8df0f12700 1 --2- 172.21.15.39:0/3422286093 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8dec107e10 0x7f8dec108220 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:10.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:10.075+0000 7f8df0f12700 1 -- 172.21.15.39:0/3422286093 >> 172.21.15.39:0/3422286093 conn(0x7f8dec0fef30 msgr2=0x7f8dec101350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:34:10.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:10.075+0000 7f8df0f12700 1 -- 172.21.15.39:0/3422286093 shutdown_connections 2024-05-09T05:34:10.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:10.075+0000 7f8df0f12700 1 -- 172.21.15.39:0/3422286093 wait complete. 2024-05-09T05:34:10.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:10.075+0000 7f8df0f12700 1 Processor -- start 2024-05-09T05:34:10.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:10.076+0000 7f8df0f12700 1 -- start start 2024-05-09T05:34:10.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:10.076+0000 7f8df0f12700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8dec1034e0 0x7f8dec19aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:34:10.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:10.076+0000 7f8df0f12700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8dec107e10 0x7f8dec19b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:34:10.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:10.076+0000 7f8df0f12700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8dec108760 0x7f8dec19f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:34:10.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:10.076+0000 7f8df0f12700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f8dec113370 con 0x7f8dec1034e0 2024-05-09T05:34:10.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:10.076+0000 7f8df0f12700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f8dec1131f0 con 0x7f8dec108760 2024-05-09T05:34:10.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:10.076+0000 7f8df0f12700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8dec1134f0 con 0x7f8dec107e10 2024-05-09T05:34:10.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:10.076+0000 7f8dea59c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8dec1034e0 0x7f8dec19aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:34:10.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:10.076+0000 7f8dea59c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8dec1034e0 0x7f8dec19aeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:39154/0 (socket says 172.21.15.39:39154) 2024-05-09T05:34:10.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:10.076+0000 7f8dea59c700 1 -- 172.21.15.39:0/880870888 learned_addr learned my addr 172.21.15.39:0/880870888 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:34:10.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:10.076+0000 7f8dead9d700 1 --2- 172.21.15.39:0/880870888 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8dec108760 0x7f8dec19f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:34:10.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:10.076+0000 7f8de9d9b700 1 --2- 172.21.15.39:0/880870888 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8dec107e10 0x7f8dec19b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:34:10.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:10.076+0000 7f8dea59c700 1 -- 172.21.15.39:0/880870888 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8dec107e10 msgr2=0x7f8dec19b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:34:10.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:10.076+0000 7f8dea59c700 1 --2- 172.21.15.39:0/880870888 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8dec107e10 0x7f8dec19b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:10.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:10.076+0000 7f8dea59c700 1 -- 172.21.15.39:0/880870888 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8dec108760 msgr2=0x7f8dec19f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:34:10.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:10.076+0000 7f8dea59c700 1 --2- 172.21.15.39:0/880870888 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8dec108760 0x7f8dec19f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:10.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:10.076+0000 7f8dea59c700 1 -- 172.21.15.39:0/880870888 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dec19fd80 con 0x7f8dec1034e0 2024-05-09T05:34:10.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:10.077+0000 7f8dea59c700 1 --2- 172.21.15.39:0/880870888 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8dec1034e0 0x7f8dec19aeb0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc00e9a0 tx=0x7f8ddc00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:34:10.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:10.077+0000 7f8ddb7fe700 1 -- 172.21.15.39:0/880870888 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ddc00ca10 con 0x7f8dec1034e0 2024-05-09T05:34:10.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:10.077+0000 7f8df0f12700 1 -- 172.21.15.39:0/880870888 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8dec1a0070 con 0x7f8dec1034e0 2024-05-09T05:34:10.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:10.077+0000 7f8ddb7fe700 1 -- 172.21.15.39:0/880870888 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8ddc00cbb0 con 0x7f8dec1034e0 2024-05-09T05:34:10.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:10.077+0000 7f8ddb7fe700 1 -- 172.21.15.39:0/880870888 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ddc018680 con 0x7f8dec1034e0 2024-05-09T05:34:10.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:10.077+0000 7f8df0f12700 1 -- 172.21.15.39:0/880870888 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8dec1a7990 con 0x7f8dec1034e0 2024-05-09T05:34:10.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:10.078+0000 7f8df0f12700 1 -- 172.21.15.39:0/880870888 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8dec104990 con 0x7f8dec1034e0 2024-05-09T05:34:10.074 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:10.080+0000 7f8ddb7fe700 1 -- 172.21.15.39:0/880870888 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f8ddc010430 con 0x7f8dec1034e0 2024-05-09T05:34:10.074 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:10.081+0000 7f8ddb7fe700 1 --2- 172.21.15.39:0/880870888 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f8dd40b2880 0x7f8dd40b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:34:10.074 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:10.081+0000 7f8de9d9b700 1 --2- 172.21.15.39:0/880870888 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f8dd40b2880 0x7f8dd40b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:34:10.075 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:10.081+0000 7f8ddb7fe700 1 -- 172.21.15.39:0/880870888 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f8ddc0e2250 con 0x7f8dec1034e0 2024-05-09T05:34:10.075 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:10.081+0000 7f8de9d9b700 1 --2- 172.21.15.39:0/880870888 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f8dd40b2880 0x7f8dd40b4d90 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8de0000c00 tx=0x7f8de001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:34:10.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:10.084+0000 7f8ddb7fe700 1 -- 172.21.15.39:0/880870888 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f8ddc0aa410 con 0x7f8dec1034e0 2024-05-09T05:34:10.364 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:10.369+0000 7f8df0f12700 1 -- 172.21.15.39:0/880870888 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8dec19c210 con 0x7f8dec1034e0 2024-05-09T05:34:10.364 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:10.369+0000 7f8ddb7fe700 1 -- 172.21.15.39:0/880870888 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2221 (secure 0 0 0) 0x7f8ddc0a9d10 con 0x7f8dec1034e0 2024-05-09T05:34:10.364 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-09T05:34:10.364 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24433,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/1308189973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":1308189973},{"type":"v1","addr":"172.21.15.100:6833","nonce":1308189973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24434,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/2789974692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2789974692},{"type":"v1","addr":"172.21.15.60:6833","nonce":2789974692}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-05-09T05:34:10.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:10.373+0000 7f8df0f12700 1 -- 172.21.15.39:0/880870888 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f8dd40b2880 msgr2=0x7f8dd40b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:34:10.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:10.373+0000 7f8df0f12700 1 --2- 172.21.15.39:0/880870888 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f8dd40b2880 0x7f8dd40b4d90 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8de0000c00 tx=0x7f8de001a040 comp rx=0 tx=0).stop 2024-05-09T05:34:10.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:10.373+0000 7f8df0f12700 1 -- 172.21.15.39:0/880870888 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8dec1034e0 msgr2=0x7f8dec19aeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:34:10.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:10.373+0000 7f8df0f12700 1 --2- 172.21.15.39:0/880870888 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8dec1034e0 0x7f8dec19aeb0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc00e9a0 tx=0x7f8ddc00ecb0 comp rx=0 tx=0).stop 2024-05-09T05:34:10.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:10.374+0000 7f8df0f12700 1 -- 172.21.15.39:0/880870888 shutdown_connections 2024-05-09T05:34:10.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:10.374+0000 7f8df0f12700 1 --2- 172.21.15.39:0/880870888 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f8dd40b2880 0x7f8dd40b4d90 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:10.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:10.374+0000 7f8df0f12700 1 --2- 172.21.15.39:0/880870888 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8dec108760 0x7f8dec19f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:10.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:10.374+0000 7f8df0f12700 1 --2- 172.21.15.39:0/880870888 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8dec1034e0 0x7f8dec19aeb0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:10.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:10.374+0000 7f8df0f12700 1 --2- 172.21.15.39:0/880870888 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8dec107e10 0x7f8dec19b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:10.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:10.374+0000 7f8df0f12700 1 -- 172.21.15.39:0/880870888 >> 172.21.15.39:0/880870888 conn(0x7f8dec0fef30 msgr2=0x7f8dec06c420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:34:10.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:10.374+0000 7f8df0f12700 1 -- 172.21.15.39:0/880870888 shutdown_connections 2024-05-09T05:34:10.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:10.374+0000 7f8df0f12700 1 -- 172.21.15.39:0/880870888 wait complete. 2024-05-09T05:34:10.369 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 3 2024-05-09T05:34:11.599 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:11 smithi060 ceph-mon[34555]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T05:34:11.599 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:11 smithi060 ceph-mon[34555]: from='client.? 172.21.15.39:0/880870888' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T05:34:11.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:11 smithi039 ceph-mon[30439]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T05:34:11.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:11 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/880870888' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T05:34:11.610 INFO:journalctl@ceph.mds.j.smithi039.stdout:May 09 05:34:11 smithi039 systemd[1]: Started Ceph mds.j for 86d4cc60-0dc4-11ef-bc97-c7b262605968. 2024-05-09T05:34:11.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:11 smithi100 ceph-mon[34353]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T05:34:11.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:11 smithi100 ceph-mon[34353]: from='client.? 172.21.15.39:0/880870888' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T05:34:12.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:12 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:12.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:12 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:12.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:12 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:12.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:12 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T05:34:12.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:12 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T05:34:12.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:12 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:34:12.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:12 smithi039 ceph-mon[30439]: Deploying daemon mds.d on smithi039 2024-05-09T05:34:12.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:12 smithi039 ceph-mon[30439]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T05:34:12.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:12 smithi039 ceph-mon[30439]: mds.? [v2:172.21.15.39:6834/1997969267,v1:172.21.15.39:6835/1997969267] up:boot 2024-05-09T05:34:12.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:12 smithi039 ceph-mon[30439]: fsmap 3 up:standby 2024-05-09T05:34:12.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:12 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-05-09T05:34:12.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:12 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:12.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:12 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:12.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:12 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:12.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:12 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T05:34:12.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:12 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T05:34:12.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:12 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:34:12.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:12 smithi100 ceph-mon[34353]: Deploying daemon mds.d on smithi039 2024-05-09T05:34:12.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:12 smithi100 ceph-mon[34353]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T05:34:12.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:12 smithi100 ceph-mon[34353]: mds.? [v2:172.21.15.39:6834/1997969267,v1:172.21.15.39:6835/1997969267] up:boot 2024-05-09T05:34:12.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:12 smithi100 ceph-mon[34353]: fsmap 3 up:standby 2024-05-09T05:34:12.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:12 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-05-09T05:34:13.028 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-09T05:34:13.046 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:12 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:13.046 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:12 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:13.046 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:12 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:13.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:12 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T05:34:13.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:12 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T05:34:13.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:12 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:34:13.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:12 smithi060 ceph-mon[34555]: Deploying daemon mds.d on smithi039 2024-05-09T05:34:13.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:12 smithi060 ceph-mon[34555]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T05:34:13.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:12 smithi060 ceph-mon[34555]: mds.? [v2:172.21.15.39:6834/1997969267,v1:172.21.15.39:6835/1997969267] up:boot 2024-05-09T05:34:13.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:12 smithi060 ceph-mon[34555]: fsmap 3 up:standby 2024-05-09T05:34:13.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:12 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-05-09T05:34:13.292 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T05:34:15.360 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:15 smithi039 ceph-mon[30439]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T05:34:15.360 INFO:journalctl@ceph.mds.d.smithi039.stdout:May 09 05:34:15 smithi039 systemd[1]: Started Ceph mds.d for 86d4cc60-0dc4-11ef-bc97-c7b262605968. 2024-05-09T05:34:15.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:15.160+0000 7f60657ef700 1 -- 172.21.15.39:0/3496766174 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6060108740 msgr2=0x7f60601100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:34:15.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:15.160+0000 7f60657ef700 1 --2- 172.21.15.39:0/3496766174 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6060108740 0x7f60601100a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f605800b0d0 tx=0x7f605800b3e0 comp rx=0 tx=0).stop 2024-05-09T05:34:15.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:15.160+0000 7f60657ef700 1 -- 172.21.15.39:0/3496766174 shutdown_connections 2024-05-09T05:34:15.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:15.160+0000 7f60657ef700 1 --2- 172.21.15.39:0/3496766174 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6060108740 0x7f60601100a0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:15.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:15.160+0000 7f60657ef700 1 --2- 172.21.15.39:0/3496766174 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60601034c0 0x7f60601038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:15.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:15.160+0000 7f60657ef700 1 --2- 172.21.15.39:0/3496766174 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6060107df0 0x7f6060108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:15.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:15.160+0000 7f60657ef700 1 -- 172.21.15.39:0/3496766174 >> 172.21.15.39:0/3496766174 conn(0x7f60600fedc0 msgr2=0x7f60601011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:34:15.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:15.160+0000 7f60657ef700 1 -- 172.21.15.39:0/3496766174 shutdown_connections 2024-05-09T05:34:15.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:15.160+0000 7f60657ef700 1 -- 172.21.15.39:0/3496766174 wait complete. 2024-05-09T05:34:15.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:15.161+0000 7f60657ef700 1 Processor -- start 2024-05-09T05:34:15.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:15.161+0000 7f60657ef700 1 -- start start 2024-05-09T05:34:15.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:15.162+0000 7f60657ef700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60601034c0 0x7f606019ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:34:15.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:15.162+0000 7f60657ef700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6060107df0 0x7f606019b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:34:15.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:15.162+0000 7f60657ef700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6060108740 0x7f606019f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:34:15.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:15.162+0000 7f60657ef700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f60601144c0 con 0x7f6060107df0 2024-05-09T05:34:15.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:15.162+0000 7f60657ef700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6060114340 con 0x7f60601034c0 2024-05-09T05:34:15.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:15.162+0000 7f60657ef700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6060114640 con 0x7f6060108740 2024-05-09T05:34:15.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:15.162+0000 7f60567fc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6060107df0 0x7f606019b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:34:15.371 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:15.162+0000 7f60567fc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6060107df0 0x7f606019b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:39190/0 (socket says 172.21.15.39:39190) 2024-05-09T05:34:15.371 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:15.162+0000 7f60567fc700 1 -- 172.21.15.39:0/4225150695 learned_addr learned my addr 172.21.15.39:0/4225150695 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:34:15.371 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:15.162+0000 7f605effd700 1 --2- 172.21.15.39:0/4225150695 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60601034c0 0x7f606019ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:34:15.371 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:15.162+0000 7f605f7fe700 1 --2- 172.21.15.39:0/4225150695 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6060108740 0x7f606019f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:34:15.371 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:15.162+0000 7f605effd700 1 -- 172.21.15.39:0/4225150695 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6060108740 msgr2=0x7f606019f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:34:15.371 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:15.162+0000 7f605effd700 1 --2- 172.21.15.39:0/4225150695 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6060108740 0x7f606019f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:15.371 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:15.162+0000 7f605effd700 1 -- 172.21.15.39:0/4225150695 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6060107df0 msgr2=0x7f606019b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:34:15.371 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:15.162+0000 7f605effd700 1 --2- 172.21.15.39:0/4225150695 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6060107df0 0x7f606019b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:15.371 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:15.162+0000 7f605effd700 1 -- 172.21.15.39:0/4225150695 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f606019fc60 con 0x7f60601034c0 2024-05-09T05:34:15.371 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:15.162+0000 7f60567fc700 1 --2- 172.21.15.39:0/4225150695 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6060107df0 0x7f606019b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T05:34:15.371 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:15.162+0000 7f605f7fe700 1 --2- 172.21.15.39:0/4225150695 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6060108740 0x7f606019f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T05:34:15.371 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:15.163+0000 7f605effd700 1 --2- 172.21.15.39:0/4225150695 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60601034c0 0x7f606019ad90 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f605000d950 tx=0x7f605000dc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:34:15.371 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:15.163+0000 7f605cff9700 1 -- 172.21.15.39:0/4225150695 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6050016070 con 0x7f60601034c0 2024-05-09T05:34:15.371 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:15.163+0000 7f605cff9700 1 -- 172.21.15.39:0/4225150695 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f605000fd40 con 0x7f60601034c0 2024-05-09T05:34:15.372 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:15.163+0000 7f60657ef700 1 -- 172.21.15.39:0/4225150695 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f606019ff50 con 0x7f60601034c0 2024-05-09T05:34:15.372 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:15.163+0000 7f605cff9700 1 -- 172.21.15.39:0/4225150695 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f605000e3b0 con 0x7f60601034c0 2024-05-09T05:34:15.372 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:15.163+0000 7f60657ef700 1 -- 172.21.15.39:0/4225150695 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60601a7870 con 0x7f60601034c0 2024-05-09T05:34:15.372 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:15.164+0000 7f60657ef700 1 -- 172.21.15.39:0/4225150695 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60600512c0 con 0x7f60601034c0 2024-05-09T05:34:15.372 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:15.167+0000 7f605cff9700 1 -- 172.21.15.39:0/4225150695 <== mon.2 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f6050019070 con 0x7f60601034c0 2024-05-09T05:34:15.372 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:15.167+0000 7f605cff9700 1 --2- 172.21.15.39:0/4225150695 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f604c0b2880 0x7f604c0b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:34:15.372 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:15.168+0000 7f60567fc700 1 --2- 172.21.15.39:0/4225150695 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f604c0b2880 0x7f604c0b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:34:15.372 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:15.168+0000 7f605cff9700 1 -- 172.21.15.39:0/4225150695 <== mon.2 v2:172.21.15.60:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f60500e1c60 con 0x7f60601034c0 2024-05-09T05:34:15.372 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:15.168+0000 7f60567fc700 1 --2- 172.21.15.39:0/4225150695 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f604c0b2880 0x7f604c0b4d90 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6060106b40 tx=0x7f6048009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:34:15.372 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:15.171+0000 7f605cff9700 1 -- 172.21.15.39:0/4225150695 <== mon.2 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f60500a9e20 con 0x7f60601034c0 2024-05-09T05:34:15.423 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:15 smithi100 ceph-mon[34353]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T05:34:15.434 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:15.440+0000 7f60657ef700 1 -- 172.21.15.39:0/4225150695 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f606019c0f0 con 0x7f60601034c0 2024-05-09T05:34:15.435 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:15.441+0000 7f605cff9700 1 -- 172.21.15.39:0/4225150695 <== mon.2 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3868 (secure 0 0 0) 0x7f60500a9720 con 0x7f60601034c0 2024-05-09T05:34:15.435 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-09T05:34:15.435 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":5,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/1997969267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":1997969267},{"type":"v1","addr":"172.21.15.39:6835","nonce":1997969267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/283022063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":283022063},{"type":"v1","addr":"172.21.15.39:6837","nonce":283022063}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24433,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/1308189973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":1308189973},{"type":"v1","addr":"172.21.15.100:6833","nonce":1308189973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24434,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/2789974692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2789974692},{"type":"v1","addr":"172.21.15.60:6833","nonce":2789974692}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-05-09T05:34:15.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:15.443+0000 7f60657ef700 1 -- 172.21.15.39:0/4225150695 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f604c0b2880 msgr2=0x7f604c0b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:34:15.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:15.443+0000 7f60657ef700 1 --2- 172.21.15.39:0/4225150695 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f604c0b2880 0x7f604c0b4d90 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6060106b40 tx=0x7f6048009260 comp rx=0 tx=0).stop 2024-05-09T05:34:15.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:15.443+0000 7f60657ef700 1 -- 172.21.15.39:0/4225150695 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60601034c0 msgr2=0x7f606019ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:34:15.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:15.443+0000 7f60657ef700 1 --2- 172.21.15.39:0/4225150695 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60601034c0 0x7f606019ad90 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f605000d950 tx=0x7f605000dc60 comp rx=0 tx=0).stop 2024-05-09T05:34:15.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:15.443+0000 7f60657ef700 1 -- 172.21.15.39:0/4225150695 shutdown_connections 2024-05-09T05:34:15.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:15.443+0000 7f60657ef700 1 --2- 172.21.15.39:0/4225150695 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f604c0b2880 0x7f604c0b4d90 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:15.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:15.443+0000 7f60657ef700 1 --2- 172.21.15.39:0/4225150695 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6060108740 0x7f606019f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:15.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:15.443+0000 7f60657ef700 1 --2- 172.21.15.39:0/4225150695 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60601034c0 0x7f606019ad90 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:15.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:15.443+0000 7f60657ef700 1 --2- 172.21.15.39:0/4225150695 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6060107df0 0x7f606019b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:15.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:15.443+0000 7f60657ef700 1 -- 172.21.15.39:0/4225150695 >> 172.21.15.39:0/4225150695 conn(0x7f60600fedc0 msgr2=0x7f6060107560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:34:15.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:15.444+0000 7f60657ef700 1 -- 172.21.15.39:0/4225150695 shutdown_connections 2024-05-09T05:34:15.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:15.444+0000 7f60657ef700 1 -- 172.21.15.39:0/4225150695 wait complete. 2024-05-09T05:34:15.438 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 5 2024-05-09T05:34:15.546 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:15 smithi060 ceph-mon[34555]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T05:34:16.360 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:16 smithi039 ceph-mon[30439]: mds.? [v2:172.21.15.39:6836/283022063,v1:172.21.15.39:6837/283022063] up:boot 2024-05-09T05:34:16.360 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:16 smithi039 ceph-mon[30439]: fsmap 4 up:standby 2024-05-09T05:34:16.360 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:16 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-05-09T05:34:16.360 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:16 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:16.360 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:16 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:16.360 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:16 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:16.360 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:16 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T05:34:16.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:16 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T05:34:16.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:16 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:34:16.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:16 smithi039 ceph-mon[30439]: Deploying daemon mds.e on smithi060 2024-05-09T05:34:16.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:16 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/4225150695' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T05:34:16.546 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:16 smithi060 ceph-mon[34555]: mds.? [v2:172.21.15.39:6836/283022063,v1:172.21.15.39:6837/283022063] up:boot 2024-05-09T05:34:16.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:16 smithi060 ceph-mon[34555]: fsmap 4 up:standby 2024-05-09T05:34:16.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:16 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-05-09T05:34:16.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:16 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:16.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:16 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:16.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:16 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:16.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:16 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T05:34:16.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:16 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T05:34:16.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:16 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:34:16.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:16 smithi060 ceph-mon[34555]: Deploying daemon mds.e on smithi060 2024-05-09T05:34:16.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:16 smithi060 ceph-mon[34555]: from='client.? 172.21.15.39:0/4225150695' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T05:34:16.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:16 smithi100 ceph-mon[34353]: mds.? [v2:172.21.15.39:6836/283022063,v1:172.21.15.39:6837/283022063] up:boot 2024-05-09T05:34:16.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:16 smithi100 ceph-mon[34353]: fsmap 4 up:standby 2024-05-09T05:34:16.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:16 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-05-09T05:34:16.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:16 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:16.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:16 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:16.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:16 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:16.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:16 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T05:34:16.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:16 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T05:34:16.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:16 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:34:16.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:16 smithi100 ceph-mon[34353]: Deploying daemon mds.e on smithi060 2024-05-09T05:34:16.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:16 smithi100 ceph-mon[34353]: from='client.? 172.21.15.39:0/4225150695' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T05:34:17.546 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:17 smithi060 ceph-mon[34555]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T05:34:17.547 INFO:journalctl@ceph.mds.e.smithi060.stdout:May 09 05:34:17 smithi060 systemd[1]: Starting Ceph mds.e for 86d4cc60-0dc4-11ef-bc97-c7b262605968... 2024-05-09T05:34:17.562 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:17 smithi100 ceph-mon[34353]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T05:34:17.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:17 smithi039 ceph-mon[30439]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T05:34:17.951 INFO:journalctl@ceph.mds.e.smithi060.stdout:May 09 05:34:17 smithi060 podman[64163]: 2024-05-09 05:34:17.531539027 +0000 UTC m=+0.018374380 image pull db794d706f492c144ccc8f2c5bbc1870e116f5c4f3309dfab4416b39d099f8d7 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584 2024-05-09T05:34:17.951 INFO:journalctl@ceph.mds.e.smithi060.stdout:May 09 05:34:17 smithi060 podman[64163]: 2024-05-09 05:34:17.638508793 +0000 UTC m=+0.125344128 container create 9ab439eb840f02a51077d45daf6ee945409bec2a64a4724b1a079799c545b471 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-e, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-09T05:34:17.951 INFO:journalctl@ceph.mds.e.smithi060.stdout:May 09 05:34:17 smithi060 podman[64163]: 2024-05-09 05:34:17.958000597 +0000 UTC m=+0.444835930 container init 9ab439eb840f02a51077d45daf6ee945409bec2a64a4724b1a079799c545b471 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-e, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-09T05:34:18.076 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-09T05:34:18.296 INFO:journalctl@ceph.mds.e.smithi060.stdout:May 09 05:34:17 smithi060 podman[64163]: 2024-05-09 05:34:17.961018945 +0000 UTC m=+0.447854284 container start 9ab439eb840f02a51077d45daf6ee945409bec2a64a4724b1a079799c545b471 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-e, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240507, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-09T05:34:18.296 INFO:journalctl@ceph.mds.e.smithi060.stdout:May 09 05:34:17 smithi060 ceph-mds[64183]: -- 172.21.15.60:0/329531059 <== mon.2 v2:172.21.15.60:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c8ec18ba40 con 0x55c8ec1d3600 2024-05-09T05:34:18.297 INFO:journalctl@ceph.mds.e.smithi060.stdout:May 09 05:34:17 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-e[64178]: starting mds.e at 2024-05-09T05:34:18.297 INFO:journalctl@ceph.mds.e.smithi060.stdout:May 09 05:34:18 smithi060 bash[64163]: 9ab439eb840f02a51077d45daf6ee945409bec2a64a4724b1a079799c545b471 2024-05-09T05:34:18.297 INFO:journalctl@ceph.mds.e.smithi060.stdout:May 09 05:34:18 smithi060 systemd[1]: Started Ceph mds.e for 86d4cc60-0dc4-11ef-bc97-c7b262605968. 2024-05-09T05:34:18.351 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T05:34:19.297 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:19 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:19.297 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:19 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:19.297 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:19 smithi060 ceph-mon[34555]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T05:34:19.297 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:19 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:19.297 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:19 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T05:34:19.297 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:19 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T05:34:19.297 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:19 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:34:19.297 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:19 smithi060 ceph-mon[34555]: Deploying daemon mds.f on smithi100 2024-05-09T05:34:19.297 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:19 smithi060 ceph-mon[34555]: mds.? [v2:172.21.15.60:6834/924472374,v1:172.21.15.60:6835/924472374] up:boot 2024-05-09T05:34:19.297 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:19 smithi060 ceph-mon[34555]: fsmap 5 up:standby 2024-05-09T05:34:19.298 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:19 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-09T05:34:19.360 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:19 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:19.360 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:19 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:19.360 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:19 smithi039 ceph-mon[30439]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T05:34:19.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:19 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:19.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:19 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T05:34:19.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:19 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T05:34:19.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:19 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:34:19.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:19 smithi039 ceph-mon[30439]: Deploying daemon mds.f on smithi100 2024-05-09T05:34:19.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:19 smithi039 ceph-mon[30439]: mds.? [v2:172.21.15.60:6834/924472374,v1:172.21.15.60:6835/924472374] up:boot 2024-05-09T05:34:19.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:19 smithi039 ceph-mon[30439]: fsmap 5 up:standby 2024-05-09T05:34:19.361 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:19 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-09T05:34:19.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:19 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:19.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:19 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:19.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:19 smithi100 ceph-mon[34353]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T05:34:19.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:19 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:19.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:19 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T05:34:19.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:19 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T05:34:19.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:19 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:34:19.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:19 smithi100 ceph-mon[34353]: Deploying daemon mds.f on smithi100 2024-05-09T05:34:19.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:19 smithi100 ceph-mon[34353]: mds.? [v2:172.21.15.60:6834/924472374,v1:172.21.15.60:6835/924472374] up:boot 2024-05-09T05:34:19.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:19 smithi100 ceph-mon[34353]: fsmap 5 up:standby 2024-05-09T05:34:19.425 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:19 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-09T05:34:19.921 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:19.924+0000 7f36a1a9c700 1 -- 172.21.15.39:0/327132009 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f369c105e30 msgr2=0x7f369c10e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:34:19.921 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:19.924+0000 7f36a1a9c700 1 --2- 172.21.15.39:0/327132009 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f369c105e30 0x7f369c10e380 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3690009990 tx=0x7f3690009ca0 comp rx=0 tx=0).stop 2024-05-09T05:34:19.921 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:19.924+0000 7f36a1a9c700 1 -- 172.21.15.39:0/327132009 shutdown_connections 2024-05-09T05:34:19.921 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:19.924+0000 7f36a1a9c700 1 --2- 172.21.15.39:0/327132009 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f369c10e910 0x7f369c110df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:19.921 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:19.924+0000 7f36a1a9c700 1 --2- 172.21.15.39:0/327132009 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f369c1054e0 0x7f369c1058f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:19.921 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:19.924+0000 7f36a1a9c700 1 --2- 172.21.15.39:0/327132009 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f369c105e30 0x7f369c10e380 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:19.921 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:19.924+0000 7f36a1a9c700 1 -- 172.21.15.39:0/327132009 >> 172.21.15.39:0/327132009 conn(0x7f369c0fef30 msgr2=0x7f369c101350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:34:19.921 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:19.924+0000 7f36a1a9c700 1 -- 172.21.15.39:0/327132009 shutdown_connections 2024-05-09T05:34:19.921 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:19.924+0000 7f36a1a9c700 1 -- 172.21.15.39:0/327132009 wait complete. 2024-05-09T05:34:19.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:19.925+0000 7f36a1a9c700 1 Processor -- start 2024-05-09T05:34:19.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:19.925+0000 7f36a1a9c700 1 -- start start 2024-05-09T05:34:19.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:19.925+0000 7f36a1a9c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f369c1054e0 0x7f369c19adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:34:19.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:19.925+0000 7f36a1a9c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f369c105e30 0x7f369c19b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:34:19.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:19.925+0000 7f36a1a9c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f369c10e910 0x7f369c19f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:34:19.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:19.925+0000 7f36a1a9c700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f369c114470 con 0x7f369c1054e0 2024-05-09T05:34:19.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:19.925+0000 7f36a1a9c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f369c1142f0 con 0x7f369c105e30 2024-05-09T05:34:19.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:19.925+0000 7f36a1a9c700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f369c1145f0 con 0x7f369c10e910 2024-05-09T05:34:19.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:19.925+0000 7f369b7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f369c1054e0 0x7f369c19adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:34:19.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:19.925+0000 7f369b7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f369c1054e0 0x7f369c19adc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:49440/0 (socket says 172.21.15.39:49440) 2024-05-09T05:34:19.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:19.925+0000 7f369b7fe700 1 -- 172.21.15.39:0/2515252350 learned_addr learned my addr 172.21.15.39:0/2515252350 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:34:19.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:19.925+0000 7f369bfff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f369c10e910 0x7f369c19f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:34:19.923 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:19.925+0000 7f369affd700 1 --2- 172.21.15.39:0/2515252350 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f369c105e30 0x7f369c19b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:34:19.923 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:19.926+0000 7f369b7fe700 1 -- 172.21.15.39:0/2515252350 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f369c10e910 msgr2=0x7f369c19f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:34:19.923 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:19.926+0000 7f369b7fe700 1 --2- 172.21.15.39:0/2515252350 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f369c10e910 0x7f369c19f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:19.923 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:19.926+0000 7f369b7fe700 1 -- 172.21.15.39:0/2515252350 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f369c105e30 msgr2=0x7f369c19b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:34:19.923 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:19.926+0000 7f369b7fe700 1 --2- 172.21.15.39:0/2515252350 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f369c105e30 0x7f369c19b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:19.923 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:19.926+0000 7f369b7fe700 1 -- 172.21.15.39:0/2515252350 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f369c19fbe0 con 0x7f369c1054e0 2024-05-09T05:34:19.923 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:19.926+0000 7f369bfff700 1 --2- 172.21.15.39:0/2515252350 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f369c10e910 0x7f369c19f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T05:34:19.923 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:19.926+0000 7f369b7fe700 1 --2- 172.21.15.39:0/2515252350 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f369c1054e0 0x7f369c19adc0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f368c00c9b0 tx=0x7f368c00ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:34:19.923 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:19.926+0000 7f3698ff9700 1 -- 172.21.15.39:0/2515252350 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f368c007b00 con 0x7f369c1054e0 2024-05-09T05:34:19.923 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:19.926+0000 7f3698ff9700 1 -- 172.21.15.39:0/2515252350 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f368c00ce50 con 0x7f369c1054e0 2024-05-09T05:34:19.923 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:19.926+0000 7f3698ff9700 1 -- 172.21.15.39:0/2515252350 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f368c018660 con 0x7f369c1054e0 2024-05-09T05:34:19.923 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:19.926+0000 7f36a1a9c700 1 -- 172.21.15.39:0/2515252350 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f369c19fed0 con 0x7f369c1054e0 2024-05-09T05:34:19.923 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:19.926+0000 7f36a1a9c700 1 -- 172.21.15.39:0/2515252350 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f369c1a0390 con 0x7f369c1054e0 2024-05-09T05:34:19.924 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:19.927+0000 7f36a1a9c700 1 -- 172.21.15.39:0/2515252350 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f369c0512c0 con 0x7f369c1054e0 2024-05-09T05:34:19.925 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:19.929+0000 7f3698ff9700 1 -- 172.21.15.39:0/2515252350 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f368c00f450 con 0x7f369c1054e0 2024-05-09T05:34:19.925 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:19.930+0000 7f3698ff9700 1 --2- 172.21.15.39:0/2515252350 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f36840b2900 0x7f36840b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:34:19.925 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:19.930+0000 7f369affd700 1 --2- 172.21.15.39:0/2515252350 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f36840b2900 0x7f36840b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:34:19.925 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:19.930+0000 7f3698ff9700 1 -- 172.21.15.39:0/2515252350 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f368c0e1f10 con 0x7f369c1054e0 2024-05-09T05:34:19.925 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:19.931+0000 7f369affd700 1 --2- 172.21.15.39:0/2515252350 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f36840b2900 0x7f36840b4e10 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f369000b2e0 tx=0x7f3690005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:34:19.928 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:19.934+0000 7f3698ff9700 1 -- 172.21.15.39:0/2515252350 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f368c014030 con 0x7f369c1054e0 2024-05-09T05:34:20.189 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:20.195+0000 7f36a1a9c700 1 -- 172.21.15.39:0/2515252350 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f369c02e5f0 con 0x7f369c1054e0 2024-05-09T05:34:20.190 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:20.196+0000 7f3698ff9700 1 -- 172.21.15.39:0/2515252350 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4690 (secure 0 0 0) 0x7f368c0aa1e0 con 0x7f369c1054e0 2024-05-09T05:34:20.190 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-09T05:34:20.190 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":6,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/1997969267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":1997969267},{"type":"v1","addr":"172.21.15.39:6835","nonce":1997969267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/283022063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":283022063},{"type":"v1","addr":"172.21.15.39:6837","nonce":283022063}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24433,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/1308189973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":1308189973},{"type":"v1","addr":"172.21.15.100:6833","nonce":1308189973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24434,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/2789974692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2789974692},{"type":"v1","addr":"172.21.15.60:6833","nonce":2789974692}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24461,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/924472374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":924472374},{"type":"v1","addr":"172.21.15.60:6835","nonce":924472374}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-05-09T05:34:20.195 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:20.198+0000 7f36a1a9c700 1 -- 172.21.15.39:0/2515252350 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f36840b2900 msgr2=0x7f36840b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:34:20.195 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:20.198+0000 7f36a1a9c700 1 --2- 172.21.15.39:0/2515252350 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f36840b2900 0x7f36840b4e10 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f369000b2e0 tx=0x7f3690005960 comp rx=0 tx=0).stop 2024-05-09T05:34:20.195 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:20.199+0000 7f36a1a9c700 1 -- 172.21.15.39:0/2515252350 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f369c1054e0 msgr2=0x7f369c19adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:34:20.195 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:20.199+0000 7f36a1a9c700 1 --2- 172.21.15.39:0/2515252350 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f369c1054e0 0x7f369c19adc0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f368c00c9b0 tx=0x7f368c00ccc0 comp rx=0 tx=0).stop 2024-05-09T05:34:20.195 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:20.199+0000 7f36a1a9c700 1 -- 172.21.15.39:0/2515252350 shutdown_connections 2024-05-09T05:34:20.196 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:20.199+0000 7f36a1a9c700 1 --2- 172.21.15.39:0/2515252350 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f36840b2900 0x7f36840b4e10 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:20.196 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:20.199+0000 7f36a1a9c700 1 --2- 172.21.15.39:0/2515252350 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f369c10e910 0x7f369c19f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:20.196 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:20.199+0000 7f36a1a9c700 1 --2- 172.21.15.39:0/2515252350 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f369c1054e0 0x7f369c19adc0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:20.196 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:20.199+0000 7f36a1a9c700 1 --2- 172.21.15.39:0/2515252350 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f369c105e30 0x7f369c19b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:20.196 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:20.199+0000 7f36a1a9c700 1 -- 172.21.15.39:0/2515252350 >> 172.21.15.39:0/2515252350 conn(0x7f369c0fef30 msgr2=0x7f369c0ff520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:34:20.196 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:20.199+0000 7f36a1a9c700 1 -- 172.21.15.39:0/2515252350 shutdown_connections 2024-05-09T05:34:20.196 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:20.199+0000 7f36a1a9c700 1 -- 172.21.15.39:0/2515252350 wait complete. 2024-05-09T05:34:20.196 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 6 2024-05-09T05:34:20.424 INFO:journalctl@ceph.mds.f.smithi100.stdout:May 09 05:34:20 smithi100 systemd[1]: Starting Ceph mds.f for 86d4cc60-0dc4-11ef-bc97-c7b262605968... 2024-05-09T05:34:20.689 INFO:journalctl@ceph.mds.f.smithi100.stdout:May 09 05:34:20 smithi100 podman[64918]: 2024-05-09 05:34:20.334482851 +0000 UTC m=+0.018046526 image pull db794d706f492c144ccc8f2c5bbc1870e116f5c4f3309dfab4416b39d099f8d7 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584 2024-05-09T05:34:20.689 INFO:journalctl@ceph.mds.f.smithi100.stdout:May 09 05:34:20 smithi100 podman[64918]: 2024-05-09 05:34:20.45832217 +0000 UTC m=+0.141885822 container create 78de515fbc7a1d4c2248e38bec743485c41d83bf896a5d4ec26095977235e930 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-f, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-09T05:34:20.689 INFO:journalctl@ceph.mds.f.smithi100.stdout:May 09 05:34:20 smithi100 podman[64918]: 2024-05-09 05:34:20.660708128 +0000 UTC m=+0.344271770 container init 78de515fbc7a1d4c2248e38bec743485c41d83bf896a5d4ec26095977235e930 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-f, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.license=GPLv2) 2024-05-09T05:34:20.689 INFO:journalctl@ceph.mds.f.smithi100.stdout:May 09 05:34:20 smithi100 podman[64918]: 2024-05-09 05:34:20.663151929 +0000 UTC m=+0.346715572 container start 78de515fbc7a1d4c2248e38bec743485c41d83bf896a5d4ec26095977235e930 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-f, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-09T05:34:21.173 INFO:journalctl@ceph.mds.f.smithi100.stdout:May 09 05:34:20 smithi100 ceph-mds[64937]: -- 172.21.15.100:0/2766015086 <== mon.1 v2:172.21.15.100:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562c37f1fa40 con 0x562c37f67600 2024-05-09T05:34:21.174 INFO:journalctl@ceph.mds.f.smithi100.stdout:May 09 05:34:20 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-f[64933]: starting mds.f at 2024-05-09T05:34:21.174 INFO:journalctl@ceph.mds.f.smithi100.stdout:May 09 05:34:20 smithi100 bash[64918]: 78de515fbc7a1d4c2248e38bec743485c41d83bf896a5d4ec26095977235e930 2024-05-09T05:34:21.174 INFO:journalctl@ceph.mds.f.smithi100.stdout:May 09 05:34:20 smithi100 systemd[1]: Started Ceph mds.f for 86d4cc60-0dc4-11ef-bc97-c7b262605968. 2024-05-09T05:34:21.469 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:21 smithi100 ceph-mon[34353]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T05:34:21.469 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:21 smithi100 ceph-mon[34353]: from='client.? 172.21.15.39:0/2515252350' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T05:34:21.469 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:21 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:21.469 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:21 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:21.470 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:21 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:21.470 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:21 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T05:34:21.470 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:21 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T05:34:21.470 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:21 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:34:21.546 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:21 smithi060 ceph-mon[34555]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T05:34:21.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:21 smithi060 ceph-mon[34555]: from='client.? 172.21.15.39:0/2515252350' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T05:34:21.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:21 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:21.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:21 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:21.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:21 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:21.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:21 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T05:34:21.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:21 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T05:34:21.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:21 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:34:21.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:21 smithi039 ceph-mon[30439]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T05:34:21.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:21 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/2515252350' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T05:34:21.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:21 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:21.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:21 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:21.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:21 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:21.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:21 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T05:34:21.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:21 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T05:34:21.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:21 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:34:22.472 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:22 smithi100 ceph-mon[34353]: Deploying daemon mds.c on smithi100 2024-05-09T05:34:22.472 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:22 smithi100 ceph-mon[34353]: mds.? [v2:172.21.15.100:6834/2595255386,v1:172.21.15.100:6835/2595255386] up:boot 2024-05-09T05:34:22.472 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:22 smithi100 ceph-mon[34353]: fsmap 6 up:standby 2024-05-09T05:34:22.472 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:22 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-09T05:34:22.546 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:22 smithi060 ceph-mon[34555]: Deploying daemon mds.c on smithi100 2024-05-09T05:34:22.546 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:22 smithi060 ceph-mon[34555]: mds.? [v2:172.21.15.100:6834/2595255386,v1:172.21.15.100:6835/2595255386] up:boot 2024-05-09T05:34:22.546 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:22 smithi060 ceph-mon[34555]: fsmap 6 up:standby 2024-05-09T05:34:22.546 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:22 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-09T05:34:22.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:22 smithi039 ceph-mon[30439]: Deploying daemon mds.c on smithi100 2024-05-09T05:34:22.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:22 smithi039 ceph-mon[30439]: mds.? [v2:172.21.15.100:6834/2595255386,v1:172.21.15.100:6835/2595255386] up:boot 2024-05-09T05:34:22.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:22 smithi039 ceph-mon[30439]: fsmap 6 up:standby 2024-05-09T05:34:22.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:22 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-09T05:34:22.885 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-09T05:34:23.154 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T05:34:23.174 INFO:journalctl@ceph.mds.c.smithi100.stdout:May 09 05:34:22 smithi100 systemd[1]: Starting Ceph mds.c for 86d4cc60-0dc4-11ef-bc97-c7b262605968... 2024-05-09T05:34:23.445 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:23 smithi100 ceph-mon[34353]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T05:34:23.445 INFO:journalctl@ceph.mds.c.smithi100.stdout:May 09 05:34:23 smithi100 podman[65221]: 2024-05-09 05:34:23.085728843 +0000 UTC m=+0.017908566 image pull db794d706f492c144ccc8f2c5bbc1870e116f5c4f3309dfab4416b39d099f8d7 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584 2024-05-09T05:34:23.445 INFO:journalctl@ceph.mds.c.smithi100.stdout:May 09 05:34:23 smithi100 podman[65221]: 2024-05-09 05:34:23.197775733 +0000 UTC m=+0.129955444 container create 3d9f81982fde83d301e2f1e9a3871af0de977636cc6e6860786bb2d3c73929e2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-c, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True) 2024-05-09T05:34:23.507 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:23 smithi039 ceph-mon[30439]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T05:34:23.546 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:23 smithi060 ceph-mon[34555]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T05:34:23.923 INFO:journalctl@ceph.mds.c.smithi100.stdout:May 09 05:34:23 smithi100 podman[65221]: 2024-05-09 05:34:23.558921173 +0000 UTC m=+0.491100882 container init 3d9f81982fde83d301e2f1e9a3871af0de977636cc6e6860786bb2d3c73929e2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-c, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-05-09T05:34:23.924 INFO:journalctl@ceph.mds.c.smithi100.stdout:May 09 05:34:23 smithi100 podman[65221]: 2024-05-09 05:34:23.561997165 +0000 UTC m=+0.494176874 container start 3d9f81982fde83d301e2f1e9a3871af0de977636cc6e6860786bb2d3c73929e2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-c, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2024-05-09T05:34:23.924 INFO:journalctl@ceph.mds.c.smithi100.stdout:May 09 05:34:23 smithi100 ceph-mds[65240]: -- 172.21.15.100:0/1506196875 <== mon.1 v2:172.21.15.100:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a30599fa40 con 0x55a3059e7180 2024-05-09T05:34:23.924 INFO:journalctl@ceph.mds.c.smithi100.stdout:May 09 05:34:23 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-c[65236]: starting mds.c at 2024-05-09T05:34:23.924 INFO:journalctl@ceph.mds.c.smithi100.stdout:May 09 05:34:23 smithi100 bash[65221]: 3d9f81982fde83d301e2f1e9a3871af0de977636cc6e6860786bb2d3c73929e2 2024-05-09T05:34:23.924 INFO:journalctl@ceph.mds.c.smithi100.stdout:May 09 05:34:23 smithi100 systemd[1]: Started Ceph mds.c for 86d4cc60-0dc4-11ef-bc97-c7b262605968. 2024-05-09T05:34:24.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:24.796+0000 7fd76bc5d700 1 -- 172.21.15.39:0/1321838474 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd764109870 msgr2=0x7fd7641111d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:34:24.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:24.796+0000 7fd76bc5d700 1 --2- 172.21.15.39:0/1321838474 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd764109870 0x7fd7641111d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd75c00b0d0 tx=0x7fd75c00b3e0 comp rx=0 tx=0).stop 2024-05-09T05:34:24.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:24.796+0000 7fd76bc5d700 1 -- 172.21.15.39:0/1321838474 shutdown_connections 2024-05-09T05:34:24.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:24.796+0000 7fd76bc5d700 1 --2- 172.21.15.39:0/1321838474 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd764109870 0x7fd7641111d0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:24.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:24.796+0000 7fd76bc5d700 1 --2- 172.21.15.39:0/1321838474 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7641045f0 0x7fd764104a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:24.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:24.796+0000 7fd76bc5d700 1 --2- 172.21.15.39:0/1321838474 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd764108f20 0x7fd764109330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:24.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:24.796+0000 7fd76bc5d700 1 -- 172.21.15.39:0/1321838474 >> 172.21.15.39:0/1321838474 conn(0x7fd7640fffe0 msgr2=0x7fd764102400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:34:24.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:24.796+0000 7fd76bc5d700 1 -- 172.21.15.39:0/1321838474 shutdown_connections 2024-05-09T05:34:24.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:24.796+0000 7fd76bc5d700 1 -- 172.21.15.39:0/1321838474 wait complete. 2024-05-09T05:34:24.791 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:24 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:24.792 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:24 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:24.792 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:24 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:24.792 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:24 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T05:34:24.792 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:24 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T05:34:24.792 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:24 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:34:24.792 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:24 smithi039 ceph-mon[30439]: Deploying daemon mds.h on smithi060 2024-05-09T05:34:24.792 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:24 smithi039 ceph-mon[30439]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T05:34:24.792 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:24 smithi039 ceph-mon[30439]: mds.? [v2:172.21.15.100:6836/3676209932,v1:172.21.15.100:6837/3676209932] up:boot 2024-05-09T05:34:24.792 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:24 smithi039 ceph-mon[30439]: fsmap 7 up:standby 2024-05-09T05:34:24.792 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:24 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-09T05:34:24.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:24.797+0000 7fd76bc5d700 1 Processor -- start 2024-05-09T05:34:24.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:24.797+0000 7fd76bc5d700 1 -- start start 2024-05-09T05:34:24.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:24.798+0000 7fd76bc5d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd7641045f0 0x7fd76419ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:34:24.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:24.798+0000 7fd76bc5d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd764108f20 0x7fd76419b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:34:24.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:24.798+0000 7fd76bc5d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd764109870 0x7fd76419f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:34:24.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:24.798+0000 7fd76bc5d700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fd7641144a0 con 0x7fd7641045f0 2024-05-09T05:34:24.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:24.798+0000 7fd76bc5d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd764114320 con 0x7fd764108f20 2024-05-09T05:34:24.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:24.798+0000 7fd76bc5d700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd764114620 con 0x7fd764109870 2024-05-09T05:34:24.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:24.798+0000 7fd7699f9700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd7641045f0 0x7fd76419ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:34:24.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:24.798+0000 7fd7699f9700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd7641045f0 0x7fd76419ad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:49464/0 (socket says 172.21.15.39:49464) 2024-05-09T05:34:24.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:24.798+0000 7fd7691f8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd764108f20 0x7fd76419b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:34:24.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:24.798+0000 7fd7699f9700 1 -- 172.21.15.39:0/2798584239 learned_addr learned my addr 172.21.15.39:0/2798584239 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:34:24.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:24.798+0000 7fd76a1fa700 1 --2- 172.21.15.39:0/2798584239 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd764109870 0x7fd76419f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:34:24.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:24.798+0000 7fd7691f8700 1 -- 172.21.15.39:0/2798584239 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd764109870 msgr2=0x7fd76419f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:34:24.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:24.798+0000 7fd7691f8700 1 --2- 172.21.15.39:0/2798584239 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd764109870 0x7fd76419f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:24.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:24.798+0000 7fd7691f8700 1 -- 172.21.15.39:0/2798584239 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd7641045f0 msgr2=0x7fd76419ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:34:24.795 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:24.798+0000 7fd7691f8700 1 --2- 172.21.15.39:0/2798584239 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd7641045f0 0x7fd76419ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:24.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:24.798+0000 7fd7691f8700 1 -- 172.21.15.39:0/2798584239 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd76419fc60 con 0x7fd764108f20 2024-05-09T05:34:24.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:24.798+0000 7fd7699f9700 1 --2- 172.21.15.39:0/2798584239 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd7641045f0 0x7fd76419ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T05:34:24.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:24.799+0000 7fd7691f8700 1 --2- 172.21.15.39:0/2798584239 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd764108f20 0x7fd76419b330 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd75400e9c0 tx=0x7fd75400ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:34:24.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:24.799+0000 7fd75affd700 1 -- 172.21.15.39:0/2798584239 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd75400c9c0 con 0x7fd764108f20 2024-05-09T05:34:24.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:24.799+0000 7fd75affd700 1 -- 172.21.15.39:0/2798584239 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd75400cb60 con 0x7fd764108f20 2024-05-09T05:34:24.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:24.799+0000 7fd75affd700 1 -- 172.21.15.39:0/2798584239 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd754018680 con 0x7fd764108f20 2024-05-09T05:34:24.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:24.799+0000 7fd76bc5d700 1 -- 172.21.15.39:0/2798584239 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd76419ff50 con 0x7fd764108f20 2024-05-09T05:34:24.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:24.799+0000 7fd76bc5d700 1 -- 172.21.15.39:0/2798584239 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7641a7870 con 0x7fd764108f20 2024-05-09T05:34:24.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:24.800+0000 7fd76bc5d700 1 -- 172.21.15.39:0/2798584239 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7640512c0 con 0x7fd764108f20 2024-05-09T05:34:24.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:24.801+0000 7fd75affd700 1 -- 172.21.15.39:0/2798584239 <== mon.2 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fd75404aab0 con 0x7fd764108f20 2024-05-09T05:34:24.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:24.802+0000 7fd75affd700 1 --2- 172.21.15.39:0/2798584239 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fd7500b2880 0x7fd7500b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:34:24.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:24.802+0000 7fd7699f9700 1 --2- 172.21.15.39:0/2798584239 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fd7500b2880 0x7fd7500b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:34:24.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:24.802+0000 7fd75affd700 1 -- 172.21.15.39:0/2798584239 <== mon.2 v2:172.21.15.60:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7fd7540e2060 con 0x7fd764108f20 2024-05-09T05:34:24.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:24.803+0000 7fd7699f9700 1 --2- 172.21.15.39:0/2798584239 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fd7500b2880 0x7fd7500b4d90 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd760005950 tx=0x7fd76000b500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:34:24.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:24.806+0000 7fd75affd700 1 -- 172.21.15.39:0/2798584239 <== mon.2 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fd7540aa180 con 0x7fd764108f20 2024-05-09T05:34:25.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:24 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:25.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:24 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:25.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:24 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:25.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:24 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T05:34:25.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:24 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T05:34:25.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:24 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:34:25.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:24 smithi060 ceph-mon[34555]: Deploying daemon mds.h on smithi060 2024-05-09T05:34:25.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:24 smithi060 ceph-mon[34555]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T05:34:25.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:24 smithi060 ceph-mon[34555]: mds.? [v2:172.21.15.100:6836/3676209932,v1:172.21.15.100:6837/3676209932] up:boot 2024-05-09T05:34:25.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:24 smithi060 ceph-mon[34555]: fsmap 7 up:standby 2024-05-09T05:34:25.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:24 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-09T05:34:25.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:25.066+0000 7fd76bc5d700 1 -- 172.21.15.39:0/2798584239 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd76402e5f0 con 0x7fd764108f20 2024-05-09T05:34:25.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:25.066+0000 7fd75affd700 1 -- 172.21.15.39:0/2798584239 <== mon.2 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6346 (secure 0 0 0) 0x7fd7540b2020 con 0x7fd764108f20 2024-05-09T05:34:25.061 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-09T05:34:25.061 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":8,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/1997969267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":1997969267},{"type":"v1","addr":"172.21.15.39:6835","nonce":1997969267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/283022063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":283022063},{"type":"v1","addr":"172.21.15.39:6837","nonce":283022063}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24433,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/1308189973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":1308189973},{"type":"v1","addr":"172.21.15.100:6833","nonce":1308189973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24434,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/2789974692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2789974692},{"type":"v1","addr":"172.21.15.60:6833","nonce":2789974692}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24461,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/924472374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":924472374},{"type":"v1","addr":"172.21.15.60:6835","nonce":924472374}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24481,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/2595255386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2595255386},{"type":"v1","addr":"172.21.15.100:6835","nonce":2595255386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24487,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/3676209932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":3676209932},{"type":"v1","addr":"172.21.15.100:6837","nonce":3676209932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-05-09T05:34:25.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:25.069+0000 7fd76bc5d700 1 -- 172.21.15.39:0/2798584239 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fd7500b2880 msgr2=0x7fd7500b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:34:25.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:25.069+0000 7fd76bc5d700 1 --2- 172.21.15.39:0/2798584239 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fd7500b2880 0x7fd7500b4d90 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd760005950 tx=0x7fd76000b500 comp rx=0 tx=0).stop 2024-05-09T05:34:25.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:25.069+0000 7fd76bc5d700 1 -- 172.21.15.39:0/2798584239 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd764108f20 msgr2=0x7fd76419b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:34:25.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:25.069+0000 7fd76bc5d700 1 --2- 172.21.15.39:0/2798584239 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd764108f20 0x7fd76419b330 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd75400e9c0 tx=0x7fd75400ecd0 comp rx=0 tx=0).stop 2024-05-09T05:34:25.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:25.069+0000 7fd76bc5d700 1 -- 172.21.15.39:0/2798584239 shutdown_connections 2024-05-09T05:34:25.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:25.069+0000 7fd76bc5d700 1 --2- 172.21.15.39:0/2798584239 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fd7500b2880 0x7fd7500b4d90 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:25.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:25.069+0000 7fd76bc5d700 1 --2- 172.21.15.39:0/2798584239 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd764109870 0x7fd76419f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:25.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:25.069+0000 7fd76bc5d700 1 --2- 172.21.15.39:0/2798584239 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd7641045f0 0x7fd76419ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:25.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:25.069+0000 7fd76bc5d700 1 --2- 172.21.15.39:0/2798584239 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd764108f20 0x7fd76419b330 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:25.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:25.069+0000 7fd76bc5d700 1 -- 172.21.15.39:0/2798584239 >> 172.21.15.39:0/2798584239 conn(0x7fd7640fffe0 msgr2=0x7fd764106f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:34:25.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:25.069+0000 7fd76bc5d700 1 -- 172.21.15.39:0/2798584239 shutdown_connections 2024-05-09T05:34:25.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:25.069+0000 7fd76bc5d700 1 -- 172.21.15.39:0/2798584239 wait complete. 2024-05-09T05:34:25.064 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 8 2024-05-09T05:34:25.173 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:24 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:25.174 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:24 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:25.174 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:24 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:25.174 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:24 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T05:34:25.174 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:24 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T05:34:25.174 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:24 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:34:25.174 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:24 smithi100 ceph-mon[34353]: Deploying daemon mds.h on smithi060 2024-05-09T05:34:25.174 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:24 smithi100 ceph-mon[34353]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T05:34:25.174 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:24 smithi100 ceph-mon[34353]: mds.? [v2:172.21.15.100:6836/3676209932,v1:172.21.15.100:6837/3676209932] up:boot 2024-05-09T05:34:25.174 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:24 smithi100 ceph-mon[34353]: fsmap 7 up:standby 2024-05-09T05:34:25.174 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:24 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-09T05:34:26.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:25 smithi060 ceph-mon[34555]: from='client.? 172.21.15.39:0/2798584239' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T05:34:26.047 INFO:journalctl@ceph.mds.h.smithi060.stdout:May 09 05:34:25 smithi060 systemd[1]: Starting Ceph mds.h for 86d4cc60-0dc4-11ef-bc97-c7b262605968... 2024-05-09T05:34:26.110 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:25 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/2798584239' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T05:34:26.173 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:25 smithi100 ceph-mon[34353]: from='client.? 172.21.15.39:0/2798584239' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T05:34:26.400 INFO:journalctl@ceph.mds.h.smithi060.stdout:May 09 05:34:26 smithi060 podman[64469]: 2024-05-09 05:34:26.043785369 +0000 UTC m=+0.017908158 image pull db794d706f492c144ccc8f2c5bbc1870e116f5c4f3309dfab4416b39d099f8d7 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584 2024-05-09T05:34:26.401 INFO:journalctl@ceph.mds.h.smithi060.stdout:May 09 05:34:26 smithi060 podman[64469]: 2024-05-09 05:34:26.151118695 +0000 UTC m=+0.125241457 container create fa9e0675f81c3595d3368ec218aafbb9549d1a89125fc4087d99317bcf16399b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-h, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=) 2024-05-09T05:34:26.401 INFO:journalctl@ceph.mds.h.smithi060.stdout:May 09 05:34:26 smithi060 podman[64469]: 2024-05-09 05:34:26.370234857 +0000 UTC m=+0.344357630 container init fa9e0675f81c3595d3368ec218aafbb9549d1a89125fc4087d99317bcf16399b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-h, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, io.buildah.version=1.33.5, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-05-09T05:34:26.401 INFO:journalctl@ceph.mds.h.smithi060.stdout:May 09 05:34:26 smithi060 podman[64469]: 2024-05-09 05:34:26.372975001 +0000 UTC m=+0.347097764 container start fa9e0675f81c3595d3368ec218aafbb9549d1a89125fc4087d99317bcf16399b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-h, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507) 2024-05-09T05:34:26.796 INFO:journalctl@ceph.mds.h.smithi060.stdout:May 09 05:34:26 smithi060 ceph-mds[64488]: -- 172.21.15.60:0/3486734306 <== mon.2 v2:172.21.15.60:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ff7d27da40 con 0x55ff7d2c5600 2024-05-09T05:34:26.796 INFO:journalctl@ceph.mds.h.smithi060.stdout:May 09 05:34:26 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-h[64484]: starting mds.h at 2024-05-09T05:34:26.797 INFO:journalctl@ceph.mds.h.smithi060.stdout:May 09 05:34:26 smithi060 bash[64469]: fa9e0675f81c3595d3368ec218aafbb9549d1a89125fc4087d99317bcf16399b 2024-05-09T05:34:26.797 INFO:journalctl@ceph.mds.h.smithi060.stdout:May 09 05:34:26 smithi060 systemd[1]: Started Ceph mds.h for 86d4cc60-0dc4-11ef-bc97-c7b262605968. 2024-05-09T05:34:27.690 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-09T05:34:27.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:27 smithi039 ceph-mon[30439]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T05:34:27.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:27 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:27.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:27 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:27.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:27 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:27.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:27 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T05:34:27.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:27 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T05:34:27.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:27 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:34:27.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:27 smithi039 ceph-mon[30439]: mds.? [v2:172.21.15.60:6836/3588840930,v1:172.21.15.60:6837/3588840930] up:boot 2024-05-09T05:34:27.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:27 smithi039 ceph-mon[30439]: fsmap 8 up:standby 2024-05-09T05:34:27.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:27 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-09T05:34:27.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:27 smithi100 ceph-mon[34353]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T05:34:27.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:27 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:27.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:27 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:27.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:27 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:27.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:27 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T05:34:27.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:27 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T05:34:27.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:27 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:34:27.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:27 smithi100 ceph-mon[34353]: mds.? [v2:172.21.15.60:6836/3588840930,v1:172.21.15.60:6837/3588840930] up:boot 2024-05-09T05:34:27.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:27 smithi100 ceph-mon[34353]: fsmap 8 up:standby 2024-05-09T05:34:27.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:27 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-09T05:34:27.956 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T05:34:28.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:27 smithi060 ceph-mon[34555]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T05:34:28.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:27 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:28.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:27 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:28.048 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:27 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:28.048 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:27 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T05:34:28.048 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:27 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T05:34:28.048 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:27 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:34:28.048 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:27 smithi060 ceph-mon[34555]: mds.? [v2:172.21.15.60:6836/3588840930,v1:172.21.15.60:6837/3588840930] up:boot 2024-05-09T05:34:28.049 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:27 smithi060 ceph-mon[34555]: fsmap 8 up:standby 2024-05-09T05:34:28.049 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:27 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-09T05:34:28.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:28 smithi039 ceph-mon[30439]: Deploying daemon mds.i on smithi100 2024-05-09T05:34:28.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:28 smithi100 ceph-mon[34353]: Deploying daemon mds.i on smithi100 2024-05-09T05:34:28.924 INFO:journalctl@ceph.mds.i.smithi100.stdout:May 09 05:34:28 smithi100 systemd[1]: Starting Ceph mds.i for 86d4cc60-0dc4-11ef-bc97-c7b262605968... 2024-05-09T05:34:29.046 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:28 smithi060 ceph-mon[34555]: Deploying daemon mds.i on smithi100 2024-05-09T05:34:29.266 INFO:journalctl@ceph.mds.i.smithi100.stdout:May 09 05:34:29 smithi100 podman[65533]: 2024-05-09 05:34:28.90689844 +0000 UTC m=+0.018029979 image pull db794d706f492c144ccc8f2c5bbc1870e116f5c4f3309dfab4416b39d099f8d7 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584 2024-05-09T05:34:29.266 INFO:journalctl@ceph.mds.i.smithi100.stdout:May 09 05:34:29 smithi100 podman[65533]: 2024-05-09 05:34:29.018493055 +0000 UTC m=+0.129624612 container create 8f96def255822fc7888e8830a1fbb4e70919f6ef8a1f4cd0a3273f766f68b806 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-i, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-09T05:34:29.266 INFO:journalctl@ceph.mds.i.smithi100.stdout:May 09 05:34:29 smithi100 podman[65533]: 2024-05-09 05:34:29.237564787 +0000 UTC m=+0.348696310 container init 8f96def255822fc7888e8830a1fbb4e70919f6ef8a1f4cd0a3273f766f68b806 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-i, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, ceph=True) 2024-05-09T05:34:29.266 INFO:journalctl@ceph.mds.i.smithi100.stdout:May 09 05:34:29 smithi100 podman[65533]: 2024-05-09 05:34:29.240133004 +0000 UTC m=+0.351264520 container start 8f96def255822fc7888e8830a1fbb4e70919f6ef8a1f4cd0a3273f766f68b806 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-i, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, io.buildah.version=1.33.5) 2024-05-09T05:34:29.267 INFO:journalctl@ceph.mds.i.smithi100.stdout:May 09 05:34:29 smithi100 ceph-mds[65552]: -- 172.21.15.100:0/1456675315 <== mon.1 v2:172.21.15.100:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c22fad1a40 con 0x55c22fb19a80 2024-05-09T05:34:29.557 INFO:journalctl@ceph.mds.i.smithi100.stdout:May 09 05:34:29 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-i[65548]: starting mds.i at 2024-05-09T05:34:29.557 INFO:journalctl@ceph.mds.i.smithi100.stdout:May 09 05:34:29 smithi100 bash[65533]: 8f96def255822fc7888e8830a1fbb4e70919f6ef8a1f4cd0a3273f766f68b806 2024-05-09T05:34:29.557 INFO:journalctl@ceph.mds.i.smithi100.stdout:May 09 05:34:29 smithi100 systemd[1]: Started Ceph mds.i for 86d4cc60-0dc4-11ef-bc97-c7b262605968. 2024-05-09T05:34:29.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:29 smithi039 ceph-mon[30439]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T05:34:29.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:29 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:29.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:29 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:29.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:29 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:29.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:29 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T05:34:29.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:29 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T05:34:29.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:29 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:34:29.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:29.627+0000 7f63bf4db700 1 -- 172.21.15.39:0/4011690976 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f63b8103a60 msgr2=0x7f63b81106f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:34:29.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:29.627+0000 7f63bf4db700 1 --2- 172.21.15.39:0/4011690976 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f63b8103a60 0x7f63b81106f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f63a8009990 tx=0x7f63a8009ca0 comp rx=0 tx=0).stop 2024-05-09T05:34:29.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:29.627+0000 7f63bf4db700 1 -- 172.21.15.39:0/4011690976 shutdown_connections 2024-05-09T05:34:29.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:29.627+0000 7f63bf4db700 1 --2- 172.21.15.39:0/4011690976 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63b8110c30 0x7f63b8113050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:29.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:29.627+0000 7f63bf4db700 1 --2- 172.21.15.39:0/4011690976 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f63b8103080 0x7f63b8103490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:29.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:29.627+0000 7f63bf4db700 1 --2- 172.21.15.39:0/4011690976 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f63b8103a60 0x7f63b81106f0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:29.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:29.627+0000 7f63bf4db700 1 -- 172.21.15.39:0/4011690976 >> 172.21.15.39:0/4011690976 conn(0x7f63b80fedc0 msgr2=0x7f63b81011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:34:29.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:29.627+0000 7f63bf4db700 1 -- 172.21.15.39:0/4011690976 shutdown_connections 2024-05-09T05:34:29.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:29.627+0000 7f63bf4db700 1 -- 172.21.15.39:0/4011690976 wait complete. 2024-05-09T05:34:29.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:29.628+0000 7f63bf4db700 1 Processor -- start 2024-05-09T05:34:29.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:29.628+0000 7f63bf4db700 1 -- start start 2024-05-09T05:34:29.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:29.628+0000 7f63bf4db700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63b8103080 0x7f63b819d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:34:29.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:29.628+0000 7f63bf4db700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f63b8103a60 0x7f63b819d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:34:29.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:29.628+0000 7f63bf4db700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f63b8110c30 0x7f63b81a1890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:34:29.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:29.628+0000 7f63bf4db700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f63b81166d0 con 0x7f63b8103a60 2024-05-09T05:34:29.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:29.628+0000 7f63bf4db700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f63b8116550 con 0x7f63b8110c30 2024-05-09T05:34:29.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:29.628+0000 7f63bf4db700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f63b8116850 con 0x7f63b8103080 2024-05-09T05:34:29.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:29.628+0000 7f63bca76700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f63b8103a60 0x7f63b819d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:34:29.625 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:29.628+0000 7f63bd277700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63b8103080 0x7f63b819d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:34:29.625 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:29.629+0000 7f63bca76700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f63b8103a60 0x7f63b819d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:52878/0 (socket says 172.21.15.39:52878) 2024-05-09T05:34:29.625 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:29.629+0000 7f63bca76700 1 -- 172.21.15.39:0/2433759284 learned_addr learned my addr 172.21.15.39:0/2433759284 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:34:29.625 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:29.629+0000 7f63bda78700 1 --2- 172.21.15.39:0/2433759284 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f63b8110c30 0x7f63b81a1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:34:29.625 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:29.629+0000 7f63bd277700 1 -- 172.21.15.39:0/2433759284 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f63b8110c30 msgr2=0x7f63b81a1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:34:29.625 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:29.629+0000 7f63bd277700 1 --2- 172.21.15.39:0/2433759284 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f63b8110c30 0x7f63b81a1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:29.625 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:29.629+0000 7f63bd277700 1 -- 172.21.15.39:0/2433759284 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f63b8103a60 msgr2=0x7f63b819d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:34:29.625 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:29.629+0000 7f63bd277700 1 --2- 172.21.15.39:0/2433759284 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f63b8103a60 0x7f63b819d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:29.625 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:29.629+0000 7f63bd277700 1 -- 172.21.15.39:0/2433759284 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63b81a1e80 con 0x7f63b8103080 2024-05-09T05:34:29.625 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:29.629+0000 7f63bca76700 1 --2- 172.21.15.39:0/2433759284 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f63b8103a60 0x7f63b819d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T05:34:29.625 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:29.629+0000 7f63bd277700 1 --2- 172.21.15.39:0/2433759284 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63b8103080 0x7f63b819d060 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f63b400c970 tx=0x7f63b400cc80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:34:29.625 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:29.629+0000 7f63ae7fc700 1 -- 172.21.15.39:0/2433759284 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63b4014070 con 0x7f63b8103080 2024-05-09T05:34:29.625 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:29.629+0000 7f63ae7fc700 1 -- 172.21.15.39:0/2433759284 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f63b4004440 con 0x7f63b8103080 2024-05-09T05:34:29.625 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:29.629+0000 7f63bf4db700 1 -- 172.21.15.39:0/2433759284 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63b81a2170 con 0x7f63b8103080 2024-05-09T05:34:29.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:29.629+0000 7f63ae7fc700 1 -- 172.21.15.39:0/2433759284 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63b4007a30 con 0x7f63b8103080 2024-05-09T05:34:29.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:29.629+0000 7f63bf4db700 1 -- 172.21.15.39:0/2433759284 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63b81a26b0 con 0x7f63b8103080 2024-05-09T05:34:29.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:29.631+0000 7f63bf4db700 1 -- 172.21.15.39:0/2433759284 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63b80512c0 con 0x7f63b8103080 2024-05-09T05:34:29.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:29.632+0000 7f63ae7fc700 1 -- 172.21.15.39:0/2433759284 <== mon.1 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f63b4017070 con 0x7f63b8103080 2024-05-09T05:34:29.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:29.633+0000 7f63ae7fc700 1 --2- 172.21.15.39:0/2433759284 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f63a40b2880 0x7f63a40b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:34:29.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:29.633+0000 7f63bca76700 1 --2- 172.21.15.39:0/2433759284 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f63a40b2880 0x7f63a40b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:34:29.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:29.633+0000 7f63ae7fc700 1 -- 172.21.15.39:0/2433759284 <== mon.1 v2:172.21.15.100:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f63b40e1620 con 0x7f63b8103080 2024-05-09T05:34:29.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:29.633+0000 7f63bca76700 1 --2- 172.21.15.39:0/2433759284 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f63a40b2880 0x7f63a40b4d90 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f63b8112360 tx=0x7f63a8005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:34:29.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:29.638+0000 7f63ae7fc700 1 -- 172.21.15.39:0/2433759284 <== mon.1 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f63b401e030 con 0x7f63b8103080 2024-05-09T05:34:29.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:29.904+0000 7f63bf4db700 1 -- 172.21.15.39:0/2433759284 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f63b819e3c0 con 0x7f63b8103080 2024-05-09T05:34:29.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:29.905+0000 7f63ae7fc700 1 -- 172.21.15.39:0/2433759284 <== mon.1 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+8001 (secure 0 0 0) 0x7f63b40a9780 con 0x7f63b8103080 2024-05-09T05:34:29.899 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-09T05:34:29.899 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":10,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/1997969267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":1997969267},{"type":"v1","addr":"172.21.15.39:6835","nonce":1997969267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/283022063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":283022063},{"type":"v1","addr":"172.21.15.39:6837","nonce":283022063}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24433,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/1308189973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":1308189973},{"type":"v1","addr":"172.21.15.100:6833","nonce":1308189973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24434,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/2789974692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2789974692},{"type":"v1","addr":"172.21.15.60:6833","nonce":2789974692}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24461,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/924472374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":924472374},{"type":"v1","addr":"172.21.15.60:6835","nonce":924472374}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24479,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/3588840930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":3588840930},{"type":"v1","addr":"172.21.15.60:6837","nonce":3588840930}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24481,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/2595255386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2595255386},{"type":"v1","addr":"172.21.15.100:6835","nonce":2595255386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24487,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/3676209932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":3676209932},{"type":"v1","addr":"172.21.15.100:6837","nonce":3676209932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24502,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/1395178742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1395178742},{"type":"v1","addr":"172.21.15.100:6839","nonce":1395178742}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-05-09T05:34:29.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:29.908+0000 7f63bf4db700 1 -- 172.21.15.39:0/2433759284 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f63a40b2880 msgr2=0x7f63a40b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:34:29.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:29.908+0000 7f63bf4db700 1 --2- 172.21.15.39:0/2433759284 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f63a40b2880 0x7f63a40b4d90 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f63b8112360 tx=0x7f63a8005fd0 comp rx=0 tx=0).stop 2024-05-09T05:34:29.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:29.908+0000 7f63bf4db700 1 -- 172.21.15.39:0/2433759284 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63b8103080 msgr2=0x7f63b819d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:34:29.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:29.908+0000 7f63bf4db700 1 --2- 172.21.15.39:0/2433759284 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63b8103080 0x7f63b819d060 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f63b400c970 tx=0x7f63b400cc80 comp rx=0 tx=0).stop 2024-05-09T05:34:29.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:29.908+0000 7f63bf4db700 1 -- 172.21.15.39:0/2433759284 shutdown_connections 2024-05-09T05:34:29.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:29.908+0000 7f63bf4db700 1 --2- 172.21.15.39:0/2433759284 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f63a40b2880 0x7f63a40b4d90 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:29.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:29.908+0000 7f63bf4db700 1 --2- 172.21.15.39:0/2433759284 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f63b8110c30 0x7f63b81a1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:29.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:29.908+0000 7f63bf4db700 1 --2- 172.21.15.39:0/2433759284 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63b8103080 0x7f63b819d060 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:29.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:29.908+0000 7f63bf4db700 1 --2- 172.21.15.39:0/2433759284 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f63b8103a60 0x7f63b819d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:29.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:29.908+0000 7f63bf4db700 1 -- 172.21.15.39:0/2433759284 >> 172.21.15.39:0/2433759284 conn(0x7f63b80fedc0 msgr2=0x7f63b81127a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:34:29.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:29.908+0000 7f63bf4db700 1 -- 172.21.15.39:0/2433759284 shutdown_connections 2024-05-09T05:34:29.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:29.908+0000 7f63bf4db700 1 -- 172.21.15.39:0/2433759284 wait complete. 2024-05-09T05:34:29.903 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 10 2024-05-09T05:34:29.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:29 smithi100 ceph-mon[34353]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T05:34:29.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:29 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:29.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:29 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:29.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:29 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:29.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:29 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T05:34:29.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:29 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T05:34:29.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:29 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:34:30.046 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:29 smithi060 ceph-mon[34555]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T05:34:30.046 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:29 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:30.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:29 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:30.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:29 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:30.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:29 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T05:34:30.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:29 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T05:34:30.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:29 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:34:30.784 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:30 smithi039 ceph-mon[30439]: Deploying daemon mds.g on smithi039 2024-05-09T05:34:30.784 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:30 smithi039 ceph-mon[30439]: mds.? [v2:172.21.15.100:6838/1395178742,v1:172.21.15.100:6839/1395178742] up:boot 2024-05-09T05:34:30.784 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:30 smithi039 ceph-mon[30439]: fsmap 9 up:standby 2024-05-09T05:34:30.784 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:30 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-09T05:34:30.784 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:30 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/2433759284' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T05:34:30.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:30 smithi100 ceph-mon[34353]: Deploying daemon mds.g on smithi039 2024-05-09T05:34:30.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:30 smithi100 ceph-mon[34353]: mds.? [v2:172.21.15.100:6838/1395178742,v1:172.21.15.100:6839/1395178742] up:boot 2024-05-09T05:34:30.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:30 smithi100 ceph-mon[34353]: fsmap 9 up:standby 2024-05-09T05:34:30.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:30 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-09T05:34:30.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:30 smithi100 ceph-mon[34353]: from='client.? 172.21.15.39:0/2433759284' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T05:34:31.046 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:30 smithi060 ceph-mon[34555]: Deploying daemon mds.g on smithi039 2024-05-09T05:34:31.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:30 smithi060 ceph-mon[34555]: mds.? [v2:172.21.15.100:6838/1395178742,v1:172.21.15.100:6839/1395178742] up:boot 2024-05-09T05:34:31.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:30 smithi060 ceph-mon[34555]: fsmap 9 up:standby 2024-05-09T05:34:31.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:30 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-09T05:34:31.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:30 smithi060 ceph-mon[34555]: from='client.? 172.21.15.39:0/2433759284' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T05:34:31.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:31 smithi039 ceph-mon[30439]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T05:34:31.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:31 smithi100 ceph-mon[34353]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T05:34:32.046 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:31 smithi060 ceph-mon[34555]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T05:34:32.324 INFO:journalctl@ceph.mds.g.smithi039.stdout:May 09 05:34:32 smithi039 systemd[1]: Starting Ceph mds.g for 86d4cc60-0dc4-11ef-bc97-c7b262605968... 2024-05-09T05:34:32.487 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-09T05:34:32.598 INFO:journalctl@ceph.mds.g.smithi039.stdout:May 09 05:34:32 smithi039 podman[70143]: 2024-05-09 05:34:32.234244585 +0000 UTC m=+0.018777325 image pull db794d706f492c144ccc8f2c5bbc1870e116f5c4f3309dfab4416b39d099f8d7 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584 2024-05-09T05:34:32.598 INFO:journalctl@ceph.mds.g.smithi039.stdout:May 09 05:34:32 smithi039 podman[70143]: 2024-05-09 05:34:32.339479003 +0000 UTC m=+0.124011765 container create e4dec390d7b56b1aae24dcde565b1a630f79b745615fdc855bcc01e179947425 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-g, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, GIT_CLEAN=True) 2024-05-09T05:34:32.598 INFO:journalctl@ceph.mds.g.smithi039.stdout:May 09 05:34:32 smithi039 podman[70143]: 2024-05-09 05:34:32.567039082 +0000 UTC m=+0.351571818 container init e4dec390d7b56b1aae24dcde565b1a630f79b745615fdc855bcc01e179947425 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-g, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_BRANCH=HEAD) 2024-05-09T05:34:32.598 INFO:journalctl@ceph.mds.g.smithi039.stdout:May 09 05:34:32 smithi039 podman[70143]: 2024-05-09 05:34:32.570205965 +0000 UTC m=+0.354738685 container start e4dec390d7b56b1aae24dcde565b1a630f79b745615fdc855bcc01e179947425 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-g, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-09T05:34:32.753 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T05:34:32.860 INFO:journalctl@ceph.mds.g.smithi039.stdout:May 09 05:34:32 smithi039 ceph-mds[70180]: -- 172.21.15.39:0/3287313962 <== mon.0 v2:172.21.15.39:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55fea3feda40 con 0x55fea4035a80 2024-05-09T05:34:32.860 INFO:journalctl@ceph.mds.g.smithi039.stdout:May 09 05:34:32 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-g[70158]: starting mds.g at 2024-05-09T05:34:32.860 INFO:journalctl@ceph.mds.g.smithi039.stdout:May 09 05:34:32 smithi039 bash[70143]: e4dec390d7b56b1aae24dcde565b1a630f79b745615fdc855bcc01e179947425 2024-05-09T05:34:32.860 INFO:journalctl@ceph.mds.g.smithi039.stdout:May 09 05:34:32 smithi039 systemd[1]: Started Ceph mds.g for 86d4cc60-0dc4-11ef-bc97-c7b262605968. 2024-05-09T05:34:33.800 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:33 smithi039 ceph-mon[30439]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T05:34:33.801 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:33 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:33.801 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:33 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:33.801 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:33 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:33.801 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:33 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T05:34:33.801 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:33 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T05:34:33.801 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:33 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:34:33.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:33 smithi100 ceph-mon[34353]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T05:34:33.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:33 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:33.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:33 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:33.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:33 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:33.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:33 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T05:34:33.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:33 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T05:34:33.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:33 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:34:34.046 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:33 smithi060 ceph-mon[34555]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T05:34:34.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:33 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:34.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:33 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:34.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:33 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:34.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:33 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T05:34:34.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:33 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T05:34:34.048 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:33 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:34:34.321 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:34.327+0000 7f68f3290700 1 -- 172.21.15.39:0/4007957698 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f68ec108760 msgr2=0x7f68ec1100c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:34:34.321 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:34.327+0000 7f68f3290700 1 --2- 172.21.15.39:0/4007957698 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f68ec108760 0x7f68ec1100c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f68e400b0d0 tx=0x7f68e400b3e0 comp rx=0 tx=0).stop 2024-05-09T05:34:34.321 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:34.327+0000 7f68f3290700 1 -- 172.21.15.39:0/4007957698 shutdown_connections 2024-05-09T05:34:34.321 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:34.327+0000 7f68f3290700 1 --2- 172.21.15.39:0/4007957698 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f68ec108760 0x7f68ec1100c0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:34.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:34.327+0000 7f68f3290700 1 --2- 172.21.15.39:0/4007957698 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68ec1034e0 0x7f68ec1038f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:34.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:34.327+0000 7f68f3290700 1 --2- 172.21.15.39:0/4007957698 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f68ec107e10 0x7f68ec108220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:34.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:34.327+0000 7f68f3290700 1 -- 172.21.15.39:0/4007957698 >> 172.21.15.39:0/4007957698 conn(0x7f68ec0fef30 msgr2=0x7f68ec101350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:34:34.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:34.327+0000 7f68f3290700 1 -- 172.21.15.39:0/4007957698 shutdown_connections 2024-05-09T05:34:34.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:34.327+0000 7f68f3290700 1 -- 172.21.15.39:0/4007957698 wait complete. 2024-05-09T05:34:34.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:34.328+0000 7f68f3290700 1 Processor -- start 2024-05-09T05:34:34.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:34.328+0000 7f68f3290700 1 -- start start 2024-05-09T05:34:34.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:34.328+0000 7f68f3290700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68ec1034e0 0x7f68ec19ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:34:34.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:34.328+0000 7f68f3290700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f68ec107e10 0x7f68ec19b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:34:34.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:34.328+0000 7f68f3290700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f68ec108760 0x7f68ec19f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:34:34.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:34.329+0000 7f68f3290700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f68ec1144e0 con 0x7f68ec108760 2024-05-09T05:34:34.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:34.329+0000 7f68f3290700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f68ec114360 con 0x7f68ec1034e0 2024-05-09T05:34:34.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:34.329+0000 7f68f3290700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f68ec114660 con 0x7f68ec107e10 2024-05-09T05:34:34.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:34.329+0000 7f68f182d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f68ec108760 0x7f68ec19f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:34:34.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:34.329+0000 7f68f182d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f68ec108760 0x7f68ec19f680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:52918/0 (socket says 172.21.15.39:52918) 2024-05-09T05:34:34.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:34.329+0000 7f68f182d700 1 -- 172.21.15.39:0/3118396280 learned_addr learned my addr 172.21.15.39:0/3118396280 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:34:34.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:34.329+0000 7f68f082b700 1 --2- 172.21.15.39:0/3118396280 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f68ec107e10 0x7f68ec19b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:34:34.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:34.329+0000 7f68f102c700 1 --2- 172.21.15.39:0/3118396280 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68ec1034e0 0x7f68ec19ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:34:34.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:34.329+0000 7f68f182d700 1 -- 172.21.15.39:0/3118396280 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f68ec107e10 msgr2=0x7f68ec19b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:34:34.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:34.329+0000 7f68f182d700 1 --2- 172.21.15.39:0/3118396280 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f68ec107e10 0x7f68ec19b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:34.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:34.329+0000 7f68f182d700 1 -- 172.21.15.39:0/3118396280 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68ec1034e0 msgr2=0x7f68ec19ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:34:34.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:34.329+0000 7f68f182d700 1 --2- 172.21.15.39:0/3118396280 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68ec1034e0 0x7f68ec19ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:34.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:34.329+0000 7f68f182d700 1 -- 172.21.15.39:0/3118396280 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68ec19fc70 con 0x7f68ec108760 2024-05-09T05:34:34.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:34.329+0000 7f68f182d700 1 --2- 172.21.15.39:0/3118396280 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f68ec108760 0x7f68ec19f680 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f68e40095c0 tx=0x7f68e4007a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:34:34.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:34.329+0000 7f68e27fc700 1 -- 172.21.15.39:0/3118396280 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68e401f070 con 0x7f68ec108760 2024-05-09T05:34:34.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:34.330+0000 7f68f3290700 1 -- 172.21.15.39:0/3118396280 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68ec19ff00 con 0x7f68ec108760 2024-05-09T05:34:34.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:34.330+0000 7f68e27fc700 1 -- 172.21.15.39:0/3118396280 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f68e4007e20 con 0x7f68ec108760 2024-05-09T05:34:34.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:34.330+0000 7f68e27fc700 1 -- 172.21.15.39:0/3118396280 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68e401b4a0 con 0x7f68ec108760 2024-05-09T05:34:34.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:34.330+0000 7f68f3290700 1 -- 172.21.15.39:0/3118396280 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68ec1a0430 con 0x7f68ec108760 2024-05-09T05:34:34.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:34.331+0000 7f68f3290700 1 -- 172.21.15.39:0/3118396280 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68ec0512c0 con 0x7f68ec108760 2024-05-09T05:34:34.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:34.332+0000 7f68e27fc700 1 -- 172.21.15.39:0/3118396280 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f68e4022070 con 0x7f68ec108760 2024-05-09T05:34:34.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:34.333+0000 7f68e27fc700 1 --2- 172.21.15.39:0/3118396280 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f68d80b2880 0x7f68d80b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:34:34.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:34.333+0000 7f68f102c700 1 --2- 172.21.15.39:0/3118396280 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f68d80b2880 0x7f68d80b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:34:34.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:34.333+0000 7f68e27fc700 1 -- 172.21.15.39:0/3118396280 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f68e400f020 con 0x7f68ec108760 2024-05-09T05:34:34.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:34.334+0000 7f68f102c700 1 --2- 172.21.15.39:0/3118396280 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f68d80b2880 0x7f68d80b4d90 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f68dc00ac50 tx=0x7f68dc00a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:34:34.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:34.337+0000 7f68e27fc700 1 -- 172.21.15.39:0/3118396280 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f68e4029020 con 0x7f68ec108760 2024-05-09T05:34:34.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:34.611+0000 7f68f3290700 1 -- 172.21.15.39:0/3118396280 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f68ec19c1b0 con 0x7f68ec108760 2024-05-09T05:34:34.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:34.611+0000 7f68e27fc700 1 -- 172.21.15.39:0/3118396280 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8824 (secure 0 0 0) 0x7f68e40ab560 con 0x7f68ec108760 2024-05-09T05:34:34.605 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-09T05:34:34.605 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":11,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/1997969267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":1997969267},{"type":"v1","addr":"172.21.15.39:6835","nonce":1997969267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/283022063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":283022063},{"type":"v1","addr":"172.21.15.39:6837","nonce":283022063}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14604,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6839/669632573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":669632573},{"type":"v1","addr":"172.21.15.39:6839","nonce":669632573}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24433,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/1308189973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":1308189973},{"type":"v1","addr":"172.21.15.100:6833","nonce":1308189973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24434,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/2789974692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2789974692},{"type":"v1","addr":"172.21.15.60:6833","nonce":2789974692}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24461,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/924472374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":924472374},{"type":"v1","addr":"172.21.15.60:6835","nonce":924472374}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24479,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/3588840930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":3588840930},{"type":"v1","addr":"172.21.15.60:6837","nonce":3588840930}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24481,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/2595255386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2595255386},{"type":"v1","addr":"172.21.15.100:6835","nonce":2595255386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24487,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/3676209932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":3676209932},{"type":"v1","addr":"172.21.15.100:6837","nonce":3676209932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24502,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/1395178742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1395178742},{"type":"v1","addr":"172.21.15.100:6839","nonce":1395178742}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-05-09T05:34:34.607 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:34.613+0000 7f68f3290700 1 -- 172.21.15.39:0/3118396280 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f68d80b2880 msgr2=0x7f68d80b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:34:34.607 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:34.613+0000 7f68f3290700 1 --2- 172.21.15.39:0/3118396280 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f68d80b2880 0x7f68d80b4d90 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f68dc00ac50 tx=0x7f68dc00a380 comp rx=0 tx=0).stop 2024-05-09T05:34:34.607 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:34.613+0000 7f68f3290700 1 -- 172.21.15.39:0/3118396280 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f68ec108760 msgr2=0x7f68ec19f680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:34:34.608 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:34.613+0000 7f68f3290700 1 --2- 172.21.15.39:0/3118396280 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f68ec108760 0x7f68ec19f680 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f68e40095c0 tx=0x7f68e4007a20 comp rx=0 tx=0).stop 2024-05-09T05:34:34.608 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:34.614+0000 7f68f3290700 1 -- 172.21.15.39:0/3118396280 shutdown_connections 2024-05-09T05:34:34.608 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:34.614+0000 7f68f3290700 1 --2- 172.21.15.39:0/3118396280 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f68d80b2880 0x7f68d80b4d90 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:34.608 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:34.614+0000 7f68f3290700 1 --2- 172.21.15.39:0/3118396280 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f68ec108760 0x7f68ec19f680 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:34.608 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:34.614+0000 7f68f3290700 1 --2- 172.21.15.39:0/3118396280 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68ec1034e0 0x7f68ec19ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:34.608 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:34.614+0000 7f68f3290700 1 --2- 172.21.15.39:0/3118396280 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f68ec107e10 0x7f68ec19b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:34.608 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:34.614+0000 7f68f3290700 1 -- 172.21.15.39:0/3118396280 >> 172.21.15.39:0/3118396280 conn(0x7f68ec0fef30 msgr2=0x7f68ec107580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:34:34.609 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:34.614+0000 7f68f3290700 1 -- 172.21.15.39:0/3118396280 shutdown_connections 2024-05-09T05:34:34.609 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:34.614+0000 7f68f3290700 1 -- 172.21.15.39:0/3118396280 wait complete. 2024-05-09T05:34:34.609 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 11 2024-05-09T05:34:34.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:34 smithi039 ceph-mon[30439]: Deploying daemon mds.a on smithi039 2024-05-09T05:34:34.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:34 smithi039 ceph-mon[30439]: mds.? [v2:172.21.15.39:6838/669632573,v1:172.21.15.39:6839/669632573] up:boot 2024-05-09T05:34:34.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:34 smithi039 ceph-mon[30439]: fsmap 10 up:standby 2024-05-09T05:34:34.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:34 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-09T05:34:34.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:34 smithi100 ceph-mon[34353]: Deploying daemon mds.a on smithi039 2024-05-09T05:34:34.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:34 smithi100 ceph-mon[34353]: mds.? [v2:172.21.15.39:6838/669632573,v1:172.21.15.39:6839/669632573] up:boot 2024-05-09T05:34:34.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:34 smithi100 ceph-mon[34353]: fsmap 10 up:standby 2024-05-09T05:34:34.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:34 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-09T05:34:35.046 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:34 smithi060 ceph-mon[34555]: Deploying daemon mds.a on smithi039 2024-05-09T05:34:35.046 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:34 smithi060 ceph-mon[34555]: mds.? [v2:172.21.15.39:6838/669632573,v1:172.21.15.39:6839/669632573] up:boot 2024-05-09T05:34:35.046 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:34 smithi060 ceph-mon[34555]: fsmap 10 up:standby 2024-05-09T05:34:35.046 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:34 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-09T05:34:35.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:35 smithi039 ceph-mon[30439]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T05:34:35.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:35 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/3118396280' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T05:34:35.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:35 smithi100 ceph-mon[34353]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T05:34:35.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:35 smithi100 ceph-mon[34353]: from='client.? 172.21.15.39:0/3118396280' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T05:34:36.046 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:35 smithi060 ceph-mon[34555]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T05:34:36.046 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:35 smithi060 ceph-mon[34555]: from='client.? 172.21.15.39:0/3118396280' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T05:34:36.611 INFO:journalctl@ceph.mds.a.smithi039.stdout:May 09 05:34:36 smithi039 podman[70611]: 2024-05-09 05:34:36.439409674 +0000 UTC m=+0.018869436 image pull db794d706f492c144ccc8f2c5bbc1870e116f5c4f3309dfab4416b39d099f8d7 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584 2024-05-09T05:34:36.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:36 smithi100 ceph-mon[34353]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T05:34:37.046 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:36 smithi060 ceph-mon[34555]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T05:34:37.110 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:36 smithi039 ceph-mon[30439]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T05:34:37.110 INFO:journalctl@ceph.mds.a.smithi039.stdout:May 09 05:34:36 smithi039 podman[70611]: 2024-05-09 05:34:36.755292052 +0000 UTC m=+0.334751812 container init fe69fbfa83014e3196771bb493975a5f1d7ab8b702e96339a8390fdad2b71510 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-a, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-09T05:34:37.110 INFO:journalctl@ceph.mds.a.smithi039.stdout:May 09 05:34:36 smithi039 podman[70611]: 2024-05-09 05:34:36.758207191 +0000 UTC m=+0.337666949 container start fe69fbfa83014e3196771bb493975a5f1d7ab8b702e96339a8390fdad2b71510 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-a, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-09T05:34:37.111 INFO:journalctl@ceph.mds.a.smithi039.stdout:May 09 05:34:36 smithi039 ceph-mds[70630]: -- 172.21.15.39:0/1616653336 <== mon.0 v2:172.21.15.39:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559b020c3a40 con 0x559b0210b600 2024-05-09T05:34:37.111 INFO:journalctl@ceph.mds.a.smithi039.stdout:May 09 05:34:36 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-a[70626]: starting mds.a at 2024-05-09T05:34:37.111 INFO:journalctl@ceph.mds.a.smithi039.stdout:May 09 05:34:36 smithi039 bash[70611]: fe69fbfa83014e3196771bb493975a5f1d7ab8b702e96339a8390fdad2b71510 2024-05-09T05:34:37.111 INFO:journalctl@ceph.mds.a.smithi039.stdout:May 09 05:34:36 smithi039 systemd[1]: Started Ceph mds.a for 86d4cc60-0dc4-11ef-bc97-c7b262605968. 2024-05-09T05:34:37.423 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-09T05:34:37.679 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T05:34:38.058 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:37 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:38.058 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:37 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:38.058 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:37 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:38.058 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:37 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T05:34:38.058 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:37 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T05:34:38.058 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:37 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:34:38.058 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:37 smithi039 ceph-mon[30439]: Deploying daemon mds.b on smithi060 2024-05-09T05:34:38.058 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:37 smithi039 ceph-mon[30439]: mds.? [v2:172.21.15.39:6840/2202260395,v1:172.21.15.39:6841/2202260395] up:boot 2024-05-09T05:34:38.058 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:37 smithi039 ceph-mon[30439]: fsmap 11 up:standby 2024-05-09T05:34:38.058 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:37 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-09T05:34:38.174 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:37 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:38.174 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:37 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:38.174 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:37 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:38.174 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:37 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T05:34:38.174 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:37 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T05:34:38.174 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:37 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:34:38.174 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:37 smithi100 ceph-mon[34353]: Deploying daemon mds.b on smithi060 2024-05-09T05:34:38.174 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:37 smithi100 ceph-mon[34353]: mds.? [v2:172.21.15.39:6840/2202260395,v1:172.21.15.39:6841/2202260395] up:boot 2024-05-09T05:34:38.174 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:37 smithi100 ceph-mon[34353]: fsmap 11 up:standby 2024-05-09T05:34:38.174 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:37 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-09T05:34:38.297 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:37 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:38.297 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:37 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:38.297 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:37 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:38.297 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:37 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T05:34:38.297 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:37 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T05:34:38.297 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:37 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:34:38.297 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:37 smithi060 ceph-mon[34555]: Deploying daemon mds.b on smithi060 2024-05-09T05:34:38.297 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:37 smithi060 ceph-mon[34555]: mds.? [v2:172.21.15.39:6840/2202260395,v1:172.21.15.39:6841/2202260395] up:boot 2024-05-09T05:34:38.297 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:37 smithi060 ceph-mon[34555]: fsmap 11 up:standby 2024-05-09T05:34:38.297 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:37 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-09T05:34:39.140 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:39.145+0000 7fb68bd33700 1 -- 172.21.15.39:0/488733021 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb684107df0 msgr2=0x7fb684108200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:34:39.140 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:39.145+0000 7fb68bd33700 1 --2- 172.21.15.39:0/488733021 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb684107df0 0x7fb684108200 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb6780099c0 tx=0x7fb678009cd0 comp rx=0 tx=0).stop 2024-05-09T05:34:39.140 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:39.146+0000 7fb68bd33700 1 -- 172.21.15.39:0/488733021 shutdown_connections 2024-05-09T05:34:39.140 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:39.146+0000 7fb68bd33700 1 --2- 172.21.15.39:0/488733021 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb684108740 0x7fb6841100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:39.140 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:39.146+0000 7fb68bd33700 1 --2- 172.21.15.39:0/488733021 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6841034c0 0x7fb6841038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:39.141 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:39.146+0000 7fb68bd33700 1 --2- 172.21.15.39:0/488733021 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb684107df0 0x7fb684108200 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:39.141 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:39.146+0000 7fb68bd33700 1 -- 172.21.15.39:0/488733021 >> 172.21.15.39:0/488733021 conn(0x7fb6840fedc0 msgr2=0x7fb6841011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:34:39.141 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:39.146+0000 7fb68bd33700 1 -- 172.21.15.39:0/488733021 shutdown_connections 2024-05-09T05:34:39.141 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:39.146+0000 7fb68bd33700 1 -- 172.21.15.39:0/488733021 wait complete. 2024-05-09T05:34:39.141 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:38 smithi039 ceph-mon[30439]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T05:34:39.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:39.146+0000 7fb68bd33700 1 Processor -- start 2024-05-09T05:34:39.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:39.146+0000 7fb68bd33700 1 -- start start 2024-05-09T05:34:39.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:39.147+0000 7fb68bd33700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6841034c0 0x7fb684110a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:34:39.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:39.147+0000 7fb68bd33700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb684107df0 0x7fb684110fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:34:39.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:39.147+0000 7fb68bd33700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb684108740 0x7fb684111500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:34:39.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:39.147+0000 7fb68bd33700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fb684114480 con 0x7fb684107df0 2024-05-09T05:34:39.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:39.147+0000 7fb68bd33700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb684114300 con 0x7fb684108740 2024-05-09T05:34:39.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:39.147+0000 7fb68bd33700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb684114600 con 0x7fb6841034c0 2024-05-09T05:34:39.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:39.147+0000 7fb6892ce700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb684107df0 0x7fb684110fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:34:39.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:39.147+0000 7fb6892ce700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb684107df0 0x7fb684110fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45122/0 (socket says 172.21.15.39:45122) 2024-05-09T05:34:39.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:39.147+0000 7fb6892ce700 1 -- 172.21.15.39:0/572143351 learned_addr learned my addr 172.21.15.39:0/572143351 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:34:39.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:39.147+0000 7fb689acf700 1 --2- 172.21.15.39:0/572143351 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6841034c0 0x7fb684110a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:34:39.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:39.147+0000 7fb68a2d0700 1 --2- 172.21.15.39:0/572143351 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb684108740 0x7fb684111500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:34:39.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:39.147+0000 7fb6892ce700 1 -- 172.21.15.39:0/572143351 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6841034c0 msgr2=0x7fb684110a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:34:39.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:39.147+0000 7fb6892ce700 1 --2- 172.21.15.39:0/572143351 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6841034c0 0x7fb684110a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:39.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:39.147+0000 7fb6892ce700 1 -- 172.21.15.39:0/572143351 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb684108740 msgr2=0x7fb684111500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:34:39.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:39.147+0000 7fb6892ce700 1 --2- 172.21.15.39:0/572143351 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb684108740 0x7fb684111500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:39.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:39.147+0000 7fb6892ce700 1 -- 172.21.15.39:0/572143351 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6841a9170 con 0x7fb684107df0 2024-05-09T05:34:39.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:39.147+0000 7fb689acf700 1 --2- 172.21.15.39:0/572143351 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6841034c0 0x7fb684110a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T05:34:39.145 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:39.148+0000 7fb6892ce700 1 --2- 172.21.15.39:0/572143351 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb684107df0 0x7fb684110fc0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb678006010 tx=0x7fb6780055f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:34:39.145 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:39.148+0000 7fb682ffd700 1 -- 172.21.15.39:0/572143351 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb678026070 con 0x7fb684107df0 2024-05-09T05:34:39.145 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:39.148+0000 7fb682ffd700 1 -- 172.21.15.39:0/572143351 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb67800f460 con 0x7fb684107df0 2024-05-09T05:34:39.145 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:39.148+0000 7fb68bd33700 1 -- 172.21.15.39:0/572143351 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6841a9400 con 0x7fb684107df0 2024-05-09T05:34:39.145 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:39.148+0000 7fb682ffd700 1 -- 172.21.15.39:0/572143351 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb678009e60 con 0x7fb684107df0 2024-05-09T05:34:39.145 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:39.148+0000 7fb68bd33700 1 -- 172.21.15.39:0/572143351 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6841a9850 con 0x7fb684107df0 2024-05-09T05:34:39.145 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:39.149+0000 7fb68bd33700 1 -- 172.21.15.39:0/572143351 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6840512c0 con 0x7fb684107df0 2024-05-09T05:34:39.146 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:39.151+0000 7fb682ffd700 1 -- 172.21.15.39:0/572143351 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fb678029070 con 0x7fb684107df0 2024-05-09T05:34:39.146 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:39.152+0000 7fb682ffd700 1 --2- 172.21.15.39:0/572143351 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fb66c0b2880 0x7fb66c0b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:34:39.146 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:39.152+0000 7fb689acf700 1 --2- 172.21.15.39:0/572143351 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fb66c0b2880 0x7fb66c0b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:34:39.146 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:39.152+0000 7fb682ffd700 1 -- 172.21.15.39:0/572143351 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7fb6780e2660 con 0x7fb684107df0 2024-05-09T05:34:39.146 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:39.152+0000 7fb689acf700 1 --2- 172.21.15.39:0/572143351 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fb66c0b2880 0x7fb66c0b4d90 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb674009fd0 tx=0x7fb6740091f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:34:39.149 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:39.156+0000 7fb682ffd700 1 -- 172.21.15.39:0/572143351 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fb678013070 con 0x7fb684107df0 2024-05-09T05:34:39.296 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:38 smithi060 ceph-mon[34555]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T05:34:39.296 INFO:journalctl@ceph.mds.b.smithi060.stdout:May 09 05:34:39 smithi060 systemd[1]: Starting Ceph mds.b for 86d4cc60-0dc4-11ef-bc97-c7b262605968... 2024-05-09T05:34:39.381 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:38 smithi100 ceph-mon[34353]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T05:34:39.410 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:39.416+0000 7fb68bd33700 1 -- 172.21.15.39:0/572143351 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb68402e5f0 con 0x7fb684107df0 2024-05-09T05:34:39.411 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:39.417+0000 7fb682ffd700 1 -- 172.21.15.39:0/572143351 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9650 (secure 0 0 0) 0x7fb6780aa8b0 con 0x7fb684107df0 2024-05-09T05:34:39.411 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-09T05:34:39.411 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":12,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/1997969267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":1997969267},{"type":"v1","addr":"172.21.15.39:6835","nonce":1997969267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/283022063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":283022063},{"type":"v1","addr":"172.21.15.39:6837","nonce":283022063}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14604,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6839/669632573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":669632573},{"type":"v1","addr":"172.21.15.39:6839","nonce":669632573}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14616,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6841/2202260395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6840","nonce":2202260395},{"type":"v1","addr":"172.21.15.39:6841","nonce":2202260395}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24433,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/1308189973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":1308189973},{"type":"v1","addr":"172.21.15.100:6833","nonce":1308189973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24434,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/2789974692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2789974692},{"type":"v1","addr":"172.21.15.60:6833","nonce":2789974692}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24461,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/924472374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":924472374},{"type":"v1","addr":"172.21.15.60:6835","nonce":924472374}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24479,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/3588840930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":3588840930},{"type":"v1","addr":"172.21.15.60:6837","nonce":3588840930}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24481,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/2595255386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2595255386},{"type":"v1","addr":"172.21.15.100:6835","nonce":2595255386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24487,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/3676209932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":3676209932},{"type":"v1","addr":"172.21.15.100:6837","nonce":3676209932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24502,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/1395178742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1395178742},{"type":"v1","addr":"172.21.15.100:6839","nonce":1395178742}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-05-09T05:34:39.413 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:39.419+0000 7fb68bd33700 1 -- 172.21.15.39:0/572143351 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fb66c0b2880 msgr2=0x7fb66c0b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:34:39.413 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:39.419+0000 7fb68bd33700 1 --2- 172.21.15.39:0/572143351 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fb66c0b2880 0x7fb66c0b4d90 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb674009fd0 tx=0x7fb6740091f0 comp rx=0 tx=0).stop 2024-05-09T05:34:39.413 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:39.419+0000 7fb68bd33700 1 -- 172.21.15.39:0/572143351 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb684107df0 msgr2=0x7fb684110fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:34:39.413 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:39.419+0000 7fb68bd33700 1 --2- 172.21.15.39:0/572143351 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb684107df0 0x7fb684110fc0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb678006010 tx=0x7fb6780055f0 comp rx=0 tx=0).stop 2024-05-09T05:34:39.413 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:39.419+0000 7fb68bd33700 1 -- 172.21.15.39:0/572143351 shutdown_connections 2024-05-09T05:34:39.413 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:39.419+0000 7fb68bd33700 1 --2- 172.21.15.39:0/572143351 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fb66c0b2880 0x7fb66c0b4d90 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:39.414 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:39.419+0000 7fb68bd33700 1 --2- 172.21.15.39:0/572143351 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb684108740 0x7fb684111500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:39.414 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:39.419+0000 7fb68bd33700 1 --2- 172.21.15.39:0/572143351 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6841034c0 0x7fb684110a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:39.414 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:39.419+0000 7fb68bd33700 1 --2- 172.21.15.39:0/572143351 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb684107df0 0x7fb684110fc0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:39.414 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:39.419+0000 7fb68bd33700 1 -- 172.21.15.39:0/572143351 >> 172.21.15.39:0/572143351 conn(0x7fb6840fedc0 msgr2=0x7fb6841096a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:34:39.414 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:39.419+0000 7fb68bd33700 1 -- 172.21.15.39:0/572143351 shutdown_connections 2024-05-09T05:34:39.414 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:39.419+0000 7fb68bd33700 1 -- 172.21.15.39:0/572143351 wait complete. 2024-05-09T05:34:39.414 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 12 2024-05-09T05:34:39.638 INFO:journalctl@ceph.mds.b.smithi060.stdout:May 09 05:34:39 smithi060 podman[64779]: 2024-05-09 05:34:39.297163207 +0000 UTC m=+0.018500227 image pull db794d706f492c144ccc8f2c5bbc1870e116f5c4f3309dfab4416b39d099f8d7 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584 2024-05-09T05:34:39.638 INFO:journalctl@ceph.mds.b.smithi060.stdout:May 09 05:34:39 smithi060 podman[64779]: 2024-05-09 05:34:39.413901195 +0000 UTC m=+0.135238195 container create 8d92a93d8766391fccd4c9ed69d65bac62caea21649cfd40081c62cfeb2e2182 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-b, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404) 2024-05-09T05:34:39.638 INFO:journalctl@ceph.mds.b.smithi060.stdout:May 09 05:34:39 smithi060 podman[64779]: 2024-05-09 05:34:39.607919346 +0000 UTC m=+0.329256346 container init 8d92a93d8766391fccd4c9ed69d65bac62caea21649cfd40081c62cfeb2e2182 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-b, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True) 2024-05-09T05:34:39.638 INFO:journalctl@ceph.mds.b.smithi060.stdout:May 09 05:34:39 smithi060 podman[64779]: 2024-05-09 05:34:39.610485166 +0000 UTC m=+0.331822171 container start 8d92a93d8766391fccd4c9ed69d65bac62caea21649cfd40081c62cfeb2e2182 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-b, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True) 2024-05-09T05:34:39.638 INFO:journalctl@ceph.mds.b.smithi060.stdout:May 09 05:34:39 smithi060 ceph-mds[64798]: -- 172.21.15.60:0/3643178927 <== mon.2 v2:172.21.15.60:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564d8536da40 con 0x564d853b5a80 2024-05-09T05:34:39.957 INFO:journalctl@ceph.mds.b.smithi060.stdout:May 09 05:34:39 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-b[64794]: starting mds.b at 2024-05-09T05:34:39.957 INFO:journalctl@ceph.mds.b.smithi060.stdout:May 09 05:34:39 smithi060 bash[64779]: 8d92a93d8766391fccd4c9ed69d65bac62caea21649cfd40081c62cfeb2e2182 2024-05-09T05:34:39.957 INFO:journalctl@ceph.mds.b.smithi060.stdout:May 09 05:34:39 smithi060 systemd[1]: Started Ceph mds.b for 86d4cc60-0dc4-11ef-bc97-c7b262605968. 2024-05-09T05:34:40.062 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:39 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/572143351' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T05:34:40.062 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:39 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:40.062 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:39 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:40.062 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:39 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:40.062 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:39 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:40.062 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:39 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:40.296 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:39 smithi060 ceph-mon[34555]: from='client.? 172.21.15.39:0/572143351' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T05:34:40.296 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:39 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:40.296 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:39 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:40.297 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:39 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:40.297 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:39 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:40.297 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:39 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:40.423 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:39 smithi100 ceph-mon[34353]: from='client.? 172.21.15.39:0/572143351' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T05:34:40.423 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:39 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:40.423 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:39 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:40.423 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:39 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:40.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:39 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:40.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:39 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:41.070 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:40 smithi060 ceph-mon[34555]: mds.? [v2:172.21.15.60:6838/1418956667,v1:172.21.15.60:6839/1418956667] up:boot 2024-05-09T05:34:41.070 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:40 smithi060 ceph-mon[34555]: fsmap 12 up:standby 2024-05-09T05:34:41.070 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:40 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-09T05:34:41.070 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:40 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:34:41.070 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:40 smithi060 ceph-mon[34555]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T05:34:41.110 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:40 smithi039 ceph-mon[30439]: mds.? [v2:172.21.15.60:6838/1418956667,v1:172.21.15.60:6839/1418956667] up:boot 2024-05-09T05:34:41.110 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:40 smithi039 ceph-mon[30439]: fsmap 12 up:standby 2024-05-09T05:34:41.110 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:40 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-09T05:34:41.110 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:40 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:34:41.110 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:40 smithi039 ceph-mon[30439]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T05:34:41.174 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:40 smithi100 ceph-mon[34353]: mds.? [v2:172.21.15.60:6838/1418956667,v1:172.21.15.60:6839/1418956667] up:boot 2024-05-09T05:34:41.174 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:40 smithi100 ceph-mon[34353]: fsmap 12 up:standby 2024-05-09T05:34:41.174 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:40 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-09T05:34:41.174 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:40 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:34:41.174 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:40 smithi100 ceph-mon[34353]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T05:34:42.092 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-09T05:34:42.348 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T05:34:42.786 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:42 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:42.786 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:42 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:42.787 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:42 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:42.787 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:42 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:42.787 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:42 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:42.787 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:42 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:42.787 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:42 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:34:42.787 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:42 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:34:42.787 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:42 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:42.787 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:42 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:34:42.787 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:42 smithi039 ceph-mon[30439]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T05:34:42.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:42 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:42.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:42 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:42.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:42 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:42.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:42 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:42.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:42 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:42.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:42 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:42.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:42 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:34:42.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:42 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:34:42.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:42 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:42.925 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:42 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:34:42.925 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:42 smithi100 ceph-mon[34353]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T05:34:43.000 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:42 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:43.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:42 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:43.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:42 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:43.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:42 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:43.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:42 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:43.001 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:42 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:43.002 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:42 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:34:43.002 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:42 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:34:43.002 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:42 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:43.002 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:42 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:34:43.006 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:42 smithi060 ceph-mon[34555]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T05:34:43.927 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:43.933+0000 7f5e4109b700 1 -- 172.21.15.39:0/565953268 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5e3c108740 msgr2=0x7f5e3c1100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:34:43.927 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:43.933+0000 7f5e4109b700 1 --2- 172.21.15.39:0/565953268 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5e3c108740 0x7f5e3c1100a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5e3400b0d0 tx=0x7f5e3400b3e0 comp rx=0 tx=0).stop 2024-05-09T05:34:43.927 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:43.933+0000 7f5e4109b700 1 -- 172.21.15.39:0/565953268 shutdown_connections 2024-05-09T05:34:43.927 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:43.933+0000 7f5e4109b700 1 --2- 172.21.15.39:0/565953268 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5e3c108740 0x7f5e3c1100a0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:43.927 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:43.933+0000 7f5e4109b700 1 --2- 172.21.15.39:0/565953268 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e3c1034c0 0x7f5e3c1038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:43.928 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:43.933+0000 7f5e4109b700 1 --2- 172.21.15.39:0/565953268 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e3c107df0 0x7f5e3c108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:43.928 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:43.933+0000 7f5e4109b700 1 -- 172.21.15.39:0/565953268 >> 172.21.15.39:0/565953268 conn(0x7f5e3c0fedc0 msgr2=0x7f5e3c1011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:34:43.928 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:43.933+0000 7f5e4109b700 1 -- 172.21.15.39:0/565953268 shutdown_connections 2024-05-09T05:34:43.928 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:43.933+0000 7f5e4109b700 1 -- 172.21.15.39:0/565953268 wait complete. 2024-05-09T05:34:43.930 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:43.934+0000 7f5e4109b700 1 Processor -- start 2024-05-09T05:34:43.930 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:43.934+0000 7f5e4109b700 1 -- start start 2024-05-09T05:34:43.930 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:43.934+0000 7f5e4109b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e3c1034c0 0x7f5e3c19ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:34:43.930 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:43.934+0000 7f5e4109b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e3c107df0 0x7f5e3c19b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:34:43.931 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:43.934+0000 7f5e4109b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5e3c108740 0x7f5e3c19f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:34:43.931 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:43.935+0000 7f5e4109b700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f5e3c1133c0 con 0x7f5e3c108740 2024-05-09T05:34:43.931 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:43.935+0000 7f5e4109b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f5e3c113240 con 0x7f5e3c107df0 2024-05-09T05:34:43.931 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:43.935+0000 7f5e4109b700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f5e3c113540 con 0x7f5e3c1034c0 2024-05-09T05:34:43.931 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:43.935+0000 7f5e3b59e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5e3c108740 0x7f5e3c19f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:34:43.931 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:43.935+0000 7f5e3a59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e3c107df0 0x7f5e3c19b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:34:43.931 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:43.935+0000 7f5e3b59e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5e3c108740 0x7f5e3c19f690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45134/0 (socket says 172.21.15.39:45134) 2024-05-09T05:34:43.931 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:43.935+0000 7f5e3b59e700 1 -- 172.21.15.39:0/172640852 learned_addr learned my addr 172.21.15.39:0/172640852 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:34:43.932 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:43.935+0000 7f5e3ad9d700 1 --2- 172.21.15.39:0/172640852 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e3c1034c0 0x7f5e3c19ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:34:43.932 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:43.935+0000 7f5e3a59c700 1 -- 172.21.15.39:0/172640852 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e3c1034c0 msgr2=0x7f5e3c19ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:34:43.932 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:43.935+0000 7f5e3a59c700 1 --2- 172.21.15.39:0/172640852 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e3c1034c0 0x7f5e3c19ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:43.932 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:43.935+0000 7f5e3a59c700 1 -- 172.21.15.39:0/172640852 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5e3c108740 msgr2=0x7f5e3c19f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:34:43.932 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:43.935+0000 7f5e3a59c700 1 --2- 172.21.15.39:0/172640852 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5e3c108740 0x7f5e3c19f690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:43.932 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:43.935+0000 7f5e3a59c700 1 -- 172.21.15.39:0/172640852 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e3c19fd30 con 0x7f5e3c107df0 2024-05-09T05:34:43.932 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:43.935+0000 7f5e3a59c700 1 --2- 172.21.15.39:0/172640852 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e3c107df0 0x7f5e3c19b400 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5e3000d720 tx=0x7f5e3000da30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:34:43.932 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:43.935+0000 7f5e23fff700 1 -- 172.21.15.39:0/172640852 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e30014030 con 0x7f5e3c107df0 2024-05-09T05:34:43.932 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:43.936+0000 7f5e23fff700 1 -- 172.21.15.39:0/172640852 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5e300044d0 con 0x7f5e3c107df0 2024-05-09T05:34:43.932 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:43.936+0000 7f5e4109b700 1 -- 172.21.15.39:0/172640852 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e3c1a0020 con 0x7f5e3c107df0 2024-05-09T05:34:43.932 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:43.936+0000 7f5e23fff700 1 -- 172.21.15.39:0/172640852 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e30005400 con 0x7f5e3c107df0 2024-05-09T05:34:43.932 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:43.936+0000 7f5e4109b700 1 -- 172.21.15.39:0/172640852 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e3c1a7940 con 0x7f5e3c107df0 2024-05-09T05:34:43.933 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:43.937+0000 7f5e4109b700 1 -- 172.21.15.39:0/172640852 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e3c0512c0 con 0x7f5e3c107df0 2024-05-09T05:34:43.933 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:43.938+0000 7f5e23fff700 1 -- 172.21.15.39:0/172640852 <== mon.2 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f5e300055a0 con 0x7f5e3c107df0 2024-05-09T05:34:43.933 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:43.939+0000 7f5e23fff700 1 --2- 172.21.15.39:0/172640852 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f5e240b2900 0x7f5e240b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:34:43.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:43.939+0000 7f5e3ad9d700 1 --2- 172.21.15.39:0/172640852 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f5e240b2900 0x7f5e240b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:34:43.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:43.939+0000 7f5e23fff700 1 -- 172.21.15.39:0/172640852 <== mon.2 v2:172.21.15.60:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f5e300e1820 con 0x7f5e3c107df0 2024-05-09T05:34:43.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:43.939+0000 7f5e3ad9d700 1 --2- 172.21.15.39:0/172640852 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f5e240b2900 0x7f5e240b4e10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c009c60 tx=0x7f5e2c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:34:43.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:43.944+0000 7f5e23fff700 1 -- 172.21.15.39:0/172640852 <== mon.2 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f5e300a99e0 con 0x7f5e3c107df0 2024-05-09T05:34:44.209 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:44.216+0000 7f5e4109b700 1 -- 172.21.15.39:0/172640852 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5e3c1a7b10 con 0x7f5e3c107df0 2024-05-09T05:34:44.210 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:44.217+0000 7f5e23fff700 1 -- 172.21.15.39:0/172640852 <== mon.2 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10476 (secure 0 0 0) 0x7f5e300a92e0 con 0x7f5e3c107df0 2024-05-09T05:34:44.211 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-09T05:34:44.211 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":13,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/1997969267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":1997969267},{"type":"v1","addr":"172.21.15.39:6835","nonce":1997969267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/283022063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":283022063},{"type":"v1","addr":"172.21.15.39:6837","nonce":283022063}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14604,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6839/669632573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":669632573},{"type":"v1","addr":"172.21.15.39:6839","nonce":669632573}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14616,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6841/2202260395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6840","nonce":2202260395},{"type":"v1","addr":"172.21.15.39:6841","nonce":2202260395}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24433,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/1308189973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":1308189973},{"type":"v1","addr":"172.21.15.100:6833","nonce":1308189973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24434,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/2789974692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2789974692},{"type":"v1","addr":"172.21.15.60:6833","nonce":2789974692}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24461,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/924472374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":924472374},{"type":"v1","addr":"172.21.15.60:6835","nonce":924472374}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24479,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/3588840930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":3588840930},{"type":"v1","addr":"172.21.15.60:6837","nonce":3588840930}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24481,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/2595255386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2595255386},{"type":"v1","addr":"172.21.15.100:6835","nonce":2595255386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24487,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/3676209932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":3676209932},{"type":"v1","addr":"172.21.15.100:6837","nonce":3676209932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24502,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/1395178742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1395178742},{"type":"v1","addr":"172.21.15.100:6839","nonce":1395178742}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24509,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6839/1418956667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":1418956667},{"type":"v1","addr":"172.21.15.60:6839","nonce":1418956667}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-05-09T05:34:44.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:44.219+0000 7f5e4109b700 1 -- 172.21.15.39:0/172640852 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f5e240b2900 msgr2=0x7f5e240b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:34:44.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:44.219+0000 7f5e4109b700 1 --2- 172.21.15.39:0/172640852 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f5e240b2900 0x7f5e240b4e10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c009c60 tx=0x7f5e2c009260 comp rx=0 tx=0).stop 2024-05-09T05:34:44.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:44.219+0000 7f5e4109b700 1 -- 172.21.15.39:0/172640852 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e3c107df0 msgr2=0x7f5e3c19b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:34:44.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:44.219+0000 7f5e4109b700 1 --2- 172.21.15.39:0/172640852 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e3c107df0 0x7f5e3c19b400 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5e3000d720 tx=0x7f5e3000da30 comp rx=0 tx=0).stop 2024-05-09T05:34:44.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:44.219+0000 7f5e4109b700 1 -- 172.21.15.39:0/172640852 shutdown_connections 2024-05-09T05:34:44.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:44.219+0000 7f5e4109b700 1 --2- 172.21.15.39:0/172640852 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f5e240b2900 0x7f5e240b4e10 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:44.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:44.219+0000 7f5e4109b700 1 --2- 172.21.15.39:0/172640852 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5e3c108740 0x7f5e3c19f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:44.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:44.219+0000 7f5e4109b700 1 --2- 172.21.15.39:0/172640852 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e3c1034c0 0x7f5e3c19ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:44.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:44.219+0000 7f5e4109b700 1 --2- 172.21.15.39:0/172640852 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e3c107df0 0x7f5e3c19b400 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:44.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:44.219+0000 7f5e4109b700 1 -- 172.21.15.39:0/172640852 >> 172.21.15.39:0/172640852 conn(0x7f5e3c0fedc0 msgr2=0x7f5e3c107560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:34:44.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:44.219+0000 7f5e4109b700 1 -- 172.21.15.39:0/172640852 shutdown_connections 2024-05-09T05:34:44.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:44.220+0000 7f5e4109b700 1 -- 172.21.15.39:0/172640852 wait complete. 2024-05-09T05:34:44.214 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 13 2024-05-09T05:34:44.423 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:44 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:44.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:44 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:44.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:44 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:44.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:44 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:44.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:44 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:44.516 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:44 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:44.516 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:44 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:44.516 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:44 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:44.516 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:44 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:44.517 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:44 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:44.546 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:44 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:44.546 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:44 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:44.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:44 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:44.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:44 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:44.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:44 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:45.140 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:45 smithi039 ceph-mon[30439]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T05:34:45.141 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:45 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/172640852' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T05:34:45.143 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-05-09T05:34:45.417 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T05:34:45.423 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:45 smithi100 ceph-mon[34353]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T05:34:45.423 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:45 smithi100 ceph-mon[34353]: from='client.? 172.21.15.39:0/172640852' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T05:34:45.546 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:45 smithi060 ceph-mon[34555]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T05:34:45.546 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:45 smithi060 ceph-mon[34555]: from='client.? 172.21.15.39:0/172640852' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T05:34:46.966 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:46.972+0000 7f30f91df700 1 -- 172.21.15.39:0/53217647 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30f4109860 msgr2=0x7f30f41111c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:34:46.966 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:46.972+0000 7f30f91df700 1 --2- 172.21.15.39:0/53217647 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30f4109860 0x7f30f41111c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f30ec0099c0 tx=0x7f30ec009cd0 comp rx=0 tx=0).stop 2024-05-09T05:34:46.966 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:46.972+0000 7f30f91df700 1 -- 172.21.15.39:0/53217647 shutdown_connections 2024-05-09T05:34:46.966 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:46.972+0000 7f30f91df700 1 --2- 172.21.15.39:0/53217647 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30f4109860 0x7f30f41111c0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:46.967 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:46.972+0000 7f30f91df700 1 --2- 172.21.15.39:0/53217647 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30f41045e0 0x7f30f41049f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:46.967 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:46.972+0000 7f30f91df700 1 --2- 172.21.15.39:0/53217647 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30f4108f10 0x7f30f4109320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:46.967 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:46.972+0000 7f30f91df700 1 -- 172.21.15.39:0/53217647 >> 172.21.15.39:0/53217647 conn(0x7f30f40ffe70 msgr2=0x7f30f41022c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:34:46.967 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:46.972+0000 7f30f91df700 1 -- 172.21.15.39:0/53217647 shutdown_connections 2024-05-09T05:34:46.967 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:46.972+0000 7f30f91df700 1 -- 172.21.15.39:0/53217647 wait complete. 2024-05-09T05:34:46.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:46.973+0000 7f30f91df700 1 Processor -- start 2024-05-09T05:34:46.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:46.973+0000 7f30f91df700 1 -- start start 2024-05-09T05:34:46.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:46.974+0000 7f30f91df700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30f41045e0 0x7f30f419ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:34:46.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:46.974+0000 7f30f91df700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30f4108f10 0x7f30f419b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:34:46.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:46.974+0000 7f30ea59c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30f4108f10 0x7f30f419b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:34:46.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:46.974+0000 7f30f2d9d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30f41045e0 0x7f30f419ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:34:46.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:46.974+0000 7f30ea59c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30f4108f10 0x7f30f419b3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36812/0 (socket says 172.21.15.39:36812) 2024-05-09T05:34:46.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:46.974+0000 7f30f2d9d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30f41045e0 0x7f30f419ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.39:60698/0 (socket says 172.21.15.39:60698) 2024-05-09T05:34:46.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:46.974+0000 7f30ea59c700 1 -- 172.21.15.39:0/3858353595 learned_addr learned my addr 172.21.15.39:0/3858353595 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:34:46.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:46.974+0000 7f30f91df700 1 --2- 172.21.15.39:0/3858353595 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30f4109860 0x7f30f419f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:34:46.970 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:46.974+0000 7f30f91df700 1 -- 172.21.15.39:0/3858353595 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f30f4114490 con 0x7f30f4108f10 2024-05-09T05:34:46.970 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:46.974+0000 7f30f91df700 1 -- 172.21.15.39:0/3858353595 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f30f4114310 con 0x7f30f4109860 2024-05-09T05:34:46.970 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:46.974+0000 7f30f91df700 1 -- 172.21.15.39:0/3858353595 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f30f4114610 con 0x7f30f41045e0 2024-05-09T05:34:46.970 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:46.975+0000 7f30f359e700 1 --2- 172.21.15.39:0/3858353595 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30f4109860 0x7f30f419f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:34:46.970 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:46.975+0000 7f30f2d9d700 1 -- 172.21.15.39:0/3858353595 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30f4109860 msgr2=0x7f30f419f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:34:46.970 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:46.975+0000 7f30f2d9d700 1 --2- 172.21.15.39:0/3858353595 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30f4109860 0x7f30f419f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:46.970 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:46.975+0000 7f30f2d9d700 1 -- 172.21.15.39:0/3858353595 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30f4108f10 msgr2=0x7f30f419b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:34:46.970 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:46.975+0000 7f30f2d9d700 1 --2- 172.21.15.39:0/3858353595 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30f4108f10 0x7f30f419b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:46.970 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:46.975+0000 7f30f2d9d700 1 -- 172.21.15.39:0/3858353595 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30f419fc80 con 0x7f30f41045e0 2024-05-09T05:34:46.970 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:46.975+0000 7f30f2d9d700 1 --2- 172.21.15.39:0/3858353595 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30f41045e0 0x7f30f419ae00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f30e400b760 tx=0x7f30e400ba70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:34:46.970 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:46.975+0000 7f30f0d99700 1 -- 172.21.15.39:0/3858353595 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30e4022070 con 0x7f30f41045e0 2024-05-09T05:34:46.970 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:46.975+0000 7f30f0d99700 1 -- 172.21.15.39:0/3858353595 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f30e40092e0 con 0x7f30f41045e0 2024-05-09T05:34:46.971 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:46.975+0000 7f30f0d99700 1 -- 172.21.15.39:0/3858353595 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30e401d880 con 0x7f30f41045e0 2024-05-09T05:34:46.971 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:46.975+0000 7f30f91df700 1 -- 172.21.15.39:0/3858353595 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30f419ff70 con 0x7f30f41045e0 2024-05-09T05:34:46.971 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:46.975+0000 7f30f91df700 1 -- 172.21.15.39:0/3858353595 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30f40759f0 con 0x7f30f41045e0 2024-05-09T05:34:46.971 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:46.976+0000 7f30f91df700 1 -- 172.21.15.39:0/3858353595 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30f4105a90 con 0x7f30f41045e0 2024-05-09T05:34:46.972 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:46.978+0000 7f30f0d99700 1 -- 172.21.15.39:0/3858353595 <== mon.1 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f30e4025070 con 0x7f30f41045e0 2024-05-09T05:34:46.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:46.979+0000 7f30f0d99700 1 --2- 172.21.15.39:0/3858353595 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f30e00b2900 0x7f30e00b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:34:46.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:46.979+0000 7f30ea59c700 1 --2- 172.21.15.39:0/3858353595 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f30e00b2900 0x7f30e00b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:34:46.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:46.980+0000 7f30f0d99700 1 -- 172.21.15.39:0/3858353595 <== mon.1 v2:172.21.15.100:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f30e40e9750 con 0x7f30f41045e0 2024-05-09T05:34:46.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:46.980+0000 7f30ea59c700 1 --2- 172.21.15.39:0/3858353595 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f30e00b2900 0x7f30e00b4e10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f30f41087f0 tx=0x7f30dc009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:34:46.976 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:46.983+0000 7f30f0d99700 1 -- 172.21.15.39:0/3858353595 <== mon.1 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f30e40b1870 con 0x7f30f41045e0 2024-05-09T05:34:47.210 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:47.216+0000 7f30f91df700 1 -- 172.21.15.39:0/3858353595 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f30f419c110 con 0x7f30f41045e0 2024-05-09T05:34:47.210 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:47.217+0000 7f30f0d99700 1 -- 172.21.15.39:0/3858353595 <== mon.1 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v74) ==== 84+0+65 (secure 0 0 0) 0x7f30e40b1170 con 0x7f30f41045e0 2024-05-09T05:34:47.210 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-09T05:34:47.210 INFO:teuthology.orchestra.run.smithi039.stdout:[ 2024-05-09T05:34:47.211 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T05:34:47.211 INFO:teuthology.orchestra.run.smithi039.stdout: "poolnum": 1, 2024-05-09T05:34:47.211 INFO:teuthology.orchestra.run.smithi039.stdout: "poolname": ".mgr" 2024-05-09T05:34:47.211 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T05:34:47.211 INFO:teuthology.orchestra.run.smithi039.stdout:] 2024-05-09T05:34:47.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:47.220+0000 7f30f91df700 1 -- 172.21.15.39:0/3858353595 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f30e00b2900 msgr2=0x7f30e00b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:34:47.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:47.220+0000 7f30f91df700 1 --2- 172.21.15.39:0/3858353595 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f30e00b2900 0x7f30e00b4e10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f30f41087f0 tx=0x7f30dc009260 comp rx=0 tx=0).stop 2024-05-09T05:34:47.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:47.220+0000 7f30f91df700 1 -- 172.21.15.39:0/3858353595 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30f41045e0 msgr2=0x7f30f419ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:34:47.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:47.220+0000 7f30f91df700 1 --2- 172.21.15.39:0/3858353595 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30f41045e0 0x7f30f419ae00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f30e400b760 tx=0x7f30e400ba70 comp rx=0 tx=0).stop 2024-05-09T05:34:47.215 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:47.220+0000 7f30f91df700 1 -- 172.21.15.39:0/3858353595 shutdown_connections 2024-05-09T05:34:47.215 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:47.220+0000 7f30f91df700 1 --2- 172.21.15.39:0/3858353595 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f30e00b2900 0x7f30e00b4e10 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:47.215 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:47.220+0000 7f30f91df700 1 --2- 172.21.15.39:0/3858353595 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30f4109860 0x7f30f419f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:47.215 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:47.220+0000 7f30f91df700 1 --2- 172.21.15.39:0/3858353595 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30f41045e0 0x7f30f419ae00 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:47.215 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:47.220+0000 7f30f91df700 1 --2- 172.21.15.39:0/3858353595 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30f4108f10 0x7f30f419b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:47.215 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:47.220+0000 7f30f91df700 1 -- 172.21.15.39:0/3858353595 >> 172.21.15.39:0/3858353595 conn(0x7f30f40ffe70 msgr2=0x7f30f4107040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:34:47.215 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:47.220+0000 7f30f91df700 1 -- 172.21.15.39:0/3858353595 shutdown_connections 2024-05-09T05:34:47.215 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:47.220+0000 7f30f91df700 1 -- 172.21.15.39:0/3858353595 wait complete. 2024-05-09T05:34:47.231 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:47 smithi039 ceph-mon[30439]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T05:34:47.231 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:47 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:47.231 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:47 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:47.423 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:47 smithi100 ceph-mon[34353]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T05:34:47.423 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:47 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:47.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:47 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:47.546 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:47 smithi060 ceph-mon[34555]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T05:34:47.546 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:47 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:47.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:47 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:47.874 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-09T05:34:47.875 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-09T05:34:48.133 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T05:34:48.383 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:48 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/3858353595' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-05-09T05:34:48.383 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:48 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:34:48.383 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:48 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:34:48.383 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:48 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:48.423 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:48 smithi100 ceph-mon[34353]: from='client.? 172.21.15.39:0/3858353595' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-05-09T05:34:48.423 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:48 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:34:48.423 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:48 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:34:48.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:48 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:48.546 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:48 smithi060 ceph-mon[34555]: from='client.? 172.21.15.39:0/3858353595' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-05-09T05:34:48.546 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:48 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:34:48.546 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:48 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:34:48.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:48 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:34:49.477 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:49 smithi039 ceph-mon[30439]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T05:34:49.546 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:49 smithi060 ceph-mon[34555]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T05:34:49.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:49 smithi100 ceph-mon[34353]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T05:34:49.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:49.735+0000 7f9b9b850700 1 -- 172.21.15.39:0/2152103123 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9b941045e0 msgr2=0x7f9b941049f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:34:49.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:49.735+0000 7f9b9b850700 1 --2- 172.21.15.39:0/2152103123 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9b941045e0 0x7f9b941049f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9b900099c0 tx=0x7f9b90009cd0 comp rx=0 tx=0).stop 2024-05-09T05:34:49.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:49.735+0000 7f9b9b850700 1 -- 172.21.15.39:0/2152103123 shutdown_connections 2024-05-09T05:34:49.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:49.735+0000 7f9b9b850700 1 --2- 172.21.15.39:0/2152103123 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b94109860 0x7f9b941111c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:49.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:49.735+0000 7f9b9b850700 1 --2- 172.21.15.39:0/2152103123 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9b941045e0 0x7f9b941049f0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:49.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:49.735+0000 7f9b9b850700 1 --2- 172.21.15.39:0/2152103123 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b94108f10 0x7f9b94109320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:49.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:49.735+0000 7f9b9b850700 1 -- 172.21.15.39:0/2152103123 >> 172.21.15.39:0/2152103123 conn(0x7f9b940ffe70 msgr2=0x7f9b941022c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:34:49.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:49.735+0000 7f9b9b850700 1 -- 172.21.15.39:0/2152103123 shutdown_connections 2024-05-09T05:34:49.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:49.735+0000 7f9b9b850700 1 -- 172.21.15.39:0/2152103123 wait complete. 2024-05-09T05:34:49.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:49.736+0000 7f9b9b850700 1 Processor -- start 2024-05-09T05:34:49.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:49.736+0000 7f9b9b850700 1 -- start start 2024-05-09T05:34:49.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:49.737+0000 7f9b9b850700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9b941045e0 0x7f9b94075ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:34:49.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:49.737+0000 7f9b9b850700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b94108f10 0x7f9b94076000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:34:49.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:49.737+0000 7f9b9b850700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b94109860 0x7f9b94076540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:34:49.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:49.737+0000 7f9b9b850700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f9b94114490 con 0x7f9b941045e0 2024-05-09T05:34:49.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:49.737+0000 7f9b9b850700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f9b94114310 con 0x7f9b94108f10 2024-05-09T05:34:49.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:49.737+0000 7f9b9b850700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f9b94114610 con 0x7f9b94109860 2024-05-09T05:34:49.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:49.737+0000 7f9b995ec700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9b941045e0 0x7f9b94075ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:34:49.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:49.737+0000 7f9b995ec700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9b941045e0 0x7f9b94075ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36832/0 (socket says 172.21.15.39:36832) 2024-05-09T05:34:49.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:49.737+0000 7f9b995ec700 1 -- 172.21.15.39:0/729486628 learned_addr learned my addr 172.21.15.39:0/729486628 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:34:49.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:49.737+0000 7f9b98deb700 1 --2- 172.21.15.39:0/729486628 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b94108f10 0x7f9b94076000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:34:49.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:49.737+0000 7f9b99ded700 1 --2- 172.21.15.39:0/729486628 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b94109860 0x7f9b94076540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:34:49.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:49.737+0000 7f9b995ec700 1 -- 172.21.15.39:0/729486628 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b94109860 msgr2=0x7f9b94076540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:34:49.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:49.737+0000 7f9b995ec700 1 --2- 172.21.15.39:0/729486628 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b94109860 0x7f9b94076540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:49.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:49.737+0000 7f9b995ec700 1 -- 172.21.15.39:0/729486628 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b94108f10 msgr2=0x7f9b94076000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:34:49.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:49.737+0000 7f9b995ec700 1 --2- 172.21.15.39:0/729486628 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b94108f10 0x7f9b94076000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:49.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:49.737+0000 7f9b995ec700 1 -- 172.21.15.39:0/729486628 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b941a91a0 con 0x7f9b941045e0 2024-05-09T05:34:49.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:49.738+0000 7f9b995ec700 1 --2- 172.21.15.39:0/729486628 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9b941045e0 0x7f9b94075ac0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9b90006010 tx=0x7f9b900045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:34:49.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:49.738+0000 7f9b8a7fc700 1 -- 172.21.15.39:0/729486628 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b90026070 con 0x7f9b941045e0 2024-05-09T05:34:49.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:49.738+0000 7f9b8a7fc700 1 -- 172.21.15.39:0/729486628 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9b9000f460 con 0x7f9b941045e0 2024-05-09T05:34:49.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:49.738+0000 7f9b9b850700 1 -- 172.21.15.39:0/729486628 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b941a9430 con 0x7f9b941045e0 2024-05-09T05:34:49.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:49.738+0000 7f9b8a7fc700 1 -- 172.21.15.39:0/729486628 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b90009e60 con 0x7f9b941045e0 2024-05-09T05:34:49.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:49.738+0000 7f9b9b850700 1 -- 172.21.15.39:0/729486628 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b941a9880 con 0x7f9b941045e0 2024-05-09T05:34:49.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:49.739+0000 7f9b9b850700 1 -- 172.21.15.39:0/729486628 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b940512c0 con 0x7f9b941045e0 2024-05-09T05:34:49.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:49.740+0000 7f9b8a7fc700 1 -- 172.21.15.39:0/729486628 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f9b90029070 con 0x7f9b941045e0 2024-05-09T05:34:49.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:49.741+0000 7f9b8a7fc700 1 --2- 172.21.15.39:0/729486628 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f9b800b2880 0x7f9b800b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:34:49.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:49.741+0000 7f9b98deb700 1 --2- 172.21.15.39:0/729486628 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f9b800b2880 0x7f9b800b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:34:49.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:49.741+0000 7f9b8a7fc700 1 -- 172.21.15.39:0/729486628 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f9b900e2560 con 0x7f9b941045e0 2024-05-09T05:34:49.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:49.742+0000 7f9b98deb700 1 --2- 172.21.15.39:0/729486628 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f9b800b2880 0x7f9b800b4d90 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9b941077e0 tx=0x7f9b84009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:34:49.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:49.746+0000 7f9b8a7fc700 1 -- 172.21.15.39:0/729486628 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f9b9005edf0 con 0x7f9b941045e0 2024-05-09T05:34:49.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:49.959+0000 7f9b9b850700 1 -- 172.21.15.39:0/729486628 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f9b9402e5f0 con 0x7f9b941045e0 2024-05-09T05:34:50.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:50.273+0000 7f9b8a7fc700 1 -- 172.21.15.39:0/729486628 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v75) ==== 138+0+0 (secure 0 0 0) 0x7f9b90013070 con 0x7f9b941045e0 2024-05-09T05:34:50.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:50.276+0000 7f9b9b850700 1 -- 172.21.15.39:0/729486628 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f9b800b2880 msgr2=0x7f9b800b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:34:50.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:50.276+0000 7f9b9b850700 1 --2- 172.21.15.39:0/729486628 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f9b800b2880 0x7f9b800b4d90 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9b941077e0 tx=0x7f9b84009260 comp rx=0 tx=0).stop 2024-05-09T05:34:50.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:50.276+0000 7f9b9b850700 1 -- 172.21.15.39:0/729486628 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9b941045e0 msgr2=0x7f9b94075ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:34:50.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:50.276+0000 7f9b9b850700 1 --2- 172.21.15.39:0/729486628 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9b941045e0 0x7f9b94075ac0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9b90006010 tx=0x7f9b900045e0 comp rx=0 tx=0).stop 2024-05-09T05:34:50.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:50.276+0000 7f9b9b850700 1 -- 172.21.15.39:0/729486628 shutdown_connections 2024-05-09T05:34:50.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:50.276+0000 7f9b9b850700 1 --2- 172.21.15.39:0/729486628 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f9b800b2880 0x7f9b800b4d90 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:50.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:50.276+0000 7f9b9b850700 1 --2- 172.21.15.39:0/729486628 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b94109860 0x7f9b94076540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:50.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:50.276+0000 7f9b9b850700 1 --2- 172.21.15.39:0/729486628 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9b941045e0 0x7f9b94075ac0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:50.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:50.276+0000 7f9b9b850700 1 --2- 172.21.15.39:0/729486628 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b94108f10 0x7f9b94076000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:50.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:50.276+0000 7f9b9b850700 1 -- 172.21.15.39:0/729486628 >> 172.21.15.39:0/729486628 conn(0x7f9b940ffe70 msgr2=0x7f9b9410a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:34:50.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:50.276+0000 7f9b9b850700 1 -- 172.21.15.39:0/729486628 shutdown_connections 2024-05-09T05:34:50.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:50.276+0000 7f9b9b850700 1 -- 172.21.15.39:0/729486628 wait complete. 2024-05-09T05:34:50.271 INFO:teuthology.orchestra.run.smithi039.stderr:pool 'cephfs_metadata' created 2024-05-09T05:34:50.546 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:50 smithi060 ceph-mon[34555]: from='client.? 172.21.15.39:0/729486628' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-05-09T05:34:50.586 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:50 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/729486628' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-05-09T05:34:50.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:50 smithi100 ceph-mon[34353]: from='client.? 172.21.15.39:0/729486628' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-05-09T05:34:50.923 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-09T05:34:51.176 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T05:34:51.276 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:51 smithi039 ceph-mon[30439]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T05:34:51.276 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:51 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/729486628' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-05-09T05:34:51.276 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:51 smithi039 ceph-mon[30439]: osdmap e75: 12 total, 12 up, 12 in 2024-05-09T05:34:51.546 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:51 smithi060 ceph-mon[34555]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T05:34:51.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:51 smithi060 ceph-mon[34555]: from='client.? 172.21.15.39:0/729486628' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-05-09T05:34:51.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:51 smithi060 ceph-mon[34555]: osdmap e75: 12 total, 12 up, 12 in 2024-05-09T05:34:51.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:51 smithi100 ceph-mon[34353]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T05:34:51.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:51 smithi100 ceph-mon[34353]: from='client.? 172.21.15.39:0/729486628' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-05-09T05:34:51.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:51 smithi100 ceph-mon[34353]: osdmap e75: 12 total, 12 up, 12 in 2024-05-09T05:34:52.454 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:52 smithi039 ceph-mon[30439]: osdmap e76: 12 total, 12 up, 12 in 2024-05-09T05:34:52.546 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:52 smithi060 ceph-mon[34555]: osdmap e76: 12 total, 12 up, 12 in 2024-05-09T05:34:52.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:52 smithi100 ceph-mon[34353]: osdmap e76: 12 total, 12 up, 12 in 2024-05-09T05:34:52.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:52.686+0000 7fa33d6b1700 1 -- 172.21.15.39:0/1773135723 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa338108f00 msgr2=0x7fa338109310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:34:52.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:52.686+0000 7fa33d6b1700 1 --2- 172.21.15.39:0/1773135723 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa338108f00 0x7fa338109310 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa3200099c0 tx=0x7fa320009cd0 comp rx=0 tx=0).stop 2024-05-09T05:34:52.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:52.686+0000 7fa33d6b1700 1 -- 172.21.15.39:0/1773135723 shutdown_connections 2024-05-09T05:34:52.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:52.686+0000 7fa33d6b1700 1 --2- 172.21.15.39:0/1773135723 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa338109850 0x7fa3381111b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:52.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:52.686+0000 7fa33d6b1700 1 --2- 172.21.15.39:0/1773135723 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3381045d0 0x7fa3381049e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:52.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:52.686+0000 7fa33d6b1700 1 --2- 172.21.15.39:0/1773135723 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa338108f00 0x7fa338109310 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:52.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:52.686+0000 7fa33d6b1700 1 -- 172.21.15.39:0/1773135723 >> 172.21.15.39:0/1773135723 conn(0x7fa3380ffec0 msgr2=0x7fa338102310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:34:52.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:52.686+0000 7fa33d6b1700 1 -- 172.21.15.39:0/1773135723 shutdown_connections 2024-05-09T05:34:52.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:52.686+0000 7fa33d6b1700 1 -- 172.21.15.39:0/1773135723 wait complete. 2024-05-09T05:34:52.682 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:52.687+0000 7fa33d6b1700 1 Processor -- start 2024-05-09T05:34:52.682 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:52.687+0000 7fa33d6b1700 1 -- start start 2024-05-09T05:34:52.682 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:52.687+0000 7fa33d6b1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3381045d0 0x7fa338076bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:34:52.682 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:52.687+0000 7fa33d6b1700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa338108f00 0x7fa338077110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:34:52.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:52.687+0000 7fa33d6b1700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa338109850 0x7fa338077650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:34:52.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:52.687+0000 7fa33d6b1700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fa3381144d0 con 0x7fa338108f00 2024-05-09T05:34:52.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:52.687+0000 7fa33d6b1700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa338114350 con 0x7fa3381045d0 2024-05-09T05:34:52.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:52.687+0000 7fa33d6b1700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa338114650 con 0x7fa338109850 2024-05-09T05:34:52.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:52.687+0000 7fa3367fc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa338108f00 0x7fa338077110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:34:52.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:52.687+0000 7fa3367fc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa338108f00 0x7fa338077110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36858/0 (socket says 172.21.15.39:36858) 2024-05-09T05:34:52.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:52.687+0000 7fa3367fc700 1 -- 172.21.15.39:0/4259965325 learned_addr learned my addr 172.21.15.39:0/4259965325 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:34:52.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:52.688+0000 7fa3377fe700 1 --2- 172.21.15.39:0/4259965325 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa338109850 0x7fa338077650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:34:52.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:52.688+0000 7fa336ffd700 1 --2- 172.21.15.39:0/4259965325 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3381045d0 0x7fa338076bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:34:52.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:52.688+0000 7fa3367fc700 1 -- 172.21.15.39:0/4259965325 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa338109850 msgr2=0x7fa338077650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:34:52.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:52.688+0000 7fa3367fc700 1 --2- 172.21.15.39:0/4259965325 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa338109850 0x7fa338077650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:52.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:52.688+0000 7fa3367fc700 1 -- 172.21.15.39:0/4259965325 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3381045d0 msgr2=0x7fa338076bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:34:52.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:52.688+0000 7fa3367fc700 1 --2- 172.21.15.39:0/4259965325 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3381045d0 0x7fa338076bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:52.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:52.688+0000 7fa3367fc700 1 -- 172.21.15.39:0/4259965325 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3381a9200 con 0x7fa338108f00 2024-05-09T05:34:52.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:52.688+0000 7fa3377fe700 1 --2- 172.21.15.39:0/4259965325 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa338109850 0x7fa338077650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T05:34:52.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:52.688+0000 7fa336ffd700 1 --2- 172.21.15.39:0/4259965325 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3381045d0 0x7fa338076bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T05:34:52.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:52.688+0000 7fa3367fc700 1 --2- 172.21.15.39:0/4259965325 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa338108f00 0x7fa338077110 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa320006010 tx=0x7fa3200047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:34:52.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:52.688+0000 7fa32ffff700 1 -- 172.21.15.39:0/4259965325 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa320027070 con 0x7fa338108f00 2024-05-09T05:34:52.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:52.688+0000 7fa33d6b1700 1 -- 172.21.15.39:0/4259965325 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3381a9490 con 0x7fa338108f00 2024-05-09T05:34:52.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:52.688+0000 7fa32ffff700 1 -- 172.21.15.39:0/4259965325 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa320003fa0 con 0x7fa338108f00 2024-05-09T05:34:52.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:52.688+0000 7fa32ffff700 1 -- 172.21.15.39:0/4259965325 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa320022dd0 con 0x7fa338108f00 2024-05-09T05:34:52.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:52.688+0000 7fa33d6b1700 1 -- 172.21.15.39:0/4259965325 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3381a9940 con 0x7fa338108f00 2024-05-09T05:34:52.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:52.689+0000 7fa33d6b1700 1 -- 172.21.15.39:0/4259965325 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3380512c0 con 0x7fa338108f00 2024-05-09T05:34:52.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:52.691+0000 7fa32ffff700 1 -- 172.21.15.39:0/4259965325 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fa32002a070 con 0x7fa338108f00 2024-05-09T05:34:52.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:52.692+0000 7fa32ffff700 1 --2- 172.21.15.39:0/4259965325 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fa3240b2880 0x7fa3240b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:34:52.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:52.692+0000 7fa336ffd700 1 --2- 172.21.15.39:0/4259965325 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fa3240b2880 0x7fa3240b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:34:52.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:52.692+0000 7fa32ffff700 1 -- 172.21.15.39:0/4259965325 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7497+0+0 (secure 0 0 0) 0x7fa3200e3020 con 0x7fa338108f00 2024-05-09T05:34:52.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:52.692+0000 7fa336ffd700 1 --2- 172.21.15.39:0/4259965325 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fa3240b2880 0x7fa3240b4d90 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa328005950 tx=0x7fa3280058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:34:52.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:52.696+0000 7fa32ffff700 1 -- 172.21.15.39:0/4259965325 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fa320031080 con 0x7fa338108f00 2024-05-09T05:34:52.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:52.910+0000 7fa33d6b1700 1 -- 172.21.15.39:0/4259965325 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fa33802e5f0 con 0x7fa338108f00 2024-05-09T05:34:53.290 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:53.295+0000 7fa32ffff700 1 -- 172.21.15.39:0/4259965325 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v78) ==== 170+0+0 (secure 0 0 0) 0x7fa3200a6020 con 0x7fa338108f00 2024-05-09T05:34:53.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:53.297+0000 7fa33d6b1700 1 -- 172.21.15.39:0/4259965325 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fa3240b2880 msgr2=0x7fa3240b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:34:53.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:53.297+0000 7fa33d6b1700 1 --2- 172.21.15.39:0/4259965325 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fa3240b2880 0x7fa3240b4d90 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa328005950 tx=0x7fa3280058e0 comp rx=0 tx=0).stop 2024-05-09T05:34:53.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:53.297+0000 7fa33d6b1700 1 -- 172.21.15.39:0/4259965325 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa338108f00 msgr2=0x7fa338077110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:34:53.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:53.297+0000 7fa33d6b1700 1 --2- 172.21.15.39:0/4259965325 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa338108f00 0x7fa338077110 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa320006010 tx=0x7fa3200047b0 comp rx=0 tx=0).stop 2024-05-09T05:34:53.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:53.297+0000 7fa33d6b1700 1 -- 172.21.15.39:0/4259965325 shutdown_connections 2024-05-09T05:34:53.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:53.297+0000 7fa33d6b1700 1 --2- 172.21.15.39:0/4259965325 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fa3240b2880 0x7fa3240b4d90 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:53.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:53.297+0000 7fa33d6b1700 1 --2- 172.21.15.39:0/4259965325 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa338109850 0x7fa338077650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:53.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:53.297+0000 7fa33d6b1700 1 --2- 172.21.15.39:0/4259965325 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3381045d0 0x7fa338076bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:53.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:53.297+0000 7fa33d6b1700 1 --2- 172.21.15.39:0/4259965325 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa338108f00 0x7fa338077110 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:53.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:53.297+0000 7fa33d6b1700 1 -- 172.21.15.39:0/4259965325 >> 172.21.15.39:0/4259965325 conn(0x7fa3380ffec0 msgr2=0x7fa33810a7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:34:53.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:53.298+0000 7fa33d6b1700 1 -- 172.21.15.39:0/4259965325 shutdown_connections 2024-05-09T05:34:53.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:53.298+0000 7fa33d6b1700 1 -- 172.21.15.39:0/4259965325 wait complete. 2024-05-09T05:34:53.295 INFO:teuthology.orchestra.run.smithi039.stderr:pool 'cephfs_data' created 2024-05-09T05:34:53.546 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:53 smithi060 ceph-mon[34555]: pgmap v288: 33 pgs: 4 creating+activating, 6 creating+peering, 7 active+clean, 16 unknown; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T05:34:53.546 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:53 smithi060 ceph-mon[34555]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-09T05:34:53.546 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:53 smithi060 ceph-mon[34555]: osdmap e77: 12 total, 12 up, 12 in 2024-05-09T05:34:53.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:53 smithi060 ceph-mon[34555]: from='client.? 172.21.15.39:0/4259965325' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-05-09T05:34:53.553 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:53 smithi039 ceph-mon[30439]: pgmap v288: 33 pgs: 4 creating+activating, 6 creating+peering, 7 active+clean, 16 unknown; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T05:34:53.553 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:53 smithi039 ceph-mon[30439]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-09T05:34:53.553 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:53 smithi039 ceph-mon[30439]: osdmap e77: 12 total, 12 up, 12 in 2024-05-09T05:34:53.553 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:53 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/4259965325' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-05-09T05:34:53.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:53 smithi100 ceph-mon[34353]: pgmap v288: 33 pgs: 4 creating+activating, 6 creating+peering, 7 active+clean, 16 unknown; 577 KiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T05:34:53.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:53 smithi100 ceph-mon[34353]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-09T05:34:53.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:53 smithi100 ceph-mon[34353]: osdmap e77: 12 total, 12 up, 12 in 2024-05-09T05:34:53.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:53 smithi100 ceph-mon[34353]: from='client.? 172.21.15.39:0/4259965325' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-05-09T05:34:53.983 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-09T05:34:54.262 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T05:34:54.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:54 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/4259965325' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-05-09T05:34:54.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:54 smithi039 ceph-mon[30439]: osdmap e78: 12 total, 12 up, 12 in 2024-05-09T05:34:54.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:54 smithi100 ceph-mon[34353]: from='client.? 172.21.15.39:0/4259965325' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-05-09T05:34:54.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:54 smithi100 ceph-mon[34353]: osdmap e78: 12 total, 12 up, 12 in 2024-05-09T05:34:54.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:54 smithi060 ceph-mon[34555]: from='client.? 172.21.15.39:0/4259965325' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-05-09T05:34:54.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:54 smithi060 ceph-mon[34555]: osdmap e78: 12 total, 12 up, 12 in 2024-05-09T05:34:55.360 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:55 smithi039 ceph-mon[30439]: pgmap v291: 97 pgs: 4 creating+activating, 10 creating+peering, 20 active+clean, 63 unknown; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T05:34:55.360 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:55 smithi039 ceph-mon[30439]: osdmap e79: 12 total, 12 up, 12 in 2024-05-09T05:34:55.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:55 smithi100 ceph-mon[34353]: pgmap v291: 97 pgs: 4 creating+activating, 10 creating+peering, 20 active+clean, 63 unknown; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T05:34:55.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:55 smithi100 ceph-mon[34353]: osdmap e79: 12 total, 12 up, 12 in 2024-05-09T05:34:55.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:55 smithi060 ceph-mon[34555]: pgmap v291: 97 pgs: 4 creating+activating, 10 creating+peering, 20 active+clean, 63 unknown; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T05:34:55.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:55 smithi060 ceph-mon[34555]: osdmap e79: 12 total, 12 up, 12 in 2024-05-09T05:34:55.924 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:55.930+0000 7f1e7fd5a700 1 -- 172.21.15.39:0/1574213896 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1e78109870 msgr2=0x7f1e781111d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:34:55.924 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:55.930+0000 7f1e7fd5a700 1 --2- 172.21.15.39:0/1574213896 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1e78109870 0x7f1e781111d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1e7000b0d0 tx=0x7f1e7000b3e0 comp rx=0 tx=0).stop 2024-05-09T05:34:55.924 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:55.930+0000 7f1e7fd5a700 1 -- 172.21.15.39:0/1574213896 shutdown_connections 2024-05-09T05:34:55.925 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:55.930+0000 7f1e7fd5a700 1 --2- 172.21.15.39:0/1574213896 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1e78109870 0x7f1e781111d0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:55.925 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:55.930+0000 7f1e7fd5a700 1 --2- 172.21.15.39:0/1574213896 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e781045f0 0x7f1e78104a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:55.925 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:55.930+0000 7f1e7fd5a700 1 --2- 172.21.15.39:0/1574213896 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e78108f20 0x7f1e78109330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:55.925 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:55.930+0000 7f1e7fd5a700 1 -- 172.21.15.39:0/1574213896 >> 172.21.15.39:0/1574213896 conn(0x7f1e780ffec0 msgr2=0x7f1e78102310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:34:55.925 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:55.930+0000 7f1e7fd5a700 1 -- 172.21.15.39:0/1574213896 shutdown_connections 2024-05-09T05:34:55.925 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:55.930+0000 7f1e7fd5a700 1 -- 172.21.15.39:0/1574213896 wait complete. 2024-05-09T05:34:55.927 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:55.931+0000 7f1e7fd5a700 1 Processor -- start 2024-05-09T05:34:55.927 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:55.931+0000 7f1e7fd5a700 1 -- start start 2024-05-09T05:34:55.927 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:55.931+0000 7f1e7fd5a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1e781045f0 0x7f1e7819ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:34:55.927 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:55.931+0000 7f1e7fd5a700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e78108f20 0x7f1e7819b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:34:55.928 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:55.931+0000 7f1e7fd5a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e78109870 0x7f1e7819f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:34:55.928 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:55.932+0000 7f1e7fd5a700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f1e781144c0 con 0x7f1e781045f0 2024-05-09T05:34:55.928 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:55.932+0000 7f1e7fd5a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f1e78114340 con 0x7f1e78109870 2024-05-09T05:34:55.928 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:55.932+0000 7f1e7fd5a700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1e78114640 con 0x7f1e78108f20 2024-05-09T05:34:55.928 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:55.932+0000 7f1e7daf6700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1e781045f0 0x7f1e7819ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:34:55.928 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:55.932+0000 7f1e7daf6700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1e781045f0 0x7f1e7819ae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36890/0 (socket says 172.21.15.39:36890) 2024-05-09T05:34:55.928 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:55.932+0000 7f1e7daf6700 1 -- 172.21.15.39:0/3296227009 learned_addr learned my addr 172.21.15.39:0/3296227009 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:34:55.928 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:55.932+0000 7f1e7e2f7700 1 --2- 172.21.15.39:0/3296227009 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e78109870 0x7f1e7819f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:34:55.928 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:55.932+0000 7f1e7d2f5700 1 --2- 172.21.15.39:0/3296227009 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e78108f20 0x7f1e7819b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:34:55.928 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:55.932+0000 7f1e7daf6700 1 -- 172.21.15.39:0/3296227009 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e78108f20 msgr2=0x7f1e7819b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:34:55.928 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:55.932+0000 7f1e7daf6700 1 --2- 172.21.15.39:0/3296227009 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e78108f20 0x7f1e7819b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:55.928 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:55.932+0000 7f1e7daf6700 1 -- 172.21.15.39:0/3296227009 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e78109870 msgr2=0x7f1e7819f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:34:55.928 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:55.932+0000 7f1e7daf6700 1 --2- 172.21.15.39:0/3296227009 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e78109870 0x7f1e7819f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:55.929 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:55.932+0000 7f1e7daf6700 1 -- 172.21.15.39:0/3296227009 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e7819fce0 con 0x7f1e781045f0 2024-05-09T05:34:55.929 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:55.932+0000 7f1e7d2f5700 1 --2- 172.21.15.39:0/3296227009 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e78108f20 0x7f1e7819b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:34:55.929 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:55.932+0000 7f1e7e2f7700 1 --2- 172.21.15.39:0/3296227009 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e78109870 0x7f1e7819f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T05:34:55.929 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:55.932+0000 7f1e7daf6700 1 --2- 172.21.15.39:0/3296227009 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1e781045f0 0x7f1e7819ae10 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1e7400d950 tx=0x7f1e7400dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:34:55.929 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:55.932+0000 7f1e6effd700 1 -- 172.21.15.39:0/3296227009 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e74016070 con 0x7f1e781045f0 2024-05-09T05:34:55.929 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:55.932+0000 7f1e6effd700 1 -- 172.21.15.39:0/3296227009 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1e74010460 con 0x7f1e781045f0 2024-05-09T05:34:55.929 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:55.932+0000 7f1e7fd5a700 1 -- 172.21.15.39:0/3296227009 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e7819ffd0 con 0x7f1e781045f0 2024-05-09T05:34:55.929 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:55.932+0000 7f1e6effd700 1 -- 172.21.15.39:0/3296227009 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e7400f620 con 0x7f1e781045f0 2024-05-09T05:34:55.929 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:55.932+0000 7f1e7fd5a700 1 -- 172.21.15.39:0/3296227009 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e781a78f0 con 0x7f1e781045f0 2024-05-09T05:34:55.929 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:55.933+0000 7f1e7fd5a700 1 -- 172.21.15.39:0/3296227009 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e780512c0 con 0x7f1e781045f0 2024-05-09T05:34:55.930 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:55.935+0000 7f1e6effd700 1 -- 172.21.15.39:0/3296227009 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f1e74019070 con 0x7f1e781045f0 2024-05-09T05:34:55.930 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:55.936+0000 7f1e6effd700 1 --2- 172.21.15.39:0/3296227009 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f1e640b2900 0x7f1e640b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:34:55.930 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:55.936+0000 7f1e7d2f5700 1 --2- 172.21.15.39:0/3296227009 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f1e640b2900 0x7f1e640b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:34:55.930 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:55.936+0000 7f1e6effd700 1 -- 172.21.15.39:0/3296227009 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7879+0+0 (secure 0 0 0) 0x7f1e740e1cb0 con 0x7f1e781045f0 2024-05-09T05:34:55.930 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:55.937+0000 7f1e7d2f5700 1 --2- 172.21.15.39:0/3296227009 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f1e640b2900 0x7f1e640b4e10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1e78103a50 tx=0x7f1e68009550 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:34:55.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:55.940+0000 7f1e6effd700 1 -- 172.21.15.39:0/3296227009 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f1e740a9ae0 con 0x7f1e781045f0 2024-05-09T05:34:56.194 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:56.200+0000 7f1e7fd5a700 1 -- 172.21.15.39:0/3296227009 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f1e7802e5f0 con 0x7f1e781045f0 2024-05-09T05:34:56.314 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:56.320+0000 7f1e6effd700 1 -- 172.21.15.39:0/3296227009 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f1e740a93e0 con 0x7f1e781045f0 2024-05-09T05:34:56.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:56.323+0000 7f1e7fd5a700 1 -- 172.21.15.39:0/3296227009 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f1e640b2900 msgr2=0x7f1e640b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:34:56.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:56.323+0000 7f1e7fd5a700 1 --2- 172.21.15.39:0/3296227009 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f1e640b2900 0x7f1e640b4e10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1e78103a50 tx=0x7f1e68009550 comp rx=0 tx=0).stop 2024-05-09T05:34:56.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:56.323+0000 7f1e7fd5a700 1 -- 172.21.15.39:0/3296227009 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1e781045f0 msgr2=0x7f1e7819ae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:34:56.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:56.323+0000 7f1e7fd5a700 1 --2- 172.21.15.39:0/3296227009 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1e781045f0 0x7f1e7819ae10 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1e7400d950 tx=0x7f1e7400dd10 comp rx=0 tx=0).stop 2024-05-09T05:34:56.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:56.323+0000 7f1e7fd5a700 1 -- 172.21.15.39:0/3296227009 shutdown_connections 2024-05-09T05:34:56.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:56.323+0000 7f1e7fd5a700 1 --2- 172.21.15.39:0/3296227009 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f1e640b2900 0x7f1e640b4e10 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:56.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:56.323+0000 7f1e7fd5a700 1 --2- 172.21.15.39:0/3296227009 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e78109870 0x7f1e7819f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:56.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:56.323+0000 7f1e7fd5a700 1 --2- 172.21.15.39:0/3296227009 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1e781045f0 0x7f1e7819ae10 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:56.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:56.323+0000 7f1e7fd5a700 1 --2- 172.21.15.39:0/3296227009 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e78108f20 0x7f1e7819b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:56.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:56.323+0000 7f1e7fd5a700 1 -- 172.21.15.39:0/3296227009 >> 172.21.15.39:0/3296227009 conn(0x7f1e780ffec0 msgr2=0x7f1e7810a7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:34:56.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:56.323+0000 7f1e7fd5a700 1 -- 172.21.15.39:0/3296227009 shutdown_connections 2024-05-09T05:34:56.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:56.323+0000 7f1e7fd5a700 1 -- 172.21.15.39:0/3296227009 wait complete. 2024-05-09T05:34:56.318 INFO:teuthology.orchestra.run.smithi039.stderr:new fs with metadata pool 2 and data pool 3 2024-05-09T05:34:56.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:56 smithi039 ceph-mon[30439]: osdmap e80: 12 total, 12 up, 12 in 2024-05-09T05:34:56.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:56 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/3296227009' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-05-09T05:34:56.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:56 smithi039 ceph-mon[30439]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-05-09T05:34:56.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:56 smithi100 ceph-mon[34353]: osdmap e80: 12 total, 12 up, 12 in 2024-05-09T05:34:56.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:56 smithi100 ceph-mon[34353]: from='client.? 172.21.15.39:0/3296227009' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-05-09T05:34:56.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:56 smithi100 ceph-mon[34353]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-05-09T05:34:56.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:56 smithi060 ceph-mon[34555]: osdmap e80: 12 total, 12 up, 12 in 2024-05-09T05:34:56.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:56 smithi060 ceph-mon[34555]: from='client.? 172.21.15.39:0/3296227009' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-05-09T05:34:56.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:56 smithi060 ceph-mon[34555]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-05-09T05:34:56.953 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-09T05:34:57.208 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T05:34:57.593 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:57 smithi039 ceph-mon[30439]: pgmap v294: 97 pgs: 4 creating+activating, 7 creating+peering, 47 active+clean, 39 unknown; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T05:34:57.593 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:57 smithi039 ceph-mon[30439]: osdmap e81: 12 total, 12 up, 12 in 2024-05-09T05:34:57.593 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:57 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/3296227009' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-05-09T05:34:57.594 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:57 smithi039 ceph-mon[30439]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-05-09T05:34:57.594 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:57 smithi039 ceph-mon[30439]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-05-09T05:34:57.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:57 smithi100 ceph-mon[34353]: pgmap v294: 97 pgs: 4 creating+activating, 7 creating+peering, 47 active+clean, 39 unknown; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T05:34:57.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:57 smithi100 ceph-mon[34353]: osdmap e81: 12 total, 12 up, 12 in 2024-05-09T05:34:57.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:57 smithi100 ceph-mon[34353]: from='client.? 172.21.15.39:0/3296227009' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-05-09T05:34:57.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:57 smithi100 ceph-mon[34353]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-05-09T05:34:57.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:57 smithi100 ceph-mon[34353]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-05-09T05:34:57.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:57 smithi060 ceph-mon[34555]: pgmap v294: 97 pgs: 4 creating+activating, 7 creating+peering, 47 active+clean, 39 unknown; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T05:34:57.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:57 smithi060 ceph-mon[34555]: osdmap e81: 12 total, 12 up, 12 in 2024-05-09T05:34:57.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:57 smithi060 ceph-mon[34555]: from='client.? 172.21.15.39:0/3296227009' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-05-09T05:34:57.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:57 smithi060 ceph-mon[34555]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-05-09T05:34:57.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:57 smithi060 ceph-mon[34555]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-05-09T05:34:58.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:58 smithi039 ceph-mon[30439]: mds.? [v2:172.21.15.60:6838/1418956667,v1:172.21.15.60:6839/1418956667] up:active 2024-05-09T05:34:58.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:58 smithi039 ceph-mon[30439]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-09T05:34:58.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:58 smithi039 ceph-mon[30439]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-09T05:34:58.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:58 smithi039 ceph-mon[30439]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-09T05:34:58.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:58 smithi100 ceph-mon[34353]: mds.? [v2:172.21.15.60:6838/1418956667,v1:172.21.15.60:6839/1418956667] up:active 2024-05-09T05:34:58.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:58 smithi100 ceph-mon[34353]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-09T05:34:58.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:58 smithi100 ceph-mon[34353]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-09T05:34:58.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:58 smithi100 ceph-mon[34353]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-09T05:34:58.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:58 smithi060 ceph-mon[34555]: mds.? [v2:172.21.15.60:6838/1418956667,v1:172.21.15.60:6839/1418956667] up:active 2024-05-09T05:34:58.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:58 smithi060 ceph-mon[34555]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-09T05:34:58.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:58 smithi060 ceph-mon[34555]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-09T05:34:58.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:58 smithi060 ceph-mon[34555]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-09T05:34:58.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:58.907+0000 7ff18f339700 1 -- 172.21.15.39:0/563751982 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff188108740 msgr2=0x7ff1881100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:34:58.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:58.907+0000 7ff18f339700 1 --2- 172.21.15.39:0/563751982 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff188108740 0x7ff1881100a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff18000b0d0 tx=0x7ff18000b3e0 comp rx=0 tx=0).stop 2024-05-09T05:34:58.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:58.907+0000 7ff18f339700 1 -- 172.21.15.39:0/563751982 shutdown_connections 2024-05-09T05:34:58.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:58.907+0000 7ff18f339700 1 --2- 172.21.15.39:0/563751982 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff188108740 0x7ff1881100a0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:58.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:58.907+0000 7ff18f339700 1 --2- 172.21.15.39:0/563751982 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1881034c0 0x7ff1881038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:58.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:58.907+0000 7ff18f339700 1 --2- 172.21.15.39:0/563751982 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff188107df0 0x7ff188108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:58.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:58.907+0000 7ff18f339700 1 -- 172.21.15.39:0/563751982 >> 172.21.15.39:0/563751982 conn(0x7ff1880fedf0 msgr2=0x7ff188101210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:34:58.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:58.907+0000 7ff18f339700 1 -- 172.21.15.39:0/563751982 shutdown_connections 2024-05-09T05:34:58.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:58.907+0000 7ff18f339700 1 -- 172.21.15.39:0/563751982 wait complete. 2024-05-09T05:34:58.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:58.908+0000 7ff18f339700 1 Processor -- start 2024-05-09T05:34:58.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:58.908+0000 7ff18f339700 1 -- start start 2024-05-09T05:34:58.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:58.908+0000 7ff18f339700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff1881034c0 0x7ff18819f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:34:58.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:58.908+0000 7ff18f339700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff188107df0 0x7ff18819fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:34:58.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:58.908+0000 7ff18f339700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff188108740 0x7ff188199ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:34:58.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:58.908+0000 7ff18f339700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7ff188113370 con 0x7ff1881034c0 2024-05-09T05:34:58.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:58.908+0000 7ff18f339700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff1881131f0 con 0x7ff188108740 2024-05-09T05:34:58.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:58.908+0000 7ff18f339700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff1881134f0 con 0x7ff188107df0 2024-05-09T05:34:58.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:58.908+0000 7ff18d0d5700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff1881034c0 0x7ff18819f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:34:58.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:58.908+0000 7ff18d0d5700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff1881034c0 0x7ff18819f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44458/0 (socket says 172.21.15.39:44458) 2024-05-09T05:34:58.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:58.908+0000 7ff18d0d5700 1 -- 172.21.15.39:0/1802107141 learned_addr learned my addr 172.21.15.39:0/1802107141 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:34:58.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:58.909+0000 7ff18c8d4700 1 --2- 172.21.15.39:0/1802107141 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff188107df0 0x7ff18819fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:34:58.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:58.909+0000 7ff18d8d6700 1 --2- 172.21.15.39:0/1802107141 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff188108740 0x7ff188199ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:34:58.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:58.909+0000 7ff18d0d5700 1 -- 172.21.15.39:0/1802107141 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff188107df0 msgr2=0x7ff18819fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:34:58.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:58.909+0000 7ff18d0d5700 1 --2- 172.21.15.39:0/1802107141 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff188107df0 0x7ff18819fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:58.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:58.909+0000 7ff18d0d5700 1 -- 172.21.15.39:0/1802107141 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff188108740 msgr2=0x7ff188199ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:34:58.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:58.909+0000 7ff18d0d5700 1 --2- 172.21.15.39:0/1802107141 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff188108740 0x7ff188199ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:58.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:58.909+0000 7ff18d0d5700 1 -- 172.21.15.39:0/1802107141 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff18819a1b0 con 0x7ff1881034c0 2024-05-09T05:34:58.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:58.909+0000 7ff18d0d5700 1 --2- 172.21.15.39:0/1802107141 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff1881034c0 0x7ff18819f890 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff18400d950 tx=0x7ff18400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:34:58.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:58.909+0000 7ff17e7fc700 1 -- 172.21.15.39:0/1802107141 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff184016070 con 0x7ff1881034c0 2024-05-09T05:34:58.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:58.909+0000 7ff18f339700 1 -- 172.21.15.39:0/1802107141 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff18819a4a0 con 0x7ff1881034c0 2024-05-09T05:34:58.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:58.909+0000 7ff17e7fc700 1 -- 172.21.15.39:0/1802107141 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff18400fd40 con 0x7ff1881034c0 2024-05-09T05:34:58.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:58.909+0000 7ff17e7fc700 1 -- 172.21.15.39:0/1802107141 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff18400e3b0 con 0x7ff1881034c0 2024-05-09T05:34:58.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:58.909+0000 7ff18f339700 1 -- 172.21.15.39:0/1802107141 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1880759f0 con 0x7ff1881034c0 2024-05-09T05:34:58.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:58.910+0000 7ff18f339700 1 -- 172.21.15.39:0/1802107141 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1880512c0 con 0x7ff1881034c0 2024-05-09T05:34:58.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:58.913+0000 7ff17e7fc700 1 -- 172.21.15.39:0/1802107141 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7ff184019070 con 0x7ff1881034c0 2024-05-09T05:34:58.906 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:58.913+0000 7ff17e7fc700 1 --2- 172.21.15.39:0/1802107141 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7ff1740b2880 0x7ff1740b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:34:58.906 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:58.914+0000 7ff18c8d4700 1 --2- 172.21.15.39:0/1802107141 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7ff1740b2880 0x7ff1740b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:34:58.906 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:58.914+0000 7ff17e7fc700 1 -- 172.21.15.39:0/1802107141 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7ff1840e1ed0 con 0x7ff1881034c0 2024-05-09T05:34:58.907 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:58.914+0000 7ff18c8d4700 1 --2- 172.21.15.39:0/1802107141 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7ff1740b2880 0x7ff1740b4d90 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff188102880 tx=0x7ff1780073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:34:58.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:58.917+0000 7ff17e7fc700 1 -- 172.21.15.39:0/1802107141 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7ff1840a9d40 con 0x7ff1881034c0 2024-05-09T05:34:59.127 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:59.134+0000 7ff18f339700 1 -- 172.21.15.39:0/1802107141 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff188076420 con 0x7ff1881034c0 2024-05-09T05:34:59.128 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:59.136+0000 7ff17e7fc700 1 -- 172.21.15.39:0/1802107141 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+22169 (secure 0 0 0) 0x7ff1840a9640 con 0x7ff1881034c0 2024-05-09T05:34:59.129 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-09T05:34:59.129 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":81,"fsid":"86d4cc60-0dc4-11ef-bc97-c7b262605968","created":"2024-05-09T05:26:33.514203+0000","modified":"2024-05-09T05:34:56.202321+0000","last_up_change":"2024-05-09T05:33:48.776015+0000","last_in_change":"2024-05-09T05:33:28.117875+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T05:29:56.122407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-09T05:34:49.964521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-09T05:34:52.915301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3491bbda-3a9b-40d2-8627-87d15660f864","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":1056276932},{"type":"v1","addr":"172.21.15.39:6803","nonce":1056276932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":1056276932},{"type":"v1","addr":"172.21.15.39:6805","nonce":1056276932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":1056276932},{"type":"v1","addr":"172.21.15.39:6809","nonce":1056276932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":1056276932},{"type":"v1","addr":"172.21.15.39:6807","nonce":1056276932}]},"public_addr":"172.21.15.39:6803/1056276932","cluster_addr":"172.21.15.39:6805/1056276932","heartbeat_back_addr":"172.21.15.39:6809/1056276932","heartbeat_front_addr":"172.21.15.39:6807/1056276932","state":["exists","up"]},{"osd":1,"uuid":"ec2bd2d0-2975-402c-9df8-3469dfd6070f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":4245630636},{"type":"v1","addr":"172.21.15.60:6801","nonce":4245630636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":4245630636},{"type":"v1","addr":"172.21.15.60:6803","nonce":4245630636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":4245630636},{"type":"v1","addr":"172.21.15.60:6807","nonce":4245630636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":4245630636},{"type":"v1","addr":"172.21.15.60:6805","nonce":4245630636}]},"public_addr":"172.21.15.60:6801/4245630636","cluster_addr":"172.21.15.60:6803/4245630636","heartbeat_back_addr":"172.21.15.60:6807/4245630636","heartbeat_front_addr":"172.21.15.60:6805/4245630636","state":["exists","up"]},{"osd":2,"uuid":"9efaf6dd-086e-4095-b92e-cbbecf738523","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":4141597693},{"type":"v1","addr":"172.21.15.100:6801","nonce":4141597693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":4141597693},{"type":"v1","addr":"172.21.15.100:6803","nonce":4141597693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":4141597693},{"type":"v1","addr":"172.21.15.100:6807","nonce":4141597693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":4141597693},{"type":"v1","addr":"172.21.15.100:6805","nonce":4141597693}]},"public_addr":"172.21.15.100:6801/4141597693","cluster_addr":"172.21.15.100:6803/4141597693","heartbeat_back_addr":"172.21.15.100:6807/4141597693","heartbeat_front_addr":"172.21.15.100:6805/4141597693","state":["exists","up"]},{"osd":3,"uuid":"1ebe1a25-541d-4b54-bed8-4f0ec51b2432","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":2254197543},{"type":"v1","addr":"172.21.15.39:6811","nonce":2254197543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":2254197543},{"type":"v1","addr":"172.21.15.39:6813","nonce":2254197543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2254197543},{"type":"v1","addr":"172.21.15.39:6817","nonce":2254197543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":2254197543},{"type":"v1","addr":"172.21.15.39:6815","nonce":2254197543}]},"public_addr":"172.21.15.39:6811/2254197543","cluster_addr":"172.21.15.39:6813/2254197543","heartbeat_back_addr":"172.21.15.39:6817/2254197543","heartbeat_front_addr":"172.21.15.39:6815/2254197543","state":["exists","up"]},{"osd":4,"uuid":"d52450a3-8a97-4746-a857-35aec69aac44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":649037162},{"type":"v1","addr":"172.21.15.60:6809","nonce":649037162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":649037162},{"type":"v1","addr":"172.21.15.60:6811","nonce":649037162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":649037162},{"type":"v1","addr":"172.21.15.60:6815","nonce":649037162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":649037162},{"type":"v1","addr":"172.21.15.60:6813","nonce":649037162}]},"public_addr":"172.21.15.60:6809/649037162","cluster_addr":"172.21.15.60:6811/649037162","heartbeat_back_addr":"172.21.15.60:6815/649037162","heartbeat_front_addr":"172.21.15.60:6813/649037162","state":["exists","up"]},{"osd":5,"uuid":"b35bf704-898d-40f7-b575-90267764a5b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":658409226},{"type":"v1","addr":"172.21.15.100:6809","nonce":658409226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":658409226},{"type":"v1","addr":"172.21.15.100:6811","nonce":658409226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":658409226},{"type":"v1","addr":"172.21.15.100:6815","nonce":658409226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":658409226},{"type":"v1","addr":"172.21.15.100:6813","nonce":658409226}]},"public_addr":"172.21.15.100:6809/658409226","cluster_addr":"172.21.15.100:6811/658409226","heartbeat_back_addr":"172.21.15.100:6815/658409226","heartbeat_front_addr":"172.21.15.100:6813/658409226","state":["exists","up"]},{"osd":6,"uuid":"49eae2f5-1dad-4c2c-89f4-efa1dd1faefb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":237628491},{"type":"v1","addr":"172.21.15.39:6819","nonce":237628491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":237628491},{"type":"v1","addr":"172.21.15.39:6821","nonce":237628491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":237628491},{"type":"v1","addr":"172.21.15.39:6825","nonce":237628491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":237628491},{"type":"v1","addr":"172.21.15.39:6823","nonce":237628491}]},"public_addr":"172.21.15.39:6819/237628491","cluster_addr":"172.21.15.39:6821/237628491","heartbeat_back_addr":"172.21.15.39:6825/237628491","heartbeat_front_addr":"172.21.15.39:6823/237628491","state":["exists","up"]},{"osd":7,"uuid":"60ccae54-535c-4a13-98d0-881c00b5e870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":2718201647},{"type":"v1","addr":"172.21.15.60:6817","nonce":2718201647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":2718201647},{"type":"v1","addr":"172.21.15.60:6819","nonce":2718201647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":2718201647},{"type":"v1","addr":"172.21.15.60:6823","nonce":2718201647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":2718201647},{"type":"v1","addr":"172.21.15.60:6821","nonce":2718201647}]},"public_addr":"172.21.15.60:6817/2718201647","cluster_addr":"172.21.15.60:6819/2718201647","heartbeat_back_addr":"172.21.15.60:6823/2718201647","heartbeat_front_addr":"172.21.15.60:6821/2718201647","state":["exists","up"]},{"osd":8,"uuid":"edd52a21-0066-429f-9e98-15d1a74c53b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":1757558317},{"type":"v1","addr":"172.21.15.100:6817","nonce":1757558317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":1757558317},{"type":"v1","addr":"172.21.15.100:6819","nonce":1757558317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":1757558317},{"type":"v1","addr":"172.21.15.100:6823","nonce":1757558317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":1757558317},{"type":"v1","addr":"172.21.15.100:6821","nonce":1757558317}]},"public_addr":"172.21.15.100:6817/1757558317","cluster_addr":"172.21.15.100:6819/1757558317","heartbeat_back_addr":"172.21.15.100:6823/1757558317","heartbeat_front_addr":"172.21.15.100:6821/1757558317","state":["exists","up"]},{"osd":9,"uuid":"03fb7543-3386-49a4-b165-1007f07d88d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":2944584368},{"type":"v1","addr":"172.21.15.39:6827","nonce":2944584368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":2944584368},{"type":"v1","addr":"172.21.15.39:6829","nonce":2944584368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":2944584368},{"type":"v1","addr":"172.21.15.39:6833","nonce":2944584368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":2944584368},{"type":"v1","addr":"172.21.15.39:6831","nonce":2944584368}]},"public_addr":"172.21.15.39:6827/2944584368","cluster_addr":"172.21.15.39:6829/2944584368","heartbeat_back_addr":"172.21.15.39:6833/2944584368","heartbeat_front_addr":"172.21.15.39:6831/2944584368","state":["exists","up"]},{"osd":10,"uuid":"c1cadd6c-fcc4-4d76-b07e-0f392066a8d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1940670367},{"type":"v1","addr":"172.21.15.60:6825","nonce":1940670367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":1940670367},{"type":"v1","addr":"172.21.15.60:6827","nonce":1940670367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":1940670367},{"type":"v1","addr":"172.21.15.60:6831","nonce":1940670367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":1940670367},{"type":"v1","addr":"172.21.15.60:6829","nonce":1940670367}]},"public_addr":"172.21.15.60:6825/1940670367","cluster_addr":"172.21.15.60:6827/1940670367","heartbeat_back_addr":"172.21.15.60:6831/1940670367","heartbeat_front_addr":"172.21.15.60:6829/1940670367","state":["exists","up"]},{"osd":11,"uuid":"56806877-9ce2-41e2-9506-ce67897fa09b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":3318561029},{"type":"v1","addr":"172.21.15.100:6825","nonce":3318561029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":3318561029},{"type":"v1","addr":"172.21.15.100:6827","nonce":3318561029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":3318561029},{"type":"v1","addr":"172.21.15.100:6831","nonce":3318561029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":3318561029},{"type":"v1","addr":"172.21.15.100:6829","nonce":3318561029}]},"public_addr":"172.21.15.100:6825/3318561029","cluster_addr":"172.21.15.100:6827/3318561029","heartbeat_back_addr":"172.21.15.100:6831/3318561029","heartbeat_front_addr":"172.21.15.100:6829/3318561029","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:29:03.565705+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:29:28.380764+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:29:53.300224+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:30:20.046517+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:30:45.557983+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:31:10.397933+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:31:37.644428+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:32:02.325329+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:32:27.699044+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:32:54.436305+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:33:20.691300+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:33:46.806146+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.39:6801/4091500272":"2024-05-10T05:27:28.034010+0000","172.21.15.39:6800/4091500272":"2024-05-10T05:27:28.034010+0000","172.21.15.39:0/782312916":"2024-05-10T05:27:28.034010+0000","172.21.15.39:0/1899316433":"2024-05-10T05:27:28.034010+0000","172.21.15.39:0/1613215795":"2024-05-10T05:27:00.650123+0000","172.21.15.39:0/2870431271":"2024-05-10T05:27:00.650123+0000","172.21.15.39:0/438945726":"2024-05-10T05:27:00.650123+0000","172.21.15.39:6800/499609328":"2024-05-10T05:27:00.650123+0000","172.21.15.39:6801/499609328":"2024-05-10T05:27:00.650123+0000","172.21.15.39:0/1698165886":"2024-05-10T05:27:28.034010+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T05:34:59.131 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:59.138+0000 7ff18f339700 1 -- 172.21.15.39:0/1802107141 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7ff1740b2880 msgr2=0x7ff1740b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:34:59.131 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:59.138+0000 7ff18f339700 1 --2- 172.21.15.39:0/1802107141 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7ff1740b2880 0x7ff1740b4d90 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff188102880 tx=0x7ff1780073d0 comp rx=0 tx=0).stop 2024-05-09T05:34:59.131 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:59.138+0000 7ff18f339700 1 -- 172.21.15.39:0/1802107141 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff1881034c0 msgr2=0x7ff18819f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:34:59.131 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:59.138+0000 7ff18f339700 1 --2- 172.21.15.39:0/1802107141 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff1881034c0 0x7ff18819f890 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff18400d950 tx=0x7ff18400dc60 comp rx=0 tx=0).stop 2024-05-09T05:34:59.131 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:59.138+0000 7ff18f339700 1 -- 172.21.15.39:0/1802107141 shutdown_connections 2024-05-09T05:34:59.131 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:59.138+0000 7ff18f339700 1 --2- 172.21.15.39:0/1802107141 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7ff1740b2880 0x7ff1740b4d90 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:59.131 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:59.138+0000 7ff18f339700 1 --2- 172.21.15.39:0/1802107141 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff188108740 0x7ff188199ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:59.131 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:59.138+0000 7ff18f339700 1 --2- 172.21.15.39:0/1802107141 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff1881034c0 0x7ff18819f890 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:59.131 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:59.138+0000 7ff18f339700 1 --2- 172.21.15.39:0/1802107141 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff188107df0 0x7ff18819fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:34:59.132 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:59.138+0000 7ff18f339700 1 -- 172.21.15.39:0/1802107141 >> 172.21.15.39:0/1802107141 conn(0x7ff1880fedf0 msgr2=0x7ff188107560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:34:59.132 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:59.138+0000 7ff18f339700 1 -- 172.21.15.39:0/1802107141 shutdown_connections 2024-05-09T05:34:59.132 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:34:59.138+0000 7ff18f339700 1 -- 172.21.15.39:0/1802107141 wait complete. 2024-05-09T05:34:59.606 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:59 smithi039 ceph-mon[30439]: pgmap v296: 97 pgs: 4 creating+peering, 86 active+clean, 7 unknown; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 212 B/s wr, 0 op/s 2024-05-09T05:34:59.606 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:59 smithi039 ceph-mon[30439]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-05-09T05:34:59.606 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:59 smithi039 ceph-mon[30439]: Cluster is now healthy 2024-05-09T05:34:59.606 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:34:59 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/1802107141' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T05:34:59.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:59 smithi100 ceph-mon[34353]: pgmap v296: 97 pgs: 4 creating+peering, 86 active+clean, 7 unknown; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 212 B/s wr, 0 op/s 2024-05-09T05:34:59.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:59 smithi100 ceph-mon[34353]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-05-09T05:34:59.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:59 smithi100 ceph-mon[34353]: Cluster is now healthy 2024-05-09T05:34:59.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:34:59 smithi100 ceph-mon[34353]: from='client.? 172.21.15.39:0/1802107141' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T05:34:59.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:59 smithi060 ceph-mon[34555]: pgmap v296: 97 pgs: 4 creating+peering, 86 active+clean, 7 unknown; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 212 B/s wr, 0 op/s 2024-05-09T05:34:59.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:59 smithi060 ceph-mon[34555]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-05-09T05:34:59.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:59 smithi060 ceph-mon[34555]: Cluster is now healthy 2024-05-09T05:34:59.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:34:59 smithi060 ceph-mon[34555]: from='client.? 172.21.15.39:0/1802107141' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T05:34:59.936 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-09T05:35:00.193 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T05:35:00.296 INFO:journalctl@ceph.mds.b.smithi060.stdout:May 09 05:34:59 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-b[64794]: 2024-05-09T05:34:59.982+0000 7f2eb4989700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-09T05:35:01.556 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:35:01 smithi039 ceph-mon[30439]: pgmap v297: 97 pgs: 97 active+clean; 579 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s wr, 2 op/s 2024-05-09T05:35:01.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:35:01 smithi100 ceph-mon[34353]: pgmap v297: 97 pgs: 97 active+clean; 579 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s wr, 2 op/s 2024-05-09T05:35:01.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:35:01 smithi060 ceph-mon[34555]: pgmap v297: 97 pgs: 97 active+clean; 579 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s wr, 2 op/s 2024-05-09T05:35:01.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:01.813+0000 7f497a773700 1 -- 172.21.15.39:0/2885725903 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f49741034c0 msgr2=0x7f49741038d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:35:01.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:01.813+0000 7f497a773700 1 --2- 172.21.15.39:0/2885725903 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f49741034c0 0x7f49741038d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f49640099c0 tx=0x7f4964009cd0 comp rx=0 tx=0).stop 2024-05-09T05:35:01.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:01.813+0000 7f497a773700 1 -- 172.21.15.39:0/2885725903 shutdown_connections 2024-05-09T05:35:01.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:01.813+0000 7f497a773700 1 --2- 172.21.15.39:0/2885725903 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4974108740 0x7f49741100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:01.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:01.813+0000 7f497a773700 1 --2- 172.21.15.39:0/2885725903 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f49741034c0 0x7f49741038d0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:01.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:01.813+0000 7f497a773700 1 --2- 172.21.15.39:0/2885725903 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4974107df0 0x7f4974108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:01.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:01.813+0000 7f497a773700 1 -- 172.21.15.39:0/2885725903 >> 172.21.15.39:0/2885725903 conn(0x7f49740fedf0 msgr2=0x7f4974101210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:35:01.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:01.813+0000 7f497a773700 1 -- 172.21.15.39:0/2885725903 shutdown_connections 2024-05-09T05:35:01.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:01.813+0000 7f497a773700 1 -- 172.21.15.39:0/2885725903 wait complete. 2024-05-09T05:35:01.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:01.814+0000 7f497a773700 1 Processor -- start 2024-05-09T05:35:01.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:01.814+0000 7f497a773700 1 -- start start 2024-05-09T05:35:01.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:01.814+0000 7f497a773700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f49741034c0 0x7f49740ff2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:35:01.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:01.814+0000 7f497a773700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4974107df0 0x7f49740ff810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:35:01.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:01.814+0000 7f497a773700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4974108740 0x7f49740ffd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:35:01.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:01.814+0000 7f497a773700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f49741133f0 con 0x7f49741034c0 2024-05-09T05:35:01.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:01.814+0000 7f497a773700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f4974113270 con 0x7f4974108740 2024-05-09T05:35:01.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:01.814+0000 7f497a773700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4974113570 con 0x7f4974107df0 2024-05-09T05:35:01.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:01.814+0000 7f4973fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f49741034c0 0x7f49740ff2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:35:01.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:01.814+0000 7f4973fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f49741034c0 0x7f49740ff2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44464/0 (socket says 172.21.15.39:44464) 2024-05-09T05:35:01.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:01.814+0000 7f4973fff700 1 -- 172.21.15.39:0/2414617067 learned_addr learned my addr 172.21.15.39:0/2414617067 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:35:01.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:01.815+0000 7f49737fe700 1 --2- 172.21.15.39:0/2414617067 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4974107df0 0x7f49740ff810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:35:01.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:01.815+0000 7f4978d10700 1 --2- 172.21.15.39:0/2414617067 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4974108740 0x7f49740ffd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:35:01.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:01.815+0000 7f4973fff700 1 -- 172.21.15.39:0/2414617067 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4974107df0 msgr2=0x7f49740ff810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:35:01.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:01.815+0000 7f4973fff700 1 --2- 172.21.15.39:0/2414617067 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4974107df0 0x7f49740ff810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:01.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:01.815+0000 7f4973fff700 1 -- 172.21.15.39:0/2414617067 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4974108740 msgr2=0x7f49740ffd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:35:01.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:01.815+0000 7f4973fff700 1 --2- 172.21.15.39:0/2414617067 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4974108740 0x7f49740ffd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:01.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:01.815+0000 7f4973fff700 1 -- 172.21.15.39:0/2414617067 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49741a91d0 con 0x7f49741034c0 2024-05-09T05:35:01.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:01.815+0000 7f4973fff700 1 --2- 172.21.15.39:0/2414617067 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f49741034c0 0x7f49740ff2d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f496400b580 tx=0x7f49640047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:35:01.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:01.815+0000 7f49717fa700 1 -- 172.21.15.39:0/2414617067 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4964027070 con 0x7f49741034c0 2024-05-09T05:35:01.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:01.815+0000 7f49717fa700 1 -- 172.21.15.39:0/2414617067 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4964003f20 con 0x7f49741034c0 2024-05-09T05:35:01.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:01.815+0000 7f497a773700 1 -- 172.21.15.39:0/2414617067 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49741a9460 con 0x7f49741034c0 2024-05-09T05:35:01.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:01.815+0000 7f49717fa700 1 -- 172.21.15.39:0/2414617067 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4964022d70 con 0x7f49741034c0 2024-05-09T05:35:01.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:01.815+0000 7f497a773700 1 -- 172.21.15.39:0/2414617067 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49741a98b0 con 0x7f49741034c0 2024-05-09T05:35:01.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:01.817+0000 7f497a773700 1 -- 172.21.15.39:0/2414617067 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49740512c0 con 0x7f49741034c0 2024-05-09T05:35:01.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:01.818+0000 7f49717fa700 1 -- 172.21.15.39:0/2414617067 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f4964022500 con 0x7f49741034c0 2024-05-09T05:35:01.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:01.819+0000 7f49717fa700 1 --2- 172.21.15.39:0/2414617067 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f495c0b2880 0x7f495c0b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:35:01.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:01.819+0000 7f49717fa700 1 -- 172.21.15.39:0/2414617067 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f49640e30b0 con 0x7f49741034c0 2024-05-09T05:35:01.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:01.819+0000 7f49737fe700 1 --2- 172.21.15.39:0/2414617067 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f495c0b2880 0x7f495c0b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:35:01.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:01.819+0000 7f49737fe700 1 --2- 172.21.15.39:0/2414617067 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f495c0b2880 0x7f495c0b4d90 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f497406bac0 tx=0x7f496800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:35:01.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:01.822+0000 7f49717fa700 1 -- 172.21.15.39:0/2414617067 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f4964013070 con 0x7f49741034c0 2024-05-09T05:35:02.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:02.036+0000 7f497a773700 1 -- 172.21.15.39:0/2414617067 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f497402e7b0 con 0x7f49741034c0 2024-05-09T05:35:02.031 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:02.038+0000 7f49717fa700 1 -- 172.21.15.39:0/2414617067 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+22169 (secure 0 0 0) 0x7f49640aafb0 con 0x7f49741034c0 2024-05-09T05:35:02.033 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-09T05:35:02.033 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":81,"fsid":"86d4cc60-0dc4-11ef-bc97-c7b262605968","created":"2024-05-09T05:26:33.514203+0000","modified":"2024-05-09T05:34:56.202321+0000","last_up_change":"2024-05-09T05:33:48.776015+0000","last_in_change":"2024-05-09T05:33:28.117875+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T05:29:56.122407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-09T05:34:49.964521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-09T05:34:52.915301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3491bbda-3a9b-40d2-8627-87d15660f864","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":1056276932},{"type":"v1","addr":"172.21.15.39:6803","nonce":1056276932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":1056276932},{"type":"v1","addr":"172.21.15.39:6805","nonce":1056276932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":1056276932},{"type":"v1","addr":"172.21.15.39:6809","nonce":1056276932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":1056276932},{"type":"v1","addr":"172.21.15.39:6807","nonce":1056276932}]},"public_addr":"172.21.15.39:6803/1056276932","cluster_addr":"172.21.15.39:6805/1056276932","heartbeat_back_addr":"172.21.15.39:6809/1056276932","heartbeat_front_addr":"172.21.15.39:6807/1056276932","state":["exists","up"]},{"osd":1,"uuid":"ec2bd2d0-2975-402c-9df8-3469dfd6070f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":4245630636},{"type":"v1","addr":"172.21.15.60:6801","nonce":4245630636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":4245630636},{"type":"v1","addr":"172.21.15.60:6803","nonce":4245630636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":4245630636},{"type":"v1","addr":"172.21.15.60:6807","nonce":4245630636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":4245630636},{"type":"v1","addr":"172.21.15.60:6805","nonce":4245630636}]},"public_addr":"172.21.15.60:6801/4245630636","cluster_addr":"172.21.15.60:6803/4245630636","heartbeat_back_addr":"172.21.15.60:6807/4245630636","heartbeat_front_addr":"172.21.15.60:6805/4245630636","state":["exists","up"]},{"osd":2,"uuid":"9efaf6dd-086e-4095-b92e-cbbecf738523","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":4141597693},{"type":"v1","addr":"172.21.15.100:6801","nonce":4141597693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":4141597693},{"type":"v1","addr":"172.21.15.100:6803","nonce":4141597693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":4141597693},{"type":"v1","addr":"172.21.15.100:6807","nonce":4141597693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":4141597693},{"type":"v1","addr":"172.21.15.100:6805","nonce":4141597693}]},"public_addr":"172.21.15.100:6801/4141597693","cluster_addr":"172.21.15.100:6803/4141597693","heartbeat_back_addr":"172.21.15.100:6807/4141597693","heartbeat_front_addr":"172.21.15.100:6805/4141597693","state":["exists","up"]},{"osd":3,"uuid":"1ebe1a25-541d-4b54-bed8-4f0ec51b2432","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":2254197543},{"type":"v1","addr":"172.21.15.39:6811","nonce":2254197543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":2254197543},{"type":"v1","addr":"172.21.15.39:6813","nonce":2254197543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2254197543},{"type":"v1","addr":"172.21.15.39:6817","nonce":2254197543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":2254197543},{"type":"v1","addr":"172.21.15.39:6815","nonce":2254197543}]},"public_addr":"172.21.15.39:6811/2254197543","cluster_addr":"172.21.15.39:6813/2254197543","heartbeat_back_addr":"172.21.15.39:6817/2254197543","heartbeat_front_addr":"172.21.15.39:6815/2254197543","state":["exists","up"]},{"osd":4,"uuid":"d52450a3-8a97-4746-a857-35aec69aac44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":649037162},{"type":"v1","addr":"172.21.15.60:6809","nonce":649037162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":649037162},{"type":"v1","addr":"172.21.15.60:6811","nonce":649037162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":649037162},{"type":"v1","addr":"172.21.15.60:6815","nonce":649037162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":649037162},{"type":"v1","addr":"172.21.15.60:6813","nonce":649037162}]},"public_addr":"172.21.15.60:6809/649037162","cluster_addr":"172.21.15.60:6811/649037162","heartbeat_back_addr":"172.21.15.60:6815/649037162","heartbeat_front_addr":"172.21.15.60:6813/649037162","state":["exists","up"]},{"osd":5,"uuid":"b35bf704-898d-40f7-b575-90267764a5b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":658409226},{"type":"v1","addr":"172.21.15.100:6809","nonce":658409226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":658409226},{"type":"v1","addr":"172.21.15.100:6811","nonce":658409226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":658409226},{"type":"v1","addr":"172.21.15.100:6815","nonce":658409226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":658409226},{"type":"v1","addr":"172.21.15.100:6813","nonce":658409226}]},"public_addr":"172.21.15.100:6809/658409226","cluster_addr":"172.21.15.100:6811/658409226","heartbeat_back_addr":"172.21.15.100:6815/658409226","heartbeat_front_addr":"172.21.15.100:6813/658409226","state":["exists","up"]},{"osd":6,"uuid":"49eae2f5-1dad-4c2c-89f4-efa1dd1faefb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":237628491},{"type":"v1","addr":"172.21.15.39:6819","nonce":237628491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":237628491},{"type":"v1","addr":"172.21.15.39:6821","nonce":237628491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":237628491},{"type":"v1","addr":"172.21.15.39:6825","nonce":237628491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":237628491},{"type":"v1","addr":"172.21.15.39:6823","nonce":237628491}]},"public_addr":"172.21.15.39:6819/237628491","cluster_addr":"172.21.15.39:6821/237628491","heartbeat_back_addr":"172.21.15.39:6825/237628491","heartbeat_front_addr":"172.21.15.39:6823/237628491","state":["exists","up"]},{"osd":7,"uuid":"60ccae54-535c-4a13-98d0-881c00b5e870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":2718201647},{"type":"v1","addr":"172.21.15.60:6817","nonce":2718201647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":2718201647},{"type":"v1","addr":"172.21.15.60:6819","nonce":2718201647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":2718201647},{"type":"v1","addr":"172.21.15.60:6823","nonce":2718201647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":2718201647},{"type":"v1","addr":"172.21.15.60:6821","nonce":2718201647}]},"public_addr":"172.21.15.60:6817/2718201647","cluster_addr":"172.21.15.60:6819/2718201647","heartbeat_back_addr":"172.21.15.60:6823/2718201647","heartbeat_front_addr":"172.21.15.60:6821/2718201647","state":["exists","up"]},{"osd":8,"uuid":"edd52a21-0066-429f-9e98-15d1a74c53b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":1757558317},{"type":"v1","addr":"172.21.15.100:6817","nonce":1757558317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":1757558317},{"type":"v1","addr":"172.21.15.100:6819","nonce":1757558317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":1757558317},{"type":"v1","addr":"172.21.15.100:6823","nonce":1757558317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":1757558317},{"type":"v1","addr":"172.21.15.100:6821","nonce":1757558317}]},"public_addr":"172.21.15.100:6817/1757558317","cluster_addr":"172.21.15.100:6819/1757558317","heartbeat_back_addr":"172.21.15.100:6823/1757558317","heartbeat_front_addr":"172.21.15.100:6821/1757558317","state":["exists","up"]},{"osd":9,"uuid":"03fb7543-3386-49a4-b165-1007f07d88d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":2944584368},{"type":"v1","addr":"172.21.15.39:6827","nonce":2944584368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":2944584368},{"type":"v1","addr":"172.21.15.39:6829","nonce":2944584368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":2944584368},{"type":"v1","addr":"172.21.15.39:6833","nonce":2944584368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":2944584368},{"type":"v1","addr":"172.21.15.39:6831","nonce":2944584368}]},"public_addr":"172.21.15.39:6827/2944584368","cluster_addr":"172.21.15.39:6829/2944584368","heartbeat_back_addr":"172.21.15.39:6833/2944584368","heartbeat_front_addr":"172.21.15.39:6831/2944584368","state":["exists","up"]},{"osd":10,"uuid":"c1cadd6c-fcc4-4d76-b07e-0f392066a8d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1940670367},{"type":"v1","addr":"172.21.15.60:6825","nonce":1940670367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":1940670367},{"type":"v1","addr":"172.21.15.60:6827","nonce":1940670367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":1940670367},{"type":"v1","addr":"172.21.15.60:6831","nonce":1940670367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":1940670367},{"type":"v1","addr":"172.21.15.60:6829","nonce":1940670367}]},"public_addr":"172.21.15.60:6825/1940670367","cluster_addr":"172.21.15.60:6827/1940670367","heartbeat_back_addr":"172.21.15.60:6831/1940670367","heartbeat_front_addr":"172.21.15.60:6829/1940670367","state":["exists","up"]},{"osd":11,"uuid":"56806877-9ce2-41e2-9506-ce67897fa09b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":3318561029},{"type":"v1","addr":"172.21.15.100:6825","nonce":3318561029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":3318561029},{"type":"v1","addr":"172.21.15.100:6827","nonce":3318561029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":3318561029},{"type":"v1","addr":"172.21.15.100:6831","nonce":3318561029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":3318561029},{"type":"v1","addr":"172.21.15.100:6829","nonce":3318561029}]},"public_addr":"172.21.15.100:6825/3318561029","cluster_addr":"172.21.15.100:6827/3318561029","heartbeat_back_addr":"172.21.15.100:6831/3318561029","heartbeat_front_addr":"172.21.15.100:6829/3318561029","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:29:03.565705+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:29:28.380764+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:29:53.300224+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:30:20.046517+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:30:45.557983+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:31:10.397933+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:31:37.644428+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:32:02.325329+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:32:27.699044+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:32:54.436305+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:33:20.691300+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:33:46.806146+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.39:6801/4091500272":"2024-05-10T05:27:28.034010+0000","172.21.15.39:6800/4091500272":"2024-05-10T05:27:28.034010+0000","172.21.15.39:0/782312916":"2024-05-10T05:27:28.034010+0000","172.21.15.39:0/1899316433":"2024-05-10T05:27:28.034010+0000","172.21.15.39:0/1613215795":"2024-05-10T05:27:00.650123+0000","172.21.15.39:0/2870431271":"2024-05-10T05:27:00.650123+0000","172.21.15.39:0/438945726":"2024-05-10T05:27:00.650123+0000","172.21.15.39:6800/499609328":"2024-05-10T05:27:00.650123+0000","172.21.15.39:6801/499609328":"2024-05-10T05:27:00.650123+0000","172.21.15.39:0/1698165886":"2024-05-10T05:27:28.034010+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T05:35:02.034 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:02.040+0000 7f497a773700 1 -- 172.21.15.39:0/2414617067 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f495c0b2880 msgr2=0x7f495c0b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:35:02.034 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:02.040+0000 7f497a773700 1 --2- 172.21.15.39:0/2414617067 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f495c0b2880 0x7f495c0b4d90 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f497406bac0 tx=0x7f496800b410 comp rx=0 tx=0).stop 2024-05-09T05:35:02.034 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:02.040+0000 7f497a773700 1 -- 172.21.15.39:0/2414617067 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f49741034c0 msgr2=0x7f49740ff2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:35:02.034 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:02.040+0000 7f497a773700 1 --2- 172.21.15.39:0/2414617067 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f49741034c0 0x7f49740ff2d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f496400b580 tx=0x7f49640047b0 comp rx=0 tx=0).stop 2024-05-09T05:35:02.034 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:02.040+0000 7f497a773700 1 -- 172.21.15.39:0/2414617067 shutdown_connections 2024-05-09T05:35:02.035 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:02.040+0000 7f497a773700 1 --2- 172.21.15.39:0/2414617067 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f495c0b2880 0x7f495c0b4d90 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:02.035 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:02.040+0000 7f497a773700 1 --2- 172.21.15.39:0/2414617067 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4974108740 0x7f49740ffd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:02.035 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:02.040+0000 7f497a773700 1 --2- 172.21.15.39:0/2414617067 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f49741034c0 0x7f49740ff2d0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:02.035 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:02.040+0000 7f497a773700 1 --2- 172.21.15.39:0/2414617067 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4974107df0 0x7f49740ff810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:02.035 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:02.040+0000 7f497a773700 1 -- 172.21.15.39:0/2414617067 >> 172.21.15.39:0/2414617067 conn(0x7f49740fedf0 msgr2=0x7f4974075ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:35:02.035 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:02.040+0000 7f497a773700 1 -- 172.21.15.39:0/2414617067 shutdown_connections 2024-05-09T05:35:02.035 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:02.040+0000 7f497a773700 1 -- 172.21.15.39:0/2414617067 wait complete. 2024-05-09T05:35:02.543 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:35:02 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/2414617067' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T05:35:02.572 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-05-09T05:35:02.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:35:02 smithi100 ceph-mon[34353]: from='client.? 172.21.15.39:0/2414617067' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T05:35:02.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:35:02 smithi060 ceph-mon[34555]: from='client.? 172.21.15.39:0/2414617067' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T05:35:02.823 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T05:35:03.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:35:03 smithi039 ceph-mon[30439]: pgmap v298: 97 pgs: 97 active+clean; 579 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 5 op/s 2024-05-09T05:35:03.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:35:03 smithi100 ceph-mon[34353]: pgmap v298: 97 pgs: 97 active+clean; 579 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 5 op/s 2024-05-09T05:35:03.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:35:03 smithi060 ceph-mon[34555]: pgmap v298: 97 pgs: 97 active+clean; 579 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 5 op/s 2024-05-09T05:35:04.313 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:04.319+0000 7f66fecf0700 1 -- 172.21.15.39:0/2190422872 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f66f81034c0 msgr2=0x7f66f81038d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:35:04.313 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:04.319+0000 7f66fecf0700 1 --2- 172.21.15.39:0/2190422872 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f66f81034c0 0x7f66f81038d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f66e80099c0 tx=0x7f66e8009cd0 comp rx=0 tx=0).stop 2024-05-09T05:35:04.313 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:04.319+0000 7f66fecf0700 1 -- 172.21.15.39:0/2190422872 shutdown_connections 2024-05-09T05:35:04.313 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:04.319+0000 7f66fecf0700 1 --2- 172.21.15.39:0/2190422872 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66f8108740 0x7f66f81100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:04.314 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:04.319+0000 7f66fecf0700 1 --2- 172.21.15.39:0/2190422872 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f66f81034c0 0x7f66f81038d0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:04.314 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:04.319+0000 7f66fecf0700 1 --2- 172.21.15.39:0/2190422872 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f66f8107df0 0x7f66f8108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:04.314 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:04.319+0000 7f66fecf0700 1 -- 172.21.15.39:0/2190422872 >> 172.21.15.39:0/2190422872 conn(0x7f66f80fedf0 msgr2=0x7f66f8101210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:35:04.314 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:04.319+0000 7f66fecf0700 1 -- 172.21.15.39:0/2190422872 shutdown_connections 2024-05-09T05:35:04.314 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:04.319+0000 7f66fecf0700 1 -- 172.21.15.39:0/2190422872 wait complete. 2024-05-09T05:35:04.315 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:04.320+0000 7f66fecf0700 1 Processor -- start 2024-05-09T05:35:04.316 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:04.320+0000 7f66fecf0700 1 -- start start 2024-05-09T05:35:04.316 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:04.321+0000 7f66fecf0700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66f81034c0 0x7f66f819bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:35:04.316 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:04.321+0000 7f66fecf0700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f66f8107df0 0x7f66f819c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:35:04.316 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:04.321+0000 7f66fecf0700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f66f8108740 0x7f66f819c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:35:04.316 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:04.321+0000 7f66fecf0700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f66f81133c0 con 0x7f66f8107df0 2024-05-09T05:35:04.316 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:04.321+0000 7f66fecf0700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f66f8113240 con 0x7f66f81034c0 2024-05-09T05:35:04.316 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:04.321+0000 7f66fecf0700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f66f8113540 con 0x7f66f8108740 2024-05-09T05:35:04.316 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:04.321+0000 7f66f7fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f66f8107df0 0x7f66f819c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:35:04.316 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:04.321+0000 7f66f7fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f66f8107df0 0x7f66f819c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44484/0 (socket says 172.21.15.39:44484) 2024-05-09T05:35:04.316 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:04.321+0000 7f66f7fff700 1 -- 172.21.15.39:0/3611139449 learned_addr learned my addr 172.21.15.39:0/3611139449 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:35:04.316 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:04.321+0000 7f66fca8c700 1 --2- 172.21.15.39:0/3611139449 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66f81034c0 0x7f66f819bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:35:04.316 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:04.321+0000 7f66fd28d700 1 --2- 172.21.15.39:0/3611139449 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f66f8108740 0x7f66f819c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:35:04.316 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:04.321+0000 7f66f7fff700 1 -- 172.21.15.39:0/3611139449 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f66f8108740 msgr2=0x7f66f819c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:35:04.316 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:04.321+0000 7f66f7fff700 1 --2- 172.21.15.39:0/3611139449 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f66f8108740 0x7f66f819c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:04.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:04.321+0000 7f66f7fff700 1 -- 172.21.15.39:0/3611139449 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66f81034c0 msgr2=0x7f66f819bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:35:04.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:04.321+0000 7f66f7fff700 1 --2- 172.21.15.39:0/3611139449 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66f81034c0 0x7f66f819bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:04.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:04.321+0000 7f66f7fff700 1 -- 172.21.15.39:0/3611139449 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66f81a7010 con 0x7f66f8107df0 2024-05-09T05:35:04.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:04.321+0000 7f66f7fff700 1 --2- 172.21.15.39:0/3611139449 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f66f8107df0 0x7f66f819c200 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f66ec00e970 tx=0x7f66ec00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:35:04.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:04.321+0000 7f66f5ffb700 1 -- 172.21.15.39:0/3611139449 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66ec00cbd0 con 0x7f66f8107df0 2024-05-09T05:35:04.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:04.322+0000 7f66f5ffb700 1 -- 172.21.15.39:0/3611139449 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f66ec00cd70 con 0x7f66f8107df0 2024-05-09T05:35:04.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:04.322+0000 7f66fecf0700 1 -- 172.21.15.39:0/3611139449 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66f81a7300 con 0x7f66f8107df0 2024-05-09T05:35:04.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:04.322+0000 7f66f5ffb700 1 -- 172.21.15.39:0/3611139449 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66ec005680 con 0x7f66f8107df0 2024-05-09T05:35:04.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:04.322+0000 7f66fecf0700 1 -- 172.21.15.39:0/3611139449 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66f81a7890 con 0x7f66f8107df0 2024-05-09T05:35:04.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:04.323+0000 7f66fecf0700 1 -- 172.21.15.39:0/3611139449 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66f80512c0 con 0x7f66f8107df0 2024-05-09T05:35:04.318 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:04.324+0000 7f66f5ffb700 1 -- 172.21.15.39:0/3611139449 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f66ec004750 con 0x7f66f8107df0 2024-05-09T05:35:04.319 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:04.325+0000 7f66f5ffb700 1 --2- 172.21.15.39:0/3611139449 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f66e00b2900 0x7f66e00b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:35:04.319 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:04.325+0000 7f66fca8c700 1 --2- 172.21.15.39:0/3611139449 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f66e00b2900 0x7f66e00b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:35:04.319 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:04.325+0000 7f66f5ffb700 1 -- 172.21.15.39:0/3611139449 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f66ec0e24b0 con 0x7f66f8107df0 2024-05-09T05:35:04.319 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:04.326+0000 7f66fca8c700 1 --2- 172.21.15.39:0/3611139449 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f66e00b2900 0x7f66e00b4e10 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f66e8000c00 tx=0x7f66e801a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:35:04.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:04.329+0000 7f66f5ffb700 1 -- 172.21.15.39:0/3611139449 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f66ec054df0 con 0x7f66f8107df0 2024-05-09T05:35:04.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:04.590+0000 7f66fecf0700 1 -- 172.21.15.39:0/3611139449 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f66f8075fe0 con 0x7f66f8107df0 2024-05-09T05:35:05.366 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:05.371+0000 7f66f5ffb700 1 -- 172.21.15.39:0/3611139449 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7f66ec0aa320 con 0x7f66f8107df0 2024-05-09T05:35:05.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:05.375+0000 7f66fecf0700 1 -- 172.21.15.39:0/3611139449 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f66e00b2900 msgr2=0x7f66e00b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:35:05.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:05.375+0000 7f66fecf0700 1 --2- 172.21.15.39:0/3611139449 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f66e00b2900 0x7f66e00b4e10 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f66e8000c00 tx=0x7f66e801a040 comp rx=0 tx=0).stop 2024-05-09T05:35:05.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:05.375+0000 7f66fecf0700 1 -- 172.21.15.39:0/3611139449 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f66f8107df0 msgr2=0x7f66f819c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:35:05.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:05.375+0000 7f66fecf0700 1 --2- 172.21.15.39:0/3611139449 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f66f8107df0 0x7f66f819c200 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f66ec00e970 tx=0x7f66ec00ec80 comp rx=0 tx=0).stop 2024-05-09T05:35:05.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:05.375+0000 7f66fecf0700 1 -- 172.21.15.39:0/3611139449 shutdown_connections 2024-05-09T05:35:05.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:05.375+0000 7f66fecf0700 1 --2- 172.21.15.39:0/3611139449 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f66e00b2900 0x7f66e00b4e10 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:05.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:05.375+0000 7f66fecf0700 1 --2- 172.21.15.39:0/3611139449 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f66f8108740 0x7f66f819c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:05.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:05.375+0000 7f66fecf0700 1 --2- 172.21.15.39:0/3611139449 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66f81034c0 0x7f66f819bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:05.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:05.375+0000 7f66fecf0700 1 --2- 172.21.15.39:0/3611139449 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f66f8107df0 0x7f66f819c200 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:05.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:05.375+0000 7f66fecf0700 1 -- 172.21.15.39:0/3611139449 >> 172.21.15.39:0/3611139449 conn(0x7f66f80fedf0 msgr2=0x7f66f81096a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:35:05.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:05.375+0000 7f66fecf0700 1 -- 172.21.15.39:0/3611139449 shutdown_connections 2024-05-09T05:35:05.369 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:05.375+0000 7f66fecf0700 1 -- 172.21.15.39:0/3611139449 wait complete. 2024-05-09T05:35:05.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:35:05 smithi039 ceph-mon[30439]: pgmap v299: 97 pgs: 97 active+clean; 579 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 5 op/s 2024-05-09T05:35:05.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:35:05 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/3611139449' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-05-09T05:35:05.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:35:05 smithi100 ceph-mon[34353]: pgmap v299: 97 pgs: 97 active+clean; 579 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 5 op/s 2024-05-09T05:35:05.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:35:05 smithi100 ceph-mon[34353]: from='client.? 172.21.15.39:0/3611139449' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-05-09T05:35:05.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:35:05 smithi060 ceph-mon[34555]: pgmap v299: 97 pgs: 97 active+clean; 579 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 5 op/s 2024-05-09T05:35:05.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:35:05 smithi060 ceph-mon[34555]: from='client.? 172.21.15.39:0/3611139449' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-05-09T05:35:06.110 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2}} 2024-05-09T05:35:06.110 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph fs set cephfs max_mds 3 2024-05-09T05:35:06.370 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T05:35:06.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:35:06 smithi100 ceph-mon[34353]: from='client.? 172.21.15.39:0/3611139449' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-05-09T05:35:06.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:35:06 smithi100 ceph-mon[34353]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-09T05:35:06.719 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:35:06 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/3611139449' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-05-09T05:35:06.720 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:35:06 smithi039 ceph-mon[30439]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-09T05:35:06.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:35:06 smithi060 ceph-mon[34555]: from='client.? 172.21.15.39:0/3611139449' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-05-09T05:35:06.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:35:06 smithi060 ceph-mon[34555]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-09T05:35:07.557 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:35:07 smithi039 ceph-mon[30439]: pgmap v300: 97 pgs: 97 active+clean; 579 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2024-05-09T05:35:07.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:35:07 smithi100 ceph-mon[34353]: pgmap v300: 97 pgs: 97 active+clean; 579 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2024-05-09T05:35:07.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:35:07 smithi060 ceph-mon[34555]: pgmap v300: 97 pgs: 97 active+clean; 579 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2024-05-09T05:35:08.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:08.122+0000 7fc48057e700 1 -- 172.21.15.39:0/737636671 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc478105e40 msgr2=0x7fc47810e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:35:08.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:08.122+0000 7fc48057e700 1 --2- 172.21.15.39:0/737636671 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc478105e40 0x7fc47810e390 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc46c009990 tx=0x7fc46c009ca0 comp rx=0 tx=0).stop 2024-05-09T05:35:08.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:08.122+0000 7fc48057e700 1 -- 172.21.15.39:0/737636671 shutdown_connections 2024-05-09T05:35:08.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:08.122+0000 7fc48057e700 1 --2- 172.21.15.39:0/737636671 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc47810e920 0x7fc478110e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:08.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:08.122+0000 7fc48057e700 1 --2- 172.21.15.39:0/737636671 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc4781054f0 0x7fc478105900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:08.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:08.122+0000 7fc48057e700 1 --2- 172.21.15.39:0/737636671 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc478105e40 0x7fc47810e390 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:08.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:08.122+0000 7fc48057e700 1 -- 172.21.15.39:0/737636671 >> 172.21.15.39:0/737636671 conn(0x7fc478078e00 msgr2=0x7fc478079240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:35:08.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:08.122+0000 7fc48057e700 1 -- 172.21.15.39:0/737636671 shutdown_connections 2024-05-09T05:35:08.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:08.122+0000 7fc48057e700 1 -- 172.21.15.39:0/737636671 wait complete. 2024-05-09T05:35:08.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:08.123+0000 7fc48057e700 1 Processor -- start 2024-05-09T05:35:08.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:08.123+0000 7fc48057e700 1 -- start start 2024-05-09T05:35:08.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:08.124+0000 7fc48057e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc4781054f0 0x7fc47819aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:35:08.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:08.124+0000 7fc48057e700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc478105e40 0x7fc47819b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:35:08.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:08.124+0000 7fc48057e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc47810e920 0x7fc47819f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:35:08.120 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:08.124+0000 7fc48057e700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fc478114480 con 0x7fc47810e920 2024-05-09T05:35:08.120 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:08.124+0000 7fc48057e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc478114300 con 0x7fc4781054f0 2024-05-09T05:35:08.120 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:08.124+0000 7fc48057e700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc478114600 con 0x7fc478105e40 2024-05-09T05:35:08.120 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:08.124+0000 7fc47eb1b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc47810e920 0x7fc47819f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:35:08.120 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:08.124+0000 7fc47db19700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc478105e40 0x7fc47819b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:35:08.120 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:08.124+0000 7fc47eb1b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc47810e920 0x7fc47819f720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44692/0 (socket says 172.21.15.39:44692) 2024-05-09T05:35:08.120 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:08.124+0000 7fc47eb1b700 1 -- 172.21.15.39:0/2069826004 learned_addr learned my addr 172.21.15.39:0/2069826004 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:35:08.120 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:08.124+0000 7fc47e31a700 1 --2- 172.21.15.39:0/2069826004 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc4781054f0 0x7fc47819aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:35:08.120 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:08.124+0000 7fc47eb1b700 1 -- 172.21.15.39:0/2069826004 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc478105e40 msgr2=0x7fc47819b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:35:08.120 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:08.124+0000 7fc47eb1b700 1 --2- 172.21.15.39:0/2069826004 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc478105e40 0x7fc47819b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:08.120 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:08.124+0000 7fc47eb1b700 1 -- 172.21.15.39:0/2069826004 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc4781054f0 msgr2=0x7fc47819aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:35:08.120 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:08.124+0000 7fc47eb1b700 1 --2- 172.21.15.39:0/2069826004 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc4781054f0 0x7fc47819aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:08.120 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:08.124+0000 7fc47eb1b700 1 -- 172.21.15.39:0/2069826004 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc47819fd10 con 0x7fc47810e920 2024-05-09T05:35:08.120 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:08.124+0000 7fc47e31a700 1 --2- 172.21.15.39:0/2069826004 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc4781054f0 0x7fc47819aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T05:35:08.120 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:08.124+0000 7fc47eb1b700 1 --2- 172.21.15.39:0/2069826004 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc47810e920 0x7fc47819f720 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc47000c900 tx=0x7fc47000cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:35:08.121 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:08.125+0000 7fc4777fe700 1 -- 172.21.15.39:0/2069826004 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc470007b00 con 0x7fc47810e920 2024-05-09T05:35:08.121 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:08.125+0000 7fc4777fe700 1 -- 172.21.15.39:0/2069826004 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc47000ce50 con 0x7fc47810e920 2024-05-09T05:35:08.121 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:08.125+0000 7fc48057e700 1 -- 172.21.15.39:0/2069826004 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4781a0000 con 0x7fc47810e920 2024-05-09T05:35:08.121 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:08.125+0000 7fc4777fe700 1 -- 172.21.15.39:0/2069826004 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc470018660 con 0x7fc47810e920 2024-05-09T05:35:08.121 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:08.125+0000 7fc48057e700 1 -- 172.21.15.39:0/2069826004 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4781a0510 con 0x7fc47810e920 2024-05-09T05:35:08.121 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:08.126+0000 7fc48057e700 1 -- 172.21.15.39:0/2069826004 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4780512c0 con 0x7fc47810e920 2024-05-09T05:35:08.121 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:08.127+0000 7fc4777fe700 1 -- 172.21.15.39:0/2069826004 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fc47000f450 con 0x7fc47810e920 2024-05-09T05:35:08.122 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:08.128+0000 7fc4777fe700 1 --2- 172.21.15.39:0/2069826004 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fc4600b2900 0x7fc4600b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:35:08.122 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:08.128+0000 7fc47e31a700 1 --2- 172.21.15.39:0/2069826004 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fc4600b2900 0x7fc4600b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:35:08.122 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:08.128+0000 7fc4777fe700 1 -- 172.21.15.39:0/2069826004 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7fc4700e1f10 con 0x7fc47810e920 2024-05-09T05:35:08.122 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:08.129+0000 7fc47e31a700 1 --2- 172.21.15.39:0/2069826004 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fc4600b2900 0x7fc4600b4e10 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc468009dd0 tx=0x7fc468009040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:35:08.125 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:08.132+0000 7fc4777fe700 1 -- 172.21.15.39:0/2069826004 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fc470014030 con 0x7fc47810e920 2024-05-09T05:35:08.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:08.397+0000 7fc48057e700 1 -- 172.21.15.39:0/2069826004 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) -- 0x7fc47819c250 con 0x7fc47810e920 2024-05-09T05:35:09.393 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:09.399+0000 7fc4777fe700 1 -- 172.21.15.39:0/2069826004 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v18) ==== 105+0+0 (secure 0 0 0) 0x7fc4700a9e90 con 0x7fc47810e920 2024-05-09T05:35:09.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:09.402+0000 7fc48057e700 1 -- 172.21.15.39:0/2069826004 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fc4600b2900 msgr2=0x7fc4600b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:35:09.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:09.402+0000 7fc48057e700 1 --2- 172.21.15.39:0/2069826004 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fc4600b2900 0x7fc4600b4e10 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc468009dd0 tx=0x7fc468009040 comp rx=0 tx=0).stop 2024-05-09T05:35:09.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:09.402+0000 7fc48057e700 1 -- 172.21.15.39:0/2069826004 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc47810e920 msgr2=0x7fc47819f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:35:09.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:09.402+0000 7fc48057e700 1 --2- 172.21.15.39:0/2069826004 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc47810e920 0x7fc47819f720 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc47000c900 tx=0x7fc47000cc10 comp rx=0 tx=0).stop 2024-05-09T05:35:09.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:09.403+0000 7fc48057e700 1 -- 172.21.15.39:0/2069826004 shutdown_connections 2024-05-09T05:35:09.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:09.403+0000 7fc48057e700 1 --2- 172.21.15.39:0/2069826004 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fc4600b2900 0x7fc4600b4e10 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:09.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:09.403+0000 7fc48057e700 1 --2- 172.21.15.39:0/2069826004 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc47810e920 0x7fc47819f720 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:09.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:09.403+0000 7fc48057e700 1 --2- 172.21.15.39:0/2069826004 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc4781054f0 0x7fc47819aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:09.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:09.403+0000 7fc48057e700 1 --2- 172.21.15.39:0/2069826004 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc478105e40 0x7fc47819b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:09.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:09.403+0000 7fc48057e700 1 -- 172.21.15.39:0/2069826004 >> 172.21.15.39:0/2069826004 conn(0x7fc478078e00 msgr2=0x7fc4781001e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:35:09.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:09.403+0000 7fc48057e700 1 -- 172.21.15.39:0/2069826004 shutdown_connections 2024-05-09T05:35:09.397 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:09.403+0000 7fc48057e700 1 -- 172.21.15.39:0/2069826004 wait complete. 2024-05-09T05:35:09.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:35:09 smithi039 ceph-mon[30439]: pgmap v301: 97 pgs: 97 active+clean; 579 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 3 op/s 2024-05-09T05:35:09.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:35:09 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/2069826004' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-05-09T05:35:09.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:35:09 smithi100 ceph-mon[34353]: pgmap v301: 97 pgs: 97 active+clean; 579 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 3 op/s 2024-05-09T05:35:09.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:35:09 smithi100 ceph-mon[34353]: from='client.? 172.21.15.39:0/2069826004' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-05-09T05:35:09.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:35:09 smithi060 ceph-mon[34555]: pgmap v301: 97 pgs: 97 active+clean; 579 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 3 op/s 2024-05-09T05:35:09.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:35:09 smithi060 ceph-mon[34555]: from='client.? 172.21.15.39:0/2069826004' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-05-09T05:35:10.209 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-05-09T05:35:10.477 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T05:35:10.601 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:35:10 smithi039 ceph-mon[30439]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-05-09T05:35:10.601 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:35:10 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/2069826004' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-05-09T05:35:10.601 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:35:10 smithi039 ceph-mon[30439]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-05-09T05:35:10.601 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:35:10 smithi039 ceph-mon[30439]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-09T05:35:10.601 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:35:10 smithi039 ceph-mon[30439]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-05-09T05:35:10.601 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:35:10 smithi039 ceph-mon[30439]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-05-09T05:35:10.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:35:10 smithi100 ceph-mon[34353]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-05-09T05:35:10.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:35:10 smithi100 ceph-mon[34353]: from='client.? 172.21.15.39:0/2069826004' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-05-09T05:35:10.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:35:10 smithi100 ceph-mon[34353]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-05-09T05:35:10.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:35:10 smithi100 ceph-mon[34353]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-09T05:35:10.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:35:10 smithi100 ceph-mon[34353]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-05-09T05:35:10.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:35:10 smithi100 ceph-mon[34353]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-05-09T05:35:10.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:35:10 smithi060 ceph-mon[34555]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-05-09T05:35:10.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:35:10 smithi060 ceph-mon[34555]: from='client.? 172.21.15.39:0/2069826004' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-05-09T05:35:10.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:35:10 smithi060 ceph-mon[34555]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-05-09T05:35:10.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:35:10 smithi060 ceph-mon[34555]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-09T05:35:10.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:35:10 smithi060 ceph-mon[34555]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-05-09T05:35:10.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:35:10 smithi060 ceph-mon[34555]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-05-09T05:35:11.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:35:11 smithi100 ceph-mon[34353]: pgmap v302: 97 pgs: 97 active+clean; 579 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s wr, 3 op/s 2024-05-09T05:35:11.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:35:11 smithi100 ceph-mon[34353]: mds.? [v2:172.21.15.100:6838/1395178742,v1:172.21.15.100:6839/1395178742] up:active 2024-05-09T05:35:11.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:35:11 smithi100 ceph-mon[34353]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-05-09T05:35:11.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:35:11 smithi100 ceph-mon[34353]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-05-09T05:35:11.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:35:11 smithi100 ceph-mon[34353]: Cluster is now healthy 2024-05-09T05:35:11.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:35:11 smithi100 ceph-mon[34353]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-05-09T05:35:11.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:35:11 smithi100 ceph-mon[34353]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2024-05-09T05:35:11.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:35:11 smithi100 ceph-mon[34353]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-05-09T05:35:11.697 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:35:11 smithi060 ceph-mon[34555]: pgmap v302: 97 pgs: 97 active+clean; 579 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s wr, 3 op/s 2024-05-09T05:35:11.697 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:35:11 smithi060 ceph-mon[34555]: mds.? [v2:172.21.15.100:6838/1395178742,v1:172.21.15.100:6839/1395178742] up:active 2024-05-09T05:35:11.698 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:35:11 smithi060 ceph-mon[34555]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-05-09T05:35:11.698 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:35:11 smithi060 ceph-mon[34555]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-05-09T05:35:11.698 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:35:11 smithi060 ceph-mon[34555]: Cluster is now healthy 2024-05-09T05:35:11.698 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:35:11 smithi060 ceph-mon[34555]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-05-09T05:35:11.698 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:35:11 smithi060 ceph-mon[34555]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2024-05-09T05:35:11.698 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:35:11 smithi060 ceph-mon[34555]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-05-09T05:35:11.786 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:35:11 smithi039 ceph-mon[30439]: pgmap v302: 97 pgs: 97 active+clean; 579 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s wr, 3 op/s 2024-05-09T05:35:11.786 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:35:11 smithi039 ceph-mon[30439]: mds.? [v2:172.21.15.100:6838/1395178742,v1:172.21.15.100:6839/1395178742] up:active 2024-05-09T05:35:11.786 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:35:11 smithi039 ceph-mon[30439]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-05-09T05:35:11.786 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:35:11 smithi039 ceph-mon[30439]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-05-09T05:35:11.787 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:35:11 smithi039 ceph-mon[30439]: Cluster is now healthy 2024-05-09T05:35:11.787 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:35:11 smithi039 ceph-mon[30439]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-05-09T05:35:11.787 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:35:11 smithi039 ceph-mon[30439]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2024-05-09T05:35:11.787 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:35:11 smithi039 ceph-mon[30439]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-05-09T05:35:12.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:12.176+0000 7f6333acb700 1 -- 172.21.15.39:0/2936686078 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f632c1034c0 msgr2=0x7f632c1038d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:35:12.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:12.176+0000 7f6333acb700 1 --2- 172.21.15.39:0/2936686078 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f632c1034c0 0x7f632c1038d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f63280099c0 tx=0x7f6328009cd0 comp rx=0 tx=0).stop 2024-05-09T05:35:12.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:12.176+0000 7f6333acb700 1 -- 172.21.15.39:0/2936686078 shutdown_connections 2024-05-09T05:35:12.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:12.176+0000 7f6333acb700 1 --2- 172.21.15.39:0/2936686078 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f632c108740 0x7f632c1100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:12.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:12.176+0000 7f6333acb700 1 --2- 172.21.15.39:0/2936686078 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f632c1034c0 0x7f632c1038d0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:12.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:12.176+0000 7f6333acb700 1 --2- 172.21.15.39:0/2936686078 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f632c107df0 0x7f632c108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:12.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:12.176+0000 7f6333acb700 1 -- 172.21.15.39:0/2936686078 >> 172.21.15.39:0/2936686078 conn(0x7f632c0fedc0 msgr2=0x7f632c1011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:35:12.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:12.176+0000 7f6333acb700 1 -- 172.21.15.39:0/2936686078 shutdown_connections 2024-05-09T05:35:12.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:12.176+0000 7f6333acb700 1 -- 172.21.15.39:0/2936686078 wait complete. 2024-05-09T05:35:12.172 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:12.177+0000 7f6333acb700 1 Processor -- start 2024-05-09T05:35:12.173 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:12.177+0000 7f6333acb700 1 -- start start 2024-05-09T05:35:12.173 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:12.177+0000 7f6333acb700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f632c1034c0 0x7f632c199db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:35:12.173 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:12.177+0000 7f6333acb700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f632c107df0 0x7f632c19a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:35:12.173 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:12.177+0000 7f6333acb700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f632c108740 0x7f632c19e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:35:12.173 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:12.177+0000 7f6333acb700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f632c1133e0 con 0x7f632c108740 2024-05-09T05:35:12.173 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:12.177+0000 7f6333acb700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f632c113260 con 0x7f632c107df0 2024-05-09T05:35:12.173 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:12.177+0000 7f6333acb700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f632c113560 con 0x7f632c1034c0 2024-05-09T05:35:12.173 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:12.177+0000 7f6332068700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f632c108740 0x7f632c19e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:35:12.173 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:12.177+0000 7f6332068700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f632c108740 0x7f632c19e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44704/0 (socket says 172.21.15.39:44704) 2024-05-09T05:35:12.173 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:12.177+0000 7f6331066700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f632c107df0 0x7f632c19a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:35:12.173 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:12.177+0000 7f6332068700 1 -- 172.21.15.39:0/1329778883 learned_addr learned my addr 172.21.15.39:0/1329778883 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:35:12.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:12.177+0000 7f6331867700 1 --2- 172.21.15.39:0/1329778883 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f632c1034c0 0x7f632c199db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:35:12.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:12.177+0000 7f6332068700 1 -- 172.21.15.39:0/1329778883 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f632c1034c0 msgr2=0x7f632c199db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:35:12.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:12.177+0000 7f6332068700 1 --2- 172.21.15.39:0/1329778883 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f632c1034c0 0x7f632c199db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:12.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:12.177+0000 7f6332068700 1 -- 172.21.15.39:0/1329778883 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f632c107df0 msgr2=0x7f632c19a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:35:12.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:12.177+0000 7f6332068700 1 --2- 172.21.15.39:0/1329778883 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f632c107df0 0x7f632c19a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:12.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:12.178+0000 7f6332068700 1 -- 172.21.15.39:0/1329778883 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f632c19ec80 con 0x7f632c108740 2024-05-09T05:35:12.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:12.178+0000 7f6331066700 1 --2- 172.21.15.39:0/1329778883 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f632c107df0 0x7f632c19a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T05:35:12.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:12.178+0000 7f6332068700 1 --2- 172.21.15.39:0/1329778883 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f632c108740 0x7f632c19e5e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f632400ef30 tx=0x7f632400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:35:12.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:12.178+0000 7f6322ffd700 1 -- 172.21.15.39:0/1329778883 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63240092e0 con 0x7f632c108740 2024-05-09T05:35:12.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:12.178+0000 7f6322ffd700 1 -- 172.21.15.39:0/1329778883 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6324004bb0 con 0x7f632c108740 2024-05-09T05:35:12.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:12.178+0000 7f6333acb700 1 -- 172.21.15.39:0/1329778883 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f632c19ef10 con 0x7f632c108740 2024-05-09T05:35:12.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:12.178+0000 7f6322ffd700 1 -- 172.21.15.39:0/1329778883 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6324004280 con 0x7f632c108740 2024-05-09T05:35:12.175 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:12.178+0000 7f6333acb700 1 -- 172.21.15.39:0/1329778883 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f632c19f400 con 0x7f632c108740 2024-05-09T05:35:12.175 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:12.179+0000 7f6333acb700 1 -- 172.21.15.39:0/1329778883 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f632c0512c0 con 0x7f632c108740 2024-05-09T05:35:12.175 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:12.181+0000 7f6322ffd700 1 -- 172.21.15.39:0/1329778883 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f632401b030 con 0x7f632c108740 2024-05-09T05:35:12.176 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:12.182+0000 7f6322ffd700 1 --2- 172.21.15.39:0/1329778883 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f63180b2880 0x7f63180b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:35:12.176 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:12.182+0000 7f6331867700 1 --2- 172.21.15.39:0/1329778883 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f63180b2880 0x7f63180b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:35:12.176 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:12.182+0000 7f6322ffd700 1 -- 172.21.15.39:0/1329778883 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f63240e2580 con 0x7f632c108740 2024-05-09T05:35:12.176 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:12.183+0000 7f6331867700 1 --2- 172.21.15.39:0/1329778883 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f63180b2880 0x7f63180b4d90 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6328006010 tx=0x7f632801a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:35:12.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:12.186+0000 7f6322ffd700 1 -- 172.21.15.39:0/1329778883 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f6324022020 con 0x7f632c108740 2024-05-09T05:35:12.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:12.449+0000 7f6333acb700 1 -- 172.21.15.39:0/1329778883 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f632c10b170 con 0x7f632c108740 2024-05-09T05:35:12.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:35:12 smithi060 ceph-mon[34555]: mds.? [v2:172.21.15.100:6836/3676209932,v1:172.21.15.100:6837/3676209932] up:active 2024-05-09T05:35:12.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:35:12 smithi060 ceph-mon[34555]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2024-05-09T05:35:12.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:35:12 smithi039 ceph-mon[30439]: mds.? [v2:172.21.15.100:6836/3676209932,v1:172.21.15.100:6837/3676209932] up:active 2024-05-09T05:35:12.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:35:12 smithi039 ceph-mon[30439]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2024-05-09T05:35:12.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:35:12 smithi100 ceph-mon[34353]: mds.? [v2:172.21.15.100:6836/3676209932,v1:172.21.15.100:6837/3676209932] up:active 2024-05-09T05:35:12.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:35:12 smithi100 ceph-mon[34353]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2024-05-09T05:35:13.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:13.267+0000 7f6322ffd700 1 -- 172.21.15.39:0/1329778883 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v23) ==== 121+0+0 (secure 0 0 0) 0x7f6324010040 con 0x7f632c108740 2024-05-09T05:35:13.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:13.270+0000 7f6333acb700 1 -- 172.21.15.39:0/1329778883 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f63180b2880 msgr2=0x7f63180b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:35:13.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:13.270+0000 7f6333acb700 1 --2- 172.21.15.39:0/1329778883 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f63180b2880 0x7f63180b4d90 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6328006010 tx=0x7f632801a040 comp rx=0 tx=0).stop 2024-05-09T05:35:13.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:13.270+0000 7f6333acb700 1 -- 172.21.15.39:0/1329778883 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f632c108740 msgr2=0x7f632c19e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:35:13.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:13.270+0000 7f6333acb700 1 --2- 172.21.15.39:0/1329778883 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f632c108740 0x7f632c19e5e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f632400ef30 tx=0x7f632400c3a0 comp rx=0 tx=0).stop 2024-05-09T05:35:13.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:13.270+0000 7f6333acb700 1 -- 172.21.15.39:0/1329778883 shutdown_connections 2024-05-09T05:35:13.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:13.271+0000 7f6333acb700 1 --2- 172.21.15.39:0/1329778883 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f63180b2880 0x7f63180b4d90 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:13.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:13.271+0000 7f6333acb700 1 --2- 172.21.15.39:0/1329778883 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f632c108740 0x7f632c19e5e0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:13.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:13.271+0000 7f6333acb700 1 --2- 172.21.15.39:0/1329778883 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f632c1034c0 0x7f632c199db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:13.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:13.271+0000 7f6333acb700 1 --2- 172.21.15.39:0/1329778883 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f632c107df0 0x7f632c19a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:13.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:13.271+0000 7f6333acb700 1 -- 172.21.15.39:0/1329778883 >> 172.21.15.39:0/1329778883 conn(0x7f632c0fedc0 msgr2=0x7f632c1096a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:35:13.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:13.271+0000 7f6333acb700 1 -- 172.21.15.39:0/1329778883 shutdown_connections 2024-05-09T05:35:13.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:13.271+0000 7f6333acb700 1 -- 172.21.15.39:0/1329778883 wait complete. 2024-05-09T05:35:13.588 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:35:13 smithi039 ceph-mon[30439]: pgmap v303: 97 pgs: 97 active+clean; 580 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 6 op/s 2024-05-09T05:35:13.588 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:35:13 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/1329778883' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-05-09T05:35:13.588 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:35:13 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/1329778883' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-05-09T05:35:13.588 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:35:13 smithi039 ceph-mon[30439]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-09T05:35:13.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:35:13 smithi060 ceph-mon[34555]: pgmap v303: 97 pgs: 97 active+clean; 580 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 6 op/s 2024-05-09T05:35:13.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:35:13 smithi060 ceph-mon[34555]: from='client.? 172.21.15.39:0/1329778883' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-05-09T05:35:13.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:35:13 smithi060 ceph-mon[34555]: from='client.? 172.21.15.39:0/1329778883' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-05-09T05:35:13.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:35:13 smithi060 ceph-mon[34555]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-09T05:35:13.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:35:13 smithi100 ceph-mon[34353]: pgmap v303: 97 pgs: 97 active+clean; 580 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 6 op/s 2024-05-09T05:35:13.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:35:13 smithi100 ceph-mon[34353]: from='client.? 172.21.15.39:0/1329778883' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-05-09T05:35:13.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:35:13 smithi100 ceph-mon[34353]: from='client.? 172.21.15.39:0/1329778883' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-05-09T05:35:13.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:35:13 smithi100 ceph-mon[34353]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-09T05:35:13.982 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-05-09T05:35:14.241 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T05:35:15.573 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:35:15 smithi039 ceph-mon[30439]: pgmap v304: 97 pgs: 97 active+clean; 582 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s rd, 2.0 KiB/s wr, 6 op/s 2024-05-09T05:35:15.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:15.790+0000 7f609bfed700 1 -- 172.21.15.39:0/282866127 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6094108740 msgr2=0x7f60941100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:35:15.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:15.790+0000 7f609bfed700 1 --2- 172.21.15.39:0/282866127 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6094108740 0x7f60941100a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f608c0099c0 tx=0x7f608c009cd0 comp rx=0 tx=0).stop 2024-05-09T05:35:15.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:15.790+0000 7f609bfed700 1 -- 172.21.15.39:0/282866127 shutdown_connections 2024-05-09T05:35:15.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:15.790+0000 7f609bfed700 1 --2- 172.21.15.39:0/282866127 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6094108740 0x7f60941100a0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:15.784 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:15.790+0000 7f609bfed700 1 --2- 172.21.15.39:0/282866127 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f60941034c0 0x7f60941038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:15.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:15.790+0000 7f609bfed700 1 --2- 172.21.15.39:0/282866127 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6094107df0 0x7f6094108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:15.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:15.790+0000 7f609bfed700 1 -- 172.21.15.39:0/282866127 >> 172.21.15.39:0/282866127 conn(0x7f60940fedc0 msgr2=0x7f60941011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:35:15.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:15.790+0000 7f609bfed700 1 -- 172.21.15.39:0/282866127 shutdown_connections 2024-05-09T05:35:15.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:15.790+0000 7f609bfed700 1 -- 172.21.15.39:0/282866127 wait complete. 2024-05-09T05:35:15.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:15.791+0000 7f609bfed700 1 Processor -- start 2024-05-09T05:35:15.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:15.791+0000 7f609bfed700 1 -- start start 2024-05-09T05:35:15.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:15.792+0000 7f609bfed700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60941034c0 0x7f6094199d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:35:15.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:15.792+0000 7f609bfed700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6094107df0 0x7f609419a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:35:15.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:15.792+0000 7f609bfed700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6094108740 0x7f609419e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:35:15.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:15.792+0000 7f609bfed700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f6094113370 con 0x7f6094108740 2024-05-09T05:35:15.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:15.792+0000 7f609bfed700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f60941131f0 con 0x7f60941034c0 2024-05-09T05:35:15.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:15.792+0000 7f609bfed700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f60941134f0 con 0x7f6094107df0 2024-05-09T05:35:15.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:15.792+0000 7f609a58a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6094108740 0x7f609419e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:35:15.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:15.792+0000 7f609a58a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6094108740 0x7f609419e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44712/0 (socket says 172.21.15.39:44712) 2024-05-09T05:35:15.788 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:15.792+0000 7f609a58a700 1 -- 172.21.15.39:0/2736518809 learned_addr learned my addr 172.21.15.39:0/2736518809 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:35:15.788 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:15.792+0000 7f6099588700 1 --2- 172.21.15.39:0/2736518809 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6094107df0 0x7f609419a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:35:15.788 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:15.792+0000 7f6099d89700 1 --2- 172.21.15.39:0/2736518809 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60941034c0 0x7f6094199d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:35:15.788 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:15.792+0000 7f609a58a700 1 -- 172.21.15.39:0/2736518809 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6094107df0 msgr2=0x7f609419a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:35:15.788 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:15.792+0000 7f609a58a700 1 --2- 172.21.15.39:0/2736518809 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6094107df0 0x7f609419a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:15.788 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:15.792+0000 7f609a58a700 1 -- 172.21.15.39:0/2736518809 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60941034c0 msgr2=0x7f6094199d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:35:15.788 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:15.792+0000 7f609a58a700 1 --2- 172.21.15.39:0/2736518809 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60941034c0 0x7f6094199d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:15.788 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:15.792+0000 7f609a58a700 1 -- 172.21.15.39:0/2736518809 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f609419ec10 con 0x7f6094108740 2024-05-09T05:35:15.788 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:15.792+0000 7f6099588700 1 --2- 172.21.15.39:0/2736518809 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6094107df0 0x7f609419a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T05:35:15.788 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:15.792+0000 7f6099d89700 1 --2- 172.21.15.39:0/2736518809 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60941034c0 0x7f6094199d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T05:35:15.788 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:15.792+0000 7f609a58a700 1 --2- 172.21.15.39:0/2736518809 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6094108740 0x7f609419e570 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f608c005910 tx=0x7f608c009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:35:15.788 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:15.793+0000 7f6092ffd700 1 -- 172.21.15.39:0/2736518809 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f608c027070 con 0x7f6094108740 2024-05-09T05:35:15.788 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:15.793+0000 7f609bfed700 1 -- 172.21.15.39:0/2736518809 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f609419eea0 con 0x7f6094108740 2024-05-09T05:35:15.789 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:15.793+0000 7f6092ffd700 1 -- 172.21.15.39:0/2736518809 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f608c003fa0 con 0x7f6094108740 2024-05-09T05:35:15.789 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:15.793+0000 7f6092ffd700 1 -- 172.21.15.39:0/2736518809 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f608c022d10 con 0x7f6094108740 2024-05-09T05:35:15.789 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:15.793+0000 7f609bfed700 1 -- 172.21.15.39:0/2736518809 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60941a6820 con 0x7f6094108740 2024-05-09T05:35:15.789 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:15.794+0000 7f609bfed700 1 -- 172.21.15.39:0/2736518809 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6094104970 con 0x7f6094108740 2024-05-09T05:35:15.789 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:15.795+0000 7f6092ffd700 1 -- 172.21.15.39:0/2736518809 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f608c02a070 con 0x7f6094108740 2024-05-09T05:35:15.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:15.796+0000 7f6092ffd700 1 --2- 172.21.15.39:0/2736518809 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f607c0b2880 0x7f607c0b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:35:15.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:15.796+0000 7f6099d89700 1 --2- 172.21.15.39:0/2736518809 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f607c0b2880 0x7f607c0b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:35:15.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:15.796+0000 7f6092ffd700 1 -- 172.21.15.39:0/2736518809 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f608c0e3200 con 0x7f6094108740 2024-05-09T05:35:15.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:15.797+0000 7f6099d89700 1 --2- 172.21.15.39:0/2736518809 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f607c0b2880 0x7f607c0b4d90 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6084007fd0 tx=0x7f6084007830 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:35:15.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:15.800+0000 7f6092ffd700 1 -- 172.21.15.39:0/2736518809 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f608c013070 con 0x7f6094108740 2024-05-09T05:35:15.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:35:15 smithi060 ceph-mon[34555]: pgmap v304: 97 pgs: 97 active+clean; 582 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s rd, 2.0 KiB/s wr, 6 op/s 2024-05-09T05:35:15.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:35:15 smithi100 ceph-mon[34353]: pgmap v304: 97 pgs: 97 active+clean; 582 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s rd, 2.0 KiB/s wr, 6 op/s 2024-05-09T05:35:16.055 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:16.062+0000 7f609bfed700 1 -- 172.21.15.39:0/2736518809 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f609419b0a0 con 0x7f6094108740 2024-05-09T05:35:16.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:16.443+0000 7f6092ffd700 1 -- 172.21.15.39:0/2736518809 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v24) ==== 115+0+0 (secure 0 0 0) 0x7f608c0ab100 con 0x7f6094108740 2024-05-09T05:35:16.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:16.446+0000 7f609bfed700 1 -- 172.21.15.39:0/2736518809 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f607c0b2880 msgr2=0x7f607c0b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:35:16.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:16.446+0000 7f609bfed700 1 --2- 172.21.15.39:0/2736518809 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f607c0b2880 0x7f607c0b4d90 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6084007fd0 tx=0x7f6084007830 comp rx=0 tx=0).stop 2024-05-09T05:35:16.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:16.446+0000 7f609bfed700 1 -- 172.21.15.39:0/2736518809 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6094108740 msgr2=0x7f609419e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:35:16.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:16.446+0000 7f609bfed700 1 --2- 172.21.15.39:0/2736518809 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6094108740 0x7f609419e570 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f608c005910 tx=0x7f608c009580 comp rx=0 tx=0).stop 2024-05-09T05:35:16.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:16.446+0000 7f609bfed700 1 -- 172.21.15.39:0/2736518809 shutdown_connections 2024-05-09T05:35:16.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:16.446+0000 7f609bfed700 1 --2- 172.21.15.39:0/2736518809 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f607c0b2880 0x7f607c0b4d90 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:16.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:16.446+0000 7f609bfed700 1 --2- 172.21.15.39:0/2736518809 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6094108740 0x7f609419e570 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:16.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:16.446+0000 7f609bfed700 1 --2- 172.21.15.39:0/2736518809 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60941034c0 0x7f6094199d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:16.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:16.446+0000 7f609bfed700 1 --2- 172.21.15.39:0/2736518809 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6094107df0 0x7f609419a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:16.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:16.446+0000 7f609bfed700 1 -- 172.21.15.39:0/2736518809 >> 172.21.15.39:0/2736518809 conn(0x7f60940fedc0 msgr2=0x7f6094107560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:35:16.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:16.446+0000 7f609bfed700 1 -- 172.21.15.39:0/2736518809 shutdown_connections 2024-05-09T05:35:16.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:16.446+0000 7f609bfed700 1 -- 172.21.15.39:0/2736518809 wait complete. 2024-05-09T05:35:16.777 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:35:16 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/2736518809' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-05-09T05:35:16.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:35:16 smithi060 ceph-mon[34555]: from='client.? 172.21.15.39:0/2736518809' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-05-09T05:35:16.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:35:16 smithi100 ceph-mon[34353]: from='client.? 172.21.15.39:0/2736518809' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-05-09T05:35:17.142 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2} subvols for filesystem 'cephfs' 2024-05-09T05:35:17.142 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-05-09T05:35:17.397 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T05:35:17.772 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:35:17 smithi039 ceph-mon[30439]: pgmap v305: 97 pgs: 97 active+clean; 582 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 597 B/s rd, 2.0 KiB/s wr, 7 op/s 2024-05-09T05:35:17.772 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:35:17 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/2736518809' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-05-09T05:35:17.772 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:35:17 smithi039 ceph-mon[30439]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-09T05:35:17.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:35:17 smithi060 ceph-mon[34555]: pgmap v305: 97 pgs: 97 active+clean; 582 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 597 B/s rd, 2.0 KiB/s wr, 7 op/s 2024-05-09T05:35:17.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:35:17 smithi060 ceph-mon[34555]: from='client.? 172.21.15.39:0/2736518809' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-05-09T05:35:17.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:35:17 smithi060 ceph-mon[34555]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-09T05:35:17.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:35:17 smithi100 ceph-mon[34353]: pgmap v305: 97 pgs: 97 active+clean; 582 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 597 B/s rd, 2.0 KiB/s wr, 7 op/s 2024-05-09T05:35:17.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:35:17 smithi100 ceph-mon[34353]: from='client.? 172.21.15.39:0/2736518809' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-05-09T05:35:17.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:35:17 smithi100 ceph-mon[34353]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-09T05:35:19.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:19.138+0000 7f7e31475700 1 -- 172.21.15.39:0/1464295786 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7e2c1045d0 msgr2=0x7f7e2c1049e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:35:19.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:19.138+0000 7f7e31475700 1 --2- 172.21.15.39:0/1464295786 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7e2c1045d0 0x7f7e2c1049e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c00b0d0 tx=0x7f7e1c00b3e0 comp rx=0 tx=0).stop 2024-05-09T05:35:19.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:19.138+0000 7f7e31475700 1 -- 172.21.15.39:0/1464295786 shutdown_connections 2024-05-09T05:35:19.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:19.138+0000 7f7e31475700 1 --2- 172.21.15.39:0/1464295786 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e2c109850 0x7f7e2c1111b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:19.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:19.138+0000 7f7e31475700 1 --2- 172.21.15.39:0/1464295786 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7e2c1045d0 0x7f7e2c1049e0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:19.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:19.138+0000 7f7e31475700 1 --2- 172.21.15.39:0/1464295786 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e2c108f00 0x7f7e2c109310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:19.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:19.138+0000 7f7e31475700 1 -- 172.21.15.39:0/1464295786 >> 172.21.15.39:0/1464295786 conn(0x7f7e2c0ffea0 msgr2=0x7f7e2c1022f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:35:19.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:19.138+0000 7f7e31475700 1 -- 172.21.15.39:0/1464295786 shutdown_connections 2024-05-09T05:35:19.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:19.138+0000 7f7e31475700 1 -- 172.21.15.39:0/1464295786 wait complete. 2024-05-09T05:35:19.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:19.139+0000 7f7e31475700 1 Processor -- start 2024-05-09T05:35:19.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:19.140+0000 7f7e31475700 1 -- start start 2024-05-09T05:35:19.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:19.140+0000 7f7e31475700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e2c1045d0 0x7f7e2c19ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:35:19.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:19.140+0000 7f7e31475700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e2c108f00 0x7f7e2c19b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:35:19.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:19.140+0000 7f7e31475700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7e2c109850 0x7f7e2c19f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:35:19.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:19.140+0000 7f7e31475700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f7e2c1144d0 con 0x7f7e2c109850 2024-05-09T05:35:19.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:19.140+0000 7f7e31475700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f7e2c114350 con 0x7f7e2c1045d0 2024-05-09T05:35:19.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:19.140+0000 7f7e31475700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7e2c114650 con 0x7f7e2c108f00 2024-05-09T05:35:19.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:19.140+0000 7f7e2b7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7e2c109850 0x7f7e2c19f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:35:19.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:19.140+0000 7f7e2b7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7e2c109850 0x7f7e2c19f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:58084/0 (socket says 172.21.15.39:58084) 2024-05-09T05:35:19.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:19.140+0000 7f7e2b7fe700 1 -- 172.21.15.39:0/1365214398 learned_addr learned my addr 172.21.15.39:0/1365214398 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:35:19.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:19.140+0000 7f7e2affd700 1 --2- 172.21.15.39:0/1365214398 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e2c1045d0 0x7f7e2c19ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:35:19.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:19.140+0000 7f7e2a7fc700 1 --2- 172.21.15.39:0/1365214398 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e2c108f00 0x7f7e2c19b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:35:19.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:19.141+0000 7f7e2b7fe700 1 -- 172.21.15.39:0/1365214398 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e2c108f00 msgr2=0x7f7e2c19b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:35:19.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:19.141+0000 7f7e2b7fe700 1 --2- 172.21.15.39:0/1365214398 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e2c108f00 0x7f7e2c19b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:19.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:19.141+0000 7f7e2b7fe700 1 -- 172.21.15.39:0/1365214398 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e2c1045d0 msgr2=0x7f7e2c19ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:35:19.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:19.141+0000 7f7e2b7fe700 1 --2- 172.21.15.39:0/1365214398 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e2c1045d0 0x7f7e2c19ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:19.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:19.141+0000 7f7e2b7fe700 1 -- 172.21.15.39:0/1365214398 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e2c19fcf0 con 0x7f7e2c109850 2024-05-09T05:35:19.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:19.141+0000 7f7e2b7fe700 1 --2- 172.21.15.39:0/1365214398 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7e2c109850 0x7f7e2c19f650 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7e2400c970 tx=0x7f7e2400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:35:19.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:19.141+0000 7f7e23fff700 1 -- 172.21.15.39:0/1365214398 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e2400ce60 con 0x7f7e2c109850 2024-05-09T05:35:19.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:19.141+0000 7f7e23fff700 1 -- 172.21.15.39:0/1365214398 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7e24004830 con 0x7f7e2c109850 2024-05-09T05:35:19.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:19.141+0000 7f7e31475700 1 -- 172.21.15.39:0/1365214398 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e2c19ffe0 con 0x7f7e2c109850 2024-05-09T05:35:19.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:19.141+0000 7f7e23fff700 1 -- 172.21.15.39:0/1365214398 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e240054c0 con 0x7f7e2c109850 2024-05-09T05:35:19.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:19.141+0000 7f7e31475700 1 -- 172.21.15.39:0/1365214398 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e2c1a7900 con 0x7f7e2c109850 2024-05-09T05:35:19.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:19.142+0000 7f7e31475700 1 -- 172.21.15.39:0/1365214398 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e2c0512c0 con 0x7f7e2c109850 2024-05-09T05:35:19.139 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:19.144+0000 7f7e23fff700 1 -- 172.21.15.39:0/1365214398 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f7e240049e0 con 0x7f7e2c109850 2024-05-09T05:35:19.139 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:19.145+0000 7f7e23fff700 1 --2- 172.21.15.39:0/1365214398 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f7e180b2880 0x7f7e180b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:35:19.139 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:19.145+0000 7f7e2affd700 1 --2- 172.21.15.39:0/1365214398 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f7e180b2880 0x7f7e180b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:35:19.139 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:19.145+0000 7f7e23fff700 1 -- 172.21.15.39:0/1365214398 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f7e240e1ff0 con 0x7f7e2c109850 2024-05-09T05:35:19.139 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:19.145+0000 7f7e2affd700 1 --2- 172.21.15.39:0/1365214398 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f7e180b2880 0x7f7e180b4d90 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c009900 tx=0x7f7e1c00b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:35:19.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:19.148+0000 7f7e23fff700 1 -- 172.21.15.39:0/1365214398 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f7e24014030 con 0x7f7e2c109850 2024-05-09T05:35:19.388 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:19.394+0000 7f7e31475700 1 -- 172.21.15.39:0/1365214398 --> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f7e2c063c00 con 0x7f7e180b2880 2024-05-09T05:35:19.414 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:19.420+0000 7f7e23fff700 1 -- 172.21.15.39:0/1365214398 <== mgr.14152 v2:172.21.15.39:6800/3184189003 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f7e2c063c00 con 0x7f7e180b2880 2024-05-09T05:35:19.419 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:19.423+0000 7f7e31475700 1 -- 172.21.15.39:0/1365214398 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f7e180b2880 msgr2=0x7f7e180b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:35:19.419 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:19.423+0000 7f7e31475700 1 --2- 172.21.15.39:0/1365214398 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f7e180b2880 0x7f7e180b4d90 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c009900 tx=0x7f7e1c00b040 comp rx=0 tx=0).stop 2024-05-09T05:35:19.419 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:19.423+0000 7f7e31475700 1 -- 172.21.15.39:0/1365214398 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7e2c109850 msgr2=0x7f7e2c19f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:35:19.419 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:19.423+0000 7f7e31475700 1 --2- 172.21.15.39:0/1365214398 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7e2c109850 0x7f7e2c19f650 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7e2400c970 tx=0x7f7e2400cc80 comp rx=0 tx=0).stop 2024-05-09T05:35:19.419 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:19.423+0000 7f7e31475700 1 -- 172.21.15.39:0/1365214398 shutdown_connections 2024-05-09T05:35:19.419 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:19.423+0000 7f7e31475700 1 --2- 172.21.15.39:0/1365214398 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f7e180b2880 0x7f7e180b4d90 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:19.419 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:19.423+0000 7f7e31475700 1 --2- 172.21.15.39:0/1365214398 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7e2c109850 0x7f7e2c19f650 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:19.419 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:19.423+0000 7f7e31475700 1 --2- 172.21.15.39:0/1365214398 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e2c1045d0 0x7f7e2c19ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:19.419 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:19.423+0000 7f7e31475700 1 --2- 172.21.15.39:0/1365214398 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e2c108f00 0x7f7e2c19b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:19.420 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:19.423+0000 7f7e31475700 1 -- 172.21.15.39:0/1365214398 >> 172.21.15.39:0/1365214398 conn(0x7f7e2c0ffea0 msgr2=0x7f7e2c10a7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:35:19.420 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:19.423+0000 7f7e31475700 1 -- 172.21.15.39:0/1365214398 shutdown_connections 2024-05-09T05:35:19.420 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:19.423+0000 7f7e31475700 1 -- 172.21.15.39:0/1365214398 wait complete. 2024-05-09T05:35:19.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:35:19 smithi060 ceph-mon[34555]: pgmap v306: 97 pgs: 97 active+clean; 582 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2.0 KiB/s wr, 7 op/s 2024-05-09T05:35:19.797 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:35:19 smithi039 ceph-mon[30439]: pgmap v306: 97 pgs: 97 active+clean; 582 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2.0 KiB/s wr, 7 op/s 2024-05-09T05:35:19.797 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:35:19 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: 2024-05-09T05:35:19.400+0000 7fcaf228a700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-09T05:35:19.797 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:35:19 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: 2024-05-09T05:35:19.400+0000 7fcaf228a700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-09T05:35:19.797 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:35:19 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: 2024-05-09T05:35:19.400+0000 7fcaf228a700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-09T05:35:19.797 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:35:19 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: 2024-05-09T05:35:19.400+0000 7fcaf228a700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-09T05:35:19.797 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:35:19 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: 2024-05-09T05:35:19.400+0000 7fcaf228a700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-09T05:35:19.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:35:19 smithi100 ceph-mon[34353]: pgmap v306: 97 pgs: 97 active+clean; 582 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2.0 KiB/s wr, 7 op/s 2024-05-09T05:35:20.133 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-05-09T05:35:20.393 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T05:35:20.729 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:35:20 smithi039 ceph-mon[30439]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T05:35:20.749 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:35:20 smithi100 ceph-mon[34353]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T05:35:20.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:35:20 smithi060 ceph-mon[34555]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T05:35:21.776 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:35:21 smithi039 ceph-mon[30439]: pgmap v307: 97 pgs: 97 active+clean; 582 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 2.0 KiB/s wr, 10 op/s 2024-05-09T05:35:21.776 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:35:21 smithi039 ceph-mon[30439]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-05-09T05:35:21.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:35:21 smithi060 ceph-mon[34555]: pgmap v307: 97 pgs: 97 active+clean; 582 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 2.0 KiB/s wr, 10 op/s 2024-05-09T05:35:21.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:35:21 smithi060 ceph-mon[34555]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-05-09T05:35:21.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:35:21 smithi100 ceph-mon[34353]: pgmap v307: 97 pgs: 97 active+clean; 582 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 2.0 KiB/s wr, 10 op/s 2024-05-09T05:35:21.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:35:21 smithi100 ceph-mon[34353]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-05-09T05:35:22.125 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:22.130+0000 7f50d5e96700 1 -- 172.21.15.39:0/2182831637 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f50d01034c0 msgr2=0x7f50d01038d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:35:22.125 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:22.130+0000 7f50d5e96700 1 --2- 172.21.15.39:0/2182831637 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f50d01034c0 0x7f50d01038d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f50c800b0d0 tx=0x7f50c800b3e0 comp rx=0 tx=0).stop 2024-05-09T05:35:22.125 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:22.131+0000 7f50d5e96700 1 -- 172.21.15.39:0/2182831637 shutdown_connections 2024-05-09T05:35:22.125 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:22.131+0000 7f50d5e96700 1 --2- 172.21.15.39:0/2182831637 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50d0108740 0x7f50d01100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:22.125 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:22.131+0000 7f50d5e96700 1 --2- 172.21.15.39:0/2182831637 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f50d01034c0 0x7f50d01038d0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:22.125 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:22.131+0000 7f50d5e96700 1 --2- 172.21.15.39:0/2182831637 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50d0107df0 0x7f50d0108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:22.125 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:22.131+0000 7f50d5e96700 1 -- 172.21.15.39:0/2182831637 >> 172.21.15.39:0/2182831637 conn(0x7f50d00fedc0 msgr2=0x7f50d01011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:35:22.125 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:22.131+0000 7f50d5e96700 1 -- 172.21.15.39:0/2182831637 shutdown_connections 2024-05-09T05:35:22.126 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:22.131+0000 7f50d5e96700 1 -- 172.21.15.39:0/2182831637 wait complete. 2024-05-09T05:35:22.127 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:22.131+0000 7f50d5e96700 1 Processor -- start 2024-05-09T05:35:22.127 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:22.132+0000 7f50d5e96700 1 -- start start 2024-05-09T05:35:22.127 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:22.132+0000 7f50d5e96700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f50d01034c0 0x7f50d019bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:35:22.128 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:22.132+0000 7f50d5e96700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50d0107df0 0x7f50d019c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:35:22.128 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:22.132+0000 7f50d5e96700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50d0108740 0x7f50d019c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:35:22.128 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:22.132+0000 7f50d5e96700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f50d0113370 con 0x7f50d01034c0 2024-05-09T05:35:22.128 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:22.132+0000 7f50d5e96700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f50d01131f0 con 0x7f50d0108740 2024-05-09T05:35:22.128 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:22.132+0000 7f50d5e96700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f50d01134f0 con 0x7f50d0107df0 2024-05-09T05:35:22.128 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:22.132+0000 7f50cf7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f50d01034c0 0x7f50d019bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:35:22.128 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:22.132+0000 7f50cf7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f50d01034c0 0x7f50d019bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:58116/0 (socket says 172.21.15.39:58116) 2024-05-09T05:35:22.128 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:22.132+0000 7f50cf7fe700 1 -- 172.21.15.39:0/3949791263 learned_addr learned my addr 172.21.15.39:0/3949791263 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:35:22.128 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:22.132+0000 7f50ceffd700 1 --2- 172.21.15.39:0/3949791263 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50d0107df0 0x7f50d019c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:35:22.128 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:22.132+0000 7f50cffff700 1 --2- 172.21.15.39:0/3949791263 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50d0108740 0x7f50d019c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:35:22.128 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:22.133+0000 7f50cf7fe700 1 -- 172.21.15.39:0/3949791263 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50d0107df0 msgr2=0x7f50d019c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:35:22.128 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:22.133+0000 7f50cf7fe700 1 --2- 172.21.15.39:0/3949791263 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50d0107df0 0x7f50d019c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:22.129 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:22.133+0000 7f50cf7fe700 1 -- 172.21.15.39:0/3949791263 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50d0108740 msgr2=0x7f50d019c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:35:22.129 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:22.133+0000 7f50cf7fe700 1 --2- 172.21.15.39:0/3949791263 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50d0108740 0x7f50d019c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:22.129 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:22.133+0000 7f50cf7fe700 1 -- 172.21.15.39:0/3949791263 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50d0199a60 con 0x7f50d01034c0 2024-05-09T05:35:22.129 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:22.133+0000 7f50cf7fe700 1 --2- 172.21.15.39:0/3949791263 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f50d01034c0 0x7f50d019bc70 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f50c800d010 tx=0x7f50c8007a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:35:22.129 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:22.133+0000 7f50ccff9700 1 -- 172.21.15.39:0/3949791263 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50c801f070 con 0x7f50d01034c0 2024-05-09T05:35:22.129 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:22.133+0000 7f50ccff9700 1 -- 172.21.15.39:0/3949791263 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f50c8007e50 con 0x7f50d01034c0 2024-05-09T05:35:22.129 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:22.133+0000 7f50d5e96700 1 -- 172.21.15.39:0/3949791263 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50d0199cf0 con 0x7f50d01034c0 2024-05-09T05:35:22.129 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:22.133+0000 7f50ccff9700 1 -- 172.21.15.39:0/3949791263 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50c801b4a0 con 0x7f50d01034c0 2024-05-09T05:35:22.129 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:22.133+0000 7f50d5e96700 1 -- 172.21.15.39:0/3949791263 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50d019a1d0 con 0x7f50d01034c0 2024-05-09T05:35:22.130 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:22.134+0000 7f50d5e96700 1 -- 172.21.15.39:0/3949791263 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50d00512c0 con 0x7f50d01034c0 2024-05-09T05:35:22.130 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:22.136+0000 7f50ccff9700 1 -- 172.21.15.39:0/3949791263 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f50c8022070 con 0x7f50d01034c0 2024-05-09T05:35:22.131 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:22.137+0000 7f50ccff9700 1 --2- 172.21.15.39:0/3949791263 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f50bc0b2910 0x7f50bc0b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:35:22.131 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:22.137+0000 7f50ceffd700 1 --2- 172.21.15.39:0/3949791263 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f50bc0b2910 0x7f50bc0b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:35:22.131 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:22.137+0000 7f50ccff9700 1 -- 172.21.15.39:0/3949791263 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f50c800f020 con 0x7f50d01034c0 2024-05-09T05:35:22.131 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:22.138+0000 7f50ceffd700 1 --2- 172.21.15.39:0/3949791263 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f50bc0b2910 0x7f50bc0b4e20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f50d0106850 tx=0x7f50b800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:35:22.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:22.141+0000 7f50ccff9700 1 -- 172.21.15.39:0/3949791263 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f50c8029020 con 0x7f50d01034c0 2024-05-09T05:35:22.387 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:22.393+0000 7f50d5e96700 1 -- 172.21.15.39:0/3949791263 --> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f50d0063c00 con 0x7f50bc0b2910 2024-05-09T05:35:22.420 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:22.426+0000 7f50ccff9700 1 -- 172.21.15.39:0/3949791263 <== mgr.14152 v2:172.21.15.39:6800/3184189003 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f50d0063c00 con 0x7f50bc0b2910 2024-05-09T05:35:22.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:22.428+0000 7f50d5e96700 1 -- 172.21.15.39:0/3949791263 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f50bc0b2910 msgr2=0x7f50bc0b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:35:22.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:22.428+0000 7f50d5e96700 1 --2- 172.21.15.39:0/3949791263 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f50bc0b2910 0x7f50bc0b4e20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f50d0106850 tx=0x7f50b800b410 comp rx=0 tx=0).stop 2024-05-09T05:35:22.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:22.428+0000 7f50d5e96700 1 -- 172.21.15.39:0/3949791263 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f50d01034c0 msgr2=0x7f50d019bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:35:22.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:22.428+0000 7f50d5e96700 1 --2- 172.21.15.39:0/3949791263 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f50d01034c0 0x7f50d019bc70 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f50c800d010 tx=0x7f50c8007a20 comp rx=0 tx=0).stop 2024-05-09T05:35:22.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:22.428+0000 7f50d5e96700 1 -- 172.21.15.39:0/3949791263 shutdown_connections 2024-05-09T05:35:22.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:22.428+0000 7f50d5e96700 1 --2- 172.21.15.39:0/3949791263 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f50bc0b2910 0x7f50bc0b4e20 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:22.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:22.428+0000 7f50d5e96700 1 --2- 172.21.15.39:0/3949791263 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50d0108740 0x7f50d019c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:22.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:22.428+0000 7f50d5e96700 1 --2- 172.21.15.39:0/3949791263 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f50d01034c0 0x7f50d019bc70 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:22.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:22.428+0000 7f50d5e96700 1 --2- 172.21.15.39:0/3949791263 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50d0107df0 0x7f50d019c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:22.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:22.428+0000 7f50d5e96700 1 -- 172.21.15.39:0/3949791263 >> 172.21.15.39:0/3949791263 conn(0x7f50d00fedc0 msgr2=0x7f50d01011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:35:22.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:22.429+0000 7f50d5e96700 1 -- 172.21.15.39:0/3949791263 shutdown_connections 2024-05-09T05:35:22.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:22.429+0000 7f50d5e96700 1 -- 172.21.15.39:0/3949791263 wait complete. 2024-05-09T05:35:23.153 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-05-09T05:35:23.412 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T05:35:23.729 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:35:23 smithi039 ceph-mon[30439]: pgmap v308: 97 pgs: 97 active+clean; 582 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 2.1 KiB/s wr, 11 op/s 2024-05-09T05:35:23.729 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:35:23 smithi039 ceph-mon[30439]: from='client.14712 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T05:35:23.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:35:23 smithi060 ceph-mon[34555]: pgmap v308: 97 pgs: 97 active+clean; 582 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 2.1 KiB/s wr, 11 op/s 2024-05-09T05:35:23.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:35:23 smithi060 ceph-mon[34555]: from='client.14712 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T05:35:23.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:35:23 smithi100 ceph-mon[34353]: pgmap v308: 97 pgs: 97 active+clean; 582 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 2.1 KiB/s wr, 11 op/s 2024-05-09T05:35:23.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:35:23 smithi100 ceph-mon[34353]: from='client.14712 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T05:35:25.021 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:25.026+0000 7f3c803b5700 1 -- 172.21.15.39:0/3818901188 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3c78108780 msgr2=0x7f3c781100e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:35:25.021 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:25.026+0000 7f3c803b5700 1 --2- 172.21.15.39:0/3818901188 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3c78108780 0x7f3c781100e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3c700099c0 tx=0x7f3c70009cd0 comp rx=0 tx=0).stop 2024-05-09T05:35:25.021 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:25.026+0000 7f3c803b5700 1 -- 172.21.15.39:0/3818901188 shutdown_connections 2024-05-09T05:35:25.021 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:25.026+0000 7f3c803b5700 1 --2- 172.21.15.39:0/3818901188 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3c78108780 0x7f3c781100e0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:25.021 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:25.026+0000 7f3c803b5700 1 --2- 172.21.15.39:0/3818901188 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c78103550 0x7f3c78103960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:25.021 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:25.026+0000 7f3c803b5700 1 --2- 172.21.15.39:0/3818901188 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c78107e30 0x7f3c78108240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:25.021 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:25.026+0000 7f3c803b5700 1 -- 172.21.15.39:0/3818901188 >> 172.21.15.39:0/3818901188 conn(0x7f3c78078e00 msgr2=0x7f3c78079240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:35:25.021 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:25.026+0000 7f3c803b5700 1 -- 172.21.15.39:0/3818901188 shutdown_connections 2024-05-09T05:35:25.021 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:25.026+0000 7f3c803b5700 1 -- 172.21.15.39:0/3818901188 wait complete. 2024-05-09T05:35:25.021 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:25.027+0000 7f3c803b5700 1 Processor -- start 2024-05-09T05:35:25.021 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:25.027+0000 7f3c803b5700 1 -- start start 2024-05-09T05:35:25.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:25.027+0000 7f3c803b5700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c78103550 0x7f3c781a70f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:35:25.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:25.027+0000 7f3c803b5700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3c78107e30 0x7f3c781a7630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:35:25.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:25.028+0000 7f3c803b5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c78108780 0x7f3c781a1330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:35:25.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:25.028+0000 7f3c803b5700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f3c78113480 con 0x7f3c78107e30 2024-05-09T05:35:25.024 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:25.028+0000 7f3c803b5700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f3c78113300 con 0x7f3c78108780 2024-05-09T05:35:25.024 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:25.028+0000 7f3c803b5700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3c78113600 con 0x7f3c78103550 2024-05-09T05:35:25.024 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:25.028+0000 7f3c7d950700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3c78107e30 0x7f3c781a7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:35:25.024 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:25.028+0000 7f3c7d950700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3c78107e30 0x7f3c781a7630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:58138/0 (socket says 172.21.15.39:58138) 2024-05-09T05:35:25.024 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:25.028+0000 7f3c7d950700 1 -- 172.21.15.39:0/1121998570 learned_addr learned my addr 172.21.15.39:0/1121998570 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:35:25.024 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:25.028+0000 7f3c7e151700 1 --2- 172.21.15.39:0/1121998570 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c78103550 0x7f3c781a70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:35:25.024 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:25.028+0000 7f3c7e952700 1 --2- 172.21.15.39:0/1121998570 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c78108780 0x7f3c781a1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:35:25.024 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:25.028+0000 7f3c7d950700 1 -- 172.21.15.39:0/1121998570 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c78103550 msgr2=0x7f3c781a70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:35:25.024 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:25.028+0000 7f3c7d950700 1 --2- 172.21.15.39:0/1121998570 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c78103550 0x7f3c781a70f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:25.024 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:25.028+0000 7f3c7d950700 1 -- 172.21.15.39:0/1121998570 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c78108780 msgr2=0x7f3c781a1330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:35:25.024 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:25.028+0000 7f3c7d950700 1 --2- 172.21.15.39:0/1121998570 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c78108780 0x7f3c781a1330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:25.024 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:25.028+0000 7f3c7d950700 1 -- 172.21.15.39:0/1121998570 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c781a1a60 con 0x7f3c78107e30 2024-05-09T05:35:25.024 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:25.028+0000 7f3c7d950700 1 --2- 172.21.15.39:0/1121998570 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3c78107e30 0x7f3c781a7630 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f3c6800d980 tx=0x7f3c6800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:35:25.025 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:25.029+0000 7f3c6f7fe700 1 -- 172.21.15.39:0/1121998570 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c68017070 con 0x7f3c78107e30 2024-05-09T05:35:25.025 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:25.029+0000 7f3c6f7fe700 1 -- 172.21.15.39:0/1121998570 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3c6800fd40 con 0x7f3c78107e30 2024-05-09T05:35:25.025 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:25.029+0000 7f3c803b5700 1 -- 172.21.15.39:0/1121998570 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c781a1d50 con 0x7f3c78107e30 2024-05-09T05:35:25.025 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:25.029+0000 7f3c6f7fe700 1 -- 172.21.15.39:0/1121998570 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c6800e3b0 con 0x7f3c78107e30 2024-05-09T05:35:25.025 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:25.029+0000 7f3c803b5700 1 -- 172.21.15.39:0/1121998570 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c781adf50 con 0x7f3c78107e30 2024-05-09T05:35:25.025 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:25.030+0000 7f3c803b5700 1 -- 172.21.15.39:0/1121998570 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c780512c0 con 0x7f3c78107e30 2024-05-09T05:35:25.026 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:25.031+0000 7f3c6f7fe700 1 -- 172.21.15.39:0/1121998570 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f3c68010610 con 0x7f3c78107e30 2024-05-09T05:35:25.026 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:25.032+0000 7f3c6f7fe700 1 --2- 172.21.15.39:0/1121998570 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f3c640b2910 0x7f3c640b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:35:25.026 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:25.032+0000 7f3c7e151700 1 --2- 172.21.15.39:0/1121998570 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f3c640b2910 0x7f3c640b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:35:25.026 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:25.032+0000 7f3c6f7fe700 1 -- 172.21.15.39:0/1121998570 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f3c680e1b80 con 0x7f3c78107e30 2024-05-09T05:35:25.026 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:25.033+0000 7f3c7e151700 1 --2- 172.21.15.39:0/1121998570 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f3c640b2910 0x7f3c640b4e20 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3c7400a400 tx=0x7f3c7400d040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:35:25.029 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:25.036+0000 7f3c6f7fe700 1 -- 172.21.15.39:0/1121998570 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f3c680a98f0 con 0x7f3c78107e30 2024-05-09T05:35:25.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:25.285+0000 7f3c803b5700 1 -- 172.21.15.39:0/1121998570 --> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f3c781023f0 con 0x7f3c640b2910 2024-05-09T05:35:25.284 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:25.290+0000 7f3c6f7fe700 1 -- 172.21.15.39:0/1121998570 <== mgr.14152 v2:172.21.15.39:6800/3184189003 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f3c781023f0 con 0x7f3c640b2910 2024-05-09T05:35:25.284 INFO:teuthology.orchestra.run.smithi039.stdout:/volumes/qa/sv_0/a06fa199-70e5-437b-b692-19489e93e422 2024-05-09T05:35:25.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:25.292+0000 7f3c803b5700 1 -- 172.21.15.39:0/1121998570 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f3c640b2910 msgr2=0x7f3c640b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:35:25.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:25.292+0000 7f3c803b5700 1 --2- 172.21.15.39:0/1121998570 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f3c640b2910 0x7f3c640b4e20 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3c7400a400 tx=0x7f3c7400d040 comp rx=0 tx=0).stop 2024-05-09T05:35:25.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:25.292+0000 7f3c803b5700 1 -- 172.21.15.39:0/1121998570 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3c78107e30 msgr2=0x7f3c781a7630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:35:25.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:25.292+0000 7f3c803b5700 1 --2- 172.21.15.39:0/1121998570 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3c78107e30 0x7f3c781a7630 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f3c6800d980 tx=0x7f3c6800dc90 comp rx=0 tx=0).stop 2024-05-09T05:35:25.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:25.292+0000 7f3c803b5700 1 -- 172.21.15.39:0/1121998570 shutdown_connections 2024-05-09T05:35:25.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:25.292+0000 7f3c803b5700 1 --2- 172.21.15.39:0/1121998570 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f3c640b2910 0x7f3c640b4e20 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:25.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:25.292+0000 7f3c803b5700 1 --2- 172.21.15.39:0/1121998570 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c78108780 0x7f3c781a1330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:25.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:25.292+0000 7f3c803b5700 1 --2- 172.21.15.39:0/1121998570 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c78103550 0x7f3c781a70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:25.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:25.292+0000 7f3c803b5700 1 --2- 172.21.15.39:0/1121998570 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3c78107e30 0x7f3c781a7630 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:25.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:25.292+0000 7f3c803b5700 1 -- 172.21.15.39:0/1121998570 >> 172.21.15.39:0/1121998570 conn(0x7f3c78078e00 msgr2=0x7f3c78100cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:35:25.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:25.293+0000 7f3c803b5700 1 -- 172.21.15.39:0/1121998570 shutdown_connections 2024-05-09T05:35:25.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:25.293+0000 7f3c803b5700 1 -- 172.21.15.39:0/1121998570 wait complete. 2024-05-09T05:35:25.605 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:35:25 smithi039 ceph-mon[30439]: pgmap v309: 97 pgs: 97 active+clean; 602 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 3.2 KiB/s wr, 10 op/s 2024-05-09T05:35:25.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:35:25 smithi060 ceph-mon[34555]: pgmap v309: 97 pgs: 97 active+clean; 602 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 3.2 KiB/s wr, 10 op/s 2024-05-09T05:35:25.893 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-05-09T05:35:25.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:35:25 smithi100 ceph-mon[34353]: pgmap v309: 97 pgs: 97 active+clean; 602 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 3.2 KiB/s wr, 10 op/s 2024-05-09T05:35:26.150 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T05:35:26.541 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:35:26 smithi039 ceph-mon[30439]: from='client.14718 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T05:35:26.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:35:26 smithi060 ceph-mon[34555]: from='client.14718 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T05:35:26.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:35:26 smithi100 ceph-mon[34353]: from='client.14718 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T05:35:27.731 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:35:27 smithi039 ceph-mon[30439]: pgmap v310: 97 pgs: 97 active+clean; 602 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 2.2 KiB/s wr, 8 op/s 2024-05-09T05:35:27.753 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:27.760+0000 7f3ace442700 1 -- 172.21.15.39:0/2601632127 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3ac8107df0 msgr2=0x7f3ac8108200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:35:27.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:27.760+0000 7f3ace442700 1 --2- 172.21.15.39:0/2601632127 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3ac8107df0 0x7f3ac8108200 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f3ab00099c0 tx=0x7f3ab0009cd0 comp rx=0 tx=0).stop 2024-05-09T05:35:27.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:27.760+0000 7f3ace442700 1 -- 172.21.15.39:0/2601632127 shutdown_connections 2024-05-09T05:35:27.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:27.760+0000 7f3ace442700 1 --2- 172.21.15.39:0/2601632127 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ac8108740 0x7f3ac81100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:27.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:27.760+0000 7f3ace442700 1 --2- 172.21.15.39:0/2601632127 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ac81034c0 0x7f3ac81038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:27.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:27.760+0000 7f3ace442700 1 --2- 172.21.15.39:0/2601632127 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3ac8107df0 0x7f3ac8108200 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:27.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:27.760+0000 7f3ace442700 1 -- 172.21.15.39:0/2601632127 >> 172.21.15.39:0/2601632127 conn(0x7f3ac80fedf0 msgr2=0x7f3ac8101210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:35:27.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:27.760+0000 7f3ace442700 1 -- 172.21.15.39:0/2601632127 shutdown_connections 2024-05-09T05:35:27.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:27.760+0000 7f3ace442700 1 -- 172.21.15.39:0/2601632127 wait complete. 2024-05-09T05:35:27.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:27.761+0000 7f3ace442700 1 Processor -- start 2024-05-09T05:35:27.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:27.761+0000 7f3ace442700 1 -- start start 2024-05-09T05:35:27.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:27.761+0000 7f3ace442700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3ac81034c0 0x7f3ac819ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:35:27.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:27.761+0000 7f3ace442700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ac8107df0 0x7f3ac819b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:35:27.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:27.761+0000 7f3ace442700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ac8108740 0x7f3ac819f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:35:27.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:27.761+0000 7f3ace442700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f3ac8113350 con 0x7f3ac81034c0 2024-05-09T05:35:27.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:27.761+0000 7f3ace442700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f3ac81131d0 con 0x7f3ac8107df0 2024-05-09T05:35:27.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:27.761+0000 7f3ace442700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3ac81134d0 con 0x7f3ac8108740 2024-05-09T05:35:27.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:27.761+0000 7f3ac7fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3ac81034c0 0x7f3ac819ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:35:27.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:27.761+0000 7f3ac7fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3ac81034c0 0x7f3ac819ae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44536/0 (socket says 172.21.15.39:44536) 2024-05-09T05:35:27.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:27.761+0000 7f3ac7fff700 1 -- 172.21.15.39:0/4011354201 learned_addr learned my addr 172.21.15.39:0/4011354201 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:35:27.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:27.761+0000 7f3abffff700 1 --2- 172.21.15.39:0/4011354201 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ac8107df0 0x7f3ac819b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:35:27.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:27.761+0000 7f3ac7fff700 1 -- 172.21.15.39:0/4011354201 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ac8108740 msgr2=0x7f3ac819f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:35:27.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:27.761+0000 7f3acc9df700 1 --2- 172.21.15.39:0/4011354201 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ac8108740 0x7f3ac819f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:35:27.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:27.761+0000 7f3ac7fff700 1 --2- 172.21.15.39:0/4011354201 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ac8108740 0x7f3ac819f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:27.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:27.761+0000 7f3ac7fff700 1 -- 172.21.15.39:0/4011354201 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ac8107df0 msgr2=0x7f3ac819b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:35:27.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:27.761+0000 7f3ac7fff700 1 --2- 172.21.15.39:0/4011354201 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ac8107df0 0x7f3ac819b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:27.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:27.761+0000 7f3ac7fff700 1 -- 172.21.15.39:0/4011354201 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ac819fce0 con 0x7f3ac81034c0 2024-05-09T05:35:27.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:27.761+0000 7f3abffff700 1 --2- 172.21.15.39:0/4011354201 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ac8107df0 0x7f3ac819b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T05:35:27.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:27.761+0000 7f3acc9df700 1 --2- 172.21.15.39:0/4011354201 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ac8108740 0x7f3ac819f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:35:27.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:27.762+0000 7f3ac7fff700 1 --2- 172.21.15.39:0/4011354201 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3ac81034c0 0x7f3ac819ae10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f3ab800e9a0 tx=0x7f3ab800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:35:27.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:27.762+0000 7f3ac5ffb700 1 -- 172.21.15.39:0/4011354201 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ab800cbd0 con 0x7f3ac81034c0 2024-05-09T05:35:27.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:27.762+0000 7f3ac5ffb700 1 -- 172.21.15.39:0/4011354201 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3ab800cd70 con 0x7f3ac81034c0 2024-05-09T05:35:27.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:27.762+0000 7f3ac5ffb700 1 -- 172.21.15.39:0/4011354201 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ab8018680 con 0x7f3ac81034c0 2024-05-09T05:35:27.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:27.762+0000 7f3ace442700 1 -- 172.21.15.39:0/4011354201 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ac819ffd0 con 0x7f3ac81034c0 2024-05-09T05:35:27.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:27.762+0000 7f3ace442700 1 -- 172.21.15.39:0/4011354201 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ac81a78f0 con 0x7f3ac81034c0 2024-05-09T05:35:27.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:27.763+0000 7f3ace442700 1 -- 172.21.15.39:0/4011354201 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ac80512c0 con 0x7f3ac81034c0 2024-05-09T05:35:27.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:27.764+0000 7f3ac5ffb700 1 -- 172.21.15.39:0/4011354201 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f3ab8010970 con 0x7f3ac81034c0 2024-05-09T05:35:27.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:27.765+0000 7f3ac5ffb700 1 --2- 172.21.15.39:0/4011354201 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f3ab40b2910 0x7f3ab40b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:35:27.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:27.766+0000 7f3abffff700 1 --2- 172.21.15.39:0/4011354201 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f3ab40b2910 0x7f3ab40b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:35:27.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:27.766+0000 7f3ac5ffb700 1 -- 172.21.15.39:0/4011354201 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f3ab80e2b10 con 0x7f3ac81034c0 2024-05-09T05:35:27.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:27.766+0000 7f3abffff700 1 --2- 172.21.15.39:0/4011354201 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f3ab40b2910 0x7f3ab40b4e20 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3ab0000c00 tx=0x7f3ab001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:35:27.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:27.769+0000 7f3ac5ffb700 1 -- 172.21.15.39:0/4011354201 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f3ab80aa780 con 0x7f3ac81034c0 2024-05-09T05:35:27.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:35:27 smithi060 ceph-mon[34555]: pgmap v310: 97 pgs: 97 active+clean; 602 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 2.2 KiB/s wr, 8 op/s 2024-05-09T05:35:27.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:35:27 smithi100 ceph-mon[34353]: pgmap v310: 97 pgs: 97 active+clean; 602 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 2.2 KiB/s wr, 8 op/s 2024-05-09T05:35:28.010 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:28.014+0000 7f3ace442700 1 -- 172.21.15.39:0/4011354201 --> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f3ac8063c00 con 0x7f3ab40b2910 2024-05-09T05:35:28.040 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:28.047+0000 7f3ac5ffb700 1 -- 172.21.15.39:0/4011354201 <== mgr.14152 v2:172.21.15.39:6800/3184189003 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f3ac8063c00 con 0x7f3ab40b2910 2024-05-09T05:35:28.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:28.049+0000 7f3ace442700 1 -- 172.21.15.39:0/4011354201 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f3ab40b2910 msgr2=0x7f3ab40b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:35:28.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:28.049+0000 7f3ace442700 1 --2- 172.21.15.39:0/4011354201 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f3ab40b2910 0x7f3ab40b4e20 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3ab0000c00 tx=0x7f3ab001a040 comp rx=0 tx=0).stop 2024-05-09T05:35:28.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:28.049+0000 7f3ace442700 1 -- 172.21.15.39:0/4011354201 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3ac81034c0 msgr2=0x7f3ac819ae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:35:28.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:28.049+0000 7f3ace442700 1 --2- 172.21.15.39:0/4011354201 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3ac81034c0 0x7f3ac819ae10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f3ab800e9a0 tx=0x7f3ab800ed60 comp rx=0 tx=0).stop 2024-05-09T05:35:28.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:28.049+0000 7f3ace442700 1 -- 172.21.15.39:0/4011354201 shutdown_connections 2024-05-09T05:35:28.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:28.049+0000 7f3ace442700 1 --2- 172.21.15.39:0/4011354201 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f3ab40b2910 0x7f3ab40b4e20 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:28.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:28.049+0000 7f3ace442700 1 --2- 172.21.15.39:0/4011354201 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ac8108740 0x7f3ac819f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:28.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:28.049+0000 7f3ace442700 1 --2- 172.21.15.39:0/4011354201 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3ac81034c0 0x7f3ac819ae10 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:28.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:28.049+0000 7f3ace442700 1 --2- 172.21.15.39:0/4011354201 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ac8107df0 0x7f3ac819b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:28.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:28.049+0000 7f3ace442700 1 -- 172.21.15.39:0/4011354201 >> 172.21.15.39:0/4011354201 conn(0x7f3ac80fedf0 msgr2=0x7f3ac8075d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:35:28.044 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:28.049+0000 7f3ace442700 1 -- 172.21.15.39:0/4011354201 shutdown_connections 2024-05-09T05:35:28.044 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:28.049+0000 7f3ace442700 1 -- 172.21.15.39:0/4011354201 wait complete. 2024-05-09T05:35:28.653 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:35:28 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]: dispatch 2024-05-09T05:35:28.653 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:35:28 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]: dispatch 2024-05-09T05:35:28.653 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:35:28 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]: dispatch 2024-05-09T05:35:28.653 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:35:28 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]: dispatch 2024-05-09T05:35:28.653 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:35:28 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]: dispatch 2024-05-09T05:35:28.653 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:35:28 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]}]: dispatch 2024-05-09T05:35:28.654 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:35:28 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]: dispatch 2024-05-09T05:35:28.654 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:35:28 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]: dispatch 2024-05-09T05:35:28.680 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-05-09T05:35:28.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:35:28 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]: dispatch 2024-05-09T05:35:28.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:35:28 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]: dispatch 2024-05-09T05:35:28.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:35:28 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]: dispatch 2024-05-09T05:35:28.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:35:28 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]: dispatch 2024-05-09T05:35:28.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:35:28 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]: dispatch 2024-05-09T05:35:28.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:35:28 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]}]: dispatch 2024-05-09T05:35:28.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:35:28 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]: dispatch 2024-05-09T05:35:28.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:35:28 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]: dispatch 2024-05-09T05:35:28.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:35:28 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]: dispatch 2024-05-09T05:35:28.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:35:28 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]: dispatch 2024-05-09T05:35:28.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:35:28 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]: dispatch 2024-05-09T05:35:28.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:35:28 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]: dispatch 2024-05-09T05:35:28.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:35:28 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]: dispatch 2024-05-09T05:35:28.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:35:28 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]}]: dispatch 2024-05-09T05:35:28.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:35:28 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]: dispatch 2024-05-09T05:35:28.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:35:28 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]: dispatch 2024-05-09T05:35:28.934 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T05:35:29.751 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:35:29 smithi039 ceph-mon[30439]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T05:35:29.751 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:35:29 smithi039 ceph-mon[30439]: pgmap v311: 97 pgs: 97 active+clean; 602 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 2.3 KiB/s wr, 8 op/s 2024-05-09T05:35:29.751 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:35:29 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2024-05-09T05:35:29.751 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:35:29 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]': finished 2024-05-09T05:35:29.751 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:35:29 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2024-05-09T05:35:29.751 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:35:29 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]': finished 2024-05-09T05:35:29.751 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:35:29 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2024-05-09T05:35:29.751 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:35:29 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]}]': finished 2024-05-09T05:35:29.751 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:35:29 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]': finished 2024-05-09T05:35:29.751 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:35:29 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2024-05-09T05:35:29.752 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:35:29 smithi039 ceph-mon[30439]: osdmap e82: 12 total, 12 up, 12 in 2024-05-09T05:35:29.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:35:29 smithi060 ceph-mon[34555]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T05:35:29.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:35:29 smithi060 ceph-mon[34555]: pgmap v311: 97 pgs: 97 active+clean; 602 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 2.3 KiB/s wr, 8 op/s 2024-05-09T05:35:29.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:35:29 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2024-05-09T05:35:29.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:35:29 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]': finished 2024-05-09T05:35:29.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:35:29 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2024-05-09T05:35:29.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:35:29 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]': finished 2024-05-09T05:35:29.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:35:29 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2024-05-09T05:35:29.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:35:29 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]}]': finished 2024-05-09T05:35:29.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:35:29 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]': finished 2024-05-09T05:35:29.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:35:29 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2024-05-09T05:35:29.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:35:29 smithi060 ceph-mon[34555]: osdmap e82: 12 total, 12 up, 12 in 2024-05-09T05:35:29.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:35:29 smithi100 ceph-mon[34353]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T05:35:29.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:35:29 smithi100 ceph-mon[34353]: pgmap v311: 97 pgs: 97 active+clean; 602 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 2.3 KiB/s wr, 8 op/s 2024-05-09T05:35:29.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:35:29 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2024-05-09T05:35:29.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:35:29 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]': finished 2024-05-09T05:35:29.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:35:29 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2024-05-09T05:35:29.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:35:29 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]': finished 2024-05-09T05:35:29.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:35:29 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2024-05-09T05:35:29.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:35:29 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [5, 9]}]': finished 2024-05-09T05:35:29.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:35:29 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]': finished 2024-05-09T05:35:29.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:35:29 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2024-05-09T05:35:29.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:35:29 smithi100 ceph-mon[34353]: osdmap e82: 12 total, 12 up, 12 in 2024-05-09T05:35:30.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:30.632+0000 7fad7f09b700 1 -- 172.21.15.39:0/510701279 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fad78108f10 msgr2=0x7fad78109320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:35:30.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:30.632+0000 7fad7f09b700 1 --2- 172.21.15.39:0/510701279 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fad78108f10 0x7fad78109320 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fad6800b0d0 tx=0x7fad6800b3e0 comp rx=0 tx=0).stop 2024-05-09T05:35:30.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:30.632+0000 7fad7f09b700 1 -- 172.21.15.39:0/510701279 shutdown_connections 2024-05-09T05:35:30.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:30.632+0000 7fad7f09b700 1 --2- 172.21.15.39:0/510701279 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad78109860 0x7fad781111c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:30.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:30.632+0000 7fad7f09b700 1 --2- 172.21.15.39:0/510701279 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad781045e0 0x7fad781049f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:30.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:30.632+0000 7fad7f09b700 1 --2- 172.21.15.39:0/510701279 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fad78108f10 0x7fad78109320 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:30.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:30.632+0000 7fad7f09b700 1 -- 172.21.15.39:0/510701279 >> 172.21.15.39:0/510701279 conn(0x7fad780ffed0 msgr2=0x7fad78102320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:35:30.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:30.632+0000 7fad7f09b700 1 -- 172.21.15.39:0/510701279 shutdown_connections 2024-05-09T05:35:30.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:30.632+0000 7fad7f09b700 1 -- 172.21.15.39:0/510701279 wait complete. 2024-05-09T05:35:30.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:30.633+0000 7fad7f09b700 1 Processor -- start 2024-05-09T05:35:30.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:30.633+0000 7fad7f09b700 1 -- start start 2024-05-09T05:35:30.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:30.633+0000 7fad7f09b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad781045e0 0x7fad7819ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:35:30.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:30.633+0000 7fad7f09b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad78108f10 0x7fad7819b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:35:30.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:30.633+0000 7fad7f09b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fad78109860 0x7fad7819f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:35:30.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:30.633+0000 7fad7f09b700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fad78114490 con 0x7fad78109860 2024-05-09T05:35:30.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:30.633+0000 7fad7f09b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fad78114310 con 0x7fad781045e0 2024-05-09T05:35:30.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:30.633+0000 7fad7f09b700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fad78114610 con 0x7fad78108f10 2024-05-09T05:35:30.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:30.633+0000 7fad7d638700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fad78109860 0x7fad7819f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:35:30.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:30.633+0000 7fad7d638700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fad78109860 0x7fad7819f630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44558/0 (socket says 172.21.15.39:44558) 2024-05-09T05:35:30.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:30.633+0000 7fad7d638700 1 -- 172.21.15.39:0/2571385309 learned_addr learned my addr 172.21.15.39:0/2571385309 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:35:30.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:30.633+0000 7fad7ce37700 1 --2- 172.21.15.39:0/2571385309 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad781045e0 0x7fad7819ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:35:30.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:30.633+0000 7fad77fff700 1 --2- 172.21.15.39:0/2571385309 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad78108f10 0x7fad7819b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:35:30.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:30.633+0000 7fad7d638700 1 -- 172.21.15.39:0/2571385309 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad78108f10 msgr2=0x7fad7819b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:35:30.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:30.633+0000 7fad7d638700 1 --2- 172.21.15.39:0/2571385309 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad78108f10 0x7fad7819b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:30.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:30.633+0000 7fad7d638700 1 -- 172.21.15.39:0/2571385309 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad781045e0 msgr2=0x7fad7819ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:35:30.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:30.633+0000 7fad7d638700 1 --2- 172.21.15.39:0/2571385309 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad781045e0 0x7fad7819ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:30.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:30.633+0000 7fad7d638700 1 -- 172.21.15.39:0/2571385309 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad7819fcd0 con 0x7fad78109860 2024-05-09T05:35:30.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:30.634+0000 7fad7d638700 1 --2- 172.21.15.39:0/2571385309 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fad78109860 0x7fad7819f630 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fad6000e940 tx=0x7fad6000ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:35:30.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:30.634+0000 7fad75ffb700 1 -- 172.21.15.39:0/2571385309 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad6000cbd0 con 0x7fad78109860 2024-05-09T05:35:30.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:30.634+0000 7fad75ffb700 1 -- 172.21.15.39:0/2571385309 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fad6000ee90 con 0x7fad78109860 2024-05-09T05:35:30.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:30.634+0000 7fad7f09b700 1 -- 172.21.15.39:0/2571385309 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad7819ffc0 con 0x7fad78109860 2024-05-09T05:35:30.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:30.634+0000 7fad75ffb700 1 -- 172.21.15.39:0/2571385309 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad60005590 con 0x7fad78109860 2024-05-09T05:35:30.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:30.634+0000 7fad7f09b700 1 -- 172.21.15.39:0/2571385309 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad781a78e0 con 0x7fad78109860 2024-05-09T05:35:30.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:30.635+0000 7fad7f09b700 1 -- 172.21.15.39:0/2571385309 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad780512c0 con 0x7fad78109860 2024-05-09T05:35:30.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:30.637+0000 7fad75ffb700 1 -- 172.21.15.39:0/2571385309 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fad60004750 con 0x7fad78109860 2024-05-09T05:35:30.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:30.637+0000 7fad75ffb700 1 --2- 172.21.15.39:0/2571385309 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fad640b2990 0x7fad640b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:35:30.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:30.637+0000 7fad7ce37700 1 --2- 172.21.15.39:0/2571385309 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fad640b2990 0x7fad640b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:35:30.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:30.637+0000 7fad75ffb700 1 -- 172.21.15.39:0/2571385309 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7fad600e2700 con 0x7fad78109860 2024-05-09T05:35:30.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:30.638+0000 7fad7ce37700 1 --2- 172.21.15.39:0/2571385309 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fad640b2990 0x7fad640b4ea0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fad70007be0 tx=0x7fad700073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:35:30.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:30.641+0000 7fad75ffb700 1 -- 172.21.15.39:0/2571385309 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fad60054df0 con 0x7fad78109860 2024-05-09T05:35:30.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:35:30 smithi060 ceph-mon[34555]: osdmap e83: 12 total, 12 up, 12 in 2024-05-09T05:35:30.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:35:30 smithi039 ceph-mon[30439]: osdmap e83: 12 total, 12 up, 12 in 2024-05-09T05:35:30.886 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:30.892+0000 7fad7f09b700 1 -- 172.21.15.39:0/2571385309 --> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7fad78063c00 con 0x7fad640b2990 2024-05-09T05:35:30.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:30.897+0000 7fad75ffb700 1 -- 172.21.15.39:0/2571385309 <== mgr.14152 v2:172.21.15.39:6800/3184189003 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fad78063c00 con 0x7fad640b2990 2024-05-09T05:35:30.892 INFO:teuthology.orchestra.run.smithi039.stdout:/volumes/qa/sv_1/1c243c8b-da02-405b-9f58-64c0c1726231 2024-05-09T05:35:30.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:30.899+0000 7fad7f09b700 1 -- 172.21.15.39:0/2571385309 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fad640b2990 msgr2=0x7fad640b4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:35:30.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:30.900+0000 7fad7f09b700 1 --2- 172.21.15.39:0/2571385309 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fad640b2990 0x7fad640b4ea0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fad70007be0 tx=0x7fad700073d0 comp rx=0 tx=0).stop 2024-05-09T05:35:30.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:30.900+0000 7fad7f09b700 1 -- 172.21.15.39:0/2571385309 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fad78109860 msgr2=0x7fad7819f630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:35:30.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:30.900+0000 7fad7f09b700 1 --2- 172.21.15.39:0/2571385309 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fad78109860 0x7fad7819f630 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fad6000e940 tx=0x7fad6000ec50 comp rx=0 tx=0).stop 2024-05-09T05:35:30.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:30.900+0000 7fad7f09b700 1 -- 172.21.15.39:0/2571385309 shutdown_connections 2024-05-09T05:35:30.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:30.900+0000 7fad7f09b700 1 --2- 172.21.15.39:0/2571385309 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fad640b2990 0x7fad640b4ea0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:30.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:30.900+0000 7fad7f09b700 1 --2- 172.21.15.39:0/2571385309 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fad78109860 0x7fad7819f630 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:30.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:30.900+0000 7fad7f09b700 1 --2- 172.21.15.39:0/2571385309 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad781045e0 0x7fad7819ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:30.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:30.900+0000 7fad7f09b700 1 --2- 172.21.15.39:0/2571385309 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad78108f10 0x7fad7819b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:30.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:30.900+0000 7fad7f09b700 1 -- 172.21.15.39:0/2571385309 >> 172.21.15.39:0/2571385309 conn(0x7fad780ffed0 msgr2=0x7fad781086b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:35:30.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:30.900+0000 7fad7f09b700 1 -- 172.21.15.39:0/2571385309 shutdown_connections 2024-05-09T05:35:30.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:30.900+0000 7fad7f09b700 1 -- 172.21.15.39:0/2571385309 wait complete. 2024-05-09T05:35:30.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:35:30 smithi100 ceph-mon[34353]: osdmap e83: 12 total, 12 up, 12 in 2024-05-09T05:35:31.523 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-09T05:35:31.778 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T05:35:31.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:35:31 smithi060 ceph-mon[34555]: pgmap v314: 97 pgs: 2 peering, 95 active+clean; 622 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 6.0 KiB/s wr, 9 op/s; 2 B/s, 0 objects/s recovering 2024-05-09T05:35:31.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:35:31 smithi039 ceph-mon[30439]: pgmap v314: 97 pgs: 2 peering, 95 active+clean; 622 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 6.0 KiB/s wr, 9 op/s; 2 B/s, 0 objects/s recovering 2024-05-09T05:35:31.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:35:31 smithi100 ceph-mon[34353]: pgmap v314: 97 pgs: 2 peering, 95 active+clean; 622 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 6.0 KiB/s wr, 9 op/s; 2 B/s, 0 objects/s recovering 2024-05-09T05:35:32.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:35:32 smithi060 ceph-mon[34555]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T05:35:32.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:35:32 smithi039 ceph-mon[30439]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T05:35:32.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:35:32 smithi100 ceph-mon[34353]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T05:35:33.395 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:33.401+0000 7fe54710f700 1 -- 172.21.15.39:0/2158094534 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe5401039d0 msgr2=0x7fe5401106f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:35:33.396 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:33.401+0000 7fe54710f700 1 --2- 172.21.15.39:0/2158094534 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe5401039d0 0x7fe5401106f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fe52c009990 tx=0x7fe52c009ca0 comp rx=0 tx=0).stop 2024-05-09T05:35:33.396 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:33.401+0000 7fe54710f700 1 -- 172.21.15.39:0/2158094534 shutdown_connections 2024-05-09T05:35:33.396 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:33.401+0000 7fe54710f700 1 --2- 172.21.15.39:0/2158094534 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe540110c30 0x7fe540113050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:33.396 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:33.401+0000 7fe54710f700 1 --2- 172.21.15.39:0/2158094534 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe540103080 0x7fe540103490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:33.396 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:33.401+0000 7fe54710f700 1 --2- 172.21.15.39:0/2158094534 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe5401039d0 0x7fe5401106f0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:33.396 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:33.401+0000 7fe54710f700 1 -- 172.21.15.39:0/2158094534 >> 172.21.15.39:0/2158094534 conn(0x7fe5400fedf0 msgr2=0x7fe540101210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:35:33.396 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:33.401+0000 7fe54710f700 1 -- 172.21.15.39:0/2158094534 shutdown_connections 2024-05-09T05:35:33.396 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:33.401+0000 7fe54710f700 1 -- 172.21.15.39:0/2158094534 wait complete. 2024-05-09T05:35:33.396 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:33.402+0000 7fe54710f700 1 Processor -- start 2024-05-09T05:35:33.396 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:33.402+0000 7fe54710f700 1 -- start start 2024-05-09T05:35:33.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:33.402+0000 7fe54710f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe540103080 0x7fe54019cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:35:33.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:33.402+0000 7fe54710f700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5401039d0 0x7fe54019d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:35:33.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:33.402+0000 7fe54710f700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe540110c30 0x7fe5401a1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:35:33.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:33.402+0000 7fe54710f700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fe540116660 con 0x7fe540110c30 2024-05-09T05:35:33.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:33.402+0000 7fe54710f700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe5401164e0 con 0x7fe540103080 2024-05-09T05:35:33.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:33.402+0000 7fe54710f700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe5401167e0 con 0x7fe5401039d0 2024-05-09T05:35:33.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:33.402+0000 7fe5456ac700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe540110c30 0x7fe5401a1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:35:33.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:33.403+0000 7fe5456ac700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe540110c30 0x7fe5401a1820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44582/0 (socket says 172.21.15.39:44582) 2024-05-09T05:35:33.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:33.403+0000 7fe5456ac700 1 -- 172.21.15.39:0/861512114 learned_addr learned my addr 172.21.15.39:0/861512114 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:35:33.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:33.403+0000 7fe544eab700 1 --2- 172.21.15.39:0/861512114 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe540103080 0x7fe54019cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:35:33.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:33.403+0000 7fe53ffff700 1 --2- 172.21.15.39:0/861512114 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5401039d0 0x7fe54019d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:35:33.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:33.403+0000 7fe5456ac700 1 -- 172.21.15.39:0/861512114 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5401039d0 msgr2=0x7fe54019d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:35:33.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:33.403+0000 7fe5456ac700 1 --2- 172.21.15.39:0/861512114 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5401039d0 0x7fe54019d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:33.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:33.403+0000 7fe5456ac700 1 -- 172.21.15.39:0/861512114 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe540103080 msgr2=0x7fe54019cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:35:33.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:33.403+0000 7fe5456ac700 1 --2- 172.21.15.39:0/861512114 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe540103080 0x7fe54019cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:33.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:33.403+0000 7fe5456ac700 1 -- 172.21.15.39:0/861512114 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5401a1e10 con 0x7fe540110c30 2024-05-09T05:35:33.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:33.403+0000 7fe5456ac700 1 --2- 172.21.15.39:0/861512114 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe540110c30 0x7fe5401a1820 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe538007d70 tx=0x7fe53800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:35:33.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:33.403+0000 7fe53dffb700 1 -- 172.21.15.39:0/861512114 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe538016020 con 0x7fe540110c30 2024-05-09T05:35:33.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:33.403+0000 7fe53dffb700 1 -- 172.21.15.39:0/861512114 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe53800ad40 con 0x7fe540110c30 2024-05-09T05:35:33.399 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:33.403+0000 7fe54710f700 1 -- 172.21.15.39:0/861512114 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5401a2100 con 0x7fe540110c30 2024-05-09T05:35:33.400 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:33.403+0000 7fe53dffb700 1 -- 172.21.15.39:0/861512114 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5380115e0 con 0x7fe540110c30 2024-05-09T05:35:33.400 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:33.404+0000 7fe54710f700 1 -- 172.21.15.39:0/861512114 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5401a2640 con 0x7fe540110c30 2024-05-09T05:35:33.400 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:33.404+0000 7fe54710f700 1 -- 172.21.15.39:0/861512114 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5400512c0 con 0x7fe540110c30 2024-05-09T05:35:33.401 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:33.406+0000 7fe53dffb700 1 -- 172.21.15.39:0/861512114 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fe538019020 con 0x7fe540110c30 2024-05-09T05:35:33.401 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:33.407+0000 7fe53dffb700 1 --2- 172.21.15.39:0/861512114 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fe5300b2990 0x7fe5300b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:35:33.401 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:33.407+0000 7fe544eab700 1 --2- 172.21.15.39:0/861512114 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fe5300b2990 0x7fe5300b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:35:33.401 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:33.407+0000 7fe53dffb700 1 -- 172.21.15.39:0/861512114 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7fe5380e21a0 con 0x7fe540110c30 2024-05-09T05:35:33.401 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:33.407+0000 7fe544eab700 1 --2- 172.21.15.39:0/861512114 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fe5300b2990 0x7fe5300b4ea0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe534005fd0 tx=0x7fe53400a560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:35:33.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:33.411+0000 7fe53dffb700 1 -- 172.21.15.39:0/861512114 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fe538020020 con 0x7fe540110c30 2024-05-09T05:35:33.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:33.675+0000 7fe54710f700 1 -- 172.21.15.39:0/861512114 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe54002e5f0 con 0x7fe540110c30 2024-05-09T05:35:33.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:33.676+0000 7fe53dffb700 1 -- 172.21.15.39:0/861512114 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11865 (secure 0 0 0) 0x7fe5380a9e80 con 0x7fe540110c30 2024-05-09T05:35:33.670 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-09T05:35:33.670 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/1997969267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":1997969267},{"type":"v1","addr":"172.21.15.39:6835","nonce":1997969267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/283022063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":283022063},{"type":"v1","addr":"172.21.15.39:6837","nonce":283022063}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14604,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6839/669632573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":669632573},{"type":"v1","addr":"172.21.15.39:6839","nonce":669632573}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14616,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6841/2202260395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6840","nonce":2202260395},{"type":"v1","addr":"172.21.15.39:6841","nonce":2202260395}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24433,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/1308189973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":1308189973},{"type":"v1","addr":"172.21.15.100:6833","nonce":1308189973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24434,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/2789974692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2789974692},{"type":"v1","addr":"172.21.15.60:6833","nonce":2789974692}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-09T05:34:56.202280+0000","modified":"2024-05-09T05:35:16.063547+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24502,"mds_2":24487},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24461":{"gid":24461,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6835/924472374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":924472374},{"type":"v1","addr":"172.21.15.60:6835","nonce":924472374}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24479":{"gid":24479,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6837/3588840930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":3588840930},{"type":"v1","addr":"172.21.15.60:6837","nonce":3588840930}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.100:6835/2595255386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2595255386},{"type":"v1","addr":"172.21.15.100:6835","nonce":2595255386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":13,"addr":"172.21.15.100:6837/3676209932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":3676209932},{"type":"v1","addr":"172.21.15.100:6837","nonce":3676209932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":12,"addr":"172.21.15.100:6839/1395178742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1395178742},{"type":"v1","addr":"172.21.15.100:6839","nonce":1395178742}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.60:6839/1418956667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":1418956667},{"type":"v1","addr":"172.21.15.60:6839","nonce":1418956667}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24487,24502,24509]},"id":1}]} 2024-05-09T05:35:33.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:33.678+0000 7fe54710f700 1 -- 172.21.15.39:0/861512114 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fe5300b2990 msgr2=0x7fe5300b4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:35:33.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:33.678+0000 7fe54710f700 1 --2- 172.21.15.39:0/861512114 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fe5300b2990 0x7fe5300b4ea0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe534005fd0 tx=0x7fe53400a560 comp rx=0 tx=0).stop 2024-05-09T05:35:33.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:33.678+0000 7fe54710f700 1 -- 172.21.15.39:0/861512114 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe540110c30 msgr2=0x7fe5401a1820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:35:33.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:33.678+0000 7fe54710f700 1 --2- 172.21.15.39:0/861512114 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe540110c30 0x7fe5401a1820 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe538007d70 tx=0x7fe53800a340 comp rx=0 tx=0).stop 2024-05-09T05:35:33.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:33.678+0000 7fe54710f700 1 -- 172.21.15.39:0/861512114 shutdown_connections 2024-05-09T05:35:33.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:33.678+0000 7fe54710f700 1 --2- 172.21.15.39:0/861512114 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fe5300b2990 0x7fe5300b4ea0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:33.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:33.678+0000 7fe54710f700 1 --2- 172.21.15.39:0/861512114 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe540110c30 0x7fe5401a1820 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:33.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:33.678+0000 7fe54710f700 1 --2- 172.21.15.39:0/861512114 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe540103080 0x7fe54019cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:33.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:33.678+0000 7fe54710f700 1 --2- 172.21.15.39:0/861512114 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5401039d0 0x7fe54019d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:33.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:33.678+0000 7fe54710f700 1 -- 172.21.15.39:0/861512114 >> 172.21.15.39:0/861512114 conn(0x7fe5400fedf0 msgr2=0x7fe5401127c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:35:33.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:33.679+0000 7fe54710f700 1 -- 172.21.15.39:0/861512114 shutdown_connections 2024-05-09T05:35:33.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:33.679+0000 7fe54710f700 1 -- 172.21.15.39:0/861512114 wait complete. 2024-05-09T05:35:33.673 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 24 2024-05-09T05:35:33.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:35:33 smithi060 ceph-mon[34555]: pgmap v315: 97 pgs: 2 peering, 95 active+clean; 622 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 3.2 KiB/s wr, 6 op/s; 2 B/s, 1 keys/s, 0 objects/s recovering 2024-05-09T05:35:33.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:35:33 smithi039 ceph-mon[30439]: pgmap v315: 97 pgs: 2 peering, 95 active+clean; 622 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 3.2 KiB/s wr, 6 op/s; 2 B/s, 1 keys/s, 0 objects/s recovering 2024-05-09T05:35:33.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:35:33 smithi100 ceph-mon[34353]: pgmap v315: 97 pgs: 2 peering, 95 active+clean; 622 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 3.2 KiB/s wr, 6 op/s; 2 B/s, 1 keys/s, 0 objects/s recovering 2024-05-09T05:35:34.322 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-09T05:35:34.576 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T05:35:34.609 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:35:34 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/861512114' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T05:35:34.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:35:34 smithi060 ceph-mon[34555]: from='client.? 172.21.15.39:0/861512114' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T05:35:34.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:35:34 smithi100 ceph-mon[34353]: from='client.? 172.21.15.39:0/861512114' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T05:35:35.609 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:35:35 smithi039 ceph-mon[30439]: pgmap v316: 97 pgs: 97 active+clean; 630 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 4.5 KiB/s wr, 9 op/s; 5.2 KiB/s, 1 keys/s, 1 objects/s recovering 2024-05-09T05:35:35.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:35:35 smithi060 ceph-mon[34555]: pgmap v316: 97 pgs: 97 active+clean; 630 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 4.5 KiB/s wr, 9 op/s; 5.2 KiB/s, 1 keys/s, 1 objects/s recovering 2024-05-09T05:35:35.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:35:35 smithi100 ceph-mon[34353]: pgmap v316: 97 pgs: 97 active+clean; 630 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 4.5 KiB/s wr, 9 op/s; 5.2 KiB/s, 1 keys/s, 1 objects/s recovering 2024-05-09T05:35:36.139 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:36.145+0000 7f29fd8a9700 1 -- 172.21.15.39:0/1200185212 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f29f8107e10 msgr2=0x7f29f8108220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:35:36.139 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:36.145+0000 7f29fd8a9700 1 --2- 172.21.15.39:0/1200185212 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f29f8107e10 0x7f29f8108220 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f29e00099c0 tx=0x7f29e0009cd0 comp rx=0 tx=0).stop 2024-05-09T05:35:36.139 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:36.145+0000 7f29fd8a9700 1 -- 172.21.15.39:0/1200185212 shutdown_connections 2024-05-09T05:35:36.139 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:36.145+0000 7f29fd8a9700 1 --2- 172.21.15.39:0/1200185212 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29f8108760 0x7f29f81100c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:36.140 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:36.145+0000 7f29fd8a9700 1 --2- 172.21.15.39:0/1200185212 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29f81034e0 0x7f29f81038f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:36.140 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:36.145+0000 7f29fd8a9700 1 --2- 172.21.15.39:0/1200185212 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f29f8107e10 0x7f29f8108220 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:36.140 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:36.145+0000 7f29fd8a9700 1 -- 172.21.15.39:0/1200185212 >> 172.21.15.39:0/1200185212 conn(0x7f29f80fef30 msgr2=0x7f29f8101350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:35:36.140 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:36.145+0000 7f29fd8a9700 1 -- 172.21.15.39:0/1200185212 shutdown_connections 2024-05-09T05:35:36.140 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:36.145+0000 7f29fd8a9700 1 -- 172.21.15.39:0/1200185212 wait complete. 2024-05-09T05:35:36.140 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:36.145+0000 7f29fd8a9700 1 Processor -- start 2024-05-09T05:35:36.140 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:36.145+0000 7f29fd8a9700 1 -- start start 2024-05-09T05:35:36.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:36.146+0000 7f29fd8a9700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29f81034e0 0x7f29f8199db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:35:36.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:36.146+0000 7f29fd8a9700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f29f8107e10 0x7f29f819a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:35:36.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:36.146+0000 7f29fd8a9700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29f8108760 0x7f29f819e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:35:36.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:36.146+0000 7f29fd8a9700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f29f81133e0 con 0x7f29f8107e10 2024-05-09T05:35:36.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:36.146+0000 7f29fd8a9700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f29f8113260 con 0x7f29f81034e0 2024-05-09T05:35:36.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:36.146+0000 7f29fd8a9700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f29f8113560 con 0x7f29f8108760 2024-05-09T05:35:36.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:36.146+0000 7f29ee7fc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f29f8107e10 0x7f29f819a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:35:36.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:36.146+0000 7f29ee7fc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f29f8107e10 0x7f29f819a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44592/0 (socket says 172.21.15.39:44592) 2024-05-09T05:35:36.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:36.146+0000 7f29ee7fc700 1 -- 172.21.15.39:0/62164606 learned_addr learned my addr 172.21.15.39:0/62164606 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:35:36.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:36.146+0000 7f29f6ffd700 1 --2- 172.21.15.39:0/62164606 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29f81034e0 0x7f29f8199db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:35:36.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:36.146+0000 7f29f77fe700 1 --2- 172.21.15.39:0/62164606 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29f8108760 0x7f29f819e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:35:36.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:36.146+0000 7f29ee7fc700 1 -- 172.21.15.39:0/62164606 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29f8108760 msgr2=0x7f29f819e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:35:36.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:36.146+0000 7f29ee7fc700 1 --2- 172.21.15.39:0/62164606 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29f8108760 0x7f29f819e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:36.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:36.146+0000 7f29ee7fc700 1 -- 172.21.15.39:0/62164606 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29f81034e0 msgr2=0x7f29f8199db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:35:36.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:36.146+0000 7f29ee7fc700 1 --2- 172.21.15.39:0/62164606 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29f81034e0 0x7f29f8199db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:36.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:36.146+0000 7f29ee7fc700 1 -- 172.21.15.39:0/62164606 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29f819ec80 con 0x7f29f8107e10 2024-05-09T05:35:36.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:36.147+0000 7f29ee7fc700 1 --2- 172.21.15.39:0/62164606 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f29f8107e10 0x7f29f819a350 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f29e0006010 tx=0x7f29e00047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:35:36.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:36.147+0000 7f29fc8a7700 1 -- 172.21.15.39:0/62164606 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29e0027070 con 0x7f29f8107e10 2024-05-09T05:35:36.145 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:36.147+0000 7f29fd8a9700 1 -- 172.21.15.39:0/62164606 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29f819ef10 con 0x7f29f8107e10 2024-05-09T05:35:36.145 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:36.147+0000 7f29fc8a7700 1 -- 172.21.15.39:0/62164606 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f29e0003f20 con 0x7f29f8107e10 2024-05-09T05:35:36.145 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:36.147+0000 7f29fc8a7700 1 -- 172.21.15.39:0/62164606 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29e0022c60 con 0x7f29f8107e10 2024-05-09T05:35:36.145 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:36.147+0000 7f29fd8a9700 1 -- 172.21.15.39:0/62164606 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29f819f3f0 con 0x7f29f8107e10 2024-05-09T05:35:36.145 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:36.148+0000 7f29fd8a9700 1 -- 172.21.15.39:0/62164606 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29f80512c0 con 0x7f29f8107e10 2024-05-09T05:35:36.146 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:36.150+0000 7f29fc8a7700 1 -- 172.21.15.39:0/62164606 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f29e002a070 con 0x7f29f8107e10 2024-05-09T05:35:36.146 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:36.150+0000 7f29fc8a7700 1 --2- 172.21.15.39:0/62164606 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f29e40b2910 0x7f29e40b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:35:36.146 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:36.150+0000 7f29f6ffd700 1 --2- 172.21.15.39:0/62164606 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f29e40b2910 0x7f29e40b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:35:36.146 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:36.151+0000 7f29fc8a7700 1 -- 172.21.15.39:0/62164606 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f29e0022e00 con 0x7f29f8107e10 2024-05-09T05:35:36.146 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:36.151+0000 7f29f6ffd700 1 --2- 172.21.15.39:0/62164606 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f29e40b2910 0x7f29e40b4e20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f29e8009a10 tx=0x7f29e8009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:35:36.148 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:36.154+0000 7f29fc8a7700 1 -- 172.21.15.39:0/62164606 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f29e0031080 con 0x7f29f8107e10 2024-05-09T05:35:36.362 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:36.368+0000 7f29fd8a9700 1 -- 172.21.15.39:0/62164606 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f29f802e5f0 con 0x7f29f8107e10 2024-05-09T05:35:36.363 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:36.370+0000 7f29fc8a7700 1 -- 172.21.15.39:0/62164606 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+22602 (secure 0 0 0) 0x7f29e0013070 con 0x7f29f8107e10 2024-05-09T05:35:36.364 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-09T05:35:36.364 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":83,"fsid":"86d4cc60-0dc4-11ef-bc97-c7b262605968","created":"2024-05-09T05:26:33.514203+0000","modified":"2024-05-09T05:35:29.485823+0000","last_up_change":"2024-05-09T05:33:48.776015+0000","last_in_change":"2024-05-09T05:33:28.117875+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T05:29:56.122407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-09T05:34:49.964521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-09T05:34:52.915301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3491bbda-3a9b-40d2-8627-87d15660f864","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":1056276932},{"type":"v1","addr":"172.21.15.39:6803","nonce":1056276932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":1056276932},{"type":"v1","addr":"172.21.15.39:6805","nonce":1056276932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":1056276932},{"type":"v1","addr":"172.21.15.39:6809","nonce":1056276932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":1056276932},{"type":"v1","addr":"172.21.15.39:6807","nonce":1056276932}]},"public_addr":"172.21.15.39:6803/1056276932","cluster_addr":"172.21.15.39:6805/1056276932","heartbeat_back_addr":"172.21.15.39:6809/1056276932","heartbeat_front_addr":"172.21.15.39:6807/1056276932","state":["exists","up"]},{"osd":1,"uuid":"ec2bd2d0-2975-402c-9df8-3469dfd6070f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":4245630636},{"type":"v1","addr":"172.21.15.60:6801","nonce":4245630636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":4245630636},{"type":"v1","addr":"172.21.15.60:6803","nonce":4245630636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":4245630636},{"type":"v1","addr":"172.21.15.60:6807","nonce":4245630636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":4245630636},{"type":"v1","addr":"172.21.15.60:6805","nonce":4245630636}]},"public_addr":"172.21.15.60:6801/4245630636","cluster_addr":"172.21.15.60:6803/4245630636","heartbeat_back_addr":"172.21.15.60:6807/4245630636","heartbeat_front_addr":"172.21.15.60:6805/4245630636","state":["exists","up"]},{"osd":2,"uuid":"9efaf6dd-086e-4095-b92e-cbbecf738523","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":4141597693},{"type":"v1","addr":"172.21.15.100:6801","nonce":4141597693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":4141597693},{"type":"v1","addr":"172.21.15.100:6803","nonce":4141597693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":4141597693},{"type":"v1","addr":"172.21.15.100:6807","nonce":4141597693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":4141597693},{"type":"v1","addr":"172.21.15.100:6805","nonce":4141597693}]},"public_addr":"172.21.15.100:6801/4141597693","cluster_addr":"172.21.15.100:6803/4141597693","heartbeat_back_addr":"172.21.15.100:6807/4141597693","heartbeat_front_addr":"172.21.15.100:6805/4141597693","state":["exists","up"]},{"osd":3,"uuid":"1ebe1a25-541d-4b54-bed8-4f0ec51b2432","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":2254197543},{"type":"v1","addr":"172.21.15.39:6811","nonce":2254197543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":2254197543},{"type":"v1","addr":"172.21.15.39:6813","nonce":2254197543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2254197543},{"type":"v1","addr":"172.21.15.39:6817","nonce":2254197543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":2254197543},{"type":"v1","addr":"172.21.15.39:6815","nonce":2254197543}]},"public_addr":"172.21.15.39:6811/2254197543","cluster_addr":"172.21.15.39:6813/2254197543","heartbeat_back_addr":"172.21.15.39:6817/2254197543","heartbeat_front_addr":"172.21.15.39:6815/2254197543","state":["exists","up"]},{"osd":4,"uuid":"d52450a3-8a97-4746-a857-35aec69aac44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":649037162},{"type":"v1","addr":"172.21.15.60:6809","nonce":649037162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":649037162},{"type":"v1","addr":"172.21.15.60:6811","nonce":649037162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":649037162},{"type":"v1","addr":"172.21.15.60:6815","nonce":649037162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":649037162},{"type":"v1","addr":"172.21.15.60:6813","nonce":649037162}]},"public_addr":"172.21.15.60:6809/649037162","cluster_addr":"172.21.15.60:6811/649037162","heartbeat_back_addr":"172.21.15.60:6815/649037162","heartbeat_front_addr":"172.21.15.60:6813/649037162","state":["exists","up"]},{"osd":5,"uuid":"b35bf704-898d-40f7-b575-90267764a5b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":658409226},{"type":"v1","addr":"172.21.15.100:6809","nonce":658409226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":658409226},{"type":"v1","addr":"172.21.15.100:6811","nonce":658409226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":658409226},{"type":"v1","addr":"172.21.15.100:6815","nonce":658409226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":658409226},{"type":"v1","addr":"172.21.15.100:6813","nonce":658409226}]},"public_addr":"172.21.15.100:6809/658409226","cluster_addr":"172.21.15.100:6811/658409226","heartbeat_back_addr":"172.21.15.100:6815/658409226","heartbeat_front_addr":"172.21.15.100:6813/658409226","state":["exists","up"]},{"osd":6,"uuid":"49eae2f5-1dad-4c2c-89f4-efa1dd1faefb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":237628491},{"type":"v1","addr":"172.21.15.39:6819","nonce":237628491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":237628491},{"type":"v1","addr":"172.21.15.39:6821","nonce":237628491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":237628491},{"type":"v1","addr":"172.21.15.39:6825","nonce":237628491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":237628491},{"type":"v1","addr":"172.21.15.39:6823","nonce":237628491}]},"public_addr":"172.21.15.39:6819/237628491","cluster_addr":"172.21.15.39:6821/237628491","heartbeat_back_addr":"172.21.15.39:6825/237628491","heartbeat_front_addr":"172.21.15.39:6823/237628491","state":["exists","up"]},{"osd":7,"uuid":"60ccae54-535c-4a13-98d0-881c00b5e870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":2718201647},{"type":"v1","addr":"172.21.15.60:6817","nonce":2718201647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":2718201647},{"type":"v1","addr":"172.21.15.60:6819","nonce":2718201647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":2718201647},{"type":"v1","addr":"172.21.15.60:6823","nonce":2718201647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":2718201647},{"type":"v1","addr":"172.21.15.60:6821","nonce":2718201647}]},"public_addr":"172.21.15.60:6817/2718201647","cluster_addr":"172.21.15.60:6819/2718201647","heartbeat_back_addr":"172.21.15.60:6823/2718201647","heartbeat_front_addr":"172.21.15.60:6821/2718201647","state":["exists","up"]},{"osd":8,"uuid":"edd52a21-0066-429f-9e98-15d1a74c53b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":1757558317},{"type":"v1","addr":"172.21.15.100:6817","nonce":1757558317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":1757558317},{"type":"v1","addr":"172.21.15.100:6819","nonce":1757558317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":1757558317},{"type":"v1","addr":"172.21.15.100:6823","nonce":1757558317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":1757558317},{"type":"v1","addr":"172.21.15.100:6821","nonce":1757558317}]},"public_addr":"172.21.15.100:6817/1757558317","cluster_addr":"172.21.15.100:6819/1757558317","heartbeat_back_addr":"172.21.15.100:6823/1757558317","heartbeat_front_addr":"172.21.15.100:6821/1757558317","state":["exists","up"]},{"osd":9,"uuid":"03fb7543-3386-49a4-b165-1007f07d88d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":2944584368},{"type":"v1","addr":"172.21.15.39:6827","nonce":2944584368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":2944584368},{"type":"v1","addr":"172.21.15.39:6829","nonce":2944584368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":2944584368},{"type":"v1","addr":"172.21.15.39:6833","nonce":2944584368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":2944584368},{"type":"v1","addr":"172.21.15.39:6831","nonce":2944584368}]},"public_addr":"172.21.15.39:6827/2944584368","cluster_addr":"172.21.15.39:6829/2944584368","heartbeat_back_addr":"172.21.15.39:6833/2944584368","heartbeat_front_addr":"172.21.15.39:6831/2944584368","state":["exists","up"]},{"osd":10,"uuid":"c1cadd6c-fcc4-4d76-b07e-0f392066a8d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1940670367},{"type":"v1","addr":"172.21.15.60:6825","nonce":1940670367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":1940670367},{"type":"v1","addr":"172.21.15.60:6827","nonce":1940670367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":1940670367},{"type":"v1","addr":"172.21.15.60:6831","nonce":1940670367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":1940670367},{"type":"v1","addr":"172.21.15.60:6829","nonce":1940670367}]},"public_addr":"172.21.15.60:6825/1940670367","cluster_addr":"172.21.15.60:6827/1940670367","heartbeat_back_addr":"172.21.15.60:6831/1940670367","heartbeat_front_addr":"172.21.15.60:6829/1940670367","state":["exists","up"]},{"osd":11,"uuid":"56806877-9ce2-41e2-9506-ce67897fa09b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":3318561029},{"type":"v1","addr":"172.21.15.100:6825","nonce":3318561029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":3318561029},{"type":"v1","addr":"172.21.15.100:6827","nonce":3318561029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":3318561029},{"type":"v1","addr":"172.21.15.100:6831","nonce":3318561029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":3318561029},{"type":"v1","addr":"172.21.15.100:6829","nonce":3318561029}]},"public_addr":"172.21.15.100:6825/3318561029","cluster_addr":"172.21.15.100:6827/3318561029","heartbeat_back_addr":"172.21.15.100:6831/3318561029","heartbeat_front_addr":"172.21.15.100:6829/3318561029","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:29:03.565705+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:29:28.380764+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:29:53.300224+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:30:20.046517+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:30:45.557983+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:31:10.397933+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:31:37.644428+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:32:02.325329+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:32:27.699044+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:32:54.436305+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:33:20.691300+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:33:46.806146+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.39:6801/4091500272":"2024-05-10T05:27:28.034010+0000","172.21.15.39:6800/4091500272":"2024-05-10T05:27:28.034010+0000","172.21.15.39:0/782312916":"2024-05-10T05:27:28.034010+0000","172.21.15.39:0/1899316433":"2024-05-10T05:27:28.034010+0000","172.21.15.39:0/1613215795":"2024-05-10T05:27:00.650123+0000","172.21.15.39:0/2870431271":"2024-05-10T05:27:00.650123+0000","172.21.15.39:0/438945726":"2024-05-10T05:27:00.650123+0000","172.21.15.39:6800/499609328":"2024-05-10T05:27:00.650123+0000","172.21.15.39:6801/499609328":"2024-05-10T05:27:00.650123+0000","172.21.15.39:0/1698165886":"2024-05-10T05:27:28.034010+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T05:35:36.366 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:36.372+0000 7f29fd8a9700 1 -- 172.21.15.39:0/62164606 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f29e40b2910 msgr2=0x7f29e40b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:35:36.366 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:36.372+0000 7f29fd8a9700 1 --2- 172.21.15.39:0/62164606 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f29e40b2910 0x7f29e40b4e20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f29e8009a10 tx=0x7f29e8009190 comp rx=0 tx=0).stop 2024-05-09T05:35:36.366 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:36.372+0000 7f29fd8a9700 1 -- 172.21.15.39:0/62164606 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f29f8107e10 msgr2=0x7f29f819a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:35:36.366 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:36.372+0000 7f29fd8a9700 1 --2- 172.21.15.39:0/62164606 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f29f8107e10 0x7f29f819a350 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f29e0006010 tx=0x7f29e00047b0 comp rx=0 tx=0).stop 2024-05-09T05:35:36.366 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:36.372+0000 7f29fd8a9700 1 -- 172.21.15.39:0/62164606 shutdown_connections 2024-05-09T05:35:36.366 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:36.372+0000 7f29fd8a9700 1 --2- 172.21.15.39:0/62164606 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f29e40b2910 0x7f29e40b4e20 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:36.367 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:36.372+0000 7f29fd8a9700 1 --2- 172.21.15.39:0/62164606 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29f8108760 0x7f29f819e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:36.367 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:36.372+0000 7f29fd8a9700 1 --2- 172.21.15.39:0/62164606 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29f81034e0 0x7f29f8199db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:36.367 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:36.372+0000 7f29fd8a9700 1 --2- 172.21.15.39:0/62164606 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f29f8107e10 0x7f29f819a350 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:36.367 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:36.372+0000 7f29fd8a9700 1 -- 172.21.15.39:0/62164606 >> 172.21.15.39:0/62164606 conn(0x7f29f80fef30 msgr2=0x7f29f8107580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:35:36.367 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:36.373+0000 7f29fd8a9700 1 -- 172.21.15.39:0/62164606 shutdown_connections 2024-05-09T05:35:36.367 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:36.373+0000 7f29fd8a9700 1 -- 172.21.15.39:0/62164606 wait complete. 2024-05-09T05:35:36.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:35:36 smithi060 ceph-mon[34555]: from='client.? 172.21.15.39:0/62164606' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T05:35:36.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:35:36 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/62164606' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T05:35:36.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:35:36 smithi100 ceph-mon[34353]: from='client.? 172.21.15.39:0/62164606' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T05:35:36.995 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-05-09T05:35:36.996 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph pg dump --format=json 2024-05-09T05:35:37.247 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T05:35:37.711 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:35:37 smithi039 ceph-mon[30439]: pgmap v317: 97 pgs: 97 active+clean; 630 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.2 KiB/s wr, 9 op/s; 5.2 KiB/s, 1 keys/s, 1 objects/s recovering 2024-05-09T05:35:37.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:35:37 smithi060 ceph-mon[34555]: pgmap v317: 97 pgs: 97 active+clean; 630 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.2 KiB/s wr, 9 op/s; 5.2 KiB/s, 1 keys/s, 1 objects/s recovering 2024-05-09T05:35:37.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:35:37 smithi100 ceph-mon[34353]: pgmap v317: 97 pgs: 97 active+clean; 630 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.2 KiB/s wr, 9 op/s; 5.2 KiB/s, 1 keys/s, 1 objects/s recovering 2024-05-09T05:35:38.842 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:38.848+0000 7f14c022d700 1 -- 172.21.15.39:0/1498041499 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f14b8103080 msgr2=0x7f14b8103490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:35:38.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:38.848+0000 7f14c022d700 1 --2- 172.21.15.39:0/1498041499 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f14b8103080 0x7f14b8103490 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f14b4009990 tx=0x7f14b4009ca0 comp rx=0 tx=0).stop 2024-05-09T05:35:38.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:38.848+0000 7f14c022d700 1 -- 172.21.15.39:0/1498041499 shutdown_connections 2024-05-09T05:35:38.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:38.848+0000 7f14c022d700 1 --2- 172.21.15.39:0/1498041499 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14b8110c30 0x7f14b8113050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:38.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:38.848+0000 7f14c022d700 1 --2- 172.21.15.39:0/1498041499 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f14b8103080 0x7f14b8103490 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:38.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:38.848+0000 7f14c022d700 1 --2- 172.21.15.39:0/1498041499 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14b81039d0 0x7f14b81106f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:38.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:38.848+0000 7f14c022d700 1 -- 172.21.15.39:0/1498041499 >> 172.21.15.39:0/1498041499 conn(0x7f14b80fedf0 msgr2=0x7f14b8101210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:35:38.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:38.848+0000 7f14c022d700 1 -- 172.21.15.39:0/1498041499 shutdown_connections 2024-05-09T05:35:38.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:38.848+0000 7f14c022d700 1 -- 172.21.15.39:0/1498041499 wait complete. 2024-05-09T05:35:38.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:38.849+0000 7f14c022d700 1 Processor -- start 2024-05-09T05:35:38.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:38.849+0000 7f14c022d700 1 -- start start 2024-05-09T05:35:38.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:38.849+0000 7f14c022d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f14b8103080 0x7f14b819d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:35:38.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:38.849+0000 7f14c022d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14b81039d0 0x7f14b819d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:35:38.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:38.849+0000 7f14c022d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14b8110c30 0x7f14b81a18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:35:38.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:38.849+0000 7f14c022d700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f14b81166f0 con 0x7f14b8103080 2024-05-09T05:35:38.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:38.849+0000 7f14c022d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f14b8116570 con 0x7f14b8110c30 2024-05-09T05:35:38.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:38.849+0000 7f14c022d700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f14b8116870 con 0x7f14b81039d0 2024-05-09T05:35:38.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:38.849+0000 7f14bdfc9700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f14b8103080 0x7f14b819d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:35:38.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:38.849+0000 7f14bdfc9700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f14b8103080 0x7f14b819d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35074/0 (socket says 172.21.15.39:35074) 2024-05-09T05:35:38.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:38.849+0000 7f14bdfc9700 1 -- 172.21.15.39:0/2628924346 learned_addr learned my addr 172.21.15.39:0/2628924346 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:35:38.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:38.850+0000 7f14bdfc9700 1 -- 172.21.15.39:0/2628924346 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14b81039d0 msgr2=0x7f14b819d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:35:38.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:38.850+0000 7f14bd7c8700 1 --2- 172.21.15.39:0/2628924346 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14b81039d0 0x7f14b819d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:35:38.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:38.850+0000 7f14bdfc9700 1 --2- 172.21.15.39:0/2628924346 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14b81039d0 0x7f14b819d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:38.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:38.850+0000 7f14bdfc9700 1 -- 172.21.15.39:0/2628924346 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14b8110c30 msgr2=0x7f14b81a18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:35:38.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:38.850+0000 7f14bdfc9700 1 --2- 172.21.15.39:0/2628924346 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14b8110c30 0x7f14b81a18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:38.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:38.850+0000 7f14bdfc9700 1 -- 172.21.15.39:0/2628924346 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14b81a1ea0 con 0x7f14b8103080 2024-05-09T05:35:38.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:38.850+0000 7f14bdfc9700 1 --2- 172.21.15.39:0/2628924346 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f14b8103080 0x7f14b819d080 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f14b4005840 tx=0x7f14b4003680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:35:38.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:38.850+0000 7f14aeffd700 1 -- 172.21.15.39:0/2628924346 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14b4027070 con 0x7f14b8103080 2024-05-09T05:35:38.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:38.850+0000 7f14aeffd700 1 -- 172.21.15.39:0/2628924346 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f14b40040a0 con 0x7f14b8103080 2024-05-09T05:35:38.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:38.850+0000 7f14c022d700 1 -- 172.21.15.39:0/2628924346 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14b81a2130 con 0x7f14b8103080 2024-05-09T05:35:38.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:38.850+0000 7f14aeffd700 1 -- 172.21.15.39:0/2628924346 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14b4022db0 con 0x7f14b8103080 2024-05-09T05:35:38.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:38.850+0000 7f14c022d700 1 -- 172.21.15.39:0/2628924346 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14b81a2610 con 0x7f14b8103080 2024-05-09T05:35:38.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:38.851+0000 7f14c022d700 1 -- 172.21.15.39:0/2628924346 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14b80512c0 con 0x7f14b8103080 2024-05-09T05:35:38.847 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:38.853+0000 7f14aeffd700 1 -- 172.21.15.39:0/2628924346 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f14b402a070 con 0x7f14b8103080 2024-05-09T05:35:38.847 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:38.854+0000 7f14aeffd700 1 --2- 172.21.15.39:0/2628924346 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f14a40b2910 0x7f14a40b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:35:38.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:38.854+0000 7f14bd7c8700 1 --2- 172.21.15.39:0/2628924346 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f14a40b2910 0x7f14a40b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:35:38.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:38.854+0000 7f14aeffd700 1 -- 172.21.15.39:0/2628924346 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f14b40e38e0 con 0x7f14b8103080 2024-05-09T05:35:38.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:38.854+0000 7f14bd7c8700 1 --2- 172.21.15.39:0/2628924346 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f14a40b2910 0x7f14a40b4e20 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f14a8006fd0 tx=0x7f14a8008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:35:38.851 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:38.857+0000 7f14aeffd700 1 -- 172.21.15.39:0/2628924346 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f14b4031080 con 0x7f14b8103080 2024-05-09T05:35:39.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:39.069+0000 7f14c022d700 1 -- 172.21.15.39:0/2628924346 --> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f14b8063c00 con 0x7f14a40b2910 2024-05-09T05:35:39.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:39.077+0000 7f14aeffd700 1 -- 172.21.15.39:0/2628924346 <== mgr.14152 v2:172.21.15.39:6800/3184189003 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258735 (secure 0 0 0) 0x7f14b8063c00 con 0x7f14a40b2910 2024-05-09T05:35:39.075 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-09T05:35:39.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:39.080+0000 7f14c022d700 1 -- 172.21.15.39:0/2628924346 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f14a40b2910 msgr2=0x7f14a40b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:35:39.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:39.080+0000 7f14c022d700 1 --2- 172.21.15.39:0/2628924346 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f14a40b2910 0x7f14a40b4e20 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f14a8006fd0 tx=0x7f14a8008040 comp rx=0 tx=0).stop 2024-05-09T05:35:39.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:39.080+0000 7f14c022d700 1 -- 172.21.15.39:0/2628924346 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f14b8103080 msgr2=0x7f14b819d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:35:39.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:39.080+0000 7f14c022d700 1 --2- 172.21.15.39:0/2628924346 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f14b8103080 0x7f14b819d080 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f14b4005840 tx=0x7f14b4003680 comp rx=0 tx=0).stop 2024-05-09T05:35:39.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:39.080+0000 7f14c022d700 1 -- 172.21.15.39:0/2628924346 shutdown_connections 2024-05-09T05:35:39.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:39.080+0000 7f14c022d700 1 --2- 172.21.15.39:0/2628924346 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f14a40b2910 0x7f14a40b4e20 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:39.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:39.080+0000 7f14c022d700 1 --2- 172.21.15.39:0/2628924346 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14b8110c30 0x7f14b81a18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:39.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:39.080+0000 7f14c022d700 1 --2- 172.21.15.39:0/2628924346 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f14b8103080 0x7f14b819d080 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:39.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:39.080+0000 7f14c022d700 1 --2- 172.21.15.39:0/2628924346 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14b81039d0 0x7f14b819d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:39.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:39.080+0000 7f14c022d700 1 -- 172.21.15.39:0/2628924346 >> 172.21.15.39:0/2628924346 conn(0x7f14b80fedf0 msgr2=0x7f14b81127c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:35:39.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:39.080+0000 7f14c022d700 1 -- 172.21.15.39:0/2628924346 shutdown_connections 2024-05-09T05:35:39.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:39.080+0000 7f14c022d700 1 -- 172.21.15.39:0/2628924346 wait complete. 2024-05-09T05:35:39.078 INFO:teuthology.orchestra.run.smithi039.stderr:dumped all 2024-05-09T05:35:39.706 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:35:39 smithi039 ceph-mon[30439]: pgmap v318: 97 pgs: 97 active+clean; 630 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 3.5 KiB/s wr, 6 op/s; 4.3 KiB/s, 1 keys/s, 0 objects/s recovering 2024-05-09T05:35:39.735 INFO:teuthology.orchestra.run.smithi039.stdout:{"pg_ready":true,"pg_map":{"version":318,"stamp":"2024-05-09T05:35:38.138484+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":645298,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":222,"num_read_kb":183,"num_write":284,"num_write_kb":2250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":2994063,"num_keys_recovered":11,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":229,"ondisk_log_size":229,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":292,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":378516,"kb_used_data":12664,"kb_used_omap":18,"kb_used_meta":365677,"kb_avail":1124563308,"statfs":{"total":1151940427776,"available":1151552827392,"internally_reserved":0,"allocated":12967936,"data_stored":7222888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":374453562},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":28482,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":47,"num_read_kb":42,"num_write":20,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":42223,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.648229"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.503540+0000","last_change":"2024-05-09T05:34:54.344495+0000","last_active":"2024-05-09T05:35:29.503540+0000","last_peered":"2024-05-09T05:35:29.503540+0000","last_clean":"2024-05-09T05:35:29.503540+0000","last_became_active":"2024-05-09T05:34:54.343680+0000","last_became_peered":"2024-05-09T05:34:54.343680+0000","last_unstale":"2024-05-09T05:35:29.503540+0000","last_undegraded":"2024-05-09T05:35:29.503540+0000","last_fullsized":"2024-05-09T05:35:29.503540+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:46:41.289022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.505470+0000","last_change":"2024-05-09T05:34:54.341618+0000","last_active":"2024-05-09T05:35:29.505470+0000","last_peered":"2024-05-09T05:35:29.505470+0000","last_clean":"2024-05-09T05:35:29.505470+0000","last_became_active":"2024-05-09T05:34:54.341176+0000","last_became_peered":"2024-05-09T05:34:54.341176+0000","last_unstale":"2024-05-09T05:35:29.505470+0000","last_undegraded":"2024-05-09T05:35:29.505470+0000","last_fullsized":"2024-05-09T05:35:29.505470+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:05:45.291132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.506037+0000","last_change":"2024-05-09T05:34:54.337847+0000","last_active":"2024-05-09T05:35:29.506037+0000","last_peered":"2024-05-09T05:35:29.506037+0000","last_clean":"2024-05-09T05:35:29.506037+0000","last_became_active":"2024-05-09T05:34:54.337449+0000","last_became_peered":"2024-05-09T05:34:54.337449+0000","last_unstale":"2024-05-09T05:35:29.506037+0000","last_undegraded":"2024-05-09T05:35:29.506037+0000","last_fullsized":"2024-05-09T05:35:29.506037+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:30:34.140802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.715051+0000","last_change":"2024-05-09T05:34:54.344969+0000","last_active":"2024-05-09T05:35:29.715051+0000","last_peered":"2024-05-09T05:35:29.715051+0000","last_clean":"2024-05-09T05:35:29.715051+0000","last_became_active":"2024-05-09T05:34:54.343975+0000","last_became_peered":"2024-05-09T05:34:54.343975+0000","last_unstale":"2024-05-09T05:35:29.715051+0000","last_undegraded":"2024-05-09T05:35:29.715051+0000","last_fullsized":"2024-05-09T05:35:29.715051+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:46:19.075155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.503160+0000","last_change":"2024-05-09T05:34:54.324335+0000","last_active":"2024-05-09T05:35:29.503160+0000","last_peered":"2024-05-09T05:35:29.503160+0000","last_clean":"2024-05-09T05:35:29.503160+0000","last_became_active":"2024-05-09T05:34:54.323950+0000","last_became_peered":"2024-05-09T05:34:54.323950+0000","last_unstale":"2024-05-09T05:35:29.503160+0000","last_undegraded":"2024-05-09T05:35:29.503160+0000","last_fullsized":"2024-05-09T05:35:29.503160+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:36:08.406518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.502572+0000","last_change":"2024-05-09T05:34:54.334887+0000","last_active":"2024-05-09T05:35:29.502572+0000","last_peered":"2024-05-09T05:35:29.502572+0000","last_clean":"2024-05-09T05:35:29.502572+0000","last_became_active":"2024-05-09T05:34:54.334420+0000","last_became_peered":"2024-05-09T05:34:54.334420+0000","last_unstale":"2024-05-09T05:35:29.502572+0000","last_undegraded":"2024-05-09T05:35:29.502572+0000","last_fullsized":"2024-05-09T05:35:29.502572+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:11:54.882338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.498923+0000","last_change":"2024-05-09T05:34:54.332085+0000","last_active":"2024-05-09T05:35:29.498923+0000","last_peered":"2024-05-09T05:35:29.498923+0000","last_clean":"2024-05-09T05:35:29.498923+0000","last_became_active":"2024-05-09T05:34:54.331648+0000","last_became_peered":"2024-05-09T05:34:54.331648+0000","last_unstale":"2024-05-09T05:35:29.498923+0000","last_undegraded":"2024-05-09T05:35:29.498923+0000","last_fullsized":"2024-05-09T05:35:29.498923+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:01:36.258271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.502103+0000","last_change":"2024-05-09T05:34:54.332924+0000","last_active":"2024-05-09T05:35:29.502103+0000","last_peered":"2024-05-09T05:35:29.502103+0000","last_clean":"2024-05-09T05:35:29.502103+0000","last_became_active":"2024-05-09T05:34:54.332370+0000","last_became_peered":"2024-05-09T05:34:54.332370+0000","last_unstale":"2024-05-09T05:35:29.502103+0000","last_undegraded":"2024-05-09T05:35:29.502103+0000","last_fullsized":"2024-05-09T05:35:29.502103+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:01:59.785668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.500313+0000","last_change":"2024-05-09T05:34:54.339222+0000","last_active":"2024-05-09T05:35:29.500313+0000","last_peered":"2024-05-09T05:35:29.500313+0000","last_clean":"2024-05-09T05:35:29.500313+0000","last_became_active":"2024-05-09T05:34:54.338832+0000","last_became_peered":"2024-05-09T05:34:54.338832+0000","last_unstale":"2024-05-09T05:35:29.500313+0000","last_undegraded":"2024-05-09T05:35:29.500313+0000","last_fullsized":"2024-05-09T05:35:29.500313+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:03:01.416515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.503162+0000","last_change":"2024-05-09T05:34:54.338774+0000","last_active":"2024-05-09T05:35:29.503162+0000","last_peered":"2024-05-09T05:35:29.503162+0000","last_clean":"2024-05-09T05:35:29.503162+0000","last_became_active":"2024-05-09T05:34:54.337259+0000","last_became_peered":"2024-05-09T05:34:54.337259+0000","last_unstale":"2024-05-09T05:35:29.503162+0000","last_undegraded":"2024-05-09T05:35:29.503162+0000","last_fullsized":"2024-05-09T05:35:29.503162+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:51:57.298412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.499221+0000","last_change":"2024-05-09T05:34:54.343973+0000","last_active":"2024-05-09T05:35:29.499221+0000","last_peered":"2024-05-09T05:35:29.499221+0000","last_clean":"2024-05-09T05:35:29.499221+0000","last_became_active":"2024-05-09T05:34:54.338980+0000","last_became_peered":"2024-05-09T05:34:54.338980+0000","last_unstale":"2024-05-09T05:35:29.499221+0000","last_undegraded":"2024-05-09T05:35:29.499221+0000","last_fullsized":"2024-05-09T05:35:29.499221+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:28:11.575715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.715054+0000","last_change":"2024-05-09T05:34:54.348135+0000","last_active":"2024-05-09T05:35:29.715054+0000","last_peered":"2024-05-09T05:35:29.715054+0000","last_clean":"2024-05-09T05:35:29.715054+0000","last_became_active":"2024-05-09T05:34:54.347686+0000","last_became_peered":"2024-05-09T05:34:54.347686+0000","last_unstale":"2024-05-09T05:35:29.715054+0000","last_undegraded":"2024-05-09T05:35:29.715054+0000","last_fullsized":"2024-05-09T05:35:29.715054+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:14:23.462361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.713149+0000","last_change":"2024-05-09T05:34:54.330614+0000","last_active":"2024-05-09T05:35:29.713149+0000","last_peered":"2024-05-09T05:35:29.713149+0000","last_clean":"2024-05-09T05:35:29.713149+0000","last_became_active":"2024-05-09T05:34:54.329739+0000","last_became_peered":"2024-05-09T05:34:54.329739+0000","last_unstale":"2024-05-09T05:35:29.713149+0000","last_undegraded":"2024-05-09T05:35:29.713149+0000","last_fullsized":"2024-05-09T05:35:29.713149+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:42:57.702085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.505437+0000","last_change":"2024-05-09T05:34:54.331920+0000","last_active":"2024-05-09T05:35:29.505437+0000","last_peered":"2024-05-09T05:35:29.505437+0000","last_clean":"2024-05-09T05:35:29.505437+0000","last_became_active":"2024-05-09T05:34:54.331548+0000","last_became_peered":"2024-05-09T05:34:54.331548+0000","last_unstale":"2024-05-09T05:35:29.505437+0000","last_undegraded":"2024-05-09T05:35:29.505437+0000","last_fullsized":"2024-05-09T05:35:29.505437+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:33:23.343863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.505122+0000","last_change":"2024-05-09T05:34:54.344257+0000","last_active":"2024-05-09T05:35:29.505122+0000","last_peered":"2024-05-09T05:35:29.505122+0000","last_clean":"2024-05-09T05:35:29.505122+0000","last_became_active":"2024-05-09T05:34:54.343888+0000","last_became_peered":"2024-05-09T05:34:54.343888+0000","last_unstale":"2024-05-09T05:35:29.505122+0000","last_undegraded":"2024-05-09T05:35:29.505122+0000","last_fullsized":"2024-05-09T05:35:29.505122+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:19:11.952108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.499265+0000","last_change":"2024-05-09T05:34:54.334613+0000","last_active":"2024-05-09T05:35:29.499265+0000","last_peered":"2024-05-09T05:35:29.499265+0000","last_clean":"2024-05-09T05:35:29.499265+0000","last_became_active":"2024-05-09T05:34:54.334225+0000","last_became_peered":"2024-05-09T05:34:54.334225+0000","last_unstale":"2024-05-09T05:35:29.499265+0000","last_undegraded":"2024-05-09T05:35:29.499265+0000","last_fullsized":"2024-05-09T05:35:29.499265+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:21.411510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.503688+0000","last_change":"2024-05-09T05:34:54.343915+0000","last_active":"2024-05-09T05:35:29.503688+0000","last_peered":"2024-05-09T05:35:29.503688+0000","last_clean":"2024-05-09T05:35:29.503688+0000","last_became_active":"2024-05-09T05:34:54.343494+0000","last_became_peered":"2024-05-09T05:34:54.343494+0000","last_unstale":"2024-05-09T05:35:29.503688+0000","last_undegraded":"2024-05-09T05:35:29.503688+0000","last_fullsized":"2024-05-09T05:35:29.503688+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:41:47.961863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.500404+0000","last_change":"2024-05-09T05:34:54.334272+0000","last_active":"2024-05-09T05:35:29.500404+0000","last_peered":"2024-05-09T05:35:29.500404+0000","last_clean":"2024-05-09T05:35:29.500404+0000","last_became_active":"2024-05-09T05:34:54.333949+0000","last_became_peered":"2024-05-09T05:34:54.333949+0000","last_unstale":"2024-05-09T05:35:29.500404+0000","last_undegraded":"2024-05-09T05:35:29.500404+0000","last_fullsized":"2024-05-09T05:35:29.500404+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:36:22.562719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.499988+0000","last_change":"2024-05-09T05:34:54.332763+0000","last_active":"2024-05-09T05:35:29.499988+0000","last_peered":"2024-05-09T05:35:29.499988+0000","last_clean":"2024-05-09T05:35:29.499988+0000","last_became_active":"2024-05-09T05:34:54.332260+0000","last_became_peered":"2024-05-09T05:34:54.332260+0000","last_unstale":"2024-05-09T05:35:29.499988+0000","last_undegraded":"2024-05-09T05:35:29.499988+0000","last_fullsized":"2024-05-09T05:35:29.499988+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:12:25.338294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"81'9","reported_seq":36,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.500519+0000","last_change":"2024-05-09T05:34:51.290514+0000","last_active":"2024-05-09T05:35:29.500519+0000","last_peered":"2024-05-09T05:35:29.500519+0000","last_clean":"2024-05-09T05:35:29.500519+0000","last_became_active":"2024-05-09T05:34:51.290097+0000","last_became_peered":"2024-05-09T05:34:51.290097+0000","last_unstale":"2024-05-09T05:35:29.500519+0000","last_undegraded":"2024-05-09T05:35:29.500519+0000","last_fullsized":"2024-05-09T05:35:29.500519+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:02:59.460307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.502491+0000","last_change":"2024-05-09T05:34:54.334272+0000","last_active":"2024-05-09T05:35:29.502491+0000","last_peered":"2024-05-09T05:35:29.502491+0000","last_clean":"2024-05-09T05:35:29.502491+0000","last_became_active":"2024-05-09T05:34:54.333926+0000","last_became_peered":"2024-05-09T05:34:54.333926+0000","last_unstale":"2024-05-09T05:35:29.502491+0000","last_undegraded":"2024-05-09T05:35:29.502491+0000","last_fullsized":"2024-05-09T05:35:29.502491+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:26:04.058278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"81'2","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.502646+0000","last_change":"2024-05-09T05:34:51.660596+0000","last_active":"2024-05-09T05:35:29.502646+0000","last_peered":"2024-05-09T05:35:29.502646+0000","last_clean":"2024-05-09T05:35:29.502646+0000","last_became_active":"2024-05-09T05:34:51.660214+0000","last_became_peered":"2024-05-09T05:34:51.660214+0000","last_unstale":"2024-05-09T05:35:29.502646+0000","last_undegraded":"2024-05-09T05:35:29.502646+0000","last_fullsized":"2024-05-09T05:35:29.502646+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:36:08.717797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.505824+0000","last_change":"2024-05-09T05:34:54.337863+0000","last_active":"2024-05-09T05:35:29.505824+0000","last_peered":"2024-05-09T05:35:29.505824+0000","last_clean":"2024-05-09T05:35:29.505824+0000","last_became_active":"2024-05-09T05:34:54.337476+0000","last_became_peered":"2024-05-09T05:34:54.337476+0000","last_unstale":"2024-05-09T05:35:29.505824+0000","last_undegraded":"2024-05-09T05:35:29.505824+0000","last_fullsized":"2024-05-09T05:35:29.505824+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:18:23.266499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"81'4","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.503655+0000","last_change":"2024-05-09T05:34:51.294750+0000","last_active":"2024-05-09T05:35:29.503655+0000","last_peered":"2024-05-09T05:35:29.503655+0000","last_clean":"2024-05-09T05:35:29.503655+0000","last_became_active":"2024-05-09T05:34:51.294305+0000","last_became_peered":"2024-05-09T05:34:51.294305+0000","last_unstale":"2024-05-09T05:35:29.503655+0000","last_undegraded":"2024-05-09T05:35:29.503655+0000","last_fullsized":"2024-05-09T05:35:29.503655+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:15:22.877230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.499546+0000","last_change":"2024-05-09T05:34:54.334540+0000","last_active":"2024-05-09T05:35:29.499546+0000","last_peered":"2024-05-09T05:35:29.499546+0000","last_clean":"2024-05-09T05:35:29.499546+0000","last_became_active":"2024-05-09T05:34:54.333416+0000","last_became_peered":"2024-05-09T05:34:54.333416+0000","last_unstale":"2024-05-09T05:35:29.499546+0000","last_undegraded":"2024-05-09T05:35:29.499546+0000","last_fullsized":"2024-05-09T05:35:29.499546+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:37:30.862850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.503293+0000","last_change":"2024-05-09T05:34:51.290377+0000","last_active":"2024-05-09T05:35:29.503293+0000","last_peered":"2024-05-09T05:35:29.503293+0000","last_clean":"2024-05-09T05:35:29.503293+0000","last_became_active":"2024-05-09T05:34:51.289974+0000","last_became_peered":"2024-05-09T05:34:51.289974+0000","last_unstale":"2024-05-09T05:35:29.503293+0000","last_undegraded":"2024-05-09T05:35:29.503293+0000","last_fullsized":"2024-05-09T05:35:29.503293+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:40:04.454876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.505866+0000","last_change":"2024-05-09T05:34:54.338620+0000","last_active":"2024-05-09T05:35:29.505866+0000","last_peered":"2024-05-09T05:35:29.505866+0000","last_clean":"2024-05-09T05:35:29.505866+0000","last_became_active":"2024-05-09T05:34:54.338218+0000","last_became_peered":"2024-05-09T05:34:54.338218+0000","last_unstale":"2024-05-09T05:35:29.505866+0000","last_undegraded":"2024-05-09T05:35:29.505866+0000","last_fullsized":"2024-05-09T05:35:29.505866+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:23:51.484732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"81'5","reported_seq":53,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:31.305366+0000","last_change":"2024-05-09T05:34:51.293962+0000","last_active":"2024-05-09T05:35:31.305366+0000","last_peered":"2024-05-09T05:35:31.305366+0000","last_clean":"2024-05-09T05:35:31.305366+0000","last_became_active":"2024-05-09T05:34:51.293567+0000","last_became_peered":"2024-05-09T05:34:51.293567+0000","last_unstale":"2024-05-09T05:35:31.305366+0000","last_undegraded":"2024-05-09T05:35:31.305366+0000","last_fullsized":"2024-05-09T05:35:31.305366+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:29:17.624820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.502752+0000","last_change":"2024-05-09T05:34:54.325411+0000","last_active":"2024-05-09T05:35:29.502752+0000","last_peered":"2024-05-09T05:35:29.502752+0000","last_clean":"2024-05-09T05:35:29.502752+0000","last_became_active":"2024-05-09T05:34:54.325036+0000","last_became_peered":"2024-05-09T05:34:54.325036+0000","last_unstale":"2024-05-09T05:35:29.502752+0000","last_undegraded":"2024-05-09T05:35:29.502752+0000","last_fullsized":"2024-05-09T05:35:29.502752+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:03:48.507512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"81'3","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.502572+0000","last_change":"2024-05-09T05:34:51.290884+0000","last_active":"2024-05-09T05:35:29.502572+0000","last_peered":"2024-05-09T05:35:29.502572+0000","last_clean":"2024-05-09T05:35:29.502572+0000","last_became_active":"2024-05-09T05:34:51.290459+0000","last_became_peered":"2024-05-09T05:34:51.290459+0000","last_unstale":"2024-05-09T05:35:29.502572+0000","last_undegraded":"2024-05-09T05:35:29.502572+0000","last_fullsized":"2024-05-09T05:35:29.502572+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:29:47.737930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.507517+0000","last_change":"2024-05-09T05:35:29.507517+0000","last_active":"2024-05-09T05:35:29.507517+0000","last_peered":"2024-05-09T05:35:29.507517+0000","last_clean":"2024-05-09T05:35:29.507517+0000","last_became_active":"2024-05-09T05:35:29.507029+0000","last_became_peered":"2024-05-09T05:35:29.507029+0000","last_unstale":"2024-05-09T05:35:29.507517+0000","last_undegraded":"2024-05-09T05:35:29.507517+0000","last_fullsized":"2024-05-09T05:35:29.507517+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:03:23.016919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"81'2","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.713053+0000","last_change":"2024-05-09T05:34:51.286241+0000","last_active":"2024-05-09T05:35:29.713053+0000","last_peered":"2024-05-09T05:35:29.713053+0000","last_clean":"2024-05-09T05:35:29.713053+0000","last_became_active":"2024-05-09T05:34:51.285814+0000","last_became_peered":"2024-05-09T05:34:51.285814+0000","last_unstale":"2024-05-09T05:35:29.713053+0000","last_undegraded":"2024-05-09T05:35:29.713053+0000","last_fullsized":"2024-05-09T05:35:29.713053+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:44:21.937909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.502179+0000","last_change":"2024-05-09T05:34:54.339247+0000","last_active":"2024-05-09T05:35:29.502179+0000","last_peered":"2024-05-09T05:35:29.502179+0000","last_clean":"2024-05-09T05:35:29.502179+0000","last_became_active":"2024-05-09T05:34:54.338899+0000","last_became_peered":"2024-05-09T05:34:54.338899+0000","last_unstale":"2024-05-09T05:35:29.502179+0000","last_undegraded":"2024-05-09T05:35:29.502179+0000","last_fullsized":"2024-05-09T05:35:29.502179+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:54:50.696065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"81'1","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.504543+0000","last_change":"2024-05-09T05:34:51.295297+0000","last_active":"2024-05-09T05:35:29.504543+0000","last_peered":"2024-05-09T05:35:29.504543+0000","last_clean":"2024-05-09T05:35:29.504543+0000","last_became_active":"2024-05-09T05:34:51.294814+0000","last_became_peered":"2024-05-09T05:34:51.294814+0000","last_unstale":"2024-05-09T05:35:29.504543+0000","last_undegraded":"2024-05-09T05:35:29.504543+0000","last_fullsized":"2024-05-09T05:35:29.504543+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:05:57.955453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.500235+0000","last_change":"2024-05-09T05:34:54.335988+0000","last_active":"2024-05-09T05:35:29.500235+0000","last_peered":"2024-05-09T05:35:29.500235+0000","last_clean":"2024-05-09T05:35:29.500235+0000","last_became_active":"2024-05-09T05:34:54.335574+0000","last_became_peered":"2024-05-09T05:34:54.335574+0000","last_unstale":"2024-05-09T05:35:29.500235+0000","last_undegraded":"2024-05-09T05:35:29.500235+0000","last_fullsized":"2024-05-09T05:35:29.500235+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:12:26.453578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"81'3","reported_seq":50,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:32.306170+0000","last_change":"2024-05-09T05:34:51.291587+0000","last_active":"2024-05-09T05:35:32.306170+0000","last_peered":"2024-05-09T05:35:32.306170+0000","last_clean":"2024-05-09T05:35:32.306170+0000","last_became_active":"2024-05-09T05:34:51.291084+0000","last_became_peered":"2024-05-09T05:34:51.291084+0000","last_unstale":"2024-05-09T05:35:32.306170+0000","last_undegraded":"2024-05-09T05:35:32.306170+0000","last_fullsized":"2024-05-09T05:35:32.306170+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:37:13.234749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.499955+0000","last_change":"2024-05-09T05:34:54.333978+0000","last_active":"2024-05-09T05:35:29.499955+0000","last_peered":"2024-05-09T05:35:29.499955+0000","last_clean":"2024-05-09T05:35:29.499955+0000","last_became_active":"2024-05-09T05:34:54.333497+0000","last_became_peered":"2024-05-09T05:34:54.333497+0000","last_unstale":"2024-05-09T05:35:29.499955+0000","last_undegraded":"2024-05-09T05:35:29.499955+0000","last_fullsized":"2024-05-09T05:35:29.499955+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:24:04.078316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"81'2","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.720038+0000","last_change":"2024-05-09T05:35:29.720038+0000","last_active":"2024-05-09T05:35:29.720038+0000","last_peered":"2024-05-09T05:35:29.720038+0000","last_clean":"2024-05-09T05:35:29.720038+0000","last_became_active":"2024-05-09T05:35:29.716097+0000","last_became_peered":"2024-05-09T05:35:29.716097+0000","last_unstale":"2024-05-09T05:35:29.720038+0000","last_undegraded":"2024-05-09T05:35:29.720038+0000","last_fullsized":"2024-05-09T05:35:29.720038+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:35:50.853791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.505931+0000","last_change":"2024-05-09T05:34:54.345340+0000","last_active":"2024-05-09T05:35:29.505931+0000","last_peered":"2024-05-09T05:35:29.505931+0000","last_clean":"2024-05-09T05:35:29.505931+0000","last_became_active":"2024-05-09T05:34:54.344690+0000","last_became_peered":"2024-05-09T05:34:54.344690+0000","last_unstale":"2024-05-09T05:35:29.505931+0000","last_undegraded":"2024-05-09T05:35:29.505931+0000","last_fullsized":"2024-05-09T05:35:29.505931+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:35:21.222688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"81'4","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.505894+0000","last_change":"2024-05-09T05:34:51.661607+0000","last_active":"2024-05-09T05:35:29.505894+0000","last_peered":"2024-05-09T05:35:29.505894+0000","last_clean":"2024-05-09T05:35:29.505894+0000","last_became_active":"2024-05-09T05:34:51.660514+0000","last_became_peered":"2024-05-09T05:34:51.660514+0000","last_unstale":"2024-05-09T05:35:29.505894+0000","last_undegraded":"2024-05-09T05:35:29.505894+0000","last_fullsized":"2024-05-09T05:35:29.505894+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:29:05.670388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.499915+0000","last_change":"2024-05-09T05:34:54.340465+0000","last_active":"2024-05-09T05:35:29.499915+0000","last_peered":"2024-05-09T05:35:29.499915+0000","last_clean":"2024-05-09T05:35:29.499915+0000","last_became_active":"2024-05-09T05:34:54.339918+0000","last_became_peered":"2024-05-09T05:34:54.339918+0000","last_unstale":"2024-05-09T05:35:29.499915+0000","last_undegraded":"2024-05-09T05:35:29.499915+0000","last_fullsized":"2024-05-09T05:35:29.499915+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:18:03.594387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'25","reported_seq":116,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:32.730318+0000","last_change":"2024-05-09T05:35:29.731065+0000","last_active":"2024-05-09T05:35:32.730318+0000","last_peered":"2024-05-09T05:35:32.730318+0000","last_clean":"2024-05-09T05:35:32.730318+0000","last_became_active":"2024-05-09T05:35:29.716353+0000","last_became_peered":"2024-05-09T05:35:29.716353+0000","last_unstale":"2024-05-09T05:35:32.730318+0000","last_undegraded":"2024-05-09T05:35:32.730318+0000","last_fullsized":"2024-05-09T05:35:32.730318+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:50:35.450572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50695,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":57,"num_write":26,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":42201,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.503455+0000","last_change":"2024-05-09T05:34:54.334616+0000","last_active":"2024-05-09T05:35:29.503455+0000","last_peered":"2024-05-09T05:35:29.503455+0000","last_clean":"2024-05-09T05:35:29.503455+0000","last_became_active":"2024-05-09T05:34:54.334267+0000","last_became_peered":"2024-05-09T05:34:54.334267+0000","last_unstale":"2024-05-09T05:35:29.503455+0000","last_undegraded":"2024-05-09T05:35:29.503455+0000","last_fullsized":"2024-05-09T05:35:29.503455+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:13:03.841458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'6","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.499985+0000","last_change":"2024-05-09T05:34:51.290247+0000","last_active":"2024-05-09T05:35:29.499985+0000","last_peered":"2024-05-09T05:35:29.499985+0000","last_clean":"2024-05-09T05:35:29.499985+0000","last_became_active":"2024-05-09T05:34:51.288599+0000","last_became_peered":"2024-05-09T05:34:51.288599+0000","last_unstale":"2024-05-09T05:35:29.499985+0000","last_undegraded":"2024-05-09T05:35:29.499985+0000","last_fullsized":"2024-05-09T05:35:29.499985+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:57:44.805526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.713082+0000","last_change":"2024-05-09T05:34:54.331768+0000","last_active":"2024-05-09T05:35:29.713082+0000","last_peered":"2024-05-09T05:35:29.713082+0000","last_clean":"2024-05-09T05:35:29.713082+0000","last_became_active":"2024-05-09T05:34:54.331407+0000","last_became_peered":"2024-05-09T05:34:54.331407+0000","last_unstale":"2024-05-09T05:35:29.713082+0000","last_undegraded":"2024-05-09T05:35:29.713082+0000","last_fullsized":"2024-05-09T05:35:29.713082+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:16:43.767055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"81'3","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.505287+0000","last_change":"2024-05-09T05:34:51.294266+0000","last_active":"2024-05-09T05:35:29.505287+0000","last_peered":"2024-05-09T05:35:29.505287+0000","last_clean":"2024-05-09T05:35:29.505287+0000","last_became_active":"2024-05-09T05:34:51.293865+0000","last_became_peered":"2024-05-09T05:34:51.293865+0000","last_unstale":"2024-05-09T05:35:29.505287+0000","last_undegraded":"2024-05-09T05:35:29.505287+0000","last_fullsized":"2024-05-09T05:35:29.505287+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:13:05.775729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.499259+0000","last_change":"2024-05-09T05:34:54.346713+0000","last_active":"2024-05-09T05:35:29.499259+0000","last_peered":"2024-05-09T05:35:29.499259+0000","last_clean":"2024-05-09T05:35:29.499259+0000","last_became_active":"2024-05-09T05:34:54.346361+0000","last_became_peered":"2024-05-09T05:34:54.346361+0000","last_unstale":"2024-05-09T05:35:29.499259+0000","last_undegraded":"2024-05-09T05:35:29.499259+0000","last_fullsized":"2024-05-09T05:35:29.499259+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:29:07.013316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"81'4","reported_seq":53,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:31.305041+0000","last_change":"2024-05-09T05:34:51.288809+0000","last_active":"2024-05-09T05:35:31.305041+0000","last_peered":"2024-05-09T05:35:31.305041+0000","last_clean":"2024-05-09T05:35:31.305041+0000","last_became_active":"2024-05-09T05:34:51.288417+0000","last_became_peered":"2024-05-09T05:34:51.288417+0000","last_unstale":"2024-05-09T05:35:31.305041+0000","last_undegraded":"2024-05-09T05:35:31.305041+0000","last_fullsized":"2024-05-09T05:35:31.305041+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:19:53.691145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":24,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.498794+0000","last_change":"2024-05-09T05:34:54.344335+0000","last_active":"2024-05-09T05:35:29.498794+0000","last_peered":"2024-05-09T05:35:29.498794+0000","last_clean":"2024-05-09T05:35:29.498794+0000","last_became_active":"2024-05-09T05:34:54.343938+0000","last_became_peered":"2024-05-09T05:34:54.343938+0000","last_unstale":"2024-05-09T05:35:29.498794+0000","last_undegraded":"2024-05-09T05:35:29.498794+0000","last_fullsized":"2024-05-09T05:35:29.498794+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:10.003294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'15","reported_seq":41,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.502510+0000","last_change":"2024-05-09T05:34:51.660939+0000","last_active":"2024-05-09T05:35:29.502510+0000","last_peered":"2024-05-09T05:35:29.502510+0000","last_clean":"2024-05-09T05:35:29.502510+0000","last_became_active":"2024-05-09T05:34:51.660501+0000","last_became_peered":"2024-05-09T05:34:51.660501+0000","last_unstale":"2024-05-09T05:35:29.502510+0000","last_undegraded":"2024-05-09T05:35:29.502510+0000","last_fullsized":"2024-05-09T05:35:29.502510+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:43:11.626811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.715011+0000","last_change":"2024-05-09T05:35:29.714515+0000","last_active":"2024-05-09T05:35:29.715011+0000","last_peered":"2024-05-09T05:35:29.715011+0000","last_clean":"2024-05-09T05:35:29.715011+0000","last_became_active":"2024-05-09T05:35:29.714125+0000","last_became_peered":"2024-05-09T05:35:29.714125+0000","last_unstale":"2024-05-09T05:35:29.715011+0000","last_undegraded":"2024-05-09T05:35:29.715011+0000","last_fullsized":"2024-05-09T05:35:29.715011+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:20:18.408711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.f","version":"81'2","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.502959+0000","last_change":"2024-05-09T05:34:51.290742+0000","last_active":"2024-05-09T05:35:29.502959+0000","last_peered":"2024-05-09T05:35:29.502959+0000","last_clean":"2024-05-09T05:35:29.502959+0000","last_became_active":"2024-05-09T05:34:51.290371+0000","last_became_peered":"2024-05-09T05:34:51.290371+0000","last_unstale":"2024-05-09T05:35:29.502959+0000","last_undegraded":"2024-05-09T05:35:29.502959+0000","last_fullsized":"2024-05-09T05:35:29.502959+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:38:05.449808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.503624+0000","last_change":"2024-05-09T05:34:54.348128+0000","last_active":"2024-05-09T05:35:29.503624+0000","last_peered":"2024-05-09T05:35:29.503624+0000","last_clean":"2024-05-09T05:35:29.503624+0000","last_became_active":"2024-05-09T05:34:54.347648+0000","last_became_peered":"2024-05-09T05:34:54.347648+0000","last_unstale":"2024-05-09T05:35:29.503624+0000","last_undegraded":"2024-05-09T05:35:29.503624+0000","last_fullsized":"2024-05-09T05:35:29.503624+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:46:19.578003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.500343+0000","last_change":"2024-05-09T05:34:51.661486+0000","last_active":"2024-05-09T05:35:29.500343+0000","last_peered":"2024-05-09T05:35:29.500343+0000","last_clean":"2024-05-09T05:35:29.500343+0000","last_became_active":"2024-05-09T05:34:51.661094+0000","last_became_peered":"2024-05-09T05:34:51.661094+0000","last_unstale":"2024-05-09T05:35:29.500343+0000","last_undegraded":"2024-05-09T05:35:29.500343+0000","last_fullsized":"2024-05-09T05:35:29.500343+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:14:26.675414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"81'1","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.502803+0000","last_change":"2024-05-09T05:34:54.330881+0000","last_active":"2024-05-09T05:35:29.502803+0000","last_peered":"2024-05-09T05:35:29.502803+0000","last_clean":"2024-05-09T05:35:29.502803+0000","last_became_active":"2024-05-09T05:34:54.330412+0000","last_became_peered":"2024-05-09T05:34:54.330412+0000","last_unstale":"2024-05-09T05:35:29.502803+0000","last_undegraded":"2024-05-09T05:35:29.502803+0000","last_fullsized":"2024-05-09T05:35:29.502803+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:21:42.481374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"81'1","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.499020+0000","last_change":"2024-05-09T05:34:51.289479+0000","last_active":"2024-05-09T05:35:29.499020+0000","last_peered":"2024-05-09T05:35:29.499020+0000","last_clean":"2024-05-09T05:35:29.499020+0000","last_became_active":"2024-05-09T05:34:51.286436+0000","last_became_peered":"2024-05-09T05:34:51.286436+0000","last_unstale":"2024-05-09T05:35:29.499020+0000","last_undegraded":"2024-05-09T05:35:29.499020+0000","last_fullsized":"2024-05-09T05:35:29.499020+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:22:59.431456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.506937+0000","last_change":"2024-05-09T05:35:29.506937+0000","last_active":"2024-05-09T05:35:29.506937+0000","last_peered":"2024-05-09T05:35:29.506937+0000","last_clean":"2024-05-09T05:35:29.506937+0000","last_became_active":"2024-05-09T05:35:29.506540+0000","last_became_peered":"2024-05-09T05:35:29.506540+0000","last_unstale":"2024-05-09T05:35:29.506937+0000","last_undegraded":"2024-05-09T05:35:29.506937+0000","last_fullsized":"2024-05-09T05:35:29.506937+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:54:51.868972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.505019+0000","last_change":"2024-05-09T05:34:54.334559+0000","last_active":"2024-05-09T05:35:29.505019+0000","last_peered":"2024-05-09T05:35:29.505019+0000","last_clean":"2024-05-09T05:35:29.505019+0000","last_became_active":"2024-05-09T05:34:54.333599+0000","last_became_peered":"2024-05-09T05:34:54.333599+0000","last_unstale":"2024-05-09T05:35:29.505019+0000","last_undegraded":"2024-05-09T05:35:29.505019+0000","last_fullsized":"2024-05-09T05:35:29.505019+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:36:16.139227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"81'4","reported_seq":53,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:34.308682+0000","last_change":"2024-05-09T05:34:51.660563+0000","last_active":"2024-05-09T05:35:34.308682+0000","last_peered":"2024-05-09T05:35:34.308682+0000","last_clean":"2024-05-09T05:35:34.308682+0000","last_became_active":"2024-05-09T05:34:51.660127+0000","last_became_peered":"2024-05-09T05:34:51.660127+0000","last_unstale":"2024-05-09T05:35:34.308682+0000","last_undegraded":"2024-05-09T05:35:34.308682+0000","last_fullsized":"2024-05-09T05:35:34.308682+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:08:56.832264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.502524+0000","last_change":"2024-05-09T05:34:54.330774+0000","last_active":"2024-05-09T05:35:29.502524+0000","last_peered":"2024-05-09T05:35:29.502524+0000","last_clean":"2024-05-09T05:35:29.502524+0000","last_became_active":"2024-05-09T05:34:54.329970+0000","last_became_peered":"2024-05-09T05:34:54.329970+0000","last_unstale":"2024-05-09T05:35:29.502524+0000","last_undegraded":"2024-05-09T05:35:29.502524+0000","last_fullsized":"2024-05-09T05:35:29.502524+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:41:30.078744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"81'3","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.714370+0000","last_change":"2024-05-09T05:34:51.289026+0000","last_active":"2024-05-09T05:35:29.714370+0000","last_peered":"2024-05-09T05:35:29.714370+0000","last_clean":"2024-05-09T05:35:29.714370+0000","last_became_active":"2024-05-09T05:34:51.288615+0000","last_became_peered":"2024-05-09T05:34:51.288615+0000","last_unstale":"2024-05-09T05:35:29.714370+0000","last_undegraded":"2024-05-09T05:35:29.714370+0000","last_fullsized":"2024-05-09T05:35:29.714370+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:17:21.395173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":101,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.498950+0000","last_change":"2024-05-09T05:33:24.272408+0000","last_active":"2024-05-09T05:35:29.498950+0000","last_peered":"2024-05-09T05:35:29.498950+0000","last_clean":"2024-05-09T05:35:29.498950+0000","last_became_active":"2024-05-09T05:33:24.266495+0000","last_became_peered":"2024-05-09T05:33:24.266495+0000","last_unstale":"2024-05-09T05:35:29.498950+0000","last_undegraded":"2024-05-09T05:35:29.498950+0000","last_fullsized":"2024-05-09T05:35:29.498950+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:29:56.191070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:29:56.191070+0000","last_clean_scrub_stamp":"2024-05-09T05:29:56.191070+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:45:12.602657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.712943+0000","last_change":"2024-05-09T05:34:54.328200+0000","last_active":"2024-05-09T05:35:29.712943+0000","last_peered":"2024-05-09T05:35:29.712943+0000","last_clean":"2024-05-09T05:35:29.712943+0000","last_became_active":"2024-05-09T05:34:54.327552+0000","last_became_peered":"2024-05-09T05:34:54.327552+0000","last_unstale":"2024-05-09T05:35:29.712943+0000","last_undegraded":"2024-05-09T05:35:29.712943+0000","last_fullsized":"2024-05-09T05:35:29.712943+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:33:13.840266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"81'3","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.499072+0000","last_change":"2024-05-09T05:34:51.292796+0000","last_active":"2024-05-09T05:35:29.499072+0000","last_peered":"2024-05-09T05:35:29.499072+0000","last_clean":"2024-05-09T05:35:29.499072+0000","last_became_active":"2024-05-09T05:34:51.292224+0000","last_became_peered":"2024-05-09T05:34:51.292224+0000","last_unstale":"2024-05-09T05:35:29.499072+0000","last_undegraded":"2024-05-09T05:35:29.499072+0000","last_fullsized":"2024-05-09T05:35:29.499072+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:32:02.925633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"81'1","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.511437+0000","last_change":"2024-05-09T05:35:29.510921+0000","last_active":"2024-05-09T05:35:29.511437+0000","last_peered":"2024-05-09T05:35:29.511437+0000","last_clean":"2024-05-09T05:35:29.511437+0000","last_became_active":"2024-05-09T05:35:29.506757+0000","last_became_peered":"2024-05-09T05:35:29.506757+0000","last_unstale":"2024-05-09T05:35:29.511437+0000","last_undegraded":"2024-05-09T05:35:29.511437+0000","last_fullsized":"2024-05-09T05:35:29.511437+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:13:57.924130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.713266+0000","last_change":"2024-05-09T05:34:54.332133+0000","last_active":"2024-05-09T05:35:29.713266+0000","last_peered":"2024-05-09T05:35:29.713266+0000","last_clean":"2024-05-09T05:35:29.713266+0000","last_became_active":"2024-05-09T05:34:54.331756+0000","last_became_peered":"2024-05-09T05:34:54.331756+0000","last_unstale":"2024-05-09T05:35:29.713266+0000","last_undegraded":"2024-05-09T05:35:29.713266+0000","last_fullsized":"2024-05-09T05:35:29.713266+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:47:54.341410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'11","reported_seq":49,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:31.335799+0000","last_change":"2024-05-09T05:35:29.509840+0000","last_active":"2024-05-09T05:35:31.335799+0000","last_peered":"2024-05-09T05:35:31.335799+0000","last_clean":"2024-05-09T05:35:31.335799+0000","last_became_active":"2024-05-09T05:35:29.505151+0000","last_became_peered":"2024-05-09T05:35:29.505151+0000","last_unstale":"2024-05-09T05:35:31.335799+0000","last_undegraded":"2024-05-09T05:35:31.335799+0000","last_fullsized":"2024-05-09T05:35:31.335799+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:04:38.224022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":11,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.502483+0000","last_change":"2024-05-09T05:34:54.339792+0000","last_active":"2024-05-09T05:35:29.502483+0000","last_peered":"2024-05-09T05:35:29.502483+0000","last_clean":"2024-05-09T05:35:29.502483+0000","last_became_active":"2024-05-09T05:34:54.339415+0000","last_became_peered":"2024-05-09T05:34:54.339415+0000","last_unstale":"2024-05-09T05:35:29.502483+0000","last_undegraded":"2024-05-09T05:35:29.502483+0000","last_fullsized":"2024-05-09T05:35:29.502483+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:08:14.148373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'4","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.714194+0000","last_change":"2024-05-09T05:34:51.284535+0000","last_active":"2024-05-09T05:35:29.714194+0000","last_peered":"2024-05-09T05:35:29.714194+0000","last_clean":"2024-05-09T05:35:29.714194+0000","last_became_active":"2024-05-09T05:34:51.283686+0000","last_became_peered":"2024-05-09T05:34:51.283686+0000","last_unstale":"2024-05-09T05:35:29.714194+0000","last_undegraded":"2024-05-09T05:35:29.714194+0000","last_fullsized":"2024-05-09T05:35:29.714194+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:05:58.544406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.505568+0000","last_change":"2024-05-09T05:34:54.344277+0000","last_active":"2024-05-09T05:35:29.505568+0000","last_peered":"2024-05-09T05:35:29.505568+0000","last_clean":"2024-05-09T05:35:29.505568+0000","last_became_active":"2024-05-09T05:34:54.343903+0000","last_became_peered":"2024-05-09T05:34:54.343903+0000","last_unstale":"2024-05-09T05:35:29.505568+0000","last_undegraded":"2024-05-09T05:35:29.505568+0000","last_fullsized":"2024-05-09T05:35:29.505568+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:33:21.052161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"81'2","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.499295+0000","last_change":"2024-05-09T05:34:51.660277+0000","last_active":"2024-05-09T05:35:29.499295+0000","last_peered":"2024-05-09T05:35:29.499295+0000","last_clean":"2024-05-09T05:35:29.499295+0000","last_became_active":"2024-05-09T05:34:51.659841+0000","last_became_peered":"2024-05-09T05:34:51.659841+0000","last_unstale":"2024-05-09T05:35:29.499295+0000","last_undegraded":"2024-05-09T05:35:29.499295+0000","last_fullsized":"2024-05-09T05:35:29.499295+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:35:41.307477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.502743+0000","last_change":"2024-05-09T05:34:54.330642+0000","last_active":"2024-05-09T05:35:29.502743+0000","last_peered":"2024-05-09T05:35:29.502743+0000","last_clean":"2024-05-09T05:35:29.502743+0000","last_became_active":"2024-05-09T05:34:54.330273+0000","last_became_peered":"2024-05-09T05:34:54.330273+0000","last_unstale":"2024-05-09T05:35:29.502743+0000","last_undegraded":"2024-05-09T05:35:29.502743+0000","last_fullsized":"2024-05-09T05:35:29.502743+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:27:17.520941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"81'3","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.502186+0000","last_change":"2024-05-09T05:34:51.288782+0000","last_active":"2024-05-09T05:35:29.502186+0000","last_peered":"2024-05-09T05:35:29.502186+0000","last_clean":"2024-05-09T05:35:29.502186+0000","last_became_active":"2024-05-09T05:34:51.288333+0000","last_became_peered":"2024-05-09T05:34:51.288333+0000","last_unstale":"2024-05-09T05:35:29.502186+0000","last_undegraded":"2024-05-09T05:35:29.502186+0000","last_fullsized":"2024-05-09T05:35:29.502186+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:13:11.893177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.503206+0000","last_change":"2024-05-09T05:34:54.343920+0000","last_active":"2024-05-09T05:35:29.503206+0000","last_peered":"2024-05-09T05:35:29.503206+0000","last_clean":"2024-05-09T05:35:29.503206+0000","last_became_active":"2024-05-09T05:34:54.343452+0000","last_became_peered":"2024-05-09T05:34:54.343452+0000","last_unstale":"2024-05-09T05:35:29.503206+0000","last_undegraded":"2024-05-09T05:35:29.503206+0000","last_fullsized":"2024-05-09T05:35:29.503206+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:28:56.425068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"81'1","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.499721+0000","last_change":"2024-05-09T05:34:51.290178+0000","last_active":"2024-05-09T05:35:29.499721+0000","last_peered":"2024-05-09T05:35:29.499721+0000","last_clean":"2024-05-09T05:35:29.499721+0000","last_became_active":"2024-05-09T05:34:51.289754+0000","last_became_peered":"2024-05-09T05:34:51.289754+0000","last_unstale":"2024-05-09T05:35:29.499721+0000","last_undegraded":"2024-05-09T05:35:29.499721+0000","last_fullsized":"2024-05-09T05:35:29.499721+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:51:41.221061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.502247+0000","last_change":"2024-05-09T05:34:54.330473+0000","last_active":"2024-05-09T05:35:29.502247+0000","last_peered":"2024-05-09T05:35:29.502247+0000","last_clean":"2024-05-09T05:35:29.502247+0000","last_became_active":"2024-05-09T05:34:54.329898+0000","last_became_peered":"2024-05-09T05:34:54.329898+0000","last_unstale":"2024-05-09T05:35:29.502247+0000","last_undegraded":"2024-05-09T05:35:29.502247+0000","last_fullsized":"2024-05-09T05:35:29.502247+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:26:24.727909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"81'4","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.503014+0000","last_change":"2024-05-09T05:34:51.294321+0000","last_active":"2024-05-09T05:35:29.503014+0000","last_peered":"2024-05-09T05:35:29.503014+0000","last_clean":"2024-05-09T05:35:29.503014+0000","last_became_active":"2024-05-09T05:34:51.293956+0000","last_became_peered":"2024-05-09T05:34:51.293956+0000","last_unstale":"2024-05-09T05:35:29.503014+0000","last_undegraded":"2024-05-09T05:35:29.503014+0000","last_fullsized":"2024-05-09T05:35:29.503014+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:45:10.404120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.499265+0000","last_change":"2024-05-09T05:34:54.335850+0000","last_active":"2024-05-09T05:35:29.499265+0000","last_peered":"2024-05-09T05:35:29.499265+0000","last_clean":"2024-05-09T05:35:29.499265+0000","last_became_active":"2024-05-09T05:34:54.335441+0000","last_became_peered":"2024-05-09T05:34:54.335441+0000","last_unstale":"2024-05-09T05:35:29.499265+0000","last_undegraded":"2024-05-09T05:35:29.499265+0000","last_fullsized":"2024-05-09T05:35:29.499265+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:15:32.379286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"81'3","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.500050+0000","last_change":"2024-05-09T05:34:51.662211+0000","last_active":"2024-05-09T05:35:29.500050+0000","last_peered":"2024-05-09T05:35:29.500050+0000","last_clean":"2024-05-09T05:35:29.500050+0000","last_became_active":"2024-05-09T05:34:51.661446+0000","last_became_peered":"2024-05-09T05:34:51.661446+0000","last_unstale":"2024-05-09T05:35:29.500050+0000","last_undegraded":"2024-05-09T05:35:29.500050+0000","last_fullsized":"2024-05-09T05:35:29.500050+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:35:56.098673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.499357+0000","last_change":"2024-05-09T05:34:54.342030+0000","last_active":"2024-05-09T05:35:29.499357+0000","last_peered":"2024-05-09T05:35:29.499357+0000","last_clean":"2024-05-09T05:35:29.499357+0000","last_became_active":"2024-05-09T05:34:54.338081+0000","last_became_peered":"2024-05-09T05:34:54.338081+0000","last_unstale":"2024-05-09T05:35:29.499357+0000","last_undegraded":"2024-05-09T05:35:29.499357+0000","last_fullsized":"2024-05-09T05:35:29.499357+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:40:55.042110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'1","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.505757+0000","last_change":"2024-05-09T05:34:51.293687+0000","last_active":"2024-05-09T05:35:29.505757+0000","last_peered":"2024-05-09T05:35:29.505757+0000","last_clean":"2024-05-09T05:35:29.505757+0000","last_became_active":"2024-05-09T05:34:51.293298+0000","last_became_peered":"2024-05-09T05:34:51.293298+0000","last_unstale":"2024-05-09T05:35:29.505757+0000","last_undegraded":"2024-05-09T05:35:29.505757+0000","last_fullsized":"2024-05-09T05:35:29.505757+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:39:57.031631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"81'1","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.499302+0000","last_change":"2024-05-09T05:34:54.344843+0000","last_active":"2024-05-09T05:35:29.499302+0000","last_peered":"2024-05-09T05:35:29.499302+0000","last_clean":"2024-05-09T05:35:29.499302+0000","last_became_active":"2024-05-09T05:34:54.339577+0000","last_became_peered":"2024-05-09T05:34:54.339577+0000","last_unstale":"2024-05-09T05:35:29.499302+0000","last_undegraded":"2024-05-09T05:35:29.499302+0000","last_fullsized":"2024-05-09T05:35:29.499302+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:03:42.398424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.713256+0000","last_change":"2024-05-09T05:34:51.292633+0000","last_active":"2024-05-09T05:35:29.713256+0000","last_peered":"2024-05-09T05:35:29.713256+0000","last_clean":"2024-05-09T05:35:29.713256+0000","last_became_active":"2024-05-09T05:34:51.292164+0000","last_became_peered":"2024-05-09T05:34:51.292164+0000","last_unstale":"2024-05-09T05:35:29.713256+0000","last_undegraded":"2024-05-09T05:35:29.713256+0000","last_fullsized":"2024-05-09T05:35:29.713256+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:27:30.527040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.499770+0000","last_change":"2024-05-09T05:34:54.345924+0000","last_active":"2024-05-09T05:35:29.499770+0000","last_peered":"2024-05-09T05:35:29.499770+0000","last_clean":"2024-05-09T05:35:29.499770+0000","last_became_active":"2024-05-09T05:34:54.344885+0000","last_became_peered":"2024-05-09T05:34:54.344885+0000","last_unstale":"2024-05-09T05:35:29.499770+0000","last_undegraded":"2024-05-09T05:35:29.499770+0000","last_fullsized":"2024-05-09T05:35:29.499770+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:59:40.079060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.503292+0000","last_change":"2024-05-09T05:34:54.340599+0000","last_active":"2024-05-09T05:35:29.503292+0000","last_peered":"2024-05-09T05:35:29.503292+0000","last_clean":"2024-05-09T05:35:29.503292+0000","last_became_active":"2024-05-09T05:34:54.340194+0000","last_became_peered":"2024-05-09T05:34:54.340194+0000","last_unstale":"2024-05-09T05:35:29.503292+0000","last_undegraded":"2024-05-09T05:35:29.503292+0000","last_fullsized":"2024-05-09T05:35:29.503292+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:10:15.868670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.499659+0000","last_change":"2024-05-09T05:34:54.334658+0000","last_active":"2024-05-09T05:35:29.499659+0000","last_peered":"2024-05-09T05:35:29.499659+0000","last_clean":"2024-05-09T05:35:29.499659+0000","last_became_active":"2024-05-09T05:34:54.334317+0000","last_became_peered":"2024-05-09T05:34:54.334317+0000","last_unstale":"2024-05-09T05:35:29.499659+0000","last_undegraded":"2024-05-09T05:35:29.499659+0000","last_fullsized":"2024-05-09T05:35:29.499659+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:50:28.262145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.499590+0000","last_change":"2024-05-09T05:34:54.330380+0000","last_active":"2024-05-09T05:35:29.499590+0000","last_peered":"2024-05-09T05:35:29.499590+0000","last_clean":"2024-05-09T05:35:29.499590+0000","last_became_active":"2024-05-09T05:34:54.329984+0000","last_became_peered":"2024-05-09T05:34:54.329984+0000","last_unstale":"2024-05-09T05:35:29.499590+0000","last_undegraded":"2024-05-09T05:35:29.499590+0000","last_fullsized":"2024-05-09T05:35:29.499590+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:10:26.051644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.506217+0000","last_change":"2024-05-09T05:34:54.344755+0000","last_active":"2024-05-09T05:35:29.506217+0000","last_peered":"2024-05-09T05:35:29.506217+0000","last_clean":"2024-05-09T05:35:29.506217+0000","last_became_active":"2024-05-09T05:34:54.343968+0000","last_became_peered":"2024-05-09T05:34:54.343968+0000","last_unstale":"2024-05-09T05:35:29.506217+0000","last_undegraded":"2024-05-09T05:35:29.506217+0000","last_fullsized":"2024-05-09T05:35:29.506217+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:58:32.086079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.713140+0000","last_change":"2024-05-09T05:34:54.335427+0000","last_active":"2024-05-09T05:35:29.713140+0000","last_peered":"2024-05-09T05:35:29.713140+0000","last_clean":"2024-05-09T05:35:29.713140+0000","last_became_active":"2024-05-09T05:34:54.335091+0000","last_became_peered":"2024-05-09T05:34:54.335091+0000","last_unstale":"2024-05-09T05:35:29.713140+0000","last_undegraded":"2024-05-09T05:35:29.713140+0000","last_fullsized":"2024-05-09T05:35:29.713140+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:24:05.939805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.504048+0000","last_change":"2024-05-09T05:34:54.342056+0000","last_active":"2024-05-09T05:35:29.504048+0000","last_peered":"2024-05-09T05:35:29.504048+0000","last_clean":"2024-05-09T05:35:29.504048+0000","last_became_active":"2024-05-09T05:34:54.341655+0000","last_became_peered":"2024-05-09T05:34:54.341655+0000","last_unstale":"2024-05-09T05:35:29.504048+0000","last_undegraded":"2024-05-09T05:35:29.504048+0000","last_fullsized":"2024-05-09T05:35:29.504048+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:19:50.284110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.499971+0000","last_change":"2024-05-09T05:34:54.331670+0000","last_active":"2024-05-09T05:35:29.499971+0000","last_peered":"2024-05-09T05:35:29.499971+0000","last_clean":"2024-05-09T05:35:29.499971+0000","last_became_active":"2024-05-09T05:34:54.330722+0000","last_became_peered":"2024-05-09T05:34:54.330722+0000","last_unstale":"2024-05-09T05:35:29.499971+0000","last_undegraded":"2024-05-09T05:35:29.499971+0000","last_fullsized":"2024-05-09T05:35:29.499971+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:36:10.417933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.502370+0000","last_change":"2024-05-09T05:34:54.336487+0000","last_active":"2024-05-09T05:35:29.502370+0000","last_peered":"2024-05-09T05:35:29.502370+0000","last_clean":"2024-05-09T05:35:29.502370+0000","last_became_active":"2024-05-09T05:34:54.336141+0000","last_became_peered":"2024-05-09T05:34:54.336141+0000","last_unstale":"2024-05-09T05:35:29.502370+0000","last_undegraded":"2024-05-09T05:35:29.502370+0000","last_fullsized":"2024-05-09T05:35:29.502370+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:45:42.541374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.504577+0000","last_change":"2024-05-09T05:34:54.330749+0000","last_active":"2024-05-09T05:35:29.504577+0000","last_peered":"2024-05-09T05:35:29.504577+0000","last_clean":"2024-05-09T05:35:29.504577+0000","last_became_active":"2024-05-09T05:34:54.330279+0000","last_became_peered":"2024-05-09T05:34:54.330279+0000","last_unstale":"2024-05-09T05:35:29.504577+0000","last_undegraded":"2024-05-09T05:35:29.504577+0000","last_fullsized":"2024-05-09T05:35:29.504577+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:49:48.704977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.502153+0000","last_change":"2024-05-09T05:34:54.338296+0000","last_active":"2024-05-09T05:35:29.502153+0000","last_peered":"2024-05-09T05:35:29.502153+0000","last_clean":"2024-05-09T05:35:29.502153+0000","last_became_active":"2024-05-09T05:34:54.337960+0000","last_became_peered":"2024-05-09T05:34:54.337960+0000","last_unstale":"2024-05-09T05:35:29.502153+0000","last_undegraded":"2024-05-09T05:35:29.502153+0000","last_fullsized":"2024-05-09T05:35:29.502153+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:48:46.436082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.500276+0000","last_change":"2024-05-09T05:34:54.334782+0000","last_active":"2024-05-09T05:35:29.500276+0000","last_peered":"2024-05-09T05:35:29.500276+0000","last_clean":"2024-05-09T05:35:29.500276+0000","last_became_active":"2024-05-09T05:34:54.333118+0000","last_became_peered":"2024-05-09T05:34:54.333118+0000","last_unstale":"2024-05-09T05:35:29.500276+0000","last_undegraded":"2024-05-09T05:35:29.500276+0000","last_fullsized":"2024-05-09T05:35:29.500276+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:04:40.473387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.713299+0000","last_change":"2024-05-09T05:34:54.334627+0000","last_active":"2024-05-09T05:35:29.713299+0000","last_peered":"2024-05-09T05:35:29.713299+0000","last_clean":"2024-05-09T05:35:29.713299+0000","last_became_active":"2024-05-09T05:34:54.333966+0000","last_became_peered":"2024-05-09T05:34:54.333966+0000","last_unstale":"2024-05-09T05:35:29.713299+0000","last_undegraded":"2024-05-09T05:35:29.713299+0000","last_fullsized":"2024-05-09T05:35:29.713299+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:15:57.733926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.507005+0000","last_change":"2024-05-09T05:35:29.507005+0000","last_active":"2024-05-09T05:35:29.507005+0000","last_peered":"2024-05-09T05:35:29.507005+0000","last_clean":"2024-05-09T05:35:29.507005+0000","last_became_active":"2024-05-09T05:35:29.506521+0000","last_became_peered":"2024-05-09T05:35:29.506521+0000","last_unstale":"2024-05-09T05:35:29.507005+0000","last_undegraded":"2024-05-09T05:35:29.507005+0000","last_fullsized":"2024-05-09T05:35:29.507005+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:58:24.605073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":54696,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":146,"num_read_kb":119,"num_write":159,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":42223,"num_keys_recovered":11,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":397312,"data_stored":168898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":135,"ondisk_log_size":135,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612632,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":440786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808861,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":41052,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704100,"statfs":{"total":95995035648,"available":95952998400,"internally_reserved":0,"allocated":1589248,"data_stored":1083331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":40434112},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972387,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":917504,"data_stored":441000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168617,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32072,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713080,"statfs":{"total":95995035648,"available":95962193920,"internally_reserved":0,"allocated":913408,"data_stored":440898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397549,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36820,"kb_used_data":1476,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708332,"statfs":{"total":95995035648,"available":95957331968,"internally_reserved":0,"allocated":1511424,"data_stored":1032850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593778,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":440389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574923,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":962560,"data_stored":495687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738450,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32084,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713068,"statfs":{"total":95995035648,"available":95962181632,"internally_reserved":0,"allocated":925696,"data_stored":441660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411399,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":921600,"data_stored":441532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182466,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":921600,"data_stored":440700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986235,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":970752,"data_stored":491912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790007,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36832,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708320,"statfs":{"total":95995035648,"available":95957319680,"internally_reserved":0,"allocated":1523712,"data_stored":1032143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":55505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":51730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":52664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T05:35:39.740 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph pg dump --format=json 2024-05-09T05:35:39.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:35:39 smithi060 ceph-mon[34555]: pgmap v318: 97 pgs: 97 active+clean; 630 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 3.5 KiB/s wr, 6 op/s; 4.3 KiB/s, 1 keys/s, 0 objects/s recovering 2024-05-09T05:35:39.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:35:39 smithi100 ceph-mon[34353]: pgmap v318: 97 pgs: 97 active+clean; 630 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 3.5 KiB/s wr, 6 op/s; 4.3 KiB/s, 1 keys/s, 0 objects/s recovering 2024-05-09T05:35:39.993 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T05:35:40.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:35:40 smithi039 ceph-mon[30439]: from='client.14748 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-09T05:35:40.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:35:40 smithi100 ceph-mon[34353]: from='client.14748 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-09T05:35:41.046 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:35:40 smithi060 ceph-mon[34555]: from='client.14748 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-09T05:35:41.695 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:41.698+0000 7f09cfa93700 1 -- 172.21.15.39:0/4206859846 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f09c81045f0 msgr2=0x7f09c8104a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:35:41.695 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:41.698+0000 7f09cfa93700 1 --2- 172.21.15.39:0/4206859846 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f09c81045f0 0x7f09c8104a00 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f09c40099c0 tx=0x7f09c4009cd0 comp rx=0 tx=0).stop 2024-05-09T05:35:41.695 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:41.698+0000 7f09cfa93700 1 -- 172.21.15.39:0/4206859846 shutdown_connections 2024-05-09T05:35:41.695 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:41.698+0000 7f09cfa93700 1 --2- 172.21.15.39:0/4206859846 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f09c8109870 0x7f09c81111d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:41.695 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:41.698+0000 7f09cfa93700 1 --2- 172.21.15.39:0/4206859846 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f09c81045f0 0x7f09c8104a00 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:41.695 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:41.698+0000 7f09cfa93700 1 --2- 172.21.15.39:0/4206859846 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09c8108f20 0x7f09c8109330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:41.695 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:41.698+0000 7f09cfa93700 1 -- 172.21.15.39:0/4206859846 >> 172.21.15.39:0/4206859846 conn(0x7f09c8100040 msgr2=0x7f09c8102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:35:41.696 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:41.698+0000 7f09cfa93700 1 -- 172.21.15.39:0/4206859846 shutdown_connections 2024-05-09T05:35:41.696 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:41.698+0000 7f09cfa93700 1 -- 172.21.15.39:0/4206859846 wait complete. 2024-05-09T05:35:41.696 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:41.698+0000 7f09cfa93700 1 Processor -- start 2024-05-09T05:35:41.696 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:41.698+0000 7f09cfa93700 1 -- start start 2024-05-09T05:35:41.696 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:41.699+0000 7f09cfa93700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f09c81045f0 0x7f09c819aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:35:41.696 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:41.699+0000 7f09cfa93700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09c8108f20 0x7f09c819b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:35:41.696 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:41.699+0000 7f09cfa93700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f09c8109870 0x7f09c819f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:35:41.696 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:41.699+0000 7f09cfa93700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f09c81144a0 con 0x7f09c81045f0 2024-05-09T05:35:41.696 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:41.699+0000 7f09cfa93700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f09c8114320 con 0x7f09c8109870 2024-05-09T05:35:41.696 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:41.699+0000 7f09cfa93700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f09c8114620 con 0x7f09c8108f20 2024-05-09T05:35:41.696 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:41.699+0000 7f09cd82f700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f09c81045f0 0x7f09c819aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:35:41.697 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:41.699+0000 7f09cd82f700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f09c81045f0 0x7f09c819aed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35082/0 (socket says 172.21.15.39:35082) 2024-05-09T05:35:41.697 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:41.699+0000 7f09cd82f700 1 -- 172.21.15.39:0/117079353 learned_addr learned my addr 172.21.15.39:0/117079353 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:35:41.697 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:41.699+0000 7f09ce030700 1 --2- 172.21.15.39:0/117079353 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f09c8109870 0x7f09c819f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:35:41.697 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:41.699+0000 7f09cd02e700 1 --2- 172.21.15.39:0/117079353 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09c8108f20 0x7f09c819b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:35:41.697 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:41.699+0000 7f09cd82f700 1 -- 172.21.15.39:0/117079353 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09c8108f20 msgr2=0x7f09c819b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:35:41.697 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:41.699+0000 7f09cd82f700 1 --2- 172.21.15.39:0/117079353 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09c8108f20 0x7f09c819b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:41.697 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:41.699+0000 7f09cd82f700 1 -- 172.21.15.39:0/117079353 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f09c8109870 msgr2=0x7f09c819f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:35:41.697 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:41.699+0000 7f09cd82f700 1 --2- 172.21.15.39:0/117079353 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f09c8109870 0x7f09c819f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:41.697 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:41.699+0000 7f09cd82f700 1 -- 172.21.15.39:0/117079353 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09c819fda0 con 0x7f09c81045f0 2024-05-09T05:35:41.697 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:41.699+0000 7f09cd82f700 1 --2- 172.21.15.39:0/117079353 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f09c81045f0 0x7f09c819aed0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f09c400b580 tx=0x7f09c40047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:35:41.697 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:41.700+0000 7f09beffd700 1 -- 172.21.15.39:0/117079353 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09c4027070 con 0x7f09c81045f0 2024-05-09T05:35:41.697 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:41.700+0000 7f09cfa93700 1 -- 172.21.15.39:0/117079353 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09c81a0030 con 0x7f09c81045f0 2024-05-09T05:35:41.697 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:41.700+0000 7f09beffd700 1 -- 172.21.15.39:0/117079353 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f09c40040a0 con 0x7f09c81045f0 2024-05-09T05:35:41.697 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:41.700+0000 7f09beffd700 1 -- 172.21.15.39:0/117079353 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09c400f460 con 0x7f09c81045f0 2024-05-09T05:35:41.698 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:41.700+0000 7f09cfa93700 1 -- 172.21.15.39:0/117079353 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09c81a79b0 con 0x7f09c81045f0 2024-05-09T05:35:41.698 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:41.701+0000 7f09cfa93700 1 -- 172.21.15.39:0/117079353 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09c8105aa0 con 0x7f09c81045f0 2024-05-09T05:35:41.699 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:41.702+0000 7f09beffd700 1 -- 172.21.15.39:0/117079353 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f09c402a070 con 0x7f09c81045f0 2024-05-09T05:35:41.699 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:41.703+0000 7f09beffd700 1 --2- 172.21.15.39:0/117079353 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f09b40b2910 0x7f09b40b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:35:41.699 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:41.703+0000 7f09cd02e700 1 --2- 172.21.15.39:0/117079353 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f09b40b2910 0x7f09b40b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:35:41.699 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:41.703+0000 7f09beffd700 1 -- 172.21.15.39:0/117079353 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f09c40e3400 con 0x7f09c81045f0 2024-05-09T05:35:41.699 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:41.704+0000 7f09cd02e700 1 --2- 172.21.15.39:0/117079353 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f09b40b2910 0x7f09b40b4e20 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f09b8005fd0 tx=0x7f09b800a560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:35:41.701 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:41.708+0000 7f09beffd700 1 -- 172.21.15.39:0/117079353 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f09c4013070 con 0x7f09c81045f0 2024-05-09T05:35:41.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:35:41 smithi039 ceph-mon[30439]: pgmap v319: 97 pgs: 97 active+clean; 635 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.9 KiB/s wr, 7 op/s; 3.9 KiB/s, 1 keys/s, 0 objects/s recovering 2024-05-09T05:35:41.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:41.918+0000 7f09cfa93700 1 -- 172.21.15.39:0/117079353 --> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f09c80512c0 con 0x7f09b40b2910 2024-05-09T05:35:41.919 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:41.926+0000 7f09beffd700 1 -- 172.21.15.39:0/117079353 <== mgr.14152 v2:172.21.15.39:6800/3184189003 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258713 (secure 0 0 0) 0x7f09c80512c0 con 0x7f09b40b2910 2024-05-09T05:35:41.922 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-09T05:35:41.925 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:41.929+0000 7f09cfa93700 1 -- 172.21.15.39:0/117079353 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f09b40b2910 msgr2=0x7f09b40b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:35:41.925 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:41.929+0000 7f09cfa93700 1 --2- 172.21.15.39:0/117079353 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f09b40b2910 0x7f09b40b4e20 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f09b8005fd0 tx=0x7f09b800a560 comp rx=0 tx=0).stop 2024-05-09T05:35:41.925 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:41.929+0000 7f09cfa93700 1 -- 172.21.15.39:0/117079353 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f09c81045f0 msgr2=0x7f09c819aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:35:41.925 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:41.929+0000 7f09cfa93700 1 --2- 172.21.15.39:0/117079353 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f09c81045f0 0x7f09c819aed0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f09c400b580 tx=0x7f09c40047b0 comp rx=0 tx=0).stop 2024-05-09T05:35:41.925 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:41.929+0000 7f09cfa93700 1 -- 172.21.15.39:0/117079353 shutdown_connections 2024-05-09T05:35:41.925 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:41.929+0000 7f09cfa93700 1 --2- 172.21.15.39:0/117079353 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f09b40b2910 0x7f09b40b4e20 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:41.925 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:41.929+0000 7f09cfa93700 1 --2- 172.21.15.39:0/117079353 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f09c8109870 0x7f09c819f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:41.925 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:41.929+0000 7f09cfa93700 1 --2- 172.21.15.39:0/117079353 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f09c81045f0 0x7f09c819aed0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:41.926 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:41.929+0000 7f09cfa93700 1 --2- 172.21.15.39:0/117079353 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09c8108f20 0x7f09c819b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:41.926 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:41.929+0000 7f09cfa93700 1 -- 172.21.15.39:0/117079353 >> 172.21.15.39:0/117079353 conn(0x7f09c8100040 msgr2=0x7f09c8102f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:35:41.926 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:41.929+0000 7f09cfa93700 1 -- 172.21.15.39:0/117079353 shutdown_connections 2024-05-09T05:35:41.926 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:41.929+0000 7f09cfa93700 1 -- 172.21.15.39:0/117079353 wait complete. 2024-05-09T05:35:41.926 INFO:teuthology.orchestra.run.smithi039.stderr:dumped all 2024-05-09T05:35:41.927 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:35:41 smithi100 ceph-mon[34353]: pgmap v319: 97 pgs: 97 active+clean; 635 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.9 KiB/s wr, 7 op/s; 3.9 KiB/s, 1 keys/s, 0 objects/s recovering 2024-05-09T05:35:41.947 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:35:41 smithi060 ceph-mon[34555]: pgmap v319: 97 pgs: 97 active+clean; 635 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.9 KiB/s wr, 7 op/s; 3.9 KiB/s, 1 keys/s, 0 objects/s recovering 2024-05-09T05:35:42.569 INFO:teuthology.orchestra.run.smithi039.stdout:{"pg_ready":true,"pg_map":{"version":319,"stamp":"2024-05-09T05:35:40.139031+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":650108,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":248,"num_read_kb":198,"num_write":287,"num_write_kb":2257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":2994063,"num_keys_recovered":11,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":232,"ondisk_log_size":232,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":378504,"kb_used_data":12672,"kb_used_omap":18,"kb_used_meta":365677,"kb_avail":1124563320,"statfs":{"total":1151940427776,"available":1151552839680,"internally_reserved":0,"allocated":12976128,"data_stored":7232508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":374453562},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":13421,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":59,"num_read_kb":42,"num_write":17,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":42223,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.641978"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.503540+0000","last_change":"2024-05-09T05:34:54.344495+0000","last_active":"2024-05-09T05:35:29.503540+0000","last_peered":"2024-05-09T05:35:29.503540+0000","last_clean":"2024-05-09T05:35:29.503540+0000","last_became_active":"2024-05-09T05:34:54.343680+0000","last_became_peered":"2024-05-09T05:34:54.343680+0000","last_unstale":"2024-05-09T05:35:29.503540+0000","last_undegraded":"2024-05-09T05:35:29.503540+0000","last_fullsized":"2024-05-09T05:35:29.503540+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:46:41.289022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.505470+0000","last_change":"2024-05-09T05:34:54.341618+0000","last_active":"2024-05-09T05:35:29.505470+0000","last_peered":"2024-05-09T05:35:29.505470+0000","last_clean":"2024-05-09T05:35:29.505470+0000","last_became_active":"2024-05-09T05:34:54.341176+0000","last_became_peered":"2024-05-09T05:34:54.341176+0000","last_unstale":"2024-05-09T05:35:29.505470+0000","last_undegraded":"2024-05-09T05:35:29.505470+0000","last_fullsized":"2024-05-09T05:35:29.505470+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:05:45.291132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.506037+0000","last_change":"2024-05-09T05:34:54.337847+0000","last_active":"2024-05-09T05:35:29.506037+0000","last_peered":"2024-05-09T05:35:29.506037+0000","last_clean":"2024-05-09T05:35:29.506037+0000","last_became_active":"2024-05-09T05:34:54.337449+0000","last_became_peered":"2024-05-09T05:34:54.337449+0000","last_unstale":"2024-05-09T05:35:29.506037+0000","last_undegraded":"2024-05-09T05:35:29.506037+0000","last_fullsized":"2024-05-09T05:35:29.506037+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:30:34.140802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.715051+0000","last_change":"2024-05-09T05:34:54.344969+0000","last_active":"2024-05-09T05:35:29.715051+0000","last_peered":"2024-05-09T05:35:29.715051+0000","last_clean":"2024-05-09T05:35:29.715051+0000","last_became_active":"2024-05-09T05:34:54.343975+0000","last_became_peered":"2024-05-09T05:34:54.343975+0000","last_unstale":"2024-05-09T05:35:29.715051+0000","last_undegraded":"2024-05-09T05:35:29.715051+0000","last_fullsized":"2024-05-09T05:35:29.715051+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:46:19.075155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.503160+0000","last_change":"2024-05-09T05:34:54.324335+0000","last_active":"2024-05-09T05:35:29.503160+0000","last_peered":"2024-05-09T05:35:29.503160+0000","last_clean":"2024-05-09T05:35:29.503160+0000","last_became_active":"2024-05-09T05:34:54.323950+0000","last_became_peered":"2024-05-09T05:34:54.323950+0000","last_unstale":"2024-05-09T05:35:29.503160+0000","last_undegraded":"2024-05-09T05:35:29.503160+0000","last_fullsized":"2024-05-09T05:35:29.503160+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:36:08.406518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.502572+0000","last_change":"2024-05-09T05:34:54.334887+0000","last_active":"2024-05-09T05:35:29.502572+0000","last_peered":"2024-05-09T05:35:29.502572+0000","last_clean":"2024-05-09T05:35:29.502572+0000","last_became_active":"2024-05-09T05:34:54.334420+0000","last_became_peered":"2024-05-09T05:34:54.334420+0000","last_unstale":"2024-05-09T05:35:29.502572+0000","last_undegraded":"2024-05-09T05:35:29.502572+0000","last_fullsized":"2024-05-09T05:35:29.502572+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:11:54.882338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.498923+0000","last_change":"2024-05-09T05:34:54.332085+0000","last_active":"2024-05-09T05:35:29.498923+0000","last_peered":"2024-05-09T05:35:29.498923+0000","last_clean":"2024-05-09T05:35:29.498923+0000","last_became_active":"2024-05-09T05:34:54.331648+0000","last_became_peered":"2024-05-09T05:34:54.331648+0000","last_unstale":"2024-05-09T05:35:29.498923+0000","last_undegraded":"2024-05-09T05:35:29.498923+0000","last_fullsized":"2024-05-09T05:35:29.498923+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:01:36.258271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.502103+0000","last_change":"2024-05-09T05:34:54.332924+0000","last_active":"2024-05-09T05:35:29.502103+0000","last_peered":"2024-05-09T05:35:29.502103+0000","last_clean":"2024-05-09T05:35:29.502103+0000","last_became_active":"2024-05-09T05:34:54.332370+0000","last_became_peered":"2024-05-09T05:34:54.332370+0000","last_unstale":"2024-05-09T05:35:29.502103+0000","last_undegraded":"2024-05-09T05:35:29.502103+0000","last_fullsized":"2024-05-09T05:35:29.502103+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:01:59.785668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.500313+0000","last_change":"2024-05-09T05:34:54.339222+0000","last_active":"2024-05-09T05:35:29.500313+0000","last_peered":"2024-05-09T05:35:29.500313+0000","last_clean":"2024-05-09T05:35:29.500313+0000","last_became_active":"2024-05-09T05:34:54.338832+0000","last_became_peered":"2024-05-09T05:34:54.338832+0000","last_unstale":"2024-05-09T05:35:29.500313+0000","last_undegraded":"2024-05-09T05:35:29.500313+0000","last_fullsized":"2024-05-09T05:35:29.500313+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:03:01.416515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.503162+0000","last_change":"2024-05-09T05:34:54.338774+0000","last_active":"2024-05-09T05:35:29.503162+0000","last_peered":"2024-05-09T05:35:29.503162+0000","last_clean":"2024-05-09T05:35:29.503162+0000","last_became_active":"2024-05-09T05:34:54.337259+0000","last_became_peered":"2024-05-09T05:34:54.337259+0000","last_unstale":"2024-05-09T05:35:29.503162+0000","last_undegraded":"2024-05-09T05:35:29.503162+0000","last_fullsized":"2024-05-09T05:35:29.503162+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:51:57.298412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.499221+0000","last_change":"2024-05-09T05:34:54.343973+0000","last_active":"2024-05-09T05:35:29.499221+0000","last_peered":"2024-05-09T05:35:29.499221+0000","last_clean":"2024-05-09T05:35:29.499221+0000","last_became_active":"2024-05-09T05:34:54.338980+0000","last_became_peered":"2024-05-09T05:34:54.338980+0000","last_unstale":"2024-05-09T05:35:29.499221+0000","last_undegraded":"2024-05-09T05:35:29.499221+0000","last_fullsized":"2024-05-09T05:35:29.499221+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:28:11.575715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.715054+0000","last_change":"2024-05-09T05:34:54.348135+0000","last_active":"2024-05-09T05:35:29.715054+0000","last_peered":"2024-05-09T05:35:29.715054+0000","last_clean":"2024-05-09T05:35:29.715054+0000","last_became_active":"2024-05-09T05:34:54.347686+0000","last_became_peered":"2024-05-09T05:34:54.347686+0000","last_unstale":"2024-05-09T05:35:29.715054+0000","last_undegraded":"2024-05-09T05:35:29.715054+0000","last_fullsized":"2024-05-09T05:35:29.715054+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:14:23.462361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.713149+0000","last_change":"2024-05-09T05:34:54.330614+0000","last_active":"2024-05-09T05:35:29.713149+0000","last_peered":"2024-05-09T05:35:29.713149+0000","last_clean":"2024-05-09T05:35:29.713149+0000","last_became_active":"2024-05-09T05:34:54.329739+0000","last_became_peered":"2024-05-09T05:34:54.329739+0000","last_unstale":"2024-05-09T05:35:29.713149+0000","last_undegraded":"2024-05-09T05:35:29.713149+0000","last_fullsized":"2024-05-09T05:35:29.713149+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:42:57.702085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.505437+0000","last_change":"2024-05-09T05:34:54.331920+0000","last_active":"2024-05-09T05:35:29.505437+0000","last_peered":"2024-05-09T05:35:29.505437+0000","last_clean":"2024-05-09T05:35:29.505437+0000","last_became_active":"2024-05-09T05:34:54.331548+0000","last_became_peered":"2024-05-09T05:34:54.331548+0000","last_unstale":"2024-05-09T05:35:29.505437+0000","last_undegraded":"2024-05-09T05:35:29.505437+0000","last_fullsized":"2024-05-09T05:35:29.505437+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:33:23.343863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.505122+0000","last_change":"2024-05-09T05:34:54.344257+0000","last_active":"2024-05-09T05:35:29.505122+0000","last_peered":"2024-05-09T05:35:29.505122+0000","last_clean":"2024-05-09T05:35:29.505122+0000","last_became_active":"2024-05-09T05:34:54.343888+0000","last_became_peered":"2024-05-09T05:34:54.343888+0000","last_unstale":"2024-05-09T05:35:29.505122+0000","last_undegraded":"2024-05-09T05:35:29.505122+0000","last_fullsized":"2024-05-09T05:35:29.505122+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:19:11.952108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.499265+0000","last_change":"2024-05-09T05:34:54.334613+0000","last_active":"2024-05-09T05:35:29.499265+0000","last_peered":"2024-05-09T05:35:29.499265+0000","last_clean":"2024-05-09T05:35:29.499265+0000","last_became_active":"2024-05-09T05:34:54.334225+0000","last_became_peered":"2024-05-09T05:34:54.334225+0000","last_unstale":"2024-05-09T05:35:29.499265+0000","last_undegraded":"2024-05-09T05:35:29.499265+0000","last_fullsized":"2024-05-09T05:35:29.499265+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:21.411510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.503688+0000","last_change":"2024-05-09T05:34:54.343915+0000","last_active":"2024-05-09T05:35:29.503688+0000","last_peered":"2024-05-09T05:35:29.503688+0000","last_clean":"2024-05-09T05:35:29.503688+0000","last_became_active":"2024-05-09T05:34:54.343494+0000","last_became_peered":"2024-05-09T05:34:54.343494+0000","last_unstale":"2024-05-09T05:35:29.503688+0000","last_undegraded":"2024-05-09T05:35:29.503688+0000","last_fullsized":"2024-05-09T05:35:29.503688+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:41:47.961863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.500404+0000","last_change":"2024-05-09T05:34:54.334272+0000","last_active":"2024-05-09T05:35:29.500404+0000","last_peered":"2024-05-09T05:35:29.500404+0000","last_clean":"2024-05-09T05:35:29.500404+0000","last_became_active":"2024-05-09T05:34:54.333949+0000","last_became_peered":"2024-05-09T05:34:54.333949+0000","last_unstale":"2024-05-09T05:35:29.500404+0000","last_undegraded":"2024-05-09T05:35:29.500404+0000","last_fullsized":"2024-05-09T05:35:29.500404+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:36:22.562719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.499988+0000","last_change":"2024-05-09T05:34:54.332763+0000","last_active":"2024-05-09T05:35:29.499988+0000","last_peered":"2024-05-09T05:35:29.499988+0000","last_clean":"2024-05-09T05:35:29.499988+0000","last_became_active":"2024-05-09T05:34:54.332260+0000","last_became_peered":"2024-05-09T05:34:54.332260+0000","last_unstale":"2024-05-09T05:35:29.499988+0000","last_undegraded":"2024-05-09T05:35:29.499988+0000","last_fullsized":"2024-05-09T05:35:29.499988+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:12:25.338294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"81'9","reported_seq":36,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.500519+0000","last_change":"2024-05-09T05:34:51.290514+0000","last_active":"2024-05-09T05:35:29.500519+0000","last_peered":"2024-05-09T05:35:29.500519+0000","last_clean":"2024-05-09T05:35:29.500519+0000","last_became_active":"2024-05-09T05:34:51.290097+0000","last_became_peered":"2024-05-09T05:34:51.290097+0000","last_unstale":"2024-05-09T05:35:29.500519+0000","last_undegraded":"2024-05-09T05:35:29.500519+0000","last_fullsized":"2024-05-09T05:35:29.500519+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:02:59.460307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.502491+0000","last_change":"2024-05-09T05:34:54.334272+0000","last_active":"2024-05-09T05:35:29.502491+0000","last_peered":"2024-05-09T05:35:29.502491+0000","last_clean":"2024-05-09T05:35:29.502491+0000","last_became_active":"2024-05-09T05:34:54.333926+0000","last_became_peered":"2024-05-09T05:34:54.333926+0000","last_unstale":"2024-05-09T05:35:29.502491+0000","last_undegraded":"2024-05-09T05:35:29.502491+0000","last_fullsized":"2024-05-09T05:35:29.502491+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:26:04.058278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"81'2","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.502646+0000","last_change":"2024-05-09T05:34:51.660596+0000","last_active":"2024-05-09T05:35:29.502646+0000","last_peered":"2024-05-09T05:35:29.502646+0000","last_clean":"2024-05-09T05:35:29.502646+0000","last_became_active":"2024-05-09T05:34:51.660214+0000","last_became_peered":"2024-05-09T05:34:51.660214+0000","last_unstale":"2024-05-09T05:35:29.502646+0000","last_undegraded":"2024-05-09T05:35:29.502646+0000","last_fullsized":"2024-05-09T05:35:29.502646+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:36:08.717797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.505824+0000","last_change":"2024-05-09T05:34:54.337863+0000","last_active":"2024-05-09T05:35:29.505824+0000","last_peered":"2024-05-09T05:35:29.505824+0000","last_clean":"2024-05-09T05:35:29.505824+0000","last_became_active":"2024-05-09T05:34:54.337476+0000","last_became_peered":"2024-05-09T05:34:54.337476+0000","last_unstale":"2024-05-09T05:35:29.505824+0000","last_undegraded":"2024-05-09T05:35:29.505824+0000","last_fullsized":"2024-05-09T05:35:29.505824+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:18:23.266499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"81'4","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.503655+0000","last_change":"2024-05-09T05:34:51.294750+0000","last_active":"2024-05-09T05:35:29.503655+0000","last_peered":"2024-05-09T05:35:29.503655+0000","last_clean":"2024-05-09T05:35:29.503655+0000","last_became_active":"2024-05-09T05:34:51.294305+0000","last_became_peered":"2024-05-09T05:34:51.294305+0000","last_unstale":"2024-05-09T05:35:29.503655+0000","last_undegraded":"2024-05-09T05:35:29.503655+0000","last_fullsized":"2024-05-09T05:35:29.503655+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:15:22.877230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.499546+0000","last_change":"2024-05-09T05:34:54.334540+0000","last_active":"2024-05-09T05:35:29.499546+0000","last_peered":"2024-05-09T05:35:29.499546+0000","last_clean":"2024-05-09T05:35:29.499546+0000","last_became_active":"2024-05-09T05:34:54.333416+0000","last_became_peered":"2024-05-09T05:34:54.333416+0000","last_unstale":"2024-05-09T05:35:29.499546+0000","last_undegraded":"2024-05-09T05:35:29.499546+0000","last_fullsized":"2024-05-09T05:35:29.499546+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:37:30.862850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.503293+0000","last_change":"2024-05-09T05:34:51.290377+0000","last_active":"2024-05-09T05:35:29.503293+0000","last_peered":"2024-05-09T05:35:29.503293+0000","last_clean":"2024-05-09T05:35:29.503293+0000","last_became_active":"2024-05-09T05:34:51.289974+0000","last_became_peered":"2024-05-09T05:34:51.289974+0000","last_unstale":"2024-05-09T05:35:29.503293+0000","last_undegraded":"2024-05-09T05:35:29.503293+0000","last_fullsized":"2024-05-09T05:35:29.503293+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:40:04.454876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.505866+0000","last_change":"2024-05-09T05:34:54.338620+0000","last_active":"2024-05-09T05:35:29.505866+0000","last_peered":"2024-05-09T05:35:29.505866+0000","last_clean":"2024-05-09T05:35:29.505866+0000","last_became_active":"2024-05-09T05:34:54.338218+0000","last_became_peered":"2024-05-09T05:34:54.338218+0000","last_unstale":"2024-05-09T05:35:29.505866+0000","last_undegraded":"2024-05-09T05:35:29.505866+0000","last_fullsized":"2024-05-09T05:35:29.505866+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:23:51.484732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"81'5","reported_seq":58,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:36.312782+0000","last_change":"2024-05-09T05:34:51.293962+0000","last_active":"2024-05-09T05:35:36.312782+0000","last_peered":"2024-05-09T05:35:36.312782+0000","last_clean":"2024-05-09T05:35:36.312782+0000","last_became_active":"2024-05-09T05:34:51.293567+0000","last_became_peered":"2024-05-09T05:34:51.293567+0000","last_unstale":"2024-05-09T05:35:36.312782+0000","last_undegraded":"2024-05-09T05:35:36.312782+0000","last_fullsized":"2024-05-09T05:35:36.312782+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:29:17.624820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":27,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.502752+0000","last_change":"2024-05-09T05:34:54.325411+0000","last_active":"2024-05-09T05:35:29.502752+0000","last_peered":"2024-05-09T05:35:29.502752+0000","last_clean":"2024-05-09T05:35:29.502752+0000","last_became_active":"2024-05-09T05:34:54.325036+0000","last_became_peered":"2024-05-09T05:34:54.325036+0000","last_unstale":"2024-05-09T05:35:29.502752+0000","last_undegraded":"2024-05-09T05:35:29.502752+0000","last_fullsized":"2024-05-09T05:35:29.502752+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:03:48.507512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"81'3","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.502572+0000","last_change":"2024-05-09T05:34:51.290884+0000","last_active":"2024-05-09T05:35:29.502572+0000","last_peered":"2024-05-09T05:35:29.502572+0000","last_clean":"2024-05-09T05:35:29.502572+0000","last_became_active":"2024-05-09T05:34:51.290459+0000","last_became_peered":"2024-05-09T05:34:51.290459+0000","last_unstale":"2024-05-09T05:35:29.502572+0000","last_undegraded":"2024-05-09T05:35:29.502572+0000","last_fullsized":"2024-05-09T05:35:29.502572+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:29:47.737930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.507517+0000","last_change":"2024-05-09T05:35:29.507517+0000","last_active":"2024-05-09T05:35:29.507517+0000","last_peered":"2024-05-09T05:35:29.507517+0000","last_clean":"2024-05-09T05:35:29.507517+0000","last_became_active":"2024-05-09T05:35:29.507029+0000","last_became_peered":"2024-05-09T05:35:29.507029+0000","last_unstale":"2024-05-09T05:35:29.507517+0000","last_undegraded":"2024-05-09T05:35:29.507517+0000","last_fullsized":"2024-05-09T05:35:29.507517+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:03:23.016919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"81'2","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.713053+0000","last_change":"2024-05-09T05:34:51.286241+0000","last_active":"2024-05-09T05:35:29.713053+0000","last_peered":"2024-05-09T05:35:29.713053+0000","last_clean":"2024-05-09T05:35:29.713053+0000","last_became_active":"2024-05-09T05:34:51.285814+0000","last_became_peered":"2024-05-09T05:34:51.285814+0000","last_unstale":"2024-05-09T05:35:29.713053+0000","last_undegraded":"2024-05-09T05:35:29.713053+0000","last_fullsized":"2024-05-09T05:35:29.713053+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:44:21.937909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.502179+0000","last_change":"2024-05-09T05:34:54.339247+0000","last_active":"2024-05-09T05:35:29.502179+0000","last_peered":"2024-05-09T05:35:29.502179+0000","last_clean":"2024-05-09T05:35:29.502179+0000","last_became_active":"2024-05-09T05:34:54.338899+0000","last_became_peered":"2024-05-09T05:34:54.338899+0000","last_unstale":"2024-05-09T05:35:29.502179+0000","last_undegraded":"2024-05-09T05:35:29.502179+0000","last_fullsized":"2024-05-09T05:35:29.502179+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:54:50.696065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"81'1","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.504543+0000","last_change":"2024-05-09T05:34:51.295297+0000","last_active":"2024-05-09T05:35:29.504543+0000","last_peered":"2024-05-09T05:35:29.504543+0000","last_clean":"2024-05-09T05:35:29.504543+0000","last_became_active":"2024-05-09T05:34:51.294814+0000","last_became_peered":"2024-05-09T05:34:51.294814+0000","last_unstale":"2024-05-09T05:35:29.504543+0000","last_undegraded":"2024-05-09T05:35:29.504543+0000","last_fullsized":"2024-05-09T05:35:29.504543+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:05:57.955453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.500235+0000","last_change":"2024-05-09T05:34:54.335988+0000","last_active":"2024-05-09T05:35:29.500235+0000","last_peered":"2024-05-09T05:35:29.500235+0000","last_clean":"2024-05-09T05:35:29.500235+0000","last_became_active":"2024-05-09T05:34:54.335574+0000","last_became_peered":"2024-05-09T05:34:54.335574+0000","last_unstale":"2024-05-09T05:35:29.500235+0000","last_undegraded":"2024-05-09T05:35:29.500235+0000","last_fullsized":"2024-05-09T05:35:29.500235+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:12:26.453578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"81'3","reported_seq":55,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:37.313522+0000","last_change":"2024-05-09T05:34:51.291587+0000","last_active":"2024-05-09T05:35:37.313522+0000","last_peered":"2024-05-09T05:35:37.313522+0000","last_clean":"2024-05-09T05:35:37.313522+0000","last_became_active":"2024-05-09T05:34:51.291084+0000","last_became_peered":"2024-05-09T05:34:51.291084+0000","last_unstale":"2024-05-09T05:35:37.313522+0000","last_undegraded":"2024-05-09T05:35:37.313522+0000","last_fullsized":"2024-05-09T05:35:37.313522+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:37:13.234749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.499955+0000","last_change":"2024-05-09T05:34:54.333978+0000","last_active":"2024-05-09T05:35:29.499955+0000","last_peered":"2024-05-09T05:35:29.499955+0000","last_clean":"2024-05-09T05:35:29.499955+0000","last_became_active":"2024-05-09T05:34:54.333497+0000","last_became_peered":"2024-05-09T05:34:54.333497+0000","last_unstale":"2024-05-09T05:35:29.499955+0000","last_undegraded":"2024-05-09T05:35:29.499955+0000","last_fullsized":"2024-05-09T05:35:29.499955+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:24:04.078316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"81'2","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.720038+0000","last_change":"2024-05-09T05:35:29.720038+0000","last_active":"2024-05-09T05:35:29.720038+0000","last_peered":"2024-05-09T05:35:29.720038+0000","last_clean":"2024-05-09T05:35:29.720038+0000","last_became_active":"2024-05-09T05:35:29.716097+0000","last_became_peered":"2024-05-09T05:35:29.716097+0000","last_unstale":"2024-05-09T05:35:29.720038+0000","last_undegraded":"2024-05-09T05:35:29.720038+0000","last_fullsized":"2024-05-09T05:35:29.720038+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:35:50.853791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.505931+0000","last_change":"2024-05-09T05:34:54.345340+0000","last_active":"2024-05-09T05:35:29.505931+0000","last_peered":"2024-05-09T05:35:29.505931+0000","last_clean":"2024-05-09T05:35:29.505931+0000","last_became_active":"2024-05-09T05:34:54.344690+0000","last_became_peered":"2024-05-09T05:34:54.344690+0000","last_unstale":"2024-05-09T05:35:29.505931+0000","last_undegraded":"2024-05-09T05:35:29.505931+0000","last_fullsized":"2024-05-09T05:35:29.505931+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:35:21.222688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"81'4","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.505894+0000","last_change":"2024-05-09T05:34:51.661607+0000","last_active":"2024-05-09T05:35:29.505894+0000","last_peered":"2024-05-09T05:35:29.505894+0000","last_clean":"2024-05-09T05:35:29.505894+0000","last_became_active":"2024-05-09T05:34:51.660514+0000","last_became_peered":"2024-05-09T05:34:51.660514+0000","last_unstale":"2024-05-09T05:35:29.505894+0000","last_undegraded":"2024-05-09T05:35:29.505894+0000","last_fullsized":"2024-05-09T05:35:29.505894+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:29:05.670388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.499915+0000","last_change":"2024-05-09T05:34:54.340465+0000","last_active":"2024-05-09T05:35:29.499915+0000","last_peered":"2024-05-09T05:35:29.499915+0000","last_clean":"2024-05-09T05:35:29.499915+0000","last_became_active":"2024-05-09T05:34:54.339918+0000","last_became_peered":"2024-05-09T05:34:54.339918+0000","last_unstale":"2024-05-09T05:35:29.499915+0000","last_undegraded":"2024-05-09T05:35:29.499915+0000","last_fullsized":"2024-05-09T05:35:29.499915+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:18:03.594387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'28","reported_seq":130,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:37.739894+0000","last_change":"2024-05-09T05:35:29.731065+0000","last_active":"2024-05-09T05:35:37.739894+0000","last_peered":"2024-05-09T05:35:37.739894+0000","last_clean":"2024-05-09T05:35:37.739894+0000","last_became_active":"2024-05-09T05:35:29.716353+0000","last_became_peered":"2024-05-09T05:35:29.716353+0000","last_unstale":"2024-05-09T05:35:37.739894+0000","last_undegraded":"2024-05-09T05:35:37.739894+0000","last_fullsized":"2024-05-09T05:35:37.739894+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:50:35.450572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55505,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":55,"num_read_kb":67,"num_write":29,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":42201,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.503455+0000","last_change":"2024-05-09T05:34:54.334616+0000","last_active":"2024-05-09T05:35:29.503455+0000","last_peered":"2024-05-09T05:35:29.503455+0000","last_clean":"2024-05-09T05:35:29.503455+0000","last_became_active":"2024-05-09T05:34:54.334267+0000","last_became_peered":"2024-05-09T05:34:54.334267+0000","last_unstale":"2024-05-09T05:35:29.503455+0000","last_undegraded":"2024-05-09T05:35:29.503455+0000","last_fullsized":"2024-05-09T05:35:29.503455+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:13:03.841458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'6","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.499985+0000","last_change":"2024-05-09T05:34:51.290247+0000","last_active":"2024-05-09T05:35:29.499985+0000","last_peered":"2024-05-09T05:35:29.499985+0000","last_clean":"2024-05-09T05:35:29.499985+0000","last_became_active":"2024-05-09T05:34:51.288599+0000","last_became_peered":"2024-05-09T05:34:51.288599+0000","last_unstale":"2024-05-09T05:35:29.499985+0000","last_undegraded":"2024-05-09T05:35:29.499985+0000","last_fullsized":"2024-05-09T05:35:29.499985+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:57:44.805526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.713082+0000","last_change":"2024-05-09T05:34:54.331768+0000","last_active":"2024-05-09T05:35:29.713082+0000","last_peered":"2024-05-09T05:35:29.713082+0000","last_clean":"2024-05-09T05:35:29.713082+0000","last_became_active":"2024-05-09T05:34:54.331407+0000","last_became_peered":"2024-05-09T05:34:54.331407+0000","last_unstale":"2024-05-09T05:35:29.713082+0000","last_undegraded":"2024-05-09T05:35:29.713082+0000","last_fullsized":"2024-05-09T05:35:29.713082+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:16:43.767055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"81'3","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.505287+0000","last_change":"2024-05-09T05:34:51.294266+0000","last_active":"2024-05-09T05:35:29.505287+0000","last_peered":"2024-05-09T05:35:29.505287+0000","last_clean":"2024-05-09T05:35:29.505287+0000","last_became_active":"2024-05-09T05:34:51.293865+0000","last_became_peered":"2024-05-09T05:34:51.293865+0000","last_unstale":"2024-05-09T05:35:29.505287+0000","last_undegraded":"2024-05-09T05:35:29.505287+0000","last_fullsized":"2024-05-09T05:35:29.505287+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:13:05.775729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.499259+0000","last_change":"2024-05-09T05:34:54.346713+0000","last_active":"2024-05-09T05:35:29.499259+0000","last_peered":"2024-05-09T05:35:29.499259+0000","last_clean":"2024-05-09T05:35:29.499259+0000","last_became_active":"2024-05-09T05:34:54.346361+0000","last_became_peered":"2024-05-09T05:34:54.346361+0000","last_unstale":"2024-05-09T05:35:29.499259+0000","last_undegraded":"2024-05-09T05:35:29.499259+0000","last_fullsized":"2024-05-09T05:35:29.499259+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:29:07.013316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"81'4","reported_seq":58,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:36.312022+0000","last_change":"2024-05-09T05:34:51.288809+0000","last_active":"2024-05-09T05:35:36.312022+0000","last_peered":"2024-05-09T05:35:36.312022+0000","last_clean":"2024-05-09T05:35:36.312022+0000","last_became_active":"2024-05-09T05:34:51.288417+0000","last_became_peered":"2024-05-09T05:34:51.288417+0000","last_unstale":"2024-05-09T05:35:36.312022+0000","last_undegraded":"2024-05-09T05:35:36.312022+0000","last_fullsized":"2024-05-09T05:35:36.312022+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:19:53.691145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.498794+0000","last_change":"2024-05-09T05:34:54.344335+0000","last_active":"2024-05-09T05:35:29.498794+0000","last_peered":"2024-05-09T05:35:29.498794+0000","last_clean":"2024-05-09T05:35:29.498794+0000","last_became_active":"2024-05-09T05:34:54.343938+0000","last_became_peered":"2024-05-09T05:34:54.343938+0000","last_unstale":"2024-05-09T05:35:29.498794+0000","last_undegraded":"2024-05-09T05:35:29.498794+0000","last_fullsized":"2024-05-09T05:35:29.498794+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:10.003294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'15","reported_seq":41,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.502510+0000","last_change":"2024-05-09T05:34:51.660939+0000","last_active":"2024-05-09T05:35:29.502510+0000","last_peered":"2024-05-09T05:35:29.502510+0000","last_clean":"2024-05-09T05:35:29.502510+0000","last_became_active":"2024-05-09T05:34:51.660501+0000","last_became_peered":"2024-05-09T05:34:51.660501+0000","last_unstale":"2024-05-09T05:35:29.502510+0000","last_undegraded":"2024-05-09T05:35:29.502510+0000","last_fullsized":"2024-05-09T05:35:29.502510+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:43:11.626811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.715011+0000","last_change":"2024-05-09T05:35:29.714515+0000","last_active":"2024-05-09T05:35:29.715011+0000","last_peered":"2024-05-09T05:35:29.715011+0000","last_clean":"2024-05-09T05:35:29.715011+0000","last_became_active":"2024-05-09T05:35:29.714125+0000","last_became_peered":"2024-05-09T05:35:29.714125+0000","last_unstale":"2024-05-09T05:35:29.715011+0000","last_undegraded":"2024-05-09T05:35:29.715011+0000","last_fullsized":"2024-05-09T05:35:29.715011+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:20:18.408711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.f","version":"81'2","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.502959+0000","last_change":"2024-05-09T05:34:51.290742+0000","last_active":"2024-05-09T05:35:29.502959+0000","last_peered":"2024-05-09T05:35:29.502959+0000","last_clean":"2024-05-09T05:35:29.502959+0000","last_became_active":"2024-05-09T05:34:51.290371+0000","last_became_peered":"2024-05-09T05:34:51.290371+0000","last_unstale":"2024-05-09T05:35:29.502959+0000","last_undegraded":"2024-05-09T05:35:29.502959+0000","last_fullsized":"2024-05-09T05:35:29.502959+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:38:05.449808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.503624+0000","last_change":"2024-05-09T05:34:54.348128+0000","last_active":"2024-05-09T05:35:29.503624+0000","last_peered":"2024-05-09T05:35:29.503624+0000","last_clean":"2024-05-09T05:35:29.503624+0000","last_became_active":"2024-05-09T05:34:54.347648+0000","last_became_peered":"2024-05-09T05:34:54.347648+0000","last_unstale":"2024-05-09T05:35:29.503624+0000","last_undegraded":"2024-05-09T05:35:29.503624+0000","last_fullsized":"2024-05-09T05:35:29.503624+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:46:19.578003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.500343+0000","last_change":"2024-05-09T05:34:51.661486+0000","last_active":"2024-05-09T05:35:29.500343+0000","last_peered":"2024-05-09T05:35:29.500343+0000","last_clean":"2024-05-09T05:35:29.500343+0000","last_became_active":"2024-05-09T05:34:51.661094+0000","last_became_peered":"2024-05-09T05:34:51.661094+0000","last_unstale":"2024-05-09T05:35:29.500343+0000","last_undegraded":"2024-05-09T05:35:29.500343+0000","last_fullsized":"2024-05-09T05:35:29.500343+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:14:26.675414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"81'1","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.502803+0000","last_change":"2024-05-09T05:34:54.330881+0000","last_active":"2024-05-09T05:35:29.502803+0000","last_peered":"2024-05-09T05:35:29.502803+0000","last_clean":"2024-05-09T05:35:29.502803+0000","last_became_active":"2024-05-09T05:34:54.330412+0000","last_became_peered":"2024-05-09T05:34:54.330412+0000","last_unstale":"2024-05-09T05:35:29.502803+0000","last_undegraded":"2024-05-09T05:35:29.502803+0000","last_fullsized":"2024-05-09T05:35:29.502803+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:21:42.481374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"81'1","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.499020+0000","last_change":"2024-05-09T05:34:51.289479+0000","last_active":"2024-05-09T05:35:29.499020+0000","last_peered":"2024-05-09T05:35:29.499020+0000","last_clean":"2024-05-09T05:35:29.499020+0000","last_became_active":"2024-05-09T05:34:51.286436+0000","last_became_peered":"2024-05-09T05:34:51.286436+0000","last_unstale":"2024-05-09T05:35:29.499020+0000","last_undegraded":"2024-05-09T05:35:29.499020+0000","last_fullsized":"2024-05-09T05:35:29.499020+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:22:59.431456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.506937+0000","last_change":"2024-05-09T05:35:29.506937+0000","last_active":"2024-05-09T05:35:29.506937+0000","last_peered":"2024-05-09T05:35:29.506937+0000","last_clean":"2024-05-09T05:35:29.506937+0000","last_became_active":"2024-05-09T05:35:29.506540+0000","last_became_peered":"2024-05-09T05:35:29.506540+0000","last_unstale":"2024-05-09T05:35:29.506937+0000","last_undegraded":"2024-05-09T05:35:29.506937+0000","last_fullsized":"2024-05-09T05:35:29.506937+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:54:51.868972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.505019+0000","last_change":"2024-05-09T05:34:54.334559+0000","last_active":"2024-05-09T05:35:29.505019+0000","last_peered":"2024-05-09T05:35:29.505019+0000","last_clean":"2024-05-09T05:35:29.505019+0000","last_became_active":"2024-05-09T05:34:54.333599+0000","last_became_peered":"2024-05-09T05:34:54.333599+0000","last_unstale":"2024-05-09T05:35:29.505019+0000","last_undegraded":"2024-05-09T05:35:29.505019+0000","last_fullsized":"2024-05-09T05:35:29.505019+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:36:16.139227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"81'4","reported_seq":53,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:34.308682+0000","last_change":"2024-05-09T05:34:51.660563+0000","last_active":"2024-05-09T05:35:34.308682+0000","last_peered":"2024-05-09T05:35:34.308682+0000","last_clean":"2024-05-09T05:35:34.308682+0000","last_became_active":"2024-05-09T05:34:51.660127+0000","last_became_peered":"2024-05-09T05:34:51.660127+0000","last_unstale":"2024-05-09T05:35:34.308682+0000","last_undegraded":"2024-05-09T05:35:34.308682+0000","last_fullsized":"2024-05-09T05:35:34.308682+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:08:56.832264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.502524+0000","last_change":"2024-05-09T05:34:54.330774+0000","last_active":"2024-05-09T05:35:29.502524+0000","last_peered":"2024-05-09T05:35:29.502524+0000","last_clean":"2024-05-09T05:35:29.502524+0000","last_became_active":"2024-05-09T05:34:54.329970+0000","last_became_peered":"2024-05-09T05:34:54.329970+0000","last_unstale":"2024-05-09T05:35:29.502524+0000","last_undegraded":"2024-05-09T05:35:29.502524+0000","last_fullsized":"2024-05-09T05:35:29.502524+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:41:30.078744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"81'3","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.714370+0000","last_change":"2024-05-09T05:34:51.289026+0000","last_active":"2024-05-09T05:35:29.714370+0000","last_peered":"2024-05-09T05:35:29.714370+0000","last_clean":"2024-05-09T05:35:29.714370+0000","last_became_active":"2024-05-09T05:34:51.288615+0000","last_became_peered":"2024-05-09T05:34:51.288615+0000","last_unstale":"2024-05-09T05:35:29.714370+0000","last_undegraded":"2024-05-09T05:35:29.714370+0000","last_fullsized":"2024-05-09T05:35:29.714370+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:17:21.395173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":101,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.498950+0000","last_change":"2024-05-09T05:33:24.272408+0000","last_active":"2024-05-09T05:35:29.498950+0000","last_peered":"2024-05-09T05:35:29.498950+0000","last_clean":"2024-05-09T05:35:29.498950+0000","last_became_active":"2024-05-09T05:33:24.266495+0000","last_became_peered":"2024-05-09T05:33:24.266495+0000","last_unstale":"2024-05-09T05:35:29.498950+0000","last_undegraded":"2024-05-09T05:35:29.498950+0000","last_fullsized":"2024-05-09T05:35:29.498950+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:29:56.191070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:29:56.191070+0000","last_clean_scrub_stamp":"2024-05-09T05:29:56.191070+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:45:12.602657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.712943+0000","last_change":"2024-05-09T05:34:54.328200+0000","last_active":"2024-05-09T05:35:29.712943+0000","last_peered":"2024-05-09T05:35:29.712943+0000","last_clean":"2024-05-09T05:35:29.712943+0000","last_became_active":"2024-05-09T05:34:54.327552+0000","last_became_peered":"2024-05-09T05:34:54.327552+0000","last_unstale":"2024-05-09T05:35:29.712943+0000","last_undegraded":"2024-05-09T05:35:29.712943+0000","last_fullsized":"2024-05-09T05:35:29.712943+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:33:13.840266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"81'3","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.499072+0000","last_change":"2024-05-09T05:34:51.292796+0000","last_active":"2024-05-09T05:35:29.499072+0000","last_peered":"2024-05-09T05:35:29.499072+0000","last_clean":"2024-05-09T05:35:29.499072+0000","last_became_active":"2024-05-09T05:34:51.292224+0000","last_became_peered":"2024-05-09T05:34:51.292224+0000","last_unstale":"2024-05-09T05:35:29.499072+0000","last_undegraded":"2024-05-09T05:35:29.499072+0000","last_fullsized":"2024-05-09T05:35:29.499072+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:32:02.925633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"81'1","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.511437+0000","last_change":"2024-05-09T05:35:29.510921+0000","last_active":"2024-05-09T05:35:29.511437+0000","last_peered":"2024-05-09T05:35:29.511437+0000","last_clean":"2024-05-09T05:35:29.511437+0000","last_became_active":"2024-05-09T05:35:29.506757+0000","last_became_peered":"2024-05-09T05:35:29.506757+0000","last_unstale":"2024-05-09T05:35:29.511437+0000","last_undegraded":"2024-05-09T05:35:29.511437+0000","last_fullsized":"2024-05-09T05:35:29.511437+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:13:57.924130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.713266+0000","last_change":"2024-05-09T05:34:54.332133+0000","last_active":"2024-05-09T05:35:29.713266+0000","last_peered":"2024-05-09T05:35:29.713266+0000","last_clean":"2024-05-09T05:35:29.713266+0000","last_became_active":"2024-05-09T05:34:54.331756+0000","last_became_peered":"2024-05-09T05:34:54.331756+0000","last_unstale":"2024-05-09T05:35:29.713266+0000","last_undegraded":"2024-05-09T05:35:29.713266+0000","last_fullsized":"2024-05-09T05:35:29.713266+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:47:54.341410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'11","reported_seq":49,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:31.335799+0000","last_change":"2024-05-09T05:35:29.509840+0000","last_active":"2024-05-09T05:35:31.335799+0000","last_peered":"2024-05-09T05:35:31.335799+0000","last_clean":"2024-05-09T05:35:31.335799+0000","last_became_active":"2024-05-09T05:35:29.505151+0000","last_became_peered":"2024-05-09T05:35:29.505151+0000","last_unstale":"2024-05-09T05:35:31.335799+0000","last_undegraded":"2024-05-09T05:35:31.335799+0000","last_fullsized":"2024-05-09T05:35:31.335799+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:04:38.224022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":11,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.502483+0000","last_change":"2024-05-09T05:34:54.339792+0000","last_active":"2024-05-09T05:35:29.502483+0000","last_peered":"2024-05-09T05:35:29.502483+0000","last_clean":"2024-05-09T05:35:29.502483+0000","last_became_active":"2024-05-09T05:34:54.339415+0000","last_became_peered":"2024-05-09T05:34:54.339415+0000","last_unstale":"2024-05-09T05:35:29.502483+0000","last_undegraded":"2024-05-09T05:35:29.502483+0000","last_fullsized":"2024-05-09T05:35:29.502483+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:08:14.148373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'4","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.714194+0000","last_change":"2024-05-09T05:34:51.284535+0000","last_active":"2024-05-09T05:35:29.714194+0000","last_peered":"2024-05-09T05:35:29.714194+0000","last_clean":"2024-05-09T05:35:29.714194+0000","last_became_active":"2024-05-09T05:34:51.283686+0000","last_became_peered":"2024-05-09T05:34:51.283686+0000","last_unstale":"2024-05-09T05:35:29.714194+0000","last_undegraded":"2024-05-09T05:35:29.714194+0000","last_fullsized":"2024-05-09T05:35:29.714194+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:05:58.544406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.505568+0000","last_change":"2024-05-09T05:34:54.344277+0000","last_active":"2024-05-09T05:35:29.505568+0000","last_peered":"2024-05-09T05:35:29.505568+0000","last_clean":"2024-05-09T05:35:29.505568+0000","last_became_active":"2024-05-09T05:34:54.343903+0000","last_became_peered":"2024-05-09T05:34:54.343903+0000","last_unstale":"2024-05-09T05:35:29.505568+0000","last_undegraded":"2024-05-09T05:35:29.505568+0000","last_fullsized":"2024-05-09T05:35:29.505568+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:33:21.052161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"81'2","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.499295+0000","last_change":"2024-05-09T05:34:51.660277+0000","last_active":"2024-05-09T05:35:29.499295+0000","last_peered":"2024-05-09T05:35:29.499295+0000","last_clean":"2024-05-09T05:35:29.499295+0000","last_became_active":"2024-05-09T05:34:51.659841+0000","last_became_peered":"2024-05-09T05:34:51.659841+0000","last_unstale":"2024-05-09T05:35:29.499295+0000","last_undegraded":"2024-05-09T05:35:29.499295+0000","last_fullsized":"2024-05-09T05:35:29.499295+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:35:41.307477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.502743+0000","last_change":"2024-05-09T05:34:54.330642+0000","last_active":"2024-05-09T05:35:29.502743+0000","last_peered":"2024-05-09T05:35:29.502743+0000","last_clean":"2024-05-09T05:35:29.502743+0000","last_became_active":"2024-05-09T05:34:54.330273+0000","last_became_peered":"2024-05-09T05:34:54.330273+0000","last_unstale":"2024-05-09T05:35:29.502743+0000","last_undegraded":"2024-05-09T05:35:29.502743+0000","last_fullsized":"2024-05-09T05:35:29.502743+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:27:17.520941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"81'3","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.502186+0000","last_change":"2024-05-09T05:34:51.288782+0000","last_active":"2024-05-09T05:35:29.502186+0000","last_peered":"2024-05-09T05:35:29.502186+0000","last_clean":"2024-05-09T05:35:29.502186+0000","last_became_active":"2024-05-09T05:34:51.288333+0000","last_became_peered":"2024-05-09T05:34:51.288333+0000","last_unstale":"2024-05-09T05:35:29.502186+0000","last_undegraded":"2024-05-09T05:35:29.502186+0000","last_fullsized":"2024-05-09T05:35:29.502186+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:13:11.893177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.503206+0000","last_change":"2024-05-09T05:34:54.343920+0000","last_active":"2024-05-09T05:35:29.503206+0000","last_peered":"2024-05-09T05:35:29.503206+0000","last_clean":"2024-05-09T05:35:29.503206+0000","last_became_active":"2024-05-09T05:34:54.343452+0000","last_became_peered":"2024-05-09T05:34:54.343452+0000","last_unstale":"2024-05-09T05:35:29.503206+0000","last_undegraded":"2024-05-09T05:35:29.503206+0000","last_fullsized":"2024-05-09T05:35:29.503206+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:28:56.425068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"81'1","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.499721+0000","last_change":"2024-05-09T05:34:51.290178+0000","last_active":"2024-05-09T05:35:29.499721+0000","last_peered":"2024-05-09T05:35:29.499721+0000","last_clean":"2024-05-09T05:35:29.499721+0000","last_became_active":"2024-05-09T05:34:51.289754+0000","last_became_peered":"2024-05-09T05:34:51.289754+0000","last_unstale":"2024-05-09T05:35:29.499721+0000","last_undegraded":"2024-05-09T05:35:29.499721+0000","last_fullsized":"2024-05-09T05:35:29.499721+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:51:41.221061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.502247+0000","last_change":"2024-05-09T05:34:54.330473+0000","last_active":"2024-05-09T05:35:29.502247+0000","last_peered":"2024-05-09T05:35:29.502247+0000","last_clean":"2024-05-09T05:35:29.502247+0000","last_became_active":"2024-05-09T05:34:54.329898+0000","last_became_peered":"2024-05-09T05:34:54.329898+0000","last_unstale":"2024-05-09T05:35:29.502247+0000","last_undegraded":"2024-05-09T05:35:29.502247+0000","last_fullsized":"2024-05-09T05:35:29.502247+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:26:24.727909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"81'4","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.503014+0000","last_change":"2024-05-09T05:34:51.294321+0000","last_active":"2024-05-09T05:35:29.503014+0000","last_peered":"2024-05-09T05:35:29.503014+0000","last_clean":"2024-05-09T05:35:29.503014+0000","last_became_active":"2024-05-09T05:34:51.293956+0000","last_became_peered":"2024-05-09T05:34:51.293956+0000","last_unstale":"2024-05-09T05:35:29.503014+0000","last_undegraded":"2024-05-09T05:35:29.503014+0000","last_fullsized":"2024-05-09T05:35:29.503014+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:45:10.404120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.499265+0000","last_change":"2024-05-09T05:34:54.335850+0000","last_active":"2024-05-09T05:35:29.499265+0000","last_peered":"2024-05-09T05:35:29.499265+0000","last_clean":"2024-05-09T05:35:29.499265+0000","last_became_active":"2024-05-09T05:34:54.335441+0000","last_became_peered":"2024-05-09T05:34:54.335441+0000","last_unstale":"2024-05-09T05:35:29.499265+0000","last_undegraded":"2024-05-09T05:35:29.499265+0000","last_fullsized":"2024-05-09T05:35:29.499265+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:15:32.379286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"81'3","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.500050+0000","last_change":"2024-05-09T05:34:51.662211+0000","last_active":"2024-05-09T05:35:29.500050+0000","last_peered":"2024-05-09T05:35:29.500050+0000","last_clean":"2024-05-09T05:35:29.500050+0000","last_became_active":"2024-05-09T05:34:51.661446+0000","last_became_peered":"2024-05-09T05:34:51.661446+0000","last_unstale":"2024-05-09T05:35:29.500050+0000","last_undegraded":"2024-05-09T05:35:29.500050+0000","last_fullsized":"2024-05-09T05:35:29.500050+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:35:56.098673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.499357+0000","last_change":"2024-05-09T05:34:54.342030+0000","last_active":"2024-05-09T05:35:29.499357+0000","last_peered":"2024-05-09T05:35:29.499357+0000","last_clean":"2024-05-09T05:35:29.499357+0000","last_became_active":"2024-05-09T05:34:54.338081+0000","last_became_peered":"2024-05-09T05:34:54.338081+0000","last_unstale":"2024-05-09T05:35:29.499357+0000","last_undegraded":"2024-05-09T05:35:29.499357+0000","last_fullsized":"2024-05-09T05:35:29.499357+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:40:55.042110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'1","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.505757+0000","last_change":"2024-05-09T05:34:51.293687+0000","last_active":"2024-05-09T05:35:29.505757+0000","last_peered":"2024-05-09T05:35:29.505757+0000","last_clean":"2024-05-09T05:35:29.505757+0000","last_became_active":"2024-05-09T05:34:51.293298+0000","last_became_peered":"2024-05-09T05:34:51.293298+0000","last_unstale":"2024-05-09T05:35:29.505757+0000","last_undegraded":"2024-05-09T05:35:29.505757+0000","last_fullsized":"2024-05-09T05:35:29.505757+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:39:57.031631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"81'1","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.499302+0000","last_change":"2024-05-09T05:34:54.344843+0000","last_active":"2024-05-09T05:35:29.499302+0000","last_peered":"2024-05-09T05:35:29.499302+0000","last_clean":"2024-05-09T05:35:29.499302+0000","last_became_active":"2024-05-09T05:34:54.339577+0000","last_became_peered":"2024-05-09T05:34:54.339577+0000","last_unstale":"2024-05-09T05:35:29.499302+0000","last_undegraded":"2024-05-09T05:35:29.499302+0000","last_fullsized":"2024-05-09T05:35:29.499302+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:03:42.398424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.713256+0000","last_change":"2024-05-09T05:34:51.292633+0000","last_active":"2024-05-09T05:35:29.713256+0000","last_peered":"2024-05-09T05:35:29.713256+0000","last_clean":"2024-05-09T05:35:29.713256+0000","last_became_active":"2024-05-09T05:34:51.292164+0000","last_became_peered":"2024-05-09T05:34:51.292164+0000","last_unstale":"2024-05-09T05:35:29.713256+0000","last_undegraded":"2024-05-09T05:35:29.713256+0000","last_fullsized":"2024-05-09T05:35:29.713256+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:27:30.527040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.499770+0000","last_change":"2024-05-09T05:34:54.345924+0000","last_active":"2024-05-09T05:35:29.499770+0000","last_peered":"2024-05-09T05:35:29.499770+0000","last_clean":"2024-05-09T05:35:29.499770+0000","last_became_active":"2024-05-09T05:34:54.344885+0000","last_became_peered":"2024-05-09T05:34:54.344885+0000","last_unstale":"2024-05-09T05:35:29.499770+0000","last_undegraded":"2024-05-09T05:35:29.499770+0000","last_fullsized":"2024-05-09T05:35:29.499770+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:59:40.079060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.503292+0000","last_change":"2024-05-09T05:34:54.340599+0000","last_active":"2024-05-09T05:35:29.503292+0000","last_peered":"2024-05-09T05:35:29.503292+0000","last_clean":"2024-05-09T05:35:29.503292+0000","last_became_active":"2024-05-09T05:34:54.340194+0000","last_became_peered":"2024-05-09T05:34:54.340194+0000","last_unstale":"2024-05-09T05:35:29.503292+0000","last_undegraded":"2024-05-09T05:35:29.503292+0000","last_fullsized":"2024-05-09T05:35:29.503292+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:10:15.868670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.499659+0000","last_change":"2024-05-09T05:34:54.334658+0000","last_active":"2024-05-09T05:35:29.499659+0000","last_peered":"2024-05-09T05:35:29.499659+0000","last_clean":"2024-05-09T05:35:29.499659+0000","last_became_active":"2024-05-09T05:34:54.334317+0000","last_became_peered":"2024-05-09T05:34:54.334317+0000","last_unstale":"2024-05-09T05:35:29.499659+0000","last_undegraded":"2024-05-09T05:35:29.499659+0000","last_fullsized":"2024-05-09T05:35:29.499659+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:50:28.262145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.499590+0000","last_change":"2024-05-09T05:34:54.330380+0000","last_active":"2024-05-09T05:35:29.499590+0000","last_peered":"2024-05-09T05:35:29.499590+0000","last_clean":"2024-05-09T05:35:29.499590+0000","last_became_active":"2024-05-09T05:34:54.329984+0000","last_became_peered":"2024-05-09T05:34:54.329984+0000","last_unstale":"2024-05-09T05:35:29.499590+0000","last_undegraded":"2024-05-09T05:35:29.499590+0000","last_fullsized":"2024-05-09T05:35:29.499590+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:10:26.051644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.506217+0000","last_change":"2024-05-09T05:34:54.344755+0000","last_active":"2024-05-09T05:35:29.506217+0000","last_peered":"2024-05-09T05:35:29.506217+0000","last_clean":"2024-05-09T05:35:29.506217+0000","last_became_active":"2024-05-09T05:34:54.343968+0000","last_became_peered":"2024-05-09T05:34:54.343968+0000","last_unstale":"2024-05-09T05:35:29.506217+0000","last_undegraded":"2024-05-09T05:35:29.506217+0000","last_fullsized":"2024-05-09T05:35:29.506217+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:58:32.086079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.713140+0000","last_change":"2024-05-09T05:34:54.335427+0000","last_active":"2024-05-09T05:35:29.713140+0000","last_peered":"2024-05-09T05:35:29.713140+0000","last_clean":"2024-05-09T05:35:29.713140+0000","last_became_active":"2024-05-09T05:34:54.335091+0000","last_became_peered":"2024-05-09T05:34:54.335091+0000","last_unstale":"2024-05-09T05:35:29.713140+0000","last_undegraded":"2024-05-09T05:35:29.713140+0000","last_fullsized":"2024-05-09T05:35:29.713140+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:24:05.939805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.504048+0000","last_change":"2024-05-09T05:34:54.342056+0000","last_active":"2024-05-09T05:35:29.504048+0000","last_peered":"2024-05-09T05:35:29.504048+0000","last_clean":"2024-05-09T05:35:29.504048+0000","last_became_active":"2024-05-09T05:34:54.341655+0000","last_became_peered":"2024-05-09T05:34:54.341655+0000","last_unstale":"2024-05-09T05:35:29.504048+0000","last_undegraded":"2024-05-09T05:35:29.504048+0000","last_fullsized":"2024-05-09T05:35:29.504048+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:19:50.284110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.499971+0000","last_change":"2024-05-09T05:34:54.331670+0000","last_active":"2024-05-09T05:35:29.499971+0000","last_peered":"2024-05-09T05:35:29.499971+0000","last_clean":"2024-05-09T05:35:29.499971+0000","last_became_active":"2024-05-09T05:34:54.330722+0000","last_became_peered":"2024-05-09T05:34:54.330722+0000","last_unstale":"2024-05-09T05:35:29.499971+0000","last_undegraded":"2024-05-09T05:35:29.499971+0000","last_fullsized":"2024-05-09T05:35:29.499971+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:36:10.417933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.502370+0000","last_change":"2024-05-09T05:34:54.336487+0000","last_active":"2024-05-09T05:35:29.502370+0000","last_peered":"2024-05-09T05:35:29.502370+0000","last_clean":"2024-05-09T05:35:29.502370+0000","last_became_active":"2024-05-09T05:34:54.336141+0000","last_became_peered":"2024-05-09T05:34:54.336141+0000","last_unstale":"2024-05-09T05:35:29.502370+0000","last_undegraded":"2024-05-09T05:35:29.502370+0000","last_fullsized":"2024-05-09T05:35:29.502370+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:45:42.541374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.504577+0000","last_change":"2024-05-09T05:34:54.330749+0000","last_active":"2024-05-09T05:35:29.504577+0000","last_peered":"2024-05-09T05:35:29.504577+0000","last_clean":"2024-05-09T05:35:29.504577+0000","last_became_active":"2024-05-09T05:34:54.330279+0000","last_became_peered":"2024-05-09T05:34:54.330279+0000","last_unstale":"2024-05-09T05:35:29.504577+0000","last_undegraded":"2024-05-09T05:35:29.504577+0000","last_fullsized":"2024-05-09T05:35:29.504577+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:49:48.704977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.502153+0000","last_change":"2024-05-09T05:34:54.338296+0000","last_active":"2024-05-09T05:35:29.502153+0000","last_peered":"2024-05-09T05:35:29.502153+0000","last_clean":"2024-05-09T05:35:29.502153+0000","last_became_active":"2024-05-09T05:34:54.337960+0000","last_became_peered":"2024-05-09T05:34:54.337960+0000","last_unstale":"2024-05-09T05:35:29.502153+0000","last_undegraded":"2024-05-09T05:35:29.502153+0000","last_fullsized":"2024-05-09T05:35:29.502153+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:48:46.436082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.500276+0000","last_change":"2024-05-09T05:34:54.334782+0000","last_active":"2024-05-09T05:35:29.500276+0000","last_peered":"2024-05-09T05:35:29.500276+0000","last_clean":"2024-05-09T05:35:29.500276+0000","last_became_active":"2024-05-09T05:34:54.333118+0000","last_became_peered":"2024-05-09T05:34:54.333118+0000","last_unstale":"2024-05-09T05:35:29.500276+0000","last_undegraded":"2024-05-09T05:35:29.500276+0000","last_fullsized":"2024-05-09T05:35:29.500276+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:04:40.473387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.713299+0000","last_change":"2024-05-09T05:34:54.334627+0000","last_active":"2024-05-09T05:35:29.713299+0000","last_peered":"2024-05-09T05:35:29.713299+0000","last_clean":"2024-05-09T05:35:29.713299+0000","last_became_active":"2024-05-09T05:34:54.333966+0000","last_became_peered":"2024-05-09T05:34:54.333966+0000","last_unstale":"2024-05-09T05:35:29.713299+0000","last_undegraded":"2024-05-09T05:35:29.713299+0000","last_fullsized":"2024-05-09T05:35:29.713299+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:15:57.733926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.507005+0000","last_change":"2024-05-09T05:35:29.507005+0000","last_active":"2024-05-09T05:35:29.507005+0000","last_peered":"2024-05-09T05:35:29.507005+0000","last_clean":"2024-05-09T05:35:29.507005+0000","last_became_active":"2024-05-09T05:35:29.506521+0000","last_became_peered":"2024-05-09T05:35:29.506521+0000","last_unstale":"2024-05-09T05:35:29.507005+0000","last_undegraded":"2024-05-09T05:35:29.507005+0000","last_fullsized":"2024-05-09T05:35:29.507005+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:58:24.605073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":59506,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":172,"num_read_kb":134,"num_write":162,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":42223,"num_keys_recovered":11,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":178518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":138,"ondisk_log_size":138,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612633,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":905216,"data_stored":440786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808862,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":41052,"kb_used_data":1556,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704100,"statfs":{"total":95995035648,"available":95952998400,"internally_reserved":0,"allocated":1593344,"data_stored":1088141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":40434112},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972387,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":917504,"data_stored":441000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168617,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32072,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713080,"statfs":{"total":95995035648,"available":95962193920,"internally_reserved":0,"allocated":913408,"data_stored":440898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397549,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36820,"kb_used_data":1476,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708332,"statfs":{"total":95995035648,"available":95957331968,"internally_reserved":0,"allocated":1511424,"data_stored":1032850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593778,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":440389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574923,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":962560,"data_stored":495687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738450,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32084,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713068,"statfs":{"total":95995035648,"available":95962181632,"internally_reserved":0,"allocated":925696,"data_stored":441660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411399,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":921600,"data_stored":441532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182466,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":921600,"data_stored":440700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986236,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":974848,"data_stored":496722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790008,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36832,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708320,"statfs":{"total":95995035648,"available":95957319680,"internally_reserved":0,"allocated":1523712,"data_stored":1032143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":55505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":56540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":57474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T05:35:42.573 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-05-09T05:35:42.574 INFO:tasks.cephadm:Setting up client nodes... 2024-05-09T05:35:42.574 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-05-09T05:35:42.828 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T05:35:43.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:35:43 smithi039 ceph-mon[30439]: from='client.14754 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-09T05:35:43.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:35:43 smithi039 ceph-mon[30439]: pgmap v320: 97 pgs: 97 active+clean; 635 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.7 KiB/s wr, 6 op/s; 3.4 KiB/s, 0 keys/s, 0 objects/s recovering 2024-05-09T05:35:43.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:35:43 smithi100 ceph-mon[34353]: from='client.14754 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-09T05:35:43.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:35:43 smithi100 ceph-mon[34353]: pgmap v320: 97 pgs: 97 active+clean; 635 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.7 KiB/s wr, 6 op/s; 3.4 KiB/s, 0 keys/s, 0 objects/s recovering 2024-05-09T05:35:44.046 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:35:43 smithi060 ceph-mon[34555]: from='client.14754 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-09T05:35:44.046 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:35:43 smithi060 ceph-mon[34555]: pgmap v320: 97 pgs: 97 active+clean; 635 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.7 KiB/s wr, 6 op/s; 3.4 KiB/s, 0 keys/s, 0 objects/s recovering 2024-05-09T05:35:44.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:44.361+0000 7f2561d0a700 1 -- 172.21.15.39:0/1189393617 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f255c103250 msgr2=0x7f255c103660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:35:44.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:44.361+0000 7f2561d0a700 1 --2- 172.21.15.39:0/1189393617 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f255c103250 0x7f255c103660 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f254c009990 tx=0x7f254c009ca0 comp rx=0 tx=0).stop 2024-05-09T05:35:44.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:44.361+0000 7f2561d0a700 1 -- 172.21.15.39:0/1189393617 shutdown_connections 2024-05-09T05:35:44.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:44.361+0000 7f2561d0a700 1 --2- 172.21.15.39:0/1189393617 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f255c104d20 0x7f255c10b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:44.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:44.361+0000 7f2561d0a700 1 --2- 172.21.15.39:0/1189393617 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f255c103250 0x7f255c103660 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:44.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:44.361+0000 7f2561d0a700 1 --2- 172.21.15.39:0/1189393617 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f255c104380 0x7f255c104790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:44.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:44.361+0000 7f2561d0a700 1 -- 172.21.15.39:0/1189393617 >> 172.21.15.39:0/1189393617 conn(0x7f255c0fe890 msgr2=0x7f255c100d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:35:44.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:44.361+0000 7f2561d0a700 1 -- 172.21.15.39:0/1189393617 shutdown_connections 2024-05-09T05:35:44.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:44.361+0000 7f2561d0a700 1 -- 172.21.15.39:0/1189393617 wait complete. 2024-05-09T05:35:44.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:44.362+0000 7f2561d0a700 1 Processor -- start 2024-05-09T05:35:44.358 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:44.362+0000 7f2561d0a700 1 -- start start 2024-05-09T05:35:44.358 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:44.362+0000 7f2561d0a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f255c103250 0x7f255c1998b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:35:44.358 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:44.362+0000 7f2561d0a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f255c104380 0x7f255c199df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:35:44.358 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:44.362+0000 7f2561d0a700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f255c104d20 0x7f255c1a0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:35:44.358 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:44.362+0000 7f2561d0a700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f255c10ecb0 con 0x7f255c103250 2024-05-09T05:35:44.358 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:44.362+0000 7f2561d0a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f255c10eb30 con 0x7f255c104380 2024-05-09T05:35:44.358 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:44.362+0000 7f2561d0a700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f255c10ee30 con 0x7f255c104d20 2024-05-09T05:35:44.358 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:44.362+0000 7f255b7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f255c103250 0x7f255c1998b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:35:44.358 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:44.362+0000 7f255b7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f255c103250 0x7f255c1998b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:35094/0 (socket says 172.21.15.39:35094) 2024-05-09T05:35:44.359 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:44.362+0000 7f255b7fe700 1 -- 172.21.15.39:0/1982524661 learned_addr learned my addr 172.21.15.39:0/1982524661 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:35:44.359 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:44.363+0000 7f255bfff700 1 --2- 172.21.15.39:0/1982524661 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f255c104d20 0x7f255c1a0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:35:44.359 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:44.363+0000 7f255affd700 1 --2- 172.21.15.39:0/1982524661 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f255c104380 0x7f255c199df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:35:44.359 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:44.363+0000 7f255b7fe700 1 -- 172.21.15.39:0/1982524661 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f255c104d20 msgr2=0x7f255c1a0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:35:44.359 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:44.363+0000 7f255b7fe700 1 --2- 172.21.15.39:0/1982524661 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f255c104d20 0x7f255c1a0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:44.359 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:44.363+0000 7f255b7fe700 1 -- 172.21.15.39:0/1982524661 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f255c104380 msgr2=0x7f255c199df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:35:44.359 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:44.363+0000 7f255b7fe700 1 --2- 172.21.15.39:0/1982524661 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f255c104380 0x7f255c199df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:44.359 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:44.363+0000 7f255b7fe700 1 -- 172.21.15.39:0/1982524661 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f255c1a13c0 con 0x7f255c103250 2024-05-09T05:35:44.359 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:44.363+0000 7f255affd700 1 --2- 172.21.15.39:0/1982524661 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f255c104380 0x7f255c199df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:35:44.359 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:44.363+0000 7f255bfff700 1 --2- 172.21.15.39:0/1982524661 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f255c104d20 0x7f255c1a0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:35:44.359 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:44.363+0000 7f255b7fe700 1 --2- 172.21.15.39:0/1982524661 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f255c103250 0x7f255c1998b0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f254c000c00 tx=0x7f254c0047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:35:44.359 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:44.363+0000 7f2558ff9700 1 -- 172.21.15.39:0/1982524661 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f254c027070 con 0x7f255c103250 2024-05-09T05:35:44.359 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:44.363+0000 7f2561d0a700 1 -- 172.21.15.39:0/1982524661 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f255c1a1650 con 0x7f255c103250 2024-05-09T05:35:44.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:44.363+0000 7f2558ff9700 1 -- 172.21.15.39:0/1982524661 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f254c0040c0 con 0x7f255c103250 2024-05-09T05:35:44.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:44.363+0000 7f2558ff9700 1 -- 172.21.15.39:0/1982524661 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f254c022de0 con 0x7f255c103250 2024-05-09T05:35:44.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:44.363+0000 7f2561d0a700 1 -- 172.21.15.39:0/1982524661 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f255c1a1ab0 con 0x7f255c103250 2024-05-09T05:35:44.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:44.364+0000 7f2561d0a700 1 -- 172.21.15.39:0/1982524661 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f255c0512c0 con 0x7f255c103250 2024-05-09T05:35:44.361 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:44.366+0000 7f2558ff9700 1 -- 172.21.15.39:0/1982524661 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f254c02a070 con 0x7f255c103250 2024-05-09T05:35:44.361 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:44.367+0000 7f2558ff9700 1 --2- 172.21.15.39:0/1982524661 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f25440b2910 0x7f25440b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:35:44.361 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:44.367+0000 7f255affd700 1 --2- 172.21.15.39:0/1982524661 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f25440b2910 0x7f25440b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:35:44.361 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:44.367+0000 7f2558ff9700 1 -- 172.21.15.39:0/1982524661 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f254c0e35c0 con 0x7f255c103250 2024-05-09T05:35:44.361 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:44.367+0000 7f255affd700 1 --2- 172.21.15.39:0/1982524661 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f25440b2910 0x7f25440b4e20 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2550005fd0 tx=0x7f2550005f00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:35:44.372 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:44.370+0000 7f2558ff9700 1 -- 172.21.15.39:0/1982524661 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f254c031080 con 0x7f255c103250 2024-05-09T05:35:44.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:44.672+0000 7f2561d0a700 1 -- 172.21.15.39:0/1982524661 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f255c02e5f0 con 0x7f255c103250 2024-05-09T05:35:44.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:44.679+0000 7f2558ff9700 1 -- 172.21.15.39:0/1982524661 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7f254c013070 con 0x7f255c103250 2024-05-09T05:35:44.673 INFO:teuthology.orchestra.run.smithi039.stdout:[client.0] 2024-05-09T05:35:44.673 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQCwYDxmuZ4tKBAAzrmguyssIM10tTXavRo9hQ== 2024-05-09T05:35:44.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:44.682+0000 7f2561d0a700 1 -- 172.21.15.39:0/1982524661 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f25440b2910 msgr2=0x7f25440b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:35:44.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:44.682+0000 7f2561d0a700 1 --2- 172.21.15.39:0/1982524661 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f25440b2910 0x7f25440b4e20 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2550005fd0 tx=0x7f2550005f00 comp rx=0 tx=0).stop 2024-05-09T05:35:44.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:44.682+0000 7f2561d0a700 1 -- 172.21.15.39:0/1982524661 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f255c103250 msgr2=0x7f255c1998b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:35:44.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:44.682+0000 7f2561d0a700 1 --2- 172.21.15.39:0/1982524661 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f255c103250 0x7f255c1998b0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f254c000c00 tx=0x7f254c0047b0 comp rx=0 tx=0).stop 2024-05-09T05:35:44.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:44.682+0000 7f2561d0a700 1 -- 172.21.15.39:0/1982524661 shutdown_connections 2024-05-09T05:35:44.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:44.682+0000 7f2561d0a700 1 --2- 172.21.15.39:0/1982524661 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f25440b2910 0x7f25440b4e20 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:44.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:44.682+0000 7f2561d0a700 1 --2- 172.21.15.39:0/1982524661 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f255c104d20 0x7f255c1a0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:44.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:44.682+0000 7f2561d0a700 1 --2- 172.21.15.39:0/1982524661 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f255c103250 0x7f255c1998b0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:44.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:44.682+0000 7f2561d0a700 1 --2- 172.21.15.39:0/1982524661 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f255c104380 0x7f255c199df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:44.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:44.682+0000 7f2561d0a700 1 -- 172.21.15.39:0/1982524661 >> 172.21.15.39:0/1982524661 conn(0x7f255c0fe890 msgr2=0x7f255c1075b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:35:44.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:44.682+0000 7f2561d0a700 1 -- 172.21.15.39:0/1982524661 shutdown_connections 2024-05-09T05:35:44.676 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:44.682+0000 7f2561d0a700 1 -- 172.21.15.39:0/1982524661 wait complete. 2024-05-09T05:35:45.284 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-05-09T05:35:45.284 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-05-09T05:35:45.284 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-05-09T05:35:45.325 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-05-09T05:35:45.325 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-05-09T05:35:45.325 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph mgr dump --format=json 2024-05-09T05:35:45.617 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T05:35:45.828 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:35:45 smithi039 ceph-mon[30439]: pgmap v321: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.8 KiB/s wr, 8 op/s; 3.4 KiB/s, 0 objects/s recovering 2024-05-09T05:35:45.828 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:35:45 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/1982524661' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-09T05:35:45.828 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:35:45 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/1982524661' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-05-09T05:35:45.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:35:45 smithi100 ceph-mon[34353]: pgmap v321: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.8 KiB/s wr, 8 op/s; 3.4 KiB/s, 0 objects/s recovering 2024-05-09T05:35:45.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:35:45 smithi100 ceph-mon[34353]: from='client.? 172.21.15.39:0/1982524661' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-09T05:35:45.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:35:45 smithi100 ceph-mon[34353]: from='client.? 172.21.15.39:0/1982524661' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-05-09T05:35:46.046 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:35:45 smithi060 ceph-mon[34555]: pgmap v321: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.8 KiB/s wr, 8 op/s; 3.4 KiB/s, 0 objects/s recovering 2024-05-09T05:35:46.046 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:35:45 smithi060 ceph-mon[34555]: from='client.? 172.21.15.39:0/1982524661' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-09T05:35:46.046 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:35:45 smithi060 ceph-mon[34555]: from='client.? 172.21.15.39:0/1982524661' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-05-09T05:35:47.039 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:47.044+0000 7f756cf1a700 1 -- 172.21.15.39:0/1487408186 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7568108740 msgr2=0x7f75681100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:35:47.039 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:47.044+0000 7f756cf1a700 1 --2- 172.21.15.39:0/1487408186 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7568108740 0x7f75681100a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f75600099c0 tx=0x7f7560009cd0 comp rx=0 tx=0).stop 2024-05-09T05:35:47.039 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:47.045+0000 7f756cf1a700 1 -- 172.21.15.39:0/1487408186 shutdown_connections 2024-05-09T05:35:47.039 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:47.045+0000 7f756cf1a700 1 --2- 172.21.15.39:0/1487408186 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7568108740 0x7f75681100a0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:47.039 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:47.045+0000 7f756cf1a700 1 --2- 172.21.15.39:0/1487408186 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75681034c0 0x7f75681038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:47.039 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:47.045+0000 7f756cf1a700 1 --2- 172.21.15.39:0/1487408186 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7568107df0 0x7f7568108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:47.039 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:47.045+0000 7f756cf1a700 1 -- 172.21.15.39:0/1487408186 >> 172.21.15.39:0/1487408186 conn(0x7f75680fedc0 msgr2=0x7f75681011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:35:47.039 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:47.045+0000 7f756cf1a700 1 -- 172.21.15.39:0/1487408186 shutdown_connections 2024-05-09T05:35:47.039 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:47.045+0000 7f756cf1a700 1 -- 172.21.15.39:0/1487408186 wait complete. 2024-05-09T05:35:47.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:47.046+0000 7f756cf1a700 1 Processor -- start 2024-05-09T05:35:47.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:47.046+0000 7f756cf1a700 1 -- start start 2024-05-09T05:35:47.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:47.046+0000 7f756cf1a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75681034c0 0x7f756819f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:35:47.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:47.046+0000 7f756cf1a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7568107df0 0x7f756819fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:35:47.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:47.046+0000 7f756cf1a700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7568108740 0x7f7568199ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:35:47.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:47.046+0000 7f756cf1a700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f75681133e0 con 0x7f7568107df0 2024-05-09T05:35:47.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:47.046+0000 7f756cf1a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f7568113260 con 0x7f75681034c0 2024-05-09T05:35:47.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:47.046+0000 7f756cf1a700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7568113560 con 0x7f7568108740 2024-05-09T05:35:47.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:47.046+0000 7f7565d9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7568107df0 0x7f756819fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:35:47.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:47.046+0000 7f7565d9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7568107df0 0x7f756819fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:52726/0 (socket says 172.21.15.39:52726) 2024-05-09T05:35:47.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:47.046+0000 7f7565d9b700 1 -- 172.21.15.39:0/133158360 learned_addr learned my addr 172.21.15.39:0/133158360 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:35:47.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:47.046+0000 7f756659c700 1 --2- 172.21.15.39:0/133158360 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75681034c0 0x7f756819f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:35:47.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:47.046+0000 7f7566d9d700 1 --2- 172.21.15.39:0/133158360 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7568108740 0x7f7568199ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:35:47.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:47.046+0000 7f7565d9b700 1 -- 172.21.15.39:0/133158360 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7568108740 msgr2=0x7f7568199ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:35:47.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:47.046+0000 7f7565d9b700 1 --2- 172.21.15.39:0/133158360 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7568108740 0x7f7568199ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:47.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:47.046+0000 7f7565d9b700 1 -- 172.21.15.39:0/133158360 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75681034c0 msgr2=0x7f756819f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:35:47.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:47.046+0000 7f7565d9b700 1 --2- 172.21.15.39:0/133158360 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75681034c0 0x7f756819f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:47.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:47.046+0000 7f7565d9b700 1 -- 172.21.15.39:0/133158360 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f756819a1c0 con 0x7f7568107df0 2024-05-09T05:35:47.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:47.047+0000 7f7565d9b700 1 --2- 172.21.15.39:0/133158360 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7568107df0 0x7f756819fe00 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f755000b500 tx=0x7f755000b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:35:47.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:47.047+0000 7f755f7fe700 1 -- 172.21.15.39:0/133158360 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7550015020 con 0x7f7568107df0 2024-05-09T05:35:47.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:47.047+0000 7f755f7fe700 1 -- 172.21.15.39:0/133158360 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7550011ce0 con 0x7f7568107df0 2024-05-09T05:35:47.044 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:47.047+0000 7f755f7fe700 1 -- 172.21.15.39:0/133158360 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7550010d40 con 0x7f7568107df0 2024-05-09T05:35:47.044 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:47.047+0000 7f756cf1a700 1 -- 172.21.15.39:0/133158360 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f756819a4b0 con 0x7f7568107df0 2024-05-09T05:35:47.044 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:47.047+0000 7f756cf1a700 1 -- 172.21.15.39:0/133158360 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75681a6750 con 0x7f7568107df0 2024-05-09T05:35:47.044 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:47.048+0000 7f756cf1a700 1 -- 172.21.15.39:0/133158360 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75680512c0 con 0x7f7568107df0 2024-05-09T05:35:47.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:47.050+0000 7f755f7fe700 1 -- 172.21.15.39:0/133158360 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f7550018020 con 0x7f7568107df0 2024-05-09T05:35:47.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:47.050+0000 7f755f7fe700 1 --2- 172.21.15.39:0/133158360 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f75540b2990 0x7f75540b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:35:47.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:47.050+0000 7f756659c700 1 --2- 172.21.15.39:0/133158360 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f75540b2990 0x7f75540b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:35:47.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:47.050+0000 7f755f7fe700 1 -- 172.21.15.39:0/133158360 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f75500e1f30 con 0x7f7568107df0 2024-05-09T05:35:47.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:47.051+0000 7f756659c700 1 --2- 172.21.15.39:0/133158360 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f75540b2990 0x7f75540b4ea0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7558009550 tx=0x7f75580091f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:35:47.047 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:47.054+0000 7f755f7fe700 1 -- 172.21.15.39:0/133158360 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f755001f020 con 0x7f7568107df0 2024-05-09T05:35:47.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:47.329+0000 7f756cf1a700 1 -- 172.21.15.39:0/133158360 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f756819afd0 con 0x7f7568107df0 2024-05-09T05:35:47.328 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:47.335+0000 7f755f7fe700 1 -- 172.21.15.39:0/133158360 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+288646 (secure 0 0 0) 0x7f75500a9c10 con 0x7f7568107df0 2024-05-09T05:35:47.333 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-09T05:35:47.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:47.339+0000 7f756cf1a700 1 -- 172.21.15.39:0/133158360 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f75540b2990 msgr2=0x7f75540b4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:35:47.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:47.339+0000 7f756cf1a700 1 --2- 172.21.15.39:0/133158360 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f75540b2990 0x7f75540b4ea0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7558009550 tx=0x7f75580091f0 comp rx=0 tx=0).stop 2024-05-09T05:35:47.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:47.339+0000 7f756cf1a700 1 -- 172.21.15.39:0/133158360 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7568107df0 msgr2=0x7f756819fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:35:47.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:47.339+0000 7f756cf1a700 1 --2- 172.21.15.39:0/133158360 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7568107df0 0x7f756819fe00 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f755000b500 tx=0x7f755000b810 comp rx=0 tx=0).stop 2024-05-09T05:35:47.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:47.339+0000 7f756cf1a700 1 -- 172.21.15.39:0/133158360 shutdown_connections 2024-05-09T05:35:47.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:47.339+0000 7f756cf1a700 1 --2- 172.21.15.39:0/133158360 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f75540b2990 0x7f75540b4ea0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:47.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:47.339+0000 7f756cf1a700 1 --2- 172.21.15.39:0/133158360 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7568108740 0x7f7568199ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:47.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:47.339+0000 7f756cf1a700 1 --2- 172.21.15.39:0/133158360 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75681034c0 0x7f756819f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:47.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:47.339+0000 7f756cf1a700 1 --2- 172.21.15.39:0/133158360 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7568107df0 0x7f756819fe00 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:47.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:47.339+0000 7f756cf1a700 1 -- 172.21.15.39:0/133158360 >> 172.21.15.39:0/133158360 conn(0x7f75680fedc0 msgr2=0x7f7568107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:35:47.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:47.339+0000 7f756cf1a700 1 -- 172.21.15.39:0/133158360 shutdown_connections 2024-05-09T05:35:47.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:47.339+0000 7f756cf1a700 1 -- 172.21.15.39:0/133158360 wait complete. 2024-05-09T05:35:47.609 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:35:47 smithi039 ceph-mon[30439]: pgmap v322: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1023 B/s wr, 6 op/s 2024-05-09T05:35:47.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:35:47 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/133158360' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-05-09T05:35:47.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:35:47 smithi100 ceph-mon[34353]: pgmap v322: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1023 B/s wr, 6 op/s 2024-05-09T05:35:47.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:35:47 smithi100 ceph-mon[34353]: from='client.? 172.21.15.39:0/133158360' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-05-09T05:35:47.973 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":17,"flags":0,"active_gid":14152,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":3184189003},{"type":"v1","addr":"172.21.15.39:6801","nonce":3184189003}]},"active_addr":"172.21.15.39:6801/3184189003","active_change":"2024-05-09T05:27:28.034198+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24109,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24122,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.39:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.39:0","nonce":1651077727}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.39:0","nonce":4138942827}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.39:0","nonce":269920905}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.39:0","nonce":1634469341}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.39:0","nonce":2086668739}]}]} 2024-05-09T05:35:47.980 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-05-09T05:35:47.980 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-05-09T05:35:47.981 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-09T05:35:48.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:35:47 smithi060 ceph-mon[34555]: pgmap v322: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1023 B/s wr, 6 op/s 2024-05-09T05:35:48.047 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:35:47 smithi060 ceph-mon[34555]: from='client.? 172.21.15.39:0/133158360' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-05-09T05:35:48.232 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T05:35:48.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:35:48 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:35:48.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:35:48 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:35:49.046 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:35:48 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:35:49.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:35:49 smithi060 ceph-mon[34555]: pgmap v323: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 1023 B/s wr, 5 op/s 2024-05-09T05:35:49.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:49.854+0000 7f012a4b7700 1 -- 172.21.15.39:0/1102479438 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f01241045e0 msgr2=0x7f01241049f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:35:49.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:49.854+0000 7f012a4b7700 1 --2- 172.21.15.39:0/1102479438 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f01241045e0 0x7f01241049f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f01140099c0 tx=0x7f0114009cd0 comp rx=0 tx=0).stop 2024-05-09T05:35:49.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:49.854+0000 7f012a4b7700 1 -- 172.21.15.39:0/1102479438 shutdown_connections 2024-05-09T05:35:49.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:49.854+0000 7f012a4b7700 1 --2- 172.21.15.39:0/1102479438 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0124109860 0x7f01241111c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:49.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:49.854+0000 7f012a4b7700 1 --2- 172.21.15.39:0/1102479438 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f01241045e0 0x7f01241049f0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:49.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:49.854+0000 7f012a4b7700 1 --2- 172.21.15.39:0/1102479438 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0124108f10 0x7f0124109320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:49.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:49.854+0000 7f012a4b7700 1 -- 172.21.15.39:0/1102479438 >> 172.21.15.39:0/1102479438 conn(0x7f01240ffed0 msgr2=0x7f0124102320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:35:49.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:49.854+0000 7f012a4b7700 1 -- 172.21.15.39:0/1102479438 shutdown_connections 2024-05-09T05:35:49.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:49.854+0000 7f012a4b7700 1 -- 172.21.15.39:0/1102479438 wait complete. 2024-05-09T05:35:49.849 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:35:49 smithi039 ceph-mon[30439]: pgmap v323: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 1023 B/s wr, 5 op/s 2024-05-09T05:35:49.851 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:49.855+0000 7f012a4b7700 1 Processor -- start 2024-05-09T05:35:49.851 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:49.855+0000 7f012a4b7700 1 -- start start 2024-05-09T05:35:49.851 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:49.856+0000 7f012a4b7700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f01241045e0 0x7f0124076bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:35:49.851 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:49.856+0000 7f012a4b7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0124108f10 0x7f0124077110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:35:49.851 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:49.856+0000 7f012a4b7700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0124109860 0x7f0124077650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:35:49.852 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:49.856+0000 7f012a4b7700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f0124114490 con 0x7f01241045e0 2024-05-09T05:35:49.852 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:49.856+0000 7f012a4b7700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f0124114310 con 0x7f0124108f10 2024-05-09T05:35:49.852 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:49.856+0000 7f0123fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f01241045e0 0x7f0124076bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:35:49.852 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:49.856+0000 7f012a4b7700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0124114610 con 0x7f0124109860 2024-05-09T05:35:49.852 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:49.856+0000 7f0123fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f01241045e0 0x7f0124076bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:52740/0 (socket says 172.21.15.39:52740) 2024-05-09T05:35:49.852 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:49.856+0000 7f0123fff700 1 -- 172.21.15.39:0/874747273 learned_addr learned my addr 172.21.15.39:0/874747273 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:35:49.852 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:49.856+0000 7f011bfff700 1 --2- 172.21.15.39:0/874747273 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0124108f10 0x7f0124077110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:35:49.852 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:49.856+0000 7f0128a54700 1 --2- 172.21.15.39:0/874747273 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0124109860 0x7f0124077650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:35:49.852 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:49.856+0000 7f0123fff700 1 -- 172.21.15.39:0/874747273 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0124109860 msgr2=0x7f0124077650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:35:49.852 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:49.856+0000 7f0123fff700 1 --2- 172.21.15.39:0/874747273 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0124109860 0x7f0124077650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:49.852 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:49.856+0000 7f0123fff700 1 -- 172.21.15.39:0/874747273 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0124108f10 msgr2=0x7f0124077110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:35:49.852 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:49.856+0000 7f0123fff700 1 --2- 172.21.15.39:0/874747273 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0124108f10 0x7f0124077110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:49.852 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:49.856+0000 7f0123fff700 1 -- 172.21.15.39:0/874747273 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01241a91a0 con 0x7f01241045e0 2024-05-09T05:35:49.852 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:49.856+0000 7f011bfff700 1 --2- 172.21.15.39:0/874747273 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0124108f10 0x7f0124077110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T05:35:49.853 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:49.856+0000 7f0123fff700 1 --2- 172.21.15.39:0/874747273 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f01241045e0 0x7f0124076bd0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0114006010 tx=0x7f0114004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:35:49.853 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:49.857+0000 7f0121ffb700 1 -- 172.21.15.39:0/874747273 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0114026070 con 0x7f01241045e0 2024-05-09T05:35:49.853 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:49.857+0000 7f012a4b7700 1 -- 172.21.15.39:0/874747273 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01241a9430 con 0x7f01241045e0 2024-05-09T05:35:49.853 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:49.857+0000 7f0121ffb700 1 -- 172.21.15.39:0/874747273 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0114004630 con 0x7f01241045e0 2024-05-09T05:35:49.853 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:49.857+0000 7f0121ffb700 1 -- 172.21.15.39:0/874747273 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f011400fb20 con 0x7f01241045e0 2024-05-09T05:35:49.853 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:49.857+0000 7f012a4b7700 1 -- 172.21.15.39:0/874747273 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01241a98e0 con 0x7f01241045e0 2024-05-09T05:35:49.853 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:49.858+0000 7f012a4b7700 1 -- 172.21.15.39:0/874747273 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01240512c0 con 0x7f01241045e0 2024-05-09T05:35:49.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:49.860+0000 7f0121ffb700 1 -- 172.21.15.39:0/874747273 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f0114029070 con 0x7f01241045e0 2024-05-09T05:35:49.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:49.860+0000 7f0121ffb700 1 --2- 172.21.15.39:0/874747273 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f01100b2910 0x7f01100b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:35:49.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:49.860+0000 7f011bfff700 1 --2- 172.21.15.39:0/874747273 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f01100b2910 0x7f01100b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:35:49.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:49.861+0000 7f0121ffb700 1 -- 172.21.15.39:0/874747273 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f01140e3360 con 0x7f01241045e0 2024-05-09T05:35:49.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:49.861+0000 7f011bfff700 1 --2- 172.21.15.39:0/874747273 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f01100b2910 0x7f01100b4e20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0124107830 tx=0x7f010c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:35:49.857 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:49.865+0000 7f0121ffb700 1 -- 172.21.15.39:0/874747273 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f0114013070 con 0x7f01241045e0 2024-05-09T05:35:49.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:35:49 smithi100 ceph-mon[34353]: pgmap v323: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 1023 B/s wr, 5 op/s 2024-05-09T05:35:50.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:50.111+0000 7f012a4b7700 1 -- 172.21.15.39:0/874747273 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f012402e5f0 con 0x7f01241045e0 2024-05-09T05:35:50.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:50.114+0000 7f0121ffb700 1 -- 172.21.15.39:0/874747273 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+22602 (secure 0 0 0) 0x7f01140aafc0 con 0x7f01241045e0 2024-05-09T05:35:50.107 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-09T05:35:50.107 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":83,"fsid":"86d4cc60-0dc4-11ef-bc97-c7b262605968","created":"2024-05-09T05:26:33.514203+0000","modified":"2024-05-09T05:35:29.485823+0000","last_up_change":"2024-05-09T05:33:48.776015+0000","last_in_change":"2024-05-09T05:33:28.117875+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T05:29:56.122407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-09T05:34:49.964521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-09T05:34:52.915301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3491bbda-3a9b-40d2-8627-87d15660f864","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":1056276932},{"type":"v1","addr":"172.21.15.39:6803","nonce":1056276932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":1056276932},{"type":"v1","addr":"172.21.15.39:6805","nonce":1056276932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":1056276932},{"type":"v1","addr":"172.21.15.39:6809","nonce":1056276932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":1056276932},{"type":"v1","addr":"172.21.15.39:6807","nonce":1056276932}]},"public_addr":"172.21.15.39:6803/1056276932","cluster_addr":"172.21.15.39:6805/1056276932","heartbeat_back_addr":"172.21.15.39:6809/1056276932","heartbeat_front_addr":"172.21.15.39:6807/1056276932","state":["exists","up"]},{"osd":1,"uuid":"ec2bd2d0-2975-402c-9df8-3469dfd6070f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":4245630636},{"type":"v1","addr":"172.21.15.60:6801","nonce":4245630636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":4245630636},{"type":"v1","addr":"172.21.15.60:6803","nonce":4245630636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":4245630636},{"type":"v1","addr":"172.21.15.60:6807","nonce":4245630636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":4245630636},{"type":"v1","addr":"172.21.15.60:6805","nonce":4245630636}]},"public_addr":"172.21.15.60:6801/4245630636","cluster_addr":"172.21.15.60:6803/4245630636","heartbeat_back_addr":"172.21.15.60:6807/4245630636","heartbeat_front_addr":"172.21.15.60:6805/4245630636","state":["exists","up"]},{"osd":2,"uuid":"9efaf6dd-086e-4095-b92e-cbbecf738523","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":4141597693},{"type":"v1","addr":"172.21.15.100:6801","nonce":4141597693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":4141597693},{"type":"v1","addr":"172.21.15.100:6803","nonce":4141597693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":4141597693},{"type":"v1","addr":"172.21.15.100:6807","nonce":4141597693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":4141597693},{"type":"v1","addr":"172.21.15.100:6805","nonce":4141597693}]},"public_addr":"172.21.15.100:6801/4141597693","cluster_addr":"172.21.15.100:6803/4141597693","heartbeat_back_addr":"172.21.15.100:6807/4141597693","heartbeat_front_addr":"172.21.15.100:6805/4141597693","state":["exists","up"]},{"osd":3,"uuid":"1ebe1a25-541d-4b54-bed8-4f0ec51b2432","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":2254197543},{"type":"v1","addr":"172.21.15.39:6811","nonce":2254197543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":2254197543},{"type":"v1","addr":"172.21.15.39:6813","nonce":2254197543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2254197543},{"type":"v1","addr":"172.21.15.39:6817","nonce":2254197543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":2254197543},{"type":"v1","addr":"172.21.15.39:6815","nonce":2254197543}]},"public_addr":"172.21.15.39:6811/2254197543","cluster_addr":"172.21.15.39:6813/2254197543","heartbeat_back_addr":"172.21.15.39:6817/2254197543","heartbeat_front_addr":"172.21.15.39:6815/2254197543","state":["exists","up"]},{"osd":4,"uuid":"d52450a3-8a97-4746-a857-35aec69aac44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":649037162},{"type":"v1","addr":"172.21.15.60:6809","nonce":649037162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":649037162},{"type":"v1","addr":"172.21.15.60:6811","nonce":649037162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":649037162},{"type":"v1","addr":"172.21.15.60:6815","nonce":649037162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":649037162},{"type":"v1","addr":"172.21.15.60:6813","nonce":649037162}]},"public_addr":"172.21.15.60:6809/649037162","cluster_addr":"172.21.15.60:6811/649037162","heartbeat_back_addr":"172.21.15.60:6815/649037162","heartbeat_front_addr":"172.21.15.60:6813/649037162","state":["exists","up"]},{"osd":5,"uuid":"b35bf704-898d-40f7-b575-90267764a5b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":658409226},{"type":"v1","addr":"172.21.15.100:6809","nonce":658409226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":658409226},{"type":"v1","addr":"172.21.15.100:6811","nonce":658409226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":658409226},{"type":"v1","addr":"172.21.15.100:6815","nonce":658409226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":658409226},{"type":"v1","addr":"172.21.15.100:6813","nonce":658409226}]},"public_addr":"172.21.15.100:6809/658409226","cluster_addr":"172.21.15.100:6811/658409226","heartbeat_back_addr":"172.21.15.100:6815/658409226","heartbeat_front_addr":"172.21.15.100:6813/658409226","state":["exists","up"]},{"osd":6,"uuid":"49eae2f5-1dad-4c2c-89f4-efa1dd1faefb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":237628491},{"type":"v1","addr":"172.21.15.39:6819","nonce":237628491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":237628491},{"type":"v1","addr":"172.21.15.39:6821","nonce":237628491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":237628491},{"type":"v1","addr":"172.21.15.39:6825","nonce":237628491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":237628491},{"type":"v1","addr":"172.21.15.39:6823","nonce":237628491}]},"public_addr":"172.21.15.39:6819/237628491","cluster_addr":"172.21.15.39:6821/237628491","heartbeat_back_addr":"172.21.15.39:6825/237628491","heartbeat_front_addr":"172.21.15.39:6823/237628491","state":["exists","up"]},{"osd":7,"uuid":"60ccae54-535c-4a13-98d0-881c00b5e870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":2718201647},{"type":"v1","addr":"172.21.15.60:6817","nonce":2718201647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":2718201647},{"type":"v1","addr":"172.21.15.60:6819","nonce":2718201647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":2718201647},{"type":"v1","addr":"172.21.15.60:6823","nonce":2718201647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":2718201647},{"type":"v1","addr":"172.21.15.60:6821","nonce":2718201647}]},"public_addr":"172.21.15.60:6817/2718201647","cluster_addr":"172.21.15.60:6819/2718201647","heartbeat_back_addr":"172.21.15.60:6823/2718201647","heartbeat_front_addr":"172.21.15.60:6821/2718201647","state":["exists","up"]},{"osd":8,"uuid":"edd52a21-0066-429f-9e98-15d1a74c53b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":1757558317},{"type":"v1","addr":"172.21.15.100:6817","nonce":1757558317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":1757558317},{"type":"v1","addr":"172.21.15.100:6819","nonce":1757558317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":1757558317},{"type":"v1","addr":"172.21.15.100:6823","nonce":1757558317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":1757558317},{"type":"v1","addr":"172.21.15.100:6821","nonce":1757558317}]},"public_addr":"172.21.15.100:6817/1757558317","cluster_addr":"172.21.15.100:6819/1757558317","heartbeat_back_addr":"172.21.15.100:6823/1757558317","heartbeat_front_addr":"172.21.15.100:6821/1757558317","state":["exists","up"]},{"osd":9,"uuid":"03fb7543-3386-49a4-b165-1007f07d88d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":2944584368},{"type":"v1","addr":"172.21.15.39:6827","nonce":2944584368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":2944584368},{"type":"v1","addr":"172.21.15.39:6829","nonce":2944584368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":2944584368},{"type":"v1","addr":"172.21.15.39:6833","nonce":2944584368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":2944584368},{"type":"v1","addr":"172.21.15.39:6831","nonce":2944584368}]},"public_addr":"172.21.15.39:6827/2944584368","cluster_addr":"172.21.15.39:6829/2944584368","heartbeat_back_addr":"172.21.15.39:6833/2944584368","heartbeat_front_addr":"172.21.15.39:6831/2944584368","state":["exists","up"]},{"osd":10,"uuid":"c1cadd6c-fcc4-4d76-b07e-0f392066a8d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1940670367},{"type":"v1","addr":"172.21.15.60:6825","nonce":1940670367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":1940670367},{"type":"v1","addr":"172.21.15.60:6827","nonce":1940670367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":1940670367},{"type":"v1","addr":"172.21.15.60:6831","nonce":1940670367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":1940670367},{"type":"v1","addr":"172.21.15.60:6829","nonce":1940670367}]},"public_addr":"172.21.15.60:6825/1940670367","cluster_addr":"172.21.15.60:6827/1940670367","heartbeat_back_addr":"172.21.15.60:6831/1940670367","heartbeat_front_addr":"172.21.15.60:6829/1940670367","state":["exists","up"]},{"osd":11,"uuid":"56806877-9ce2-41e2-9506-ce67897fa09b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":3318561029},{"type":"v1","addr":"172.21.15.100:6825","nonce":3318561029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":3318561029},{"type":"v1","addr":"172.21.15.100:6827","nonce":3318561029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":3318561029},{"type":"v1","addr":"172.21.15.100:6831","nonce":3318561029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":3318561029},{"type":"v1","addr":"172.21.15.100:6829","nonce":3318561029}]},"public_addr":"172.21.15.100:6825/3318561029","cluster_addr":"172.21.15.100:6827/3318561029","heartbeat_back_addr":"172.21.15.100:6831/3318561029","heartbeat_front_addr":"172.21.15.100:6829/3318561029","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:29:03.565705+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:29:28.380764+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:29:53.300224+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:30:20.046517+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:30:45.557983+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:31:10.397933+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:31:37.644428+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:32:02.325329+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:32:27.699044+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:32:54.436305+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:33:20.691300+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:33:46.806146+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.39:6801/4091500272":"2024-05-10T05:27:28.034010+0000","172.21.15.39:6800/4091500272":"2024-05-10T05:27:28.034010+0000","172.21.15.39:0/782312916":"2024-05-10T05:27:28.034010+0000","172.21.15.39:0/1899316433":"2024-05-10T05:27:28.034010+0000","172.21.15.39:0/1613215795":"2024-05-10T05:27:00.650123+0000","172.21.15.39:0/2870431271":"2024-05-10T05:27:00.650123+0000","172.21.15.39:0/438945726":"2024-05-10T05:27:00.650123+0000","172.21.15.39:6800/499609328":"2024-05-10T05:27:00.650123+0000","172.21.15.39:6801/499609328":"2024-05-10T05:27:00.650123+0000","172.21.15.39:0/1698165886":"2024-05-10T05:27:28.034010+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T05:35:50.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:50.116+0000 7f012a4b7700 1 -- 172.21.15.39:0/874747273 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f01100b2910 msgr2=0x7f01100b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:35:50.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:50.116+0000 7f012a4b7700 1 --2- 172.21.15.39:0/874747273 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f01100b2910 0x7f01100b4e20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0124107830 tx=0x7f010c009260 comp rx=0 tx=0).stop 2024-05-09T05:35:50.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:50.116+0000 7f012a4b7700 1 -- 172.21.15.39:0/874747273 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f01241045e0 msgr2=0x7f0124076bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:35:50.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:50.116+0000 7f012a4b7700 1 --2- 172.21.15.39:0/874747273 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f01241045e0 0x7f0124076bd0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0114006010 tx=0x7f0114004270 comp rx=0 tx=0).stop 2024-05-09T05:35:50.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:50.116+0000 7f012a4b7700 1 -- 172.21.15.39:0/874747273 shutdown_connections 2024-05-09T05:35:50.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:50.116+0000 7f012a4b7700 1 --2- 172.21.15.39:0/874747273 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f01100b2910 0x7f01100b4e20 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:50.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:50.116+0000 7f012a4b7700 1 --2- 172.21.15.39:0/874747273 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0124109860 0x7f0124077650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:50.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:50.116+0000 7f012a4b7700 1 --2- 172.21.15.39:0/874747273 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f01241045e0 0x7f0124076bd0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:50.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:50.116+0000 7f012a4b7700 1 --2- 172.21.15.39:0/874747273 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0124108f10 0x7f0124077110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:50.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:50.116+0000 7f012a4b7700 1 -- 172.21.15.39:0/874747273 >> 172.21.15.39:0/874747273 conn(0x7f01240ffed0 msgr2=0x7f01241081c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:35:50.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:50.116+0000 7f012a4b7700 1 -- 172.21.15.39:0/874747273 shutdown_connections 2024-05-09T05:35:50.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:50.116+0000 7f012a4b7700 1 -- 172.21.15.39:0/874747273 wait complete. 2024-05-09T05:35:51.048 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:35:50 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:35:51.048 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:35:50 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:35:51.049 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:35:50 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/874747273' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T05:35:51.049 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:35:50 smithi039 ceph-mon[30439]: pgmap v324: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1023 B/s wr, 7 op/s 2024-05-09T05:35:51.049 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:35:50 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:35:51.049 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:35:50 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:35:51.296 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:35:50 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:35:51.296 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:35:50 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:35:51.296 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:35:50 smithi060 ceph-mon[34555]: from='client.? 172.21.15.39:0/874747273' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T05:35:51.297 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:35:50 smithi060 ceph-mon[34555]: pgmap v324: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1023 B/s wr, 7 op/s 2024-05-09T05:35:51.297 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:35:50 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:35:51.297 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:35:50 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:35:51.353 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-05-09T05:35:51.353 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-09T05:35:51.423 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:35:50 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:35:51.423 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:35:50 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:35:51.423 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:35:50 smithi100 ceph-mon[34353]: from='client.? 172.21.15.39:0/874747273' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T05:35:51.423 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:35:50 smithi100 ceph-mon[34353]: pgmap v324: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1023 B/s wr, 7 op/s 2024-05-09T05:35:51.423 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:35:50 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:35:51.424 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:35:50 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:35:51.637 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T05:35:53.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:53.235+0000 7fa5a4538700 1 -- 172.21.15.39:0/983456014 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa59c108f10 msgr2=0x7fa59c109320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:35:53.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:53.235+0000 7fa5a4538700 1 --2- 172.21.15.39:0/983456014 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa59c108f10 0x7fa59c109320 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa5980099c0 tx=0x7fa598009cd0 comp rx=0 tx=0).stop 2024-05-09T05:35:53.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:53.236+0000 7fa5a4538700 1 -- 172.21.15.39:0/983456014 shutdown_connections 2024-05-09T05:35:53.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:53.236+0000 7fa5a4538700 1 --2- 172.21.15.39:0/983456014 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa59c109860 0x7fa59c1111c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:53.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:53.236+0000 7fa5a4538700 1 --2- 172.21.15.39:0/983456014 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa59c1045e0 0x7fa59c1049f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:53.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:53.236+0000 7fa5a4538700 1 --2- 172.21.15.39:0/983456014 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa59c108f10 0x7fa59c109320 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:53.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:53.236+0000 7fa5a4538700 1 -- 172.21.15.39:0/983456014 >> 172.21.15.39:0/983456014 conn(0x7fa59c0ffe70 msgr2=0x7fa59c1022c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:35:53.230 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:35:53 smithi039 ceph-mon[30439]: pgmap v325: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 426 B/s wr, 5 op/s 2024-05-09T05:35:53.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:53.238+0000 7fa5a4538700 1 -- 172.21.15.39:0/983456014 shutdown_connections 2024-05-09T05:35:53.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:53.238+0000 7fa5a4538700 1 -- 172.21.15.39:0/983456014 wait complete. 2024-05-09T05:35:53.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:53.238+0000 7fa5a4538700 1 Processor -- start 2024-05-09T05:35:53.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:53.238+0000 7fa5a4538700 1 -- start start 2024-05-09T05:35:53.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:53.239+0000 7fa5a4538700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa59c1045e0 0x7fa59c19ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:35:53.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:53.239+0000 7fa5a4538700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa59c108f10 0x7fa59c19b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:35:53.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:53.239+0000 7fa5a4538700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa59c109860 0x7fa59c19f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:35:53.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:53.239+0000 7fa5a4538700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fa59c114470 con 0x7fa59c1045e0 2024-05-09T05:35:53.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:53.239+0000 7fa5a4538700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa59c1142f0 con 0x7fa59c109860 2024-05-09T05:35:53.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:53.239+0000 7fa5a4538700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa59c1145f0 con 0x7fa59c108f10 2024-05-09T05:35:53.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:53.239+0000 7fa5a22d4700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa59c1045e0 0x7fa59c19ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:35:53.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:53.239+0000 7fa5a22d4700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa59c1045e0 0x7fa59c19ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:52750/0 (socket says 172.21.15.39:52750) 2024-05-09T05:35:53.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:53.239+0000 7fa5a22d4700 1 -- 172.21.15.39:0/2123932791 learned_addr learned my addr 172.21.15.39:0/2123932791 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:35:53.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:53.239+0000 7fa5a1ad3700 1 --2- 172.21.15.39:0/2123932791 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa59c108f10 0x7fa59c19b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:35:53.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:53.239+0000 7fa5a2ad5700 1 --2- 172.21.15.39:0/2123932791 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa59c109860 0x7fa59c19f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:35:53.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:53.239+0000 7fa5a22d4700 1 -- 172.21.15.39:0/2123932791 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa59c108f10 msgr2=0x7fa59c19b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:35:53.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:53.239+0000 7fa5a22d4700 1 --2- 172.21.15.39:0/2123932791 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa59c108f10 0x7fa59c19b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:53.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:53.239+0000 7fa5a22d4700 1 -- 172.21.15.39:0/2123932791 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa59c109860 msgr2=0x7fa59c19f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:35:53.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:53.239+0000 7fa5a22d4700 1 --2- 172.21.15.39:0/2123932791 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa59c109860 0x7fa59c19f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:53.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:53.239+0000 7fa5a22d4700 1 -- 172.21.15.39:0/2123932791 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa59c19fc50 con 0x7fa59c1045e0 2024-05-09T05:35:53.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:53.239+0000 7fa5a2ad5700 1 --2- 172.21.15.39:0/2123932791 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa59c109860 0x7fa59c19f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:35:53.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:53.240+0000 7fa5a22d4700 1 --2- 172.21.15.39:0/2123932791 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa59c1045e0 0x7fa59c19ae80 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fa59000c9b0 tx=0x7fa59000ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:35:53.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:53.240+0000 7fa58f7fe700 1 -- 172.21.15.39:0/2123932791 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa590007b00 con 0x7fa59c1045e0 2024-05-09T05:35:53.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:53.240+0000 7fa58f7fe700 1 -- 172.21.15.39:0/2123932791 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa590007ca0 con 0x7fa59c1045e0 2024-05-09T05:35:53.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:53.240+0000 7fa5a4538700 1 -- 172.21.15.39:0/2123932791 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa59c19ff40 con 0x7fa59c1045e0 2024-05-09T05:35:53.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:53.240+0000 7fa58f7fe700 1 -- 172.21.15.39:0/2123932791 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa590018660 con 0x7fa59c1045e0 2024-05-09T05:35:53.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:53.240+0000 7fa5a4538700 1 -- 172.21.15.39:0/2123932791 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa59c1a04a0 con 0x7fa59c1045e0 2024-05-09T05:35:53.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:53.241+0000 7fa5a4538700 1 -- 172.21.15.39:0/2123932791 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa59c0512c0 con 0x7fa59c1045e0 2024-05-09T05:35:53.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:53.244+0000 7fa58f7fe700 1 -- 172.21.15.39:0/2123932791 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fa59000f450 con 0x7fa59c1045e0 2024-05-09T05:35:53.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:53.245+0000 7fa58f7fe700 1 --2- 172.21.15.39:0/2123932791 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fa5880b2990 0x7fa5880b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:35:53.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:53.245+0000 7fa5a1ad3700 1 --2- 172.21.15.39:0/2123932791 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fa5880b2990 0x7fa5880b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:35:53.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:53.245+0000 7fa58f7fe700 1 -- 172.21.15.39:0/2123932791 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7fa5900e25c0 con 0x7fa59c1045e0 2024-05-09T05:35:53.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:53.245+0000 7fa5a1ad3700 1 --2- 172.21.15.39:0/2123932791 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fa5880b2990 0x7fa5880b4ea0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa598005b40 tx=0x7fa59801a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:35:53.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:53.248+0000 7fa58f7fe700 1 -- 172.21.15.39:0/2123932791 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fa590014030 con 0x7fa59c1045e0 2024-05-09T05:35:53.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:53.476+0000 7fa5a4538700 1 -- 172.21.15.39:0/2123932791 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa59c19c1c0 con 0x7fa59c1045e0 2024-05-09T05:35:53.471 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:53.478+0000 7fa58f7fe700 1 -- 172.21.15.39:0/2123932791 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+22602 (secure 0 0 0) 0x7fa59c19c1c0 con 0x7fa59c1045e0 2024-05-09T05:35:53.472 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-09T05:35:53.472 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":83,"fsid":"86d4cc60-0dc4-11ef-bc97-c7b262605968","created":"2024-05-09T05:26:33.514203+0000","modified":"2024-05-09T05:35:29.485823+0000","last_up_change":"2024-05-09T05:33:48.776015+0000","last_in_change":"2024-05-09T05:33:28.117875+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T05:29:56.122407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-09T05:34:49.964521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-09T05:34:52.915301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3491bbda-3a9b-40d2-8627-87d15660f864","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":1056276932},{"type":"v1","addr":"172.21.15.39:6803","nonce":1056276932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":1056276932},{"type":"v1","addr":"172.21.15.39:6805","nonce":1056276932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":1056276932},{"type":"v1","addr":"172.21.15.39:6809","nonce":1056276932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":1056276932},{"type":"v1","addr":"172.21.15.39:6807","nonce":1056276932}]},"public_addr":"172.21.15.39:6803/1056276932","cluster_addr":"172.21.15.39:6805/1056276932","heartbeat_back_addr":"172.21.15.39:6809/1056276932","heartbeat_front_addr":"172.21.15.39:6807/1056276932","state":["exists","up"]},{"osd":1,"uuid":"ec2bd2d0-2975-402c-9df8-3469dfd6070f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":4245630636},{"type":"v1","addr":"172.21.15.60:6801","nonce":4245630636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":4245630636},{"type":"v1","addr":"172.21.15.60:6803","nonce":4245630636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":4245630636},{"type":"v1","addr":"172.21.15.60:6807","nonce":4245630636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":4245630636},{"type":"v1","addr":"172.21.15.60:6805","nonce":4245630636}]},"public_addr":"172.21.15.60:6801/4245630636","cluster_addr":"172.21.15.60:6803/4245630636","heartbeat_back_addr":"172.21.15.60:6807/4245630636","heartbeat_front_addr":"172.21.15.60:6805/4245630636","state":["exists","up"]},{"osd":2,"uuid":"9efaf6dd-086e-4095-b92e-cbbecf738523","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":4141597693},{"type":"v1","addr":"172.21.15.100:6801","nonce":4141597693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":4141597693},{"type":"v1","addr":"172.21.15.100:6803","nonce":4141597693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":4141597693},{"type":"v1","addr":"172.21.15.100:6807","nonce":4141597693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":4141597693},{"type":"v1","addr":"172.21.15.100:6805","nonce":4141597693}]},"public_addr":"172.21.15.100:6801/4141597693","cluster_addr":"172.21.15.100:6803/4141597693","heartbeat_back_addr":"172.21.15.100:6807/4141597693","heartbeat_front_addr":"172.21.15.100:6805/4141597693","state":["exists","up"]},{"osd":3,"uuid":"1ebe1a25-541d-4b54-bed8-4f0ec51b2432","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":2254197543},{"type":"v1","addr":"172.21.15.39:6811","nonce":2254197543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":2254197543},{"type":"v1","addr":"172.21.15.39:6813","nonce":2254197543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2254197543},{"type":"v1","addr":"172.21.15.39:6817","nonce":2254197543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":2254197543},{"type":"v1","addr":"172.21.15.39:6815","nonce":2254197543}]},"public_addr":"172.21.15.39:6811/2254197543","cluster_addr":"172.21.15.39:6813/2254197543","heartbeat_back_addr":"172.21.15.39:6817/2254197543","heartbeat_front_addr":"172.21.15.39:6815/2254197543","state":["exists","up"]},{"osd":4,"uuid":"d52450a3-8a97-4746-a857-35aec69aac44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":649037162},{"type":"v1","addr":"172.21.15.60:6809","nonce":649037162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":649037162},{"type":"v1","addr":"172.21.15.60:6811","nonce":649037162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":649037162},{"type":"v1","addr":"172.21.15.60:6815","nonce":649037162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":649037162},{"type":"v1","addr":"172.21.15.60:6813","nonce":649037162}]},"public_addr":"172.21.15.60:6809/649037162","cluster_addr":"172.21.15.60:6811/649037162","heartbeat_back_addr":"172.21.15.60:6815/649037162","heartbeat_front_addr":"172.21.15.60:6813/649037162","state":["exists","up"]},{"osd":5,"uuid":"b35bf704-898d-40f7-b575-90267764a5b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":658409226},{"type":"v1","addr":"172.21.15.100:6809","nonce":658409226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":658409226},{"type":"v1","addr":"172.21.15.100:6811","nonce":658409226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":658409226},{"type":"v1","addr":"172.21.15.100:6815","nonce":658409226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":658409226},{"type":"v1","addr":"172.21.15.100:6813","nonce":658409226}]},"public_addr":"172.21.15.100:6809/658409226","cluster_addr":"172.21.15.100:6811/658409226","heartbeat_back_addr":"172.21.15.100:6815/658409226","heartbeat_front_addr":"172.21.15.100:6813/658409226","state":["exists","up"]},{"osd":6,"uuid":"49eae2f5-1dad-4c2c-89f4-efa1dd1faefb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":237628491},{"type":"v1","addr":"172.21.15.39:6819","nonce":237628491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":237628491},{"type":"v1","addr":"172.21.15.39:6821","nonce":237628491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":237628491},{"type":"v1","addr":"172.21.15.39:6825","nonce":237628491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":237628491},{"type":"v1","addr":"172.21.15.39:6823","nonce":237628491}]},"public_addr":"172.21.15.39:6819/237628491","cluster_addr":"172.21.15.39:6821/237628491","heartbeat_back_addr":"172.21.15.39:6825/237628491","heartbeat_front_addr":"172.21.15.39:6823/237628491","state":["exists","up"]},{"osd":7,"uuid":"60ccae54-535c-4a13-98d0-881c00b5e870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":2718201647},{"type":"v1","addr":"172.21.15.60:6817","nonce":2718201647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":2718201647},{"type":"v1","addr":"172.21.15.60:6819","nonce":2718201647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":2718201647},{"type":"v1","addr":"172.21.15.60:6823","nonce":2718201647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":2718201647},{"type":"v1","addr":"172.21.15.60:6821","nonce":2718201647}]},"public_addr":"172.21.15.60:6817/2718201647","cluster_addr":"172.21.15.60:6819/2718201647","heartbeat_back_addr":"172.21.15.60:6823/2718201647","heartbeat_front_addr":"172.21.15.60:6821/2718201647","state":["exists","up"]},{"osd":8,"uuid":"edd52a21-0066-429f-9e98-15d1a74c53b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":1757558317},{"type":"v1","addr":"172.21.15.100:6817","nonce":1757558317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":1757558317},{"type":"v1","addr":"172.21.15.100:6819","nonce":1757558317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":1757558317},{"type":"v1","addr":"172.21.15.100:6823","nonce":1757558317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":1757558317},{"type":"v1","addr":"172.21.15.100:6821","nonce":1757558317}]},"public_addr":"172.21.15.100:6817/1757558317","cluster_addr":"172.21.15.100:6819/1757558317","heartbeat_back_addr":"172.21.15.100:6823/1757558317","heartbeat_front_addr":"172.21.15.100:6821/1757558317","state":["exists","up"]},{"osd":9,"uuid":"03fb7543-3386-49a4-b165-1007f07d88d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":2944584368},{"type":"v1","addr":"172.21.15.39:6827","nonce":2944584368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":2944584368},{"type":"v1","addr":"172.21.15.39:6829","nonce":2944584368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":2944584368},{"type":"v1","addr":"172.21.15.39:6833","nonce":2944584368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":2944584368},{"type":"v1","addr":"172.21.15.39:6831","nonce":2944584368}]},"public_addr":"172.21.15.39:6827/2944584368","cluster_addr":"172.21.15.39:6829/2944584368","heartbeat_back_addr":"172.21.15.39:6833/2944584368","heartbeat_front_addr":"172.21.15.39:6831/2944584368","state":["exists","up"]},{"osd":10,"uuid":"c1cadd6c-fcc4-4d76-b07e-0f392066a8d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1940670367},{"type":"v1","addr":"172.21.15.60:6825","nonce":1940670367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":1940670367},{"type":"v1","addr":"172.21.15.60:6827","nonce":1940670367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":1940670367},{"type":"v1","addr":"172.21.15.60:6831","nonce":1940670367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":1940670367},{"type":"v1","addr":"172.21.15.60:6829","nonce":1940670367}]},"public_addr":"172.21.15.60:6825/1940670367","cluster_addr":"172.21.15.60:6827/1940670367","heartbeat_back_addr":"172.21.15.60:6831/1940670367","heartbeat_front_addr":"172.21.15.60:6829/1940670367","state":["exists","up"]},{"osd":11,"uuid":"56806877-9ce2-41e2-9506-ce67897fa09b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":3318561029},{"type":"v1","addr":"172.21.15.100:6825","nonce":3318561029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":3318561029},{"type":"v1","addr":"172.21.15.100:6827","nonce":3318561029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":3318561029},{"type":"v1","addr":"172.21.15.100:6831","nonce":3318561029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":3318561029},{"type":"v1","addr":"172.21.15.100:6829","nonce":3318561029}]},"public_addr":"172.21.15.100:6825/3318561029","cluster_addr":"172.21.15.100:6827/3318561029","heartbeat_back_addr":"172.21.15.100:6831/3318561029","heartbeat_front_addr":"172.21.15.100:6829/3318561029","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:29:03.565705+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:29:28.380764+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:29:53.300224+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:30:20.046517+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:30:45.557983+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:31:10.397933+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:31:37.644428+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:32:02.325329+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:32:27.699044+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:32:54.436305+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:33:20.691300+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:33:46.806146+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.39:6801/4091500272":"2024-05-10T05:27:28.034010+0000","172.21.15.39:6800/4091500272":"2024-05-10T05:27:28.034010+0000","172.21.15.39:0/782312916":"2024-05-10T05:27:28.034010+0000","172.21.15.39:0/1899316433":"2024-05-10T05:27:28.034010+0000","172.21.15.39:0/1613215795":"2024-05-10T05:27:00.650123+0000","172.21.15.39:0/2870431271":"2024-05-10T05:27:00.650123+0000","172.21.15.39:0/438945726":"2024-05-10T05:27:00.650123+0000","172.21.15.39:6800/499609328":"2024-05-10T05:27:00.650123+0000","172.21.15.39:6801/499609328":"2024-05-10T05:27:00.650123+0000","172.21.15.39:0/1698165886":"2024-05-10T05:27:28.034010+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T05:35:53.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:53.480+0000 7fa5a4538700 1 -- 172.21.15.39:0/2123932791 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fa5880b2990 msgr2=0x7fa5880b4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:35:53.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:53.480+0000 7fa5a4538700 1 --2- 172.21.15.39:0/2123932791 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fa5880b2990 0x7fa5880b4ea0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa598005b40 tx=0x7fa59801a040 comp rx=0 tx=0).stop 2024-05-09T05:35:53.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:53.480+0000 7fa5a4538700 1 -- 172.21.15.39:0/2123932791 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa59c1045e0 msgr2=0x7fa59c19ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:35:53.475 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:53.480+0000 7fa5a4538700 1 --2- 172.21.15.39:0/2123932791 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa59c1045e0 0x7fa59c19ae80 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fa59000c9b0 tx=0x7fa59000ccc0 comp rx=0 tx=0).stop 2024-05-09T05:35:53.475 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:53.480+0000 7fa5a4538700 1 -- 172.21.15.39:0/2123932791 shutdown_connections 2024-05-09T05:35:53.475 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:53.481+0000 7fa5a4538700 1 --2- 172.21.15.39:0/2123932791 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fa5880b2990 0x7fa5880b4ea0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:53.475 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:53.481+0000 7fa5a4538700 1 --2- 172.21.15.39:0/2123932791 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa59c109860 0x7fa59c19f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:53.475 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:53.481+0000 7fa5a4538700 1 --2- 172.21.15.39:0/2123932791 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa59c1045e0 0x7fa59c19ae80 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:53.475 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:53.481+0000 7fa5a4538700 1 --2- 172.21.15.39:0/2123932791 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa59c108f10 0x7fa59c19b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:53.475 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:53.481+0000 7fa5a4538700 1 -- 172.21.15.39:0/2123932791 >> 172.21.15.39:0/2123932791 conn(0x7fa59c0ffe70 msgr2=0x7fa59c107160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:35:53.475 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:53.481+0000 7fa5a4538700 1 -- 172.21.15.39:0/2123932791 shutdown_connections 2024-05-09T05:35:53.475 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:53.481+0000 7fa5a4538700 1 -- 172.21.15.39:0/2123932791 wait complete. 2024-05-09T05:35:53.546 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:35:53 smithi060 ceph-mon[34555]: pgmap v325: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 426 B/s wr, 5 op/s 2024-05-09T05:35:53.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:35:53 smithi100 ceph-mon[34353]: pgmap v325: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 426 B/s wr, 5 op/s 2024-05-09T05:35:54.252 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-05-09T05:35:54.253 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-05-09T05:35:54.253 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-05-09T05:35:54.253 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-05-09T05:35:54.254 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-05-09T05:35:54.254 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-05-09T05:35:54.255 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-05-09T05:35:54.255 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-05-09T05:35:54.256 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-05-09T05:35:54.256 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-05-09T05:35:54.256 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-05-09T05:35:54.257 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-05-09T05:35:54.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:35:54 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:35:54.611 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:35:54 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:35:54.612 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:35:54 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/2123932791' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T05:35:54.612 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:35:54 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:35:54.612 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:35:54 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:35:54.612 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:35:54 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:35:54.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:35:54 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:35:54.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:35:54 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:35:54.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:35:54 smithi100 ceph-mon[34353]: from='client.? 172.21.15.39:0/2123932791' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T05:35:54.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:35:54 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:35:54.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:35:54 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:35:54.675 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:35:54 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:35:54.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:35:54 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:35:54.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:35:54 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:35:54.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:35:54 smithi060 ceph-mon[34555]: from='client.? 172.21.15.39:0/2123932791' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T05:35:54.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:35:54 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:35:54.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:35:54 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:35:54.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:35:54 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:35:55.007 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T05:35:55.013 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T05:35:55.019 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T05:35:55.477 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:35:55 smithi039 ceph-mon[30439]: pgmap v326: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-05-09T05:35:55.560 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T05:35:55.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:35:55 smithi100 ceph-mon[34353]: pgmap v326: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-05-09T05:35:55.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:35:55 smithi060 ceph-mon[34555]: pgmap v326: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-05-09T05:35:56.009 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T05:35:56.244 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T05:35:56.245 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T05:35:56.247 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T05:35:56.249 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T05:35:56.252 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T05:35:56.252 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T05:35:56.252 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T05:35:57.360 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:35:57 smithi039 ceph-mon[30439]: pgmap v327: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-09T05:35:57.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:35:57 smithi100 ceph-mon[34353]: pgmap v327: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-09T05:35:57.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:35:57 smithi060 ceph-mon[34555]: pgmap v327: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-09T05:35:59.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:59.323+0000 7f8fc5fab700 1 -- 172.21.15.39:0/359270264 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8fc0109870 msgr2=0x7f8fc01111d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:35:59.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:59.323+0000 7f8fc5fab700 1 --2- 172.21.15.39:0/359270264 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8fc0109870 0x7f8fc01111d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8fb800b0d0 tx=0x7f8fb800b3e0 comp rx=0 tx=0).stop 2024-05-09T05:35:59.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:59.323+0000 7f8fc5fab700 1 -- 172.21.15.39:0/359270264 shutdown_connections 2024-05-09T05:35:59.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:59.323+0000 7f8fc5fab700 1 --2- 172.21.15.39:0/359270264 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8fc0109870 0x7f8fc01111d0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:59.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:59.323+0000 7f8fc5fab700 1 --2- 172.21.15.39:0/359270264 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8fc01045f0 0x7f8fc0104a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:59.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:59.323+0000 7f8fc5fab700 1 --2- 172.21.15.39:0/359270264 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8fc0108f20 0x7f8fc0109330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:59.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:59.323+0000 7f8fc5fab700 1 -- 172.21.15.39:0/359270264 >> 172.21.15.39:0/359270264 conn(0x7f8fc00fffe0 msgr2=0x7f8fc0102400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:35:59.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:59.323+0000 7f8fc5fab700 1 -- 172.21.15.39:0/359270264 shutdown_connections 2024-05-09T05:35:59.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:59.323+0000 7f8fc5fab700 1 -- 172.21.15.39:0/359270264 wait complete. 2024-05-09T05:35:59.319 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:59.324+0000 7f8fc5fab700 1 Processor -- start 2024-05-09T05:35:59.319 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:59.324+0000 7f8fc5fab700 1 -- start start 2024-05-09T05:35:59.319 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:59.324+0000 7f8fc5fab700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8fc01045f0 0x7f8fc0075ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:35:59.319 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:59.324+0000 7f8fc5fab700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8fc0108f20 0x7f8fc0076000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:35:59.319 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:59.324+0000 7f8fc5fab700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8fc0109870 0x7f8fc0076540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:35:59.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:59.324+0000 7f8fc5fab700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f8fc01144a0 con 0x7f8fc01045f0 2024-05-09T05:35:59.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:59.324+0000 7f8fc5fab700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f8fc0114320 con 0x7f8fc0109870 2024-05-09T05:35:59.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:59.324+0000 7f8fc5fab700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8fc0114620 con 0x7f8fc0108f20 2024-05-09T05:35:59.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:59.325+0000 7f8fbf7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8fc01045f0 0x7f8fc0075ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:35:59.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:59.325+0000 7f8fbf7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8fc01045f0 0x7f8fc0075ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:41470/0 (socket says 172.21.15.39:41470) 2024-05-09T05:35:59.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:59.325+0000 7f8fbf7fe700 1 -- 172.21.15.39:0/3928197126 learned_addr learned my addr 172.21.15.39:0/3928197126 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:35:59.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:59.325+0000 7f8fbffff700 1 --2- 172.21.15.39:0/3928197126 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8fc0109870 0x7f8fc0076540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:35:59.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:59.325+0000 7f8fbeffd700 1 --2- 172.21.15.39:0/3928197126 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8fc0108f20 0x7f8fc0076000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:35:59.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:59.325+0000 7f8fbf7fe700 1 -- 172.21.15.39:0/3928197126 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8fc0108f20 msgr2=0x7f8fc0076000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:35:59.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:59.325+0000 7f8fbf7fe700 1 --2- 172.21.15.39:0/3928197126 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8fc0108f20 0x7f8fc0076000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:59.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:59.325+0000 7f8fbf7fe700 1 -- 172.21.15.39:0/3928197126 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8fc0109870 msgr2=0x7f8fc0076540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:35:59.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:59.325+0000 7f8fbf7fe700 1 --2- 172.21.15.39:0/3928197126 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8fc0109870 0x7f8fc0076540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:59.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:59.325+0000 7f8fbf7fe700 1 -- 172.21.15.39:0/3928197126 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fc01a90d0 con 0x7f8fc01045f0 2024-05-09T05:35:59.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:59.325+0000 7f8fbf7fe700 1 --2- 172.21.15.39:0/3928197126 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8fc01045f0 0x7f8fc0075ac0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f8fb000c9b0 tx=0x7f8fb000ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:35:59.321 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:59.328+0000 7f8fbcff9700 1 -- 172.21.15.39:0/3928197126 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fb0007b00 con 0x7f8fc01045f0 2024-05-09T05:35:59.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:59.328+0000 7f8fbcff9700 1 -- 172.21.15.39:0/3928197126 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8fb000ce50 con 0x7f8fc01045f0 2024-05-09T05:35:59.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:59.328+0000 7f8fc5fab700 1 -- 172.21.15.39:0/3928197126 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fc01a93c0 con 0x7f8fc01045f0 2024-05-09T05:35:59.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:59.328+0000 7f8fbcff9700 1 -- 172.21.15.39:0/3928197126 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fb0018660 con 0x7f8fc01045f0 2024-05-09T05:35:59.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:59.328+0000 7f8fc5fab700 1 -- 172.21.15.39:0/3928197126 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fc01a9950 con 0x7f8fc01045f0 2024-05-09T05:35:59.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:59.329+0000 7f8fc5fab700 1 -- 172.21.15.39:0/3928197126 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8fc0063ed0 con 0x7f8fc01045f0 2024-05-09T05:35:59.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:59.331+0000 7f8fbcff9700 1 -- 172.21.15.39:0/3928197126 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f8fb000f450 con 0x7f8fc01045f0 2024-05-09T05:35:59.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:59.331+0000 7f8fbcff9700 1 --2- 172.21.15.39:0/3928197126 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f8fa80b2990 0x7f8fa80b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:35:59.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:59.332+0000 7f8fbeffd700 1 --2- 172.21.15.39:0/3928197126 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f8fa80b2990 0x7f8fa80b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:35:59.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:59.332+0000 7f8fbcff9700 1 -- 172.21.15.39:0/3928197126 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f8fb00e26c0 con 0x7f8fc01045f0 2024-05-09T05:35:59.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:59.332+0000 7f8fbcff9700 1 --2- 172.21.15.39:0/3928197126 >> [v2:172.21.15.60:6824/1940670367,v1:172.21.15.60:6825/1940670367] conn(0x7f8fa80bc520 0x7f8fa80bea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:35:59.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:59.332+0000 7f8fbcff9700 1 -- 172.21.15.39:0/3928197126 --> [v2:172.21.15.60:6824/1940670367,v1:172.21.15.60:6825/1940670367] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8fb0015e70 con 0x7f8fa80bc520 2024-05-09T05:35:59.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:59.332+0000 7f8fbcff9700 1 -- 172.21.15.39:0/3928197126 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f8fb00e2b10 con 0x7f8fc01045f0 2024-05-09T05:35:59.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:59.332+0000 7f8fbeffd700 1 --2- 172.21.15.39:0/3928197126 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f8fa80b2990 0x7f8fa80b4ea0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f8fc0108920 tx=0x7f8fb400a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:35:59.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:59.332+0000 7f8fbffff700 1 --2- 172.21.15.39:0/3928197126 >> [v2:172.21.15.60:6824/1940670367,v1:172.21.15.60:6825/1940670367] conn(0x7f8fa80bc520 0x7f8fa80bea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:35:59.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:59.333+0000 7f8fbffff700 1 --2- 172.21.15.39:0/3928197126 >> [v2:172.21.15.60:6824/1940670367,v1:172.21.15.60:6825/1940670367] conn(0x7f8fa80bc520 0x7f8fa80bea10 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:35:59.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:59.334+0000 7f8fbcff9700 1 -- 172.21.15.39:0/3928197126 <== osd.10 v2:172.21.15.60:6824/1940670367 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8fb0015e70 con 0x7f8fa80bc520 2024-05-09T05:35:59.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:59.350+0000 7f8fc5fab700 1 -- 172.21.15.39:0/3928197126 --> [v2:172.21.15.60:6824/1940670367,v1:172.21.15.60:6825/1940670367] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8fc00642d0 con 0x7f8fa80bc520 2024-05-09T05:35:59.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:59.351+0000 7f8fbcff9700 1 -- 172.21.15.39:0/3928197126 <== osd.10 v2:172.21.15.60:6824/1940670367 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f8fc00642d0 con 0x7f8fa80bc520 2024-05-09T05:35:59.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:59.351+0000 7f8fc5fab700 1 -- 172.21.15.39:0/3928197126 >> [v2:172.21.15.60:6824/1940670367,v1:172.21.15.60:6825/1940670367] conn(0x7f8fa80bc520 msgr2=0x7f8fa80bea10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:35:59.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:59.351+0000 7f8fc5fab700 1 --2- 172.21.15.39:0/3928197126 >> [v2:172.21.15.60:6824/1940670367,v1:172.21.15.60:6825/1940670367] conn(0x7f8fa80bc520 0x7f8fa80bea10 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:35:59.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:59.351+0000 7f8fc5fab700 1 -- 172.21.15.39:0/3928197126 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f8fa80b2990 msgr2=0x7f8fa80b4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:35:59.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:59.351+0000 7f8fc5fab700 1 --2- 172.21.15.39:0/3928197126 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f8fa80b2990 0x7f8fa80b4ea0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f8fc0108920 tx=0x7f8fb400a300 comp rx=0 tx=0).stop 2024-05-09T05:35:59.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:59.351+0000 7f8fc5fab700 1 -- 172.21.15.39:0/3928197126 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8fc01045f0 msgr2=0x7f8fc0075ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:35:59.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:59.351+0000 7f8fc5fab700 1 --2- 172.21.15.39:0/3928197126 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8fc01045f0 0x7f8fc0075ac0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f8fb000c9b0 tx=0x7f8fb000ccc0 comp rx=0 tx=0).stop 2024-05-09T05:35:59.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:59.351+0000 7f8fbffff700 1 -- 172.21.15.39:0/3928197126 reap_dead start 2024-05-09T05:35:59.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:59.351+0000 7f8fc5fab700 1 -- 172.21.15.39:0/3928197126 shutdown_connections 2024-05-09T05:35:59.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:59.351+0000 7f8fc5fab700 1 -- 172.21.15.39:0/3928197126 >> 172.21.15.39:0/3928197126 conn(0x7f8fc00fffe0 msgr2=0x7f8fc0106f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:35:59.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:59.351+0000 7f8fc5fab700 1 -- 172.21.15.39:0/3928197126 shutdown_connections 2024-05-09T05:35:59.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:35:59.351+0000 7f8fc5fab700 1 -- 172.21.15.39:0/3928197126 wait complete. 2024-05-09T05:35:59.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:35:59 smithi039 ceph-mon[30439]: pgmap v328: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-09T05:35:59.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:35:59 smithi100 ceph-mon[34353]: pgmap v328: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-09T05:35:59.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:35:59 smithi060 ceph-mon[34555]: pgmap v328: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-09T05:36:01.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:36:01 smithi039 ceph-mon[30439]: pgmap v329: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s 2024-05-09T05:36:01.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:36:01 smithi100 ceph-mon[34353]: pgmap v329: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s 2024-05-09T05:36:01.764 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:01.770+0000 7f41eb53d700 1 -- 172.21.15.39:0/1884100431 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f41e4108770 msgr2=0x7f41e41100d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:01.764 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:01.770+0000 7f41eb53d700 1 --2- 172.21.15.39:0/1884100431 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f41e4108770 0x7f41e41100d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f41dc0099c0 tx=0x7f41dc009cd0 comp rx=0 tx=0).stop 2024-05-09T05:36:01.765 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:01.770+0000 7f41eb53d700 1 -- 172.21.15.39:0/1884100431 shutdown_connections 2024-05-09T05:36:01.765 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:01.770+0000 7f41eb53d700 1 --2- 172.21.15.39:0/1884100431 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f41e4108770 0x7f41e41100d0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:01.765 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:01.770+0000 7f41eb53d700 1 --2- 172.21.15.39:0/1884100431 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41e4103540 0x7f41e4103950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:01.765 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:01.770+0000 7f41eb53d700 1 --2- 172.21.15.39:0/1884100431 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f41e4107e20 0x7f41e4108230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:01.765 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:01.770+0000 7f41eb53d700 1 -- 172.21.15.39:0/1884100431 >> 172.21.15.39:0/1884100431 conn(0x7f41e4078e50 msgr2=0x7f41e4079290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:36:01.765 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:01.771+0000 7f41eb53d700 1 -- 172.21.15.39:0/1884100431 shutdown_connections 2024-05-09T05:36:01.765 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:01.771+0000 7f41eb53d700 1 -- 172.21.15.39:0/1884100431 wait complete. 2024-05-09T05:36:01.768 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:01.771+0000 7f41eb53d700 1 Processor -- start 2024-05-09T05:36:01.768 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:01.771+0000 7f41eb53d700 1 -- start start 2024-05-09T05:36:01.768 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:01.771+0000 7f41eb53d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f41e4103540 0x7f41e419bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:01.768 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:01.772+0000 7f41eb53d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41e4107e20 0x7f41e419c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:01.768 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:01.772+0000 7f41eb53d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f41e4108770 0x7f41e419c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:01.768 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:01.772+0000 7f41eb53d700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f41e41133a0 con 0x7f41e4103540 2024-05-09T05:36:01.768 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:01.772+0000 7f41eb53d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f41e4113220 con 0x7f41e4108770 2024-05-09T05:36:01.768 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:01.772+0000 7f41eb53d700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f41e4113520 con 0x7f41e4107e20 2024-05-09T05:36:01.768 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:01.772+0000 7f41e92d9700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f41e4103540 0x7f41e419bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:01.768 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:01.772+0000 7f41e92d9700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f41e4103540 0x7f41e419bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:41492/0 (socket says 172.21.15.39:41492) 2024-05-09T05:36:01.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:01.772+0000 7f41e92d9700 1 -- 172.21.15.39:0/1411976412 learned_addr learned my addr 172.21.15.39:0/1411976412 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:36:01.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:01.772+0000 7f41e8ad8700 1 --2- 172.21.15.39:0/1411976412 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41e4107e20 0x7f41e419c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:01.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:01.772+0000 7f41e9ada700 1 --2- 172.21.15.39:0/1411976412 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f41e4108770 0x7f41e419c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:01.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:01.772+0000 7f41e92d9700 1 -- 172.21.15.39:0/1411976412 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41e4107e20 msgr2=0x7f41e419c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:01.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:01.772+0000 7f41e92d9700 1 --2- 172.21.15.39:0/1411976412 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41e4107e20 0x7f41e419c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:01.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:01.772+0000 7f41e92d9700 1 -- 172.21.15.39:0/1411976412 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f41e4108770 msgr2=0x7f41e419c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:01.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:01.772+0000 7f41e92d9700 1 --2- 172.21.15.39:0/1411976412 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f41e4108770 0x7f41e419c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:01.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:01.772+0000 7f41e92d9700 1 -- 172.21.15.39:0/1411976412 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41e41a6ee0 con 0x7f41e4103540 2024-05-09T05:36:01.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:01.772+0000 7f41e9ada700 1 --2- 172.21.15.39:0/1411976412 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f41e4108770 0x7f41e419c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T05:36:01.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:01.772+0000 7f41e92d9700 1 --2- 172.21.15.39:0/1411976412 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f41e4103540 0x7f41e419bce0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f41e00060b0 tx=0x7f41e000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:36:01.770 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:01.772+0000 7f41da7fc700 1 -- 172.21.15.39:0/1411976412 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41e001a070 con 0x7f41e4103540 2024-05-09T05:36:01.770 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:01.772+0000 7f41eb53d700 1 -- 172.21.15.39:0/1411976412 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41e41a71d0 con 0x7f41e4103540 2024-05-09T05:36:01.770 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:01.772+0000 7f41da7fc700 1 -- 172.21.15.39:0/1411976412 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f41e000ddd0 con 0x7f41e4103540 2024-05-09T05:36:01.770 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:01.773+0000 7f41da7fc700 1 -- 172.21.15.39:0/1411976412 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41e0014720 con 0x7f41e4103540 2024-05-09T05:36:01.770 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:01.773+0000 7f41eb53d700 1 -- 172.21.15.39:0/1411976412 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41e41a7710 con 0x7f41e4103540 2024-05-09T05:36:01.770 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:01.773+0000 7f41eb53d700 1 -- 172.21.15.39:0/1411976412 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f41e4063ed0 con 0x7f41e4103540 2024-05-09T05:36:01.772 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:01.775+0000 7f41da7fc700 1 -- 172.21.15.39:0/1411976412 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f41e001d070 con 0x7f41e4103540 2024-05-09T05:36:01.772 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:01.776+0000 7f41da7fc700 1 --2- 172.21.15.39:0/1411976412 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f41d00b2910 0x7f41d00b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:01.772 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:01.776+0000 7f41e8ad8700 1 --2- 172.21.15.39:0/1411976412 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f41d00b2910 0x7f41d00b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:01.772 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:01.776+0000 7f41da7fc700 1 -- 172.21.15.39:0/1411976412 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f41e00e27b0 con 0x7f41e4103540 2024-05-09T05:36:01.772 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:01.776+0000 7f41da7fc700 1 --2- 172.21.15.39:0/1411976412 >> [v2:172.21.15.39:6818/237628491,v1:172.21.15.39:6819/237628491] conn(0x7f41d00bc4a0 0x7f41d00be990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:01.772 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:01.776+0000 7f41da7fc700 1 -- 172.21.15.39:0/1411976412 --> [v2:172.21.15.39:6818/237628491,v1:172.21.15.39:6819/237628491] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f41e000ae50 con 0x7f41d00bc4a0 2024-05-09T05:36:01.772 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:01.776+0000 7f41da7fc700 1 -- 172.21.15.39:0/1411976412 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f41e00e2c00 con 0x7f41e4103540 2024-05-09T05:36:01.772 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:01.777+0000 7f41e9ada700 1 --2- 172.21.15.39:0/1411976412 >> [v2:172.21.15.39:6818/237628491,v1:172.21.15.39:6819/237628491] conn(0x7f41d00bc4a0 0x7f41d00be990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:01.772 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:01.777+0000 7f41e8ad8700 1 --2- 172.21.15.39:0/1411976412 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f41d00b2910 0x7f41d00b4e20 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f41e40fff80 tx=0x7f41d400a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:36:01.772 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:01.777+0000 7f41e9ada700 1 --2- 172.21.15.39:0/1411976412 >> [v2:172.21.15.39:6818/237628491,v1:172.21.15.39:6819/237628491] conn(0x7f41d00bc4a0 0x7f41d00be990 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:36:01.773 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:01.778+0000 7f41da7fc700 1 -- 172.21.15.39:0/1411976412 <== osd.6 v2:172.21.15.39:6818/237628491 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f41e000ae50 con 0x7f41d00bc4a0 2024-05-09T05:36:01.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:01.794+0000 7f41eb53d700 1 -- 172.21.15.39:0/1411976412 --> [v2:172.21.15.39:6818/237628491,v1:172.21.15.39:6819/237628491] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f41e40642d0 con 0x7f41d00bc4a0 2024-05-09T05:36:01.788 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:01.794+0000 7f41da7fc700 1 -- 172.21.15.39:0/1411976412 <== osd.6 v2:172.21.15.39:6818/237628491 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f41e40642d0 con 0x7f41d00bc4a0 2024-05-09T05:36:01.789 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:01.795+0000 7f41eb53d700 1 -- 172.21.15.39:0/1411976412 >> [v2:172.21.15.39:6818/237628491,v1:172.21.15.39:6819/237628491] conn(0x7f41d00bc4a0 msgr2=0x7f41d00be990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:01.789 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:01.795+0000 7f41eb53d700 1 --2- 172.21.15.39:0/1411976412 >> [v2:172.21.15.39:6818/237628491,v1:172.21.15.39:6819/237628491] conn(0x7f41d00bc4a0 0x7f41d00be990 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:01.789 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:01.795+0000 7f41eb53d700 1 -- 172.21.15.39:0/1411976412 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f41d00b2910 msgr2=0x7f41d00b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:01.789 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:01.795+0000 7f41eb53d700 1 --2- 172.21.15.39:0/1411976412 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f41d00b2910 0x7f41d00b4e20 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f41e40fff80 tx=0x7f41d400a380 comp rx=0 tx=0).stop 2024-05-09T05:36:01.789 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:01.795+0000 7f41eb53d700 1 -- 172.21.15.39:0/1411976412 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f41e4103540 msgr2=0x7f41e419bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:01.789 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:01.795+0000 7f41eb53d700 1 --2- 172.21.15.39:0/1411976412 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f41e4103540 0x7f41e419bce0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f41e00060b0 tx=0x7f41e000d3b0 comp rx=0 tx=0).stop 2024-05-09T05:36:01.789 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:01.795+0000 7f41e9ada700 1 -- 172.21.15.39:0/1411976412 reap_dead start 2024-05-09T05:36:01.789 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:01.795+0000 7f41eb53d700 1 -- 172.21.15.39:0/1411976412 shutdown_connections 2024-05-09T05:36:01.789 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:01.795+0000 7f41eb53d700 1 -- 172.21.15.39:0/1411976412 >> 172.21.15.39:0/1411976412 conn(0x7f41e4078e50 msgr2=0x7f41e4100880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:36:01.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:01.795+0000 7f41eb53d700 1 -- 172.21.15.39:0/1411976412 shutdown_connections 2024-05-09T05:36:01.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:01.795+0000 7f41eb53d700 1 -- 172.21.15.39:0/1411976412 wait complete. 2024-05-09T05:36:01.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:36:01 smithi060 ceph-mon[34555]: pgmap v329: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s 2024-05-09T05:36:02.330 INFO:teuthology.orchestra.run.smithi039.stdout:287762808867 2024-05-09T05:36:02.331 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-05-09T05:36:03.608 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:36:03 smithi039 ceph-mon[30439]: pgmap v330: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 5 op/s 2024-05-09T05:36:03.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:36:03 smithi100 ceph-mon[34353]: pgmap v330: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 5 op/s 2024-05-09T05:36:03.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:36:03 smithi060 ceph-mon[34555]: pgmap v330: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 5 op/s 2024-05-09T05:36:05.415 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:36:05 smithi039 ceph-mon[30439]: pgmap v331: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 7 op/s 2024-05-09T05:36:05.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.543+0000 7f45d086d700 1 -- 172.21.15.39:0/909589937 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f45cc103550 msgr2=0x7f45cc103960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:05.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.543+0000 7f45d086d700 1 --2- 172.21.15.39:0/909589937 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f45cc103550 0x7f45cc103960 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f45bc0099c0 tx=0x7f45bc009cd0 comp rx=0 tx=0).stop 2024-05-09T05:36:05.540 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.543+0000 7f45d086d700 1 -- 172.21.15.39:0/909589937 shutdown_connections 2024-05-09T05:36:05.540 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.543+0000 7f45d086d700 1 --2- 172.21.15.39:0/909589937 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45cc108780 0x7f45cc1100e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:05.540 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.543+0000 7f45d086d700 1 --2- 172.21.15.39:0/909589937 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f45cc103550 0x7f45cc103960 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:05.540 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.543+0000 7f45d086d700 1 --2- 172.21.15.39:0/909589937 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45cc107e30 0x7f45cc108240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:05.540 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.543+0000 7f45d086d700 1 -- 172.21.15.39:0/909589937 >> 172.21.15.39:0/909589937 conn(0x7f45cc078e00 msgr2=0x7f45cc079240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:36:05.540 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.543+0000 7f45d086d700 1 -- 172.21.15.39:0/909589937 shutdown_connections 2024-05-09T05:36:05.540 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.543+0000 7f45d086d700 1 -- 172.21.15.39:0/909589937 wait complete. 2024-05-09T05:36:05.540 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.544+0000 7f45d086d700 1 Processor -- start 2024-05-09T05:36:05.540 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.544+0000 7f45d086d700 1 -- start start 2024-05-09T05:36:05.540 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.544+0000 7f45d086d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45cc103550 0x7f45cc104ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:05.540 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.544+0000 7f45d086d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f45cc107e30 0x7f45cc105410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:05.540 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.544+0000 7f45d086d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45cc108780 0x7f45cc105950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:05.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.544+0000 7f45d086d700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f45cc113420 con 0x7f45cc107e30 2024-05-09T05:36:05.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.544+0000 7f45d086d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f45cc1132a0 con 0x7f45cc103550 2024-05-09T05:36:05.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.544+0000 7f45d086d700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f45cc1135a0 con 0x7f45cc108780 2024-05-09T05:36:05.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.545+0000 7f45c9d9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f45cc107e30 0x7f45cc105410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:05.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.545+0000 7f45c9d9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f45cc107e30 0x7f45cc105410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:41522/0 (socket says 172.21.15.39:41522) 2024-05-09T05:36:05.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.545+0000 7f45c9d9b700 1 -- 172.21.15.39:0/4267962604 learned_addr learned my addr 172.21.15.39:0/4267962604 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:36:05.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.545+0000 7f45ca59c700 1 --2- 172.21.15.39:0/4267962604 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45cc103550 0x7f45cc104ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:05.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.545+0000 7f45cad9d700 1 --2- 172.21.15.39:0/4267962604 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45cc108780 0x7f45cc105950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:05.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.545+0000 7f45c9d9b700 1 -- 172.21.15.39:0/4267962604 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45cc108780 msgr2=0x7f45cc105950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:05.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.545+0000 7f45c9d9b700 1 --2- 172.21.15.39:0/4267962604 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45cc108780 0x7f45cc105950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:05.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.545+0000 7f45c9d9b700 1 -- 172.21.15.39:0/4267962604 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45cc103550 msgr2=0x7f45cc104ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:05.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.545+0000 7f45c9d9b700 1 --2- 172.21.15.39:0/4267962604 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45cc103550 0x7f45cc104ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:05.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.545+0000 7f45c9d9b700 1 -- 172.21.15.39:0/4267962604 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45cc1a9230 con 0x7f45cc107e30 2024-05-09T05:36:05.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.545+0000 7f45cad9d700 1 --2- 172.21.15.39:0/4267962604 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45cc108780 0x7f45cc105950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:36:05.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.545+0000 7f45c9d9b700 1 --2- 172.21.15.39:0/4267962604 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f45cc107e30 0x7f45cc105410 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f45c000b500 tx=0x7f45c000b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:36:05.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.545+0000 7f45bb7fe700 1 -- 172.21.15.39:0/4267962604 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45c0015020 con 0x7f45cc107e30 2024-05-09T05:36:05.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.545+0000 7f45d086d700 1 -- 172.21.15.39:0/4267962604 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45cc1a9520 con 0x7f45cc107e30 2024-05-09T05:36:05.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.545+0000 7f45bb7fe700 1 -- 172.21.15.39:0/4267962604 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f45c0011ce0 con 0x7f45cc107e30 2024-05-09T05:36:05.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.545+0000 7f45bb7fe700 1 -- 172.21.15.39:0/4267962604 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45c0010d40 con 0x7f45cc107e30 2024-05-09T05:36:05.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.546+0000 7f45d086d700 1 -- 172.21.15.39:0/4267962604 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45cc1a9a60 con 0x7f45cc107e30 2024-05-09T05:36:05.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.546+0000 7f45d086d700 1 -- 172.21.15.39:0/4267962604 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f45cc063ed0 con 0x7f45cc107e30 2024-05-09T05:36:05.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.548+0000 7f45bb7fe700 1 -- 172.21.15.39:0/4267962604 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f45c0018020 con 0x7f45cc107e30 2024-05-09T05:36:05.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.549+0000 7f45bb7fe700 1 --2- 172.21.15.39:0/4267962604 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f45b40b2910 0x7f45b40b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:05.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.549+0000 7f45ca59c700 1 --2- 172.21.15.39:0/4267962604 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f45b40b2910 0x7f45b40b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:05.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.549+0000 7f45bb7fe700 1 -- 172.21.15.39:0/4267962604 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f45c00e20d0 con 0x7f45cc107e30 2024-05-09T05:36:05.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.549+0000 7f45bb7fe700 1 --2- 172.21.15.39:0/4267962604 >> [v2:172.21.15.60:6808/649037162,v1:172.21.15.60:6809/649037162] conn(0x7f45b40bc4a0 0x7f45b40be990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:05.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.549+0000 7f45bb7fe700 1 -- 172.21.15.39:0/4267962604 --> [v2:172.21.15.60:6808/649037162,v1:172.21.15.60:6809/649037162] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f45c0025e50 con 0x7f45b40bc4a0 2024-05-09T05:36:05.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.549+0000 7f45bb7fe700 1 -- 172.21.15.39:0/4267962604 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f45c00e2520 con 0x7f45cc107e30 2024-05-09T05:36:05.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.549+0000 7f45ca59c700 1 --2- 172.21.15.39:0/4267962604 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f45b40b2910 0x7f45b40b4e20 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f45bc009990 tx=0x7f45bc000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:36:05.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.549+0000 7f45cad9d700 1 --2- 172.21.15.39:0/4267962604 >> [v2:172.21.15.60:6808/649037162,v1:172.21.15.60:6809/649037162] conn(0x7f45b40bc4a0 0x7f45b40be990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:05.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.550+0000 7f45cad9d700 1 --2- 172.21.15.39:0/4267962604 >> [v2:172.21.15.60:6808/649037162,v1:172.21.15.60:6809/649037162] conn(0x7f45b40bc4a0 0x7f45b40be990 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:36:05.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.551+0000 7f45bb7fe700 1 -- 172.21.15.39:0/4267962604 <== osd.4 v2:172.21.15.60:6808/649037162 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f45c0025e50 con 0x7f45b40bc4a0 2024-05-09T05:36:05.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.567+0000 7f45d086d700 1 -- 172.21.15.39:0/4267962604 --> [v2:172.21.15.60:6808/649037162,v1:172.21.15.60:6809/649037162] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f45cc0642d0 con 0x7f45b40bc4a0 2024-05-09T05:36:05.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.568+0000 7f45bb7fe700 1 -- 172.21.15.39:0/4267962604 <== osd.4 v2:172.21.15.60:6808/649037162 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f45cc0642d0 con 0x7f45b40bc4a0 2024-05-09T05:36:05.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.568+0000 7f45d086d700 1 -- 172.21.15.39:0/4267962604 >> [v2:172.21.15.60:6808/649037162,v1:172.21.15.60:6809/649037162] conn(0x7f45b40bc4a0 msgr2=0x7f45b40be990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:05.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.568+0000 7f45d086d700 1 --2- 172.21.15.39:0/4267962604 >> [v2:172.21.15.60:6808/649037162,v1:172.21.15.60:6809/649037162] conn(0x7f45b40bc4a0 0x7f45b40be990 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:05.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.568+0000 7f45d086d700 1 -- 172.21.15.39:0/4267962604 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f45b40b2910 msgr2=0x7f45b40b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:05.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.568+0000 7f45d086d700 1 --2- 172.21.15.39:0/4267962604 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f45b40b2910 0x7f45b40b4e20 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f45bc009990 tx=0x7f45bc000bc0 comp rx=0 tx=0).stop 2024-05-09T05:36:05.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.568+0000 7f45d086d700 1 -- 172.21.15.39:0/4267962604 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f45cc107e30 msgr2=0x7f45cc105410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:05.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.568+0000 7f45d086d700 1 --2- 172.21.15.39:0/4267962604 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f45cc107e30 0x7f45cc105410 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f45c000b500 tx=0x7f45c000b810 comp rx=0 tx=0).stop 2024-05-09T05:36:05.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.568+0000 7f45cad9d700 1 -- 172.21.15.39:0/4267962604 reap_dead start 2024-05-09T05:36:05.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.568+0000 7f45d086d700 1 -- 172.21.15.39:0/4267962604 shutdown_connections 2024-05-09T05:36:05.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.568+0000 7f45d086d700 1 -- 172.21.15.39:0/4267962604 >> 172.21.15.39:0/4267962604 conn(0x7f45cc078e00 msgr2=0x7f45cc075e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:36:05.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.568+0000 7f45d086d700 1 -- 172.21.15.39:0/4267962604 shutdown_connections 2024-05-09T05:36:05.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.568+0000 7f45d086d700 1 -- 172.21.15.39:0/4267962604 wait complete. 2024-05-09T05:36:05.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:36:05 smithi100 ceph-mon[34353]: pgmap v331: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 7 op/s 2024-05-09T05:36:05.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:36:05 smithi060 ceph-mon[34555]: pgmap v331: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 7 op/s 2024-05-09T05:36:05.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.900+0000 7fc740974700 1 -- 172.21.15.39:0/175598474 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc73c107df0 msgr2=0x7fc73c108200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:05.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.900+0000 7fc740974700 1 --2- 172.21.15.39:0/175598474 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc73c107df0 0x7fc73c108200 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc7240099c0 tx=0x7fc724009cd0 comp rx=0 tx=0).stop 2024-05-09T05:36:05.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.900+0000 7fc740974700 1 -- 172.21.15.39:0/175598474 shutdown_connections 2024-05-09T05:36:05.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.900+0000 7fc740974700 1 --2- 172.21.15.39:0/175598474 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc73c108740 0x7fc73c1100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:05.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.900+0000 7fc740974700 1 --2- 172.21.15.39:0/175598474 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc73c1034c0 0x7fc73c1038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:05.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.900+0000 7fc740974700 1 --2- 172.21.15.39:0/175598474 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc73c107df0 0x7fc73c108200 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:05.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.900+0000 7fc740974700 1 -- 172.21.15.39:0/175598474 >> 172.21.15.39:0/175598474 conn(0x7fc73c0fedc0 msgr2=0x7fc73c1011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:36:05.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.900+0000 7fc740974700 1 -- 172.21.15.39:0/175598474 shutdown_connections 2024-05-09T05:36:05.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.900+0000 7fc740974700 1 -- 172.21.15.39:0/175598474 wait complete. 2024-05-09T05:36:05.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.901+0000 7fc740974700 1 Processor -- start 2024-05-09T05:36:05.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.901+0000 7fc740974700 1 -- start start 2024-05-09T05:36:05.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.901+0000 7fc740974700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc73c1034c0 0x7fc73c19adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:05.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.901+0000 7fc740974700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc73c107df0 0x7fc73c19b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:05.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.901+0000 7fc740974700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc73c108740 0x7fc73c19f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:05.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.901+0000 7fc740974700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fc73c113350 con 0x7fc73c107df0 2024-05-09T05:36:05.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.901+0000 7fc740974700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc73c1131d0 con 0x7fc73c1034c0 2024-05-09T05:36:05.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.901+0000 7fc740974700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc73c1134d0 con 0x7fc73c108740 2024-05-09T05:36:05.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.901+0000 7fc739d9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc73c107df0 0x7fc73c19b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:05.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.902+0000 7fc739d9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc73c107df0 0x7fc73c19b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:41544/0 (socket says 172.21.15.39:41544) 2024-05-09T05:36:05.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.902+0000 7fc739d9b700 1 -- 172.21.15.39:0/2626236014 learned_addr learned my addr 172.21.15.39:0/2626236014 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:36:05.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.902+0000 7fc73a59c700 1 --2- 172.21.15.39:0/2626236014 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc73c1034c0 0x7fc73c19adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:05.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.902+0000 7fc73ad9d700 1 --2- 172.21.15.39:0/2626236014 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc73c108740 0x7fc73c19f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:05.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.902+0000 7fc739d9b700 1 -- 172.21.15.39:0/2626236014 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc73c108740 msgr2=0x7fc73c19f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:05.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.902+0000 7fc739d9b700 1 --2- 172.21.15.39:0/2626236014 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc73c108740 0x7fc73c19f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:05.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.902+0000 7fc739d9b700 1 -- 172.21.15.39:0/2626236014 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc73c1034c0 msgr2=0x7fc73c19adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:05.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.902+0000 7fc739d9b700 1 --2- 172.21.15.39:0/2626236014 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc73c1034c0 0x7fc73c19adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:05.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.902+0000 7fc739d9b700 1 -- 172.21.15.39:0/2626236014 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc73c19fcc0 con 0x7fc73c107df0 2024-05-09T05:36:05.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.902+0000 7fc739d9b700 1 --2- 172.21.15.39:0/2626236014 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc73c107df0 0x7fc73c19b390 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc7240045e0 tx=0x7fc724004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:36:05.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.902+0000 7fc7337fe700 1 -- 172.21.15.39:0/2626236014 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc724026070 con 0x7fc73c107df0 2024-05-09T05:36:05.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.902+0000 7fc740974700 1 -- 172.21.15.39:0/2626236014 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc73c19ff50 con 0x7fc73c107df0 2024-05-09T05:36:05.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.902+0000 7fc7337fe700 1 -- 172.21.15.39:0/2626236014 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc72400f460 con 0x7fc73c107df0 2024-05-09T05:36:05.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.902+0000 7fc7337fe700 1 -- 172.21.15.39:0/2626236014 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc724009e60 con 0x7fc73c107df0 2024-05-09T05:36:05.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.902+0000 7fc740974700 1 -- 172.21.15.39:0/2626236014 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc73c1a0430 con 0x7fc73c107df0 2024-05-09T05:36:05.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.903+0000 7fc740974700 1 -- 172.21.15.39:0/2626236014 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc73c063f10 con 0x7fc73c107df0 2024-05-09T05:36:05.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.905+0000 7fc7337fe700 1 -- 172.21.15.39:0/2626236014 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fc724029070 con 0x7fc73c107df0 2024-05-09T05:36:05.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.906+0000 7fc7337fe700 1 --2- 172.21.15.39:0/2626236014 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fc7280b2910 0x7fc7280b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:05.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.906+0000 7fc73a59c700 1 --2- 172.21.15.39:0/2626236014 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fc7280b2910 0x7fc7280b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:05.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.906+0000 7fc7337fe700 1 -- 172.21.15.39:0/2626236014 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7fc7240e3120 con 0x7fc73c107df0 2024-05-09T05:36:05.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.906+0000 7fc7337fe700 1 --2- 172.21.15.39:0/2626236014 >> [v2:172.21.15.100:6824/3318561029,v1:172.21.15.100:6825/3318561029] conn(0x7fc7280bc370 0x7fc7280be860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:05.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.906+0000 7fc7337fe700 1 -- 172.21.15.39:0/2626236014 --> [v2:172.21.15.100:6824/3318561029,v1:172.21.15.100:6825/3318561029] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc7280bef30 con 0x7fc7280bc370 2024-05-09T05:36:05.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.906+0000 7fc7337fe700 1 -- 172.21.15.39:0/2626236014 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7fc7240e3570 con 0x7fc73c107df0 2024-05-09T05:36:05.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.906+0000 7fc73a59c700 1 --2- 172.21.15.39:0/2626236014 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fc7280b2910 0x7fc7280b4e20 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc72c009c60 tx=0x7fc72c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:36:05.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.906+0000 7fc73ad9d700 1 --2- 172.21.15.39:0/2626236014 >> [v2:172.21.15.100:6824/3318561029,v1:172.21.15.100:6825/3318561029] conn(0x7fc7280bc370 0x7fc7280be860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:05.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.907+0000 7fc73ad9d700 1 --2- 172.21.15.39:0/2626236014 >> [v2:172.21.15.100:6824/3318561029,v1:172.21.15.100:6825/3318561029] conn(0x7fc7280bc370 0x7fc7280be860 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:36:05.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.908+0000 7fc7337fe700 1 -- 172.21.15.39:0/2626236014 <== osd.11 v2:172.21.15.100:6824/3318561029 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc7280bef30 con 0x7fc7280bc370 2024-05-09T05:36:05.918 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.924+0000 7fc740974700 1 -- 172.21.15.39:0/2626236014 --> [v2:172.21.15.100:6824/3318561029,v1:172.21.15.100:6825/3318561029] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc73c064310 con 0x7fc7280bc370 2024-05-09T05:36:05.918 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.925+0000 7fc7337fe700 1 -- 172.21.15.39:0/2626236014 <== osd.11 v2:172.21.15.100:6824/3318561029 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fc73c064310 con 0x7fc7280bc370 2024-05-09T05:36:05.919 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.925+0000 7fc740974700 1 -- 172.21.15.39:0/2626236014 >> [v2:172.21.15.100:6824/3318561029,v1:172.21.15.100:6825/3318561029] conn(0x7fc7280bc370 msgr2=0x7fc7280be860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:05.919 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.925+0000 7fc740974700 1 --2- 172.21.15.39:0/2626236014 >> [v2:172.21.15.100:6824/3318561029,v1:172.21.15.100:6825/3318561029] conn(0x7fc7280bc370 0x7fc7280be860 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:05.919 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.925+0000 7fc740974700 1 -- 172.21.15.39:0/2626236014 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fc7280b2910 msgr2=0x7fc7280b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:05.919 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.925+0000 7fc740974700 1 --2- 172.21.15.39:0/2626236014 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fc7280b2910 0x7fc7280b4e20 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc72c009c60 tx=0x7fc72c009260 comp rx=0 tx=0).stop 2024-05-09T05:36:05.919 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.925+0000 7fc740974700 1 -- 172.21.15.39:0/2626236014 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc73c107df0 msgr2=0x7fc73c19b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:05.919 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.925+0000 7fc740974700 1 --2- 172.21.15.39:0/2626236014 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc73c107df0 0x7fc73c19b390 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc7240045e0 tx=0x7fc724004610 comp rx=0 tx=0).stop 2024-05-09T05:36:05.919 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.925+0000 7fc73ad9d700 1 -- 172.21.15.39:0/2626236014 reap_dead start 2024-05-09T05:36:05.919 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.925+0000 7fc740974700 1 -- 172.21.15.39:0/2626236014 shutdown_connections 2024-05-09T05:36:05.920 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.925+0000 7fc740974700 1 -- 172.21.15.39:0/2626236014 >> 172.21.15.39:0/2626236014 conn(0x7fc73c0fedc0 msgr2=0x7fc73c06b950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:36:05.920 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.925+0000 7fc740974700 1 -- 172.21.15.39:0/2626236014 shutdown_connections 2024-05-09T05:36:05.920 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:05.925+0000 7fc740974700 1 -- 172.21.15.39:0/2626236014 wait complete. 2024-05-09T05:36:06.565 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:06.571+0000 7f0036e6c700 1 -- 172.21.15.39:0/1147369972 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f00301045d0 msgr2=0x7f00301049e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:06.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:06.571+0000 7f0036e6c700 1 --2- 172.21.15.39:0/1147369972 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f00301045d0 0x7f00301049e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f00240099c0 tx=0x7f0024009cd0 comp rx=0 tx=0).stop 2024-05-09T05:36:06.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:06.571+0000 7f0036e6c700 1 -- 172.21.15.39:0/1147369972 shutdown_connections 2024-05-09T05:36:06.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:06.571+0000 7f0036e6c700 1 --2- 172.21.15.39:0/1147369972 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0030109850 0x7f00301111b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:06.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:06.571+0000 7f0036e6c700 1 --2- 172.21.15.39:0/1147369972 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f00301045d0 0x7f00301049e0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:06.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:06.571+0000 7f0036e6c700 1 --2- 172.21.15.39:0/1147369972 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0030108f00 0x7f0030109310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:06.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:06.571+0000 7f0036e6c700 1 -- 172.21.15.39:0/1147369972 >> 172.21.15.39:0/1147369972 conn(0x7f00300ffea0 msgr2=0x7f00301022f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:36:06.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:06.572+0000 7f0036e6c700 1 -- 172.21.15.39:0/1147369972 shutdown_connections 2024-05-09T05:36:06.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:06.572+0000 7f0036e6c700 1 -- 172.21.15.39:0/1147369972 wait complete. 2024-05-09T05:36:06.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:06.572+0000 7f0036e6c700 1 Processor -- start 2024-05-09T05:36:06.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:06.573+0000 7f0036e6c700 1 -- start start 2024-05-09T05:36:06.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:06.573+0000 7f0036e6c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f00301045d0 0x7f0030076bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:06.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:06.573+0000 7f0036e6c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0030108f00 0x7f0030077110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:06.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:06.573+0000 7f0036e6c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0030109850 0x7f0030077650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:06.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:06.573+0000 7f0036e6c700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f0030114480 con 0x7f00301045d0 2024-05-09T05:36:06.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:06.573+0000 7f0036e6c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f0030114300 con 0x7f0030109850 2024-05-09T05:36:06.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:06.573+0000 7f0036e6c700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0030114600 con 0x7f0030108f00 2024-05-09T05:36:06.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:06.573+0000 7f0034c08700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f00301045d0 0x7f0030076bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:06.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:06.573+0000 7f0034c08700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f00301045d0 0x7f0030076bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:41564/0 (socket says 172.21.15.39:41564) 2024-05-09T05:36:06.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:06.573+0000 7f0034c08700 1 -- 172.21.15.39:0/2368997210 learned_addr learned my addr 172.21.15.39:0/2368997210 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:36:06.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:06.573+0000 7f002ffff700 1 --2- 172.21.15.39:0/2368997210 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0030108f00 0x7f0030077110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:06.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:06.573+0000 7f0035409700 1 --2- 172.21.15.39:0/2368997210 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0030109850 0x7f0030077650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:06.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:06.573+0000 7f0034c08700 1 -- 172.21.15.39:0/2368997210 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0030108f00 msgr2=0x7f0030077110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:06.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:06.573+0000 7f0034c08700 1 --2- 172.21.15.39:0/2368997210 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0030108f00 0x7f0030077110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:06.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:06.573+0000 7f0034c08700 1 -- 172.21.15.39:0/2368997210 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0030109850 msgr2=0x7f0030077650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:06.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:06.573+0000 7f0034c08700 1 --2- 172.21.15.39:0/2368997210 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0030109850 0x7f0030077650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:06.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:06.573+0000 7f0034c08700 1 -- 172.21.15.39:0/2368997210 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00301a9190 con 0x7f00301045d0 2024-05-09T05:36:06.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:06.573+0000 7f0035409700 1 --2- 172.21.15.39:0/2368997210 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0030109850 0x7f0030077650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:36:06.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:06.574+0000 7f0034c08700 1 --2- 172.21.15.39:0/2368997210 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f00301045d0 0x7f0030076bd0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f002400b580 tx=0x7f00240047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:36:06.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:06.574+0000 7f002dffb700 1 -- 172.21.15.39:0/2368997210 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0024027070 con 0x7f00301045d0 2024-05-09T05:36:06.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:06.574+0000 7f0036e6c700 1 -- 172.21.15.39:0/2368997210 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00301a9420 con 0x7f00301045d0 2024-05-09T05:36:06.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:06.574+0000 7f002dffb700 1 -- 172.21.15.39:0/2368997210 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0024004020 con 0x7f00301045d0 2024-05-09T05:36:06.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:06.574+0000 7f002dffb700 1 -- 172.21.15.39:0/2368997210 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0024022e30 con 0x7f00301045d0 2024-05-09T05:36:06.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:06.574+0000 7f0036e6c700 1 -- 172.21.15.39:0/2368997210 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00301a9870 con 0x7f00301045d0 2024-05-09T05:36:06.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:06.575+0000 7f0036e6c700 1 -- 172.21.15.39:0/2368997210 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0030063ed0 con 0x7f00301045d0 2024-05-09T05:36:06.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:06.577+0000 7f002dffb700 1 -- 172.21.15.39:0/2368997210 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f0024022590 con 0x7f00301045d0 2024-05-09T05:36:06.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:06.577+0000 7f002dffb700 1 --2- 172.21.15.39:0/2368997210 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f00200b2910 0x7f00200b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:06.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:06.578+0000 7f002ffff700 1 --2- 172.21.15.39:0/2368997210 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f00200b2910 0x7f00200b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:06.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:06.578+0000 7f002dffb700 1 -- 172.21.15.39:0/2368997210 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f00240e3a00 con 0x7f00301045d0 2024-05-09T05:36:06.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:06.578+0000 7f002dffb700 1 --2- 172.21.15.39:0/2368997210 >> [v2:172.21.15.39:6802/1056276932,v1:172.21.15.39:6803/1056276932] conn(0x7f00200bc4a0 0x7f00200be990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:06.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:06.578+0000 7f002dffb700 1 -- 172.21.15.39:0/2368997210 --> [v2:172.21.15.39:6802/1056276932,v1:172.21.15.39:6803/1056276932] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f002402be50 con 0x7f00200bc4a0 2024-05-09T05:36:06.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:06.578+0000 7f002dffb700 1 -- 172.21.15.39:0/2368997210 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f00240e3e50 con 0x7f00301045d0 2024-05-09T05:36:06.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:06.578+0000 7f0035409700 1 --2- 172.21.15.39:0/2368997210 >> [v2:172.21.15.39:6802/1056276932,v1:172.21.15.39:6803/1056276932] conn(0x7f00200bc4a0 0x7f00200be990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:06.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:06.578+0000 7f002ffff700 1 --2- 172.21.15.39:0/2368997210 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f00200b2910 0x7f00200b4e20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f001c005950 tx=0x7f001c0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:36:06.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:06.578+0000 7f0035409700 1 --2- 172.21.15.39:0/2368997210 >> [v2:172.21.15.39:6802/1056276932,v1:172.21.15.39:6803/1056276932] conn(0x7f00200bc4a0 0x7f00200be990 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:36:06.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:06.579+0000 7f002dffb700 1 -- 172.21.15.39:0/2368997210 <== osd.0 v2:172.21.15.39:6802/1056276932 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f002402be50 con 0x7f00200bc4a0 2024-05-09T05:36:06.589 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:06.596+0000 7f0036e6c700 1 -- 172.21.15.39:0/2368997210 --> [v2:172.21.15.39:6802/1056276932,v1:172.21.15.39:6803/1056276932] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f00300642d0 con 0x7f00200bc4a0 2024-05-09T05:36:06.589 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:06.596+0000 7f002dffb700 1 -- 172.21.15.39:0/2368997210 <== osd.0 v2:172.21.15.39:6802/1056276932 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f00300642d0 con 0x7f00200bc4a0 2024-05-09T05:36:06.590 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:06.596+0000 7f0036e6c700 1 -- 172.21.15.39:0/2368997210 >> [v2:172.21.15.39:6802/1056276932,v1:172.21.15.39:6803/1056276932] conn(0x7f00200bc4a0 msgr2=0x7f00200be990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:06.590 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:06.596+0000 7f0036e6c700 1 --2- 172.21.15.39:0/2368997210 >> [v2:172.21.15.39:6802/1056276932,v1:172.21.15.39:6803/1056276932] conn(0x7f00200bc4a0 0x7f00200be990 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:06.590 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:06.596+0000 7f0036e6c700 1 -- 172.21.15.39:0/2368997210 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f00200b2910 msgr2=0x7f00200b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:06.590 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:06.596+0000 7f0036e6c700 1 --2- 172.21.15.39:0/2368997210 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f00200b2910 0x7f00200b4e20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f001c005950 tx=0x7f001c0058e0 comp rx=0 tx=0).stop 2024-05-09T05:36:06.591 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:06.596+0000 7f0036e6c700 1 -- 172.21.15.39:0/2368997210 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f00301045d0 msgr2=0x7f0030076bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:06.591 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:06.596+0000 7f0036e6c700 1 --2- 172.21.15.39:0/2368997210 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f00301045d0 0x7f0030076bd0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f002400b580 tx=0x7f00240047b0 comp rx=0 tx=0).stop 2024-05-09T05:36:06.591 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:06.596+0000 7f0035409700 1 -- 172.21.15.39:0/2368997210 reap_dead start 2024-05-09T05:36:06.591 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:06.597+0000 7f0036e6c700 1 -- 172.21.15.39:0/2368997210 shutdown_connections 2024-05-09T05:36:06.591 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:06.597+0000 7f0036e6c700 1 -- 172.21.15.39:0/2368997210 >> 172.21.15.39:0/2368997210 conn(0x7f00300ffea0 msgr2=0x7f0030102df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:36:06.591 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:06.597+0000 7f0036e6c700 1 -- 172.21.15.39:0/2368997210 shutdown_connections 2024-05-09T05:36:06.591 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:06.597+0000 7f0036e6c700 1 -- 172.21.15.39:0/2368997210 wait complete. 2024-05-09T05:36:07.557 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:36:07 smithi039 ceph-mon[30439]: pgmap v332: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-09T05:36:07.583 INFO:teuthology.orchestra.run.smithi039.stdout:133143986242 2024-05-09T05:36:07.584 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-05-09T05:36:07.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:36:07 smithi100 ceph-mon[34353]: pgmap v332: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-09T05:36:07.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:36:07 smithi060 ceph-mon[34555]: pgmap v332: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-09T05:36:08.390 INFO:teuthology.orchestra.run.smithi039.stdout:34359738456 2024-05-09T05:36:08.390 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-05-09T05:36:09.609 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:36:09 smithi039 ceph-mon[30439]: pgmap v333: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-09T05:36:09.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:36:09 smithi100 ceph-mon[34353]: pgmap v333: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-09T05:36:09.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:36:09 smithi060 ceph-mon[34555]: pgmap v333: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-09T05:36:10.121 INFO:teuthology.orchestra.run.smithi039.stdout:313532612639 2024-05-09T05:36:10.121 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-05-09T05:36:10.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:10.313+0000 7fe36aca5700 1 -- 172.21.15.39:0/4116630917 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe364106ec0 msgr2=0x7fe364113350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:10.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:10.313+0000 7fe36aca5700 1 --2- 172.21.15.39:0/4116630917 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe364106ec0 0x7fe364113350 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe35c00b0a0 tx=0x7fe35c00b3b0 comp rx=0 tx=0).stop 2024-05-09T05:36:10.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:10.313+0000 7fe36aca5700 1 -- 172.21.15.39:0/4116630917 shutdown_connections 2024-05-09T05:36:10.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:10.313+0000 7fe36aca5700 1 --2- 172.21.15.39:0/4116630917 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe364106ec0 0x7fe364113350 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:10.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:10.313+0000 7fe36aca5700 1 --2- 172.21.15.39:0/4116630917 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe36410c5b0 0x7fe36410c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:10.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:10.313+0000 7fe36aca5700 1 --2- 172.21.15.39:0/4116630917 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe364106570 0x7fe364106980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:10.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:10.313+0000 7fe36aca5700 1 -- 172.21.15.39:0/4116630917 >> 172.21.15.39:0/4116630917 conn(0x7fe364102050 msgr2=0x7fe3641044a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:36:10.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:10.313+0000 7fe36aca5700 1 -- 172.21.15.39:0/4116630917 shutdown_connections 2024-05-09T05:36:10.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:10.313+0000 7fe36aca5700 1 -- 172.21.15.39:0/4116630917 wait complete. 2024-05-09T05:36:10.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:10.314+0000 7fe36aca5700 1 Processor -- start 2024-05-09T05:36:10.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:10.314+0000 7fe36aca5700 1 -- start start 2024-05-09T05:36:10.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:10.315+0000 7fe36aca5700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe364106570 0x7fe36419d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:10.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:10.315+0000 7fe36aca5700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe364106ec0 0x7fe36419d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:10.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:10.315+0000 7fe36aca5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe36410c5b0 0x7fe3641a1840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:10.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:10.315+0000 7fe36aca5700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fe3641166e0 con 0x7fe364106ec0 2024-05-09T05:36:10.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:10.315+0000 7fe36aca5700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe364116560 con 0x7fe36410c5b0 2024-05-09T05:36:10.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:10.315+0000 7fe36aca5700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe364116860 con 0x7fe364106570 2024-05-09T05:36:10.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:10.315+0000 7fe363fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe364106ec0 0x7fe36419d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:10.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:10.315+0000 7fe363fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe364106ec0 0x7fe36419d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55938/0 (socket says 172.21.15.39:55938) 2024-05-09T05:36:10.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:10.315+0000 7fe363fff700 1 -- 172.21.15.39:0/806162790 learned_addr learned my addr 172.21.15.39:0/806162790 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:36:10.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:10.315+0000 7fe369242700 1 --2- 172.21.15.39:0/806162790 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe36410c5b0 0x7fe3641a1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:10.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:10.315+0000 7fe368a41700 1 --2- 172.21.15.39:0/806162790 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe364106570 0x7fe36419d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:10.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:10.315+0000 7fe363fff700 1 -- 172.21.15.39:0/806162790 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe364106570 msgr2=0x7fe36419d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:10.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:10.315+0000 7fe363fff700 1 --2- 172.21.15.39:0/806162790 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe364106570 0x7fe36419d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:10.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:10.315+0000 7fe363fff700 1 -- 172.21.15.39:0/806162790 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe36410c5b0 msgr2=0x7fe3641a1840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:10.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:10.315+0000 7fe363fff700 1 --2- 172.21.15.39:0/806162790 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe36410c5b0 0x7fe3641a1840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:10.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:10.315+0000 7fe363fff700 1 -- 172.21.15.39:0/806162790 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3641a1ee0 con 0x7fe364106ec0 2024-05-09T05:36:10.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:10.316+0000 7fe363fff700 1 --2- 172.21.15.39:0/806162790 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe364106ec0 0x7fe36419d5b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe35000c8c0 tx=0x7fe35000cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:36:10.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:10.316+0000 7fe361ffb700 1 -- 172.21.15.39:0/806162790 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe350004220 con 0x7fe364106ec0 2024-05-09T05:36:10.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:10.316+0000 7fe361ffb700 1 -- 172.21.15.39:0/806162790 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe3500043c0 con 0x7fe364106ec0 2024-05-09T05:36:10.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:10.316+0000 7fe36aca5700 1 -- 172.21.15.39:0/806162790 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3641a21d0 con 0x7fe364106ec0 2024-05-09T05:36:10.312 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:10.317+0000 7fe361ffb700 1 -- 172.21.15.39:0/806162790 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe350003680 con 0x7fe364106ec0 2024-05-09T05:36:10.312 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:10.317+0000 7fe36aca5700 1 -- 172.21.15.39:0/806162790 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3641a9af0 con 0x7fe364106ec0 2024-05-09T05:36:10.312 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:10.318+0000 7fe36aca5700 1 -- 172.21.15.39:0/806162790 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe364063f10 con 0x7fe364106ec0 2024-05-09T05:36:10.312 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:10.319+0000 7fe361ffb700 1 -- 172.21.15.39:0/806162790 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fe350004830 con 0x7fe364106ec0 2024-05-09T05:36:10.314 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:10.320+0000 7fe361ffb700 1 --2- 172.21.15.39:0/806162790 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fe3540b2990 0x7fe3540b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:10.314 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:10.320+0000 7fe368a41700 1 --2- 172.21.15.39:0/806162790 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fe3540b2990 0x7fe3540b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:10.314 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:10.320+0000 7fe361ffb700 1 -- 172.21.15.39:0/806162790 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7fe3500e1e10 con 0x7fe364106ec0 2024-05-09T05:36:10.315 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:10.320+0000 7fe361ffb700 1 --2- 172.21.15.39:0/806162790 >> [v2:172.21.15.100:6800/4141597693,v1:172.21.15.100:6801/4141597693] conn(0x7fe3540bc520 0x7fe3540bea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:10.315 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:10.321+0000 7fe361ffb700 1 -- 172.21.15.39:0/806162790 --> [v2:172.21.15.100:6800/4141597693,v1:172.21.15.100:6801/4141597693] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe350012ec0 con 0x7fe3540bc520 2024-05-09T05:36:10.315 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:10.321+0000 7fe368a41700 1 --2- 172.21.15.39:0/806162790 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fe3540b2990 0x7fe3540b4ea0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe358005950 tx=0x7fe35800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:36:10.315 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:10.321+0000 7fe361ffb700 1 -- 172.21.15.39:0/806162790 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7fe3500e44d0 con 0x7fe364106ec0 2024-05-09T05:36:10.315 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:10.321+0000 7fe369242700 1 --2- 172.21.15.39:0/806162790 >> [v2:172.21.15.100:6800/4141597693,v1:172.21.15.100:6801/4141597693] conn(0x7fe3540bc520 0x7fe3540bea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:10.315 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:10.321+0000 7fe369242700 1 --2- 172.21.15.39:0/806162790 >> [v2:172.21.15.100:6800/4141597693,v1:172.21.15.100:6801/4141597693] conn(0x7fe3540bc520 0x7fe3540bea10 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:36:10.316 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:10.322+0000 7fe361ffb700 1 -- 172.21.15.39:0/806162790 <== osd.2 v2:172.21.15.100:6800/4141597693 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe350012ec0 con 0x7fe3540bc520 2024-05-09T05:36:10.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:10.352+0000 7fe36aca5700 1 -- 172.21.15.39:0/806162790 --> [v2:172.21.15.100:6800/4141597693,v1:172.21.15.100:6801/4141597693] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe364064390 con 0x7fe3540bc520 2024-05-09T05:36:10.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:10.352+0000 7fe361ffb700 1 -- 172.21.15.39:0/806162790 <== osd.2 v2:172.21.15.100:6800/4141597693 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fe364064390 con 0x7fe3540bc520 2024-05-09T05:36:10.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:10.353+0000 7fe36aca5700 1 -- 172.21.15.39:0/806162790 >> [v2:172.21.15.100:6800/4141597693,v1:172.21.15.100:6801/4141597693] conn(0x7fe3540bc520 msgr2=0x7fe3540bea10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:10.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:10.353+0000 7fe36aca5700 1 --2- 172.21.15.39:0/806162790 >> [v2:172.21.15.100:6800/4141597693,v1:172.21.15.100:6801/4141597693] conn(0x7fe3540bc520 0x7fe3540bea10 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:10.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:10.354+0000 7fe36aca5700 1 -- 172.21.15.39:0/806162790 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fe3540b2990 msgr2=0x7fe3540b4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:10.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:10.354+0000 7fe36aca5700 1 --2- 172.21.15.39:0/806162790 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fe3540b2990 0x7fe3540b4ea0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe358005950 tx=0x7fe35800b410 comp rx=0 tx=0).stop 2024-05-09T05:36:10.348 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:10.354+0000 7fe36aca5700 1 -- 172.21.15.39:0/806162790 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe364106ec0 msgr2=0x7fe36419d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:10.348 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:10.354+0000 7fe36aca5700 1 --2- 172.21.15.39:0/806162790 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe364106ec0 0x7fe36419d5b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe35000c8c0 tx=0x7fe35000cbd0 comp rx=0 tx=0).stop 2024-05-09T05:36:10.348 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:10.354+0000 7fe369242700 1 -- 172.21.15.39:0/806162790 reap_dead start 2024-05-09T05:36:10.348 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:10.354+0000 7fe36aca5700 1 -- 172.21.15.39:0/806162790 shutdown_connections 2024-05-09T05:36:10.348 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:10.354+0000 7fe36aca5700 1 -- 172.21.15.39:0/806162790 >> 172.21.15.39:0/806162790 conn(0x7fe364102050 msgr2=0x7fe364103630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:36:10.348 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:10.354+0000 7fe36aca5700 1 -- 172.21.15.39:0/806162790 shutdown_connections 2024-05-09T05:36:10.348 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:10.354+0000 7fe36aca5700 1 -- 172.21.15.39:0/806162790 wait complete. 2024-05-09T05:36:11.562 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:36:11 smithi039 ceph-mon[30439]: pgmap v334: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-09T05:36:11.617 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:36:11 smithi060 ceph-mon[34555]: pgmap v334: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-09T05:36:11.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:36:11 smithi100 ceph-mon[34353]: pgmap v334: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-09T05:36:13.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.242+0000 7f5b773aa700 1 -- 172.21.15.39:0/3715437665 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5b70107df0 msgr2=0x7f5b70108200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:13.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.242+0000 7f5b773aa700 1 --2- 172.21.15.39:0/3715437665 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5b70107df0 0x7f5b70108200 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f5b600099c0 tx=0x7f5b60009cd0 comp rx=0 tx=0).stop 2024-05-09T05:36:13.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.242+0000 7f5b773aa700 1 -- 172.21.15.39:0/3715437665 shutdown_connections 2024-05-09T05:36:13.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.242+0000 7f5b773aa700 1 --2- 172.21.15.39:0/3715437665 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b70108740 0x7f5b701100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:13.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.242+0000 7f5b773aa700 1 --2- 172.21.15.39:0/3715437665 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5b701034c0 0x7f5b701038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:13.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.242+0000 7f5b773aa700 1 --2- 172.21.15.39:0/3715437665 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5b70107df0 0x7f5b70108200 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:13.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.242+0000 7f5b773aa700 1 -- 172.21.15.39:0/3715437665 >> 172.21.15.39:0/3715437665 conn(0x7f5b700fedf0 msgr2=0x7f5b70101210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:36:13.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.242+0000 7f5b773aa700 1 -- 172.21.15.39:0/3715437665 shutdown_connections 2024-05-09T05:36:13.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.243+0000 7f5b773aa700 1 -- 172.21.15.39:0/3715437665 wait complete. 2024-05-09T05:36:13.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.243+0000 7f5b773aa700 1 Processor -- start 2024-05-09T05:36:13.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.243+0000 7f5b773aa700 1 -- start start 2024-05-09T05:36:13.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.243+0000 7f5b773aa700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5b701034c0 0x7f5b7019bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:13.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.244+0000 7f5b773aa700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b70107df0 0x7f5b7019c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:13.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.244+0000 7f5b773aa700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5b70108740 0x7f5b7019c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:13.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.244+0000 7f5b773aa700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f5b70113370 con 0x7f5b70108740 2024-05-09T05:36:13.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.244+0000 7f5b773aa700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f5b701131f0 con 0x7f5b70107df0 2024-05-09T05:36:13.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.244+0000 7f5b773aa700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f5b701134f0 con 0x7f5b701034c0 2024-05-09T05:36:13.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.244+0000 7f5b75947700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5b70108740 0x7f5b7019c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:13.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.244+0000 7f5b75947700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5b70108740 0x7f5b7019c730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55960/0 (socket says 172.21.15.39:55960) 2024-05-09T05:36:13.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.244+0000 7f5b75947700 1 -- 172.21.15.39:0/2363153997 learned_addr learned my addr 172.21.15.39:0/2363153997 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:36:13.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.244+0000 7f5b74945700 1 --2- 172.21.15.39:0/2363153997 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b70107df0 0x7f5b7019c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:13.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.244+0000 7f5b75146700 1 --2- 172.21.15.39:0/2363153997 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5b701034c0 0x7f5b7019bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:13.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.244+0000 7f5b75947700 1 -- 172.21.15.39:0/2363153997 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5b701034c0 msgr2=0x7f5b7019bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:13.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.244+0000 7f5b75947700 1 --2- 172.21.15.39:0/2363153997 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5b701034c0 0x7f5b7019bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:13.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.244+0000 7f5b75947700 1 -- 172.21.15.39:0/2363153997 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b70107df0 msgr2=0x7f5b7019c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:13.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.244+0000 7f5b75947700 1 --2- 172.21.15.39:0/2363153997 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b70107df0 0x7f5b7019c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:13.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.244+0000 7f5b75947700 1 -- 172.21.15.39:0/2363153997 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b701a6fe0 con 0x7f5b70108740 2024-05-09T05:36:13.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.244+0000 7f5b75146700 1 --2- 172.21.15.39:0/2363153997 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5b701034c0 0x7f5b7019bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T05:36:13.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.244+0000 7f5b74945700 1 --2- 172.21.15.39:0/2363153997 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b70107df0 0x7f5b7019c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T05:36:13.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.244+0000 7f5b75947700 1 --2- 172.21.15.39:0/2363153997 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5b70108740 0x7f5b7019c730 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f5b68007ee0 tx=0x7f5b6800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:36:13.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.244+0000 7f5b667fc700 1 -- 172.21.15.39:0/2363153997 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b6800dbd0 con 0x7f5b70108740 2024-05-09T05:36:13.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.245+0000 7f5b773aa700 1 -- 172.21.15.39:0/2363153997 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b701a72d0 con 0x7f5b70108740 2024-05-09T05:36:13.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.245+0000 7f5b667fc700 1 -- 172.21.15.39:0/2363153997 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5b6800dd70 con 0x7f5b70108740 2024-05-09T05:36:13.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.245+0000 7f5b667fc700 1 -- 172.21.15.39:0/2363153997 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b68005990 con 0x7f5b70108740 2024-05-09T05:36:13.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.245+0000 7f5b773aa700 1 -- 172.21.15.39:0/2363153997 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b701a7790 con 0x7f5b70108740 2024-05-09T05:36:13.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.245+0000 7f5b773aa700 1 -- 172.21.15.39:0/2363153997 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5b70063e90 con 0x7f5b70108740 2024-05-09T05:36:13.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.247+0000 7f5b667fc700 1 -- 172.21.15.39:0/2363153997 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f5b6801a020 con 0x7f5b70108740 2024-05-09T05:36:13.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.248+0000 7f5b667fc700 1 --2- 172.21.15.39:0/2363153997 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f5b5c0b2910 0x7f5b5c0b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:13.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.248+0000 7f5b75146700 1 --2- 172.21.15.39:0/2363153997 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f5b5c0b2910 0x7f5b5c0b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:13.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.248+0000 7f5b667fc700 1 -- 172.21.15.39:0/2363153997 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f5b680e21c0 con 0x7f5b70108740 2024-05-09T05:36:13.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.248+0000 7f5b667fc700 1 --2- 172.21.15.39:0/2363153997 >> [v2:172.21.15.100:6816/1757558317,v1:172.21.15.100:6817/1757558317] conn(0x7f5b5c0bc4a0 0x7f5b5c0be990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:13.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.248+0000 7f5b667fc700 1 -- 172.21.15.39:0/2363153997 --> [v2:172.21.15.100:6816/1757558317,v1:172.21.15.100:6817/1757558317] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5b68012ec0 con 0x7f5b5c0bc4a0 2024-05-09T05:36:13.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.248+0000 7f5b667fc700 1 -- 172.21.15.39:0/2363153997 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f5b680e2610 con 0x7f5b70108740 2024-05-09T05:36:13.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.248+0000 7f5b75146700 1 --2- 172.21.15.39:0/2363153997 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f5b5c0b2910 0x7f5b5c0b4e20 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c00bcf0 tx=0x7f5b6c00b2c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:36:13.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.249+0000 7f5b74945700 1 --2- 172.21.15.39:0/2363153997 >> [v2:172.21.15.100:6816/1757558317,v1:172.21.15.100:6817/1757558317] conn(0x7f5b5c0bc4a0 0x7f5b5c0be990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:13.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.249+0000 7f5b74945700 1 --2- 172.21.15.39:0/2363153997 >> [v2:172.21.15.100:6816/1757558317,v1:172.21.15.100:6817/1757558317] conn(0x7f5b5c0bc4a0 0x7f5b5c0be990 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:36:13.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.250+0000 7f5b667fc700 1 -- 172.21.15.39:0/2363153997 <== osd.8 v2:172.21.15.100:6816/1757558317 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5b68012ec0 con 0x7f5b5c0bc4a0 2024-05-09T05:36:13.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.266+0000 7f5b773aa700 1 -- 172.21.15.39:0/2363153997 --> [v2:172.21.15.100:6816/1757558317,v1:172.21.15.100:6817/1757558317] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5b70064310 con 0x7f5b5c0bc4a0 2024-05-09T05:36:13.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.267+0000 7f5b667fc700 1 -- 172.21.15.39:0/2363153997 <== osd.8 v2:172.21.15.100:6816/1757558317 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f5b70064310 con 0x7f5b5c0bc4a0 2024-05-09T05:36:13.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.268+0000 7f5b773aa700 1 -- 172.21.15.39:0/2363153997 >> [v2:172.21.15.100:6816/1757558317,v1:172.21.15.100:6817/1757558317] conn(0x7f5b5c0bc4a0 msgr2=0x7f5b5c0be990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:13.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.268+0000 7f5b773aa700 1 --2- 172.21.15.39:0/2363153997 >> [v2:172.21.15.100:6816/1757558317,v1:172.21.15.100:6817/1757558317] conn(0x7f5b5c0bc4a0 0x7f5b5c0be990 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:13.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.268+0000 7f5b773aa700 1 -- 172.21.15.39:0/2363153997 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f5b5c0b2910 msgr2=0x7f5b5c0b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:13.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.268+0000 7f5b773aa700 1 --2- 172.21.15.39:0/2363153997 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f5b5c0b2910 0x7f5b5c0b4e20 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c00bcf0 tx=0x7f5b6c00b2c0 comp rx=0 tx=0).stop 2024-05-09T05:36:13.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.268+0000 7f5b773aa700 1 -- 172.21.15.39:0/2363153997 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5b70108740 msgr2=0x7f5b7019c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:13.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.268+0000 7f5b773aa700 1 --2- 172.21.15.39:0/2363153997 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5b70108740 0x7f5b7019c730 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f5b68007ee0 tx=0x7f5b6800d3b0 comp rx=0 tx=0).stop 2024-05-09T05:36:13.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.268+0000 7f5b75947700 1 -- 172.21.15.39:0/2363153997 reap_dead start 2024-05-09T05:36:13.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.268+0000 7f5b773aa700 1 -- 172.21.15.39:0/2363153997 shutdown_connections 2024-05-09T05:36:13.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.268+0000 7f5b773aa700 1 -- 172.21.15.39:0/2363153997 >> 172.21.15.39:0/2363153997 conn(0x7f5b700fedf0 msgr2=0x7f5b70101210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:36:13.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.268+0000 7f5b773aa700 1 -- 172.21.15.39:0/2363153997 shutdown_connections 2024-05-09T05:36:13.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.268+0000 7f5b773aa700 1 -- 172.21.15.39:0/2363153997 wait complete. 2024-05-09T05:36:13.321 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:11.567+0000 7f7ff9db3700 1 -- 172.21.15.39:0/1479678297 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ff41034c0 msgr2=0x7f7ff41038d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:13.321 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:11.567+0000 7f7ff9db3700 1 --2- 172.21.15.39:0/1479678297 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ff41034c0 0x7f7ff41038d0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7fe40099c0 tx=0x7f7fe4009cd0 comp rx=0 tx=0).stop 2024-05-09T05:36:13.321 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:11.567+0000 7f7ff9db3700 1 -- 172.21.15.39:0/1479678297 shutdown_connections 2024-05-09T05:36:13.321 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:11.567+0000 7f7ff9db3700 1 --2- 172.21.15.39:0/1479678297 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ff4108740 0x7f7ff41100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:13.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:11.567+0000 7f7ff9db3700 1 --2- 172.21.15.39:0/1479678297 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ff41034c0 0x7f7ff41038d0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:13.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:11.567+0000 7f7ff9db3700 1 --2- 172.21.15.39:0/1479678297 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ff4107df0 0x7f7ff4108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:13.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:11.567+0000 7f7ff9db3700 1 -- 172.21.15.39:0/1479678297 >> 172.21.15.39:0/1479678297 conn(0x7f7ff40fedc0 msgr2=0x7f7ff41011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:36:13.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:11.568+0000 7f7ff9db3700 1 -- 172.21.15.39:0/1479678297 shutdown_connections 2024-05-09T05:36:13.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:11.568+0000 7f7ff9db3700 1 -- 172.21.15.39:0/1479678297 wait complete. 2024-05-09T05:36:13.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:11.568+0000 7f7ff9db3700 1 Processor -- start 2024-05-09T05:36:13.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:11.569+0000 7f7ff9db3700 1 -- start start 2024-05-09T05:36:13.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:11.569+0000 7f7ff9db3700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ff41034c0 0x7f7ff419f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:13.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:11.569+0000 7f7ff9db3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ff4107df0 0x7f7ff419fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:13.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:11.569+0000 7f7ff9db3700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ff4108740 0x7f7ff4199af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:13.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:11.569+0000 7f7ff9db3700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f7ff4113370 con 0x7f7ff41034c0 2024-05-09T05:36:13.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:11.569+0000 7f7ff9db3700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f7ff41131f0 con 0x7f7ff4107df0 2024-05-09T05:36:13.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:11.569+0000 7f7ff9db3700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7ff41134f0 con 0x7f7ff4108740 2024-05-09T05:36:13.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:11.569+0000 7f7ff37fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ff41034c0 0x7f7ff419f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:13.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:11.569+0000 7f7ff37fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ff41034c0 0x7f7ff419f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55954/0 (socket says 172.21.15.39:55954) 2024-05-09T05:36:13.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:11.569+0000 7f7ff37fe700 1 -- 172.21.15.39:0/3278807848 learned_addr learned my addr 172.21.15.39:0/3278807848 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:36:13.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:11.569+0000 7f7ff3fff700 1 --2- 172.21.15.39:0/3278807848 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ff4108740 0x7f7ff4199af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:13.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:11.569+0000 7f7ff2ffd700 1 --2- 172.21.15.39:0/3278807848 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ff4107df0 0x7f7ff419fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:13.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:11.569+0000 7f7ff37fe700 1 -- 172.21.15.39:0/3278807848 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ff4108740 msgr2=0x7f7ff4199af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:13.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:11.569+0000 7f7ff37fe700 1 --2- 172.21.15.39:0/3278807848 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ff4108740 0x7f7ff4199af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:13.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:11.569+0000 7f7ff37fe700 1 -- 172.21.15.39:0/3278807848 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ff4107df0 msgr2=0x7f7ff419fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:13.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:11.569+0000 7f7ff37fe700 1 --2- 172.21.15.39:0/3278807848 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ff4107df0 0x7f7ff419fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:13.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:11.569+0000 7f7ff37fe700 1 -- 172.21.15.39:0/3278807848 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ff419a1d0 con 0x7f7ff41034c0 2024-05-09T05:36:13.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:11.569+0000 7f7ff2ffd700 1 --2- 172.21.15.39:0/3278807848 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ff4107df0 0x7f7ff419fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:36:13.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:11.570+0000 7f7ff37fe700 1 --2- 172.21.15.39:0/3278807848 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ff41034c0 0x7f7ff419f8b0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7fe4006010 tx=0x7f7fe4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:36:13.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:11.570+0000 7f7ff0ff9700 1 -- 172.21.15.39:0/3278807848 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fe4026070 con 0x7f7ff41034c0 2024-05-09T05:36:13.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:11.570+0000 7f7ff0ff9700 1 -- 172.21.15.39:0/3278807848 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7fe4003c70 con 0x7f7ff41034c0 2024-05-09T05:36:13.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:11.570+0000 7f7ff9db3700 1 -- 172.21.15.39:0/3278807848 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ff419a460 con 0x7f7ff41034c0 2024-05-09T05:36:13.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:11.570+0000 7f7ff0ff9700 1 -- 172.21.15.39:0/3278807848 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fe400fbe0 con 0x7f7ff41034c0 2024-05-09T05:36:13.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:11.570+0000 7f7ff9db3700 1 -- 172.21.15.39:0/3278807848 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ff406b610 con 0x7f7ff41034c0 2024-05-09T05:36:13.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:11.571+0000 7f7ff9db3700 1 -- 172.21.15.39:0/3278807848 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7ff406bbc0 con 0x7f7ff41034c0 2024-05-09T05:36:13.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:11.572+0000 7f7ff0ff9700 1 -- 172.21.15.39:0/3278807848 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f7fe4029070 con 0x7f7ff41034c0 2024-05-09T05:36:13.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:11.573+0000 7f7ff0ff9700 1 --2- 172.21.15.39:0/3278807848 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f7fdc0b2910 0x7f7fdc0b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:13.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:11.573+0000 7f7ff2ffd700 1 --2- 172.21.15.39:0/3278807848 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f7fdc0b2910 0x7f7fdc0b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:13.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:11.573+0000 7f7ff0ff9700 1 -- 172.21.15.39:0/3278807848 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f7fe40e34a0 con 0x7f7ff41034c0 2024-05-09T05:36:13.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:11.573+0000 7f7ff0ff9700 1 --2- 172.21.15.39:0/3278807848 >> [v2:172.21.15.60:6800/4245630636,v1:172.21.15.60:6801/4245630636] conn(0x7f7fdc0bc4a0 0x7f7fdc0be990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:13.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:11.573+0000 7f7ff0ff9700 1 -- 172.21.15.39:0/3278807848 --> [v2:172.21.15.60:6800/4245630636,v1:172.21.15.60:6801/4245630636] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7fdc0bf060 con 0x7f7fdc0bc4a0 2024-05-09T05:36:13.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:11.573+0000 7f7ff0ff9700 1 -- 172.21.15.39:0/3278807848 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f7fe40e38f0 con 0x7f7ff41034c0 2024-05-09T05:36:13.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:11.574+0000 7f7ff2ffd700 1 --2- 172.21.15.39:0/3278807848 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f7fdc0b2910 0x7f7fdc0b4e20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7ff41063e0 tx=0x7f7fe8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:36:13.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:11.574+0000 7f7ff3fff700 1 --2- 172.21.15.39:0/3278807848 >> [v2:172.21.15.60:6800/4245630636,v1:172.21.15.60:6801/4245630636] conn(0x7f7fdc0bc4a0 0x7f7fdc0be990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:13.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:11.574+0000 7f7ff3fff700 1 --2- 172.21.15.39:0/3278807848 >> [v2:172.21.15.60:6800/4245630636,v1:172.21.15.60:6801/4245630636] conn(0x7f7fdc0bc4a0 0x7f7fdc0be990 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:36:13.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:11.575+0000 7f7ff0ff9700 1 -- 172.21.15.39:0/3278807848 <== osd.1 v2:172.21.15.60:6800/4245630636 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7fdc0bf060 con 0x7f7fdc0bc4a0 2024-05-09T05:36:13.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:11.591+0000 7f7ff9db3700 1 -- 172.21.15.39:0/3278807848 --> [v2:172.21.15.60:6800/4245630636,v1:172.21.15.60:6801/4245630636] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7ff406c040 con 0x7f7fdc0bc4a0 2024-05-09T05:36:13.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:11.592+0000 7f7ff0ff9700 1 -- 172.21.15.39:0/3278807848 <== osd.1 v2:172.21.15.60:6800/4245630636 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7ff406c040 con 0x7f7fdc0bc4a0 2024-05-09T05:36:13.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:11.592+0000 7f7ff9db3700 1 -- 172.21.15.39:0/3278807848 >> [v2:172.21.15.60:6800/4245630636,v1:172.21.15.60:6801/4245630636] conn(0x7f7fdc0bc4a0 msgr2=0x7f7fdc0be990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:13.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:11.592+0000 7f7ff9db3700 1 --2- 172.21.15.39:0/3278807848 >> [v2:172.21.15.60:6800/4245630636,v1:172.21.15.60:6801/4245630636] conn(0x7f7fdc0bc4a0 0x7f7fdc0be990 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:13.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:11.593+0000 7f7ff9db3700 1 -- 172.21.15.39:0/3278807848 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f7fdc0b2910 msgr2=0x7f7fdc0b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:13.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:11.593+0000 7f7ff9db3700 1 --2- 172.21.15.39:0/3278807848 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f7fdc0b2910 0x7f7fdc0b4e20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7ff41063e0 tx=0x7f7fe8009260 comp rx=0 tx=0).stop 2024-05-09T05:36:13.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:11.593+0000 7f7ff9db3700 1 -- 172.21.15.39:0/3278807848 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ff41034c0 msgr2=0x7f7ff419f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:13.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:11.593+0000 7f7ff9db3700 1 --2- 172.21.15.39:0/3278807848 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7ff41034c0 0x7f7ff419f8b0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7fe4006010 tx=0x7f7fe4004270 comp rx=0 tx=0).stop 2024-05-09T05:36:13.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:11.593+0000 7f7ff3fff700 1 -- 172.21.15.39:0/3278807848 reap_dead start 2024-05-09T05:36:13.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:11.593+0000 7f7ff9db3700 1 -- 172.21.15.39:0/3278807848 shutdown_connections 2024-05-09T05:36:13.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:11.593+0000 7f7ff9db3700 1 -- 172.21.15.39:0/3278807848 >> 172.21.15.39:0/3278807848 conn(0x7f7ff40fedc0 msgr2=0x7f7ff4101c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:36:13.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:11.593+0000 7f7ff9db3700 1 -- 172.21.15.39:0/3278807848 shutdown_connections 2024-05-09T05:36:13.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:11.593+0000 7f7ff9db3700 1 -- 172.21.15.39:0/3278807848 wait complete. 2024-05-09T05:36:13.502 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:36:13 smithi039 ceph-mon[30439]: pgmap v335: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-05-09T05:36:13.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:36:13 smithi100 ceph-mon[34353]: pgmap v335: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-05-09T05:36:13.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:36:13 smithi060 ceph-mon[34555]: pgmap v335: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-05-09T05:36:13.924 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.930+0000 7f4a20c4a700 1 -- 172.21.15.39:0/2672516672 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4a1c107df0 msgr2=0x7f4a1c108200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:13.924 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.930+0000 7f4a20c4a700 1 --2- 172.21.15.39:0/2672516672 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4a1c107df0 0x7f4a1c108200 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c0099c0 tx=0x7f4a0c009cd0 comp rx=0 tx=0).stop 2024-05-09T05:36:13.924 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.931+0000 7f4a20c4a700 1 -- 172.21.15.39:0/2672516672 shutdown_connections 2024-05-09T05:36:13.925 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.931+0000 7f4a20c4a700 1 --2- 172.21.15.39:0/2672516672 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a1c108740 0x7f4a1c1100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:13.925 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.931+0000 7f4a20c4a700 1 --2- 172.21.15.39:0/2672516672 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a1c1034c0 0x7f4a1c1038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:13.925 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.931+0000 7f4a20c4a700 1 --2- 172.21.15.39:0/2672516672 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4a1c107df0 0x7f4a1c108200 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:13.925 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.931+0000 7f4a20c4a700 1 -- 172.21.15.39:0/2672516672 >> 172.21.15.39:0/2672516672 conn(0x7f4a1c0fedf0 msgr2=0x7f4a1c101210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:36:13.925 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.931+0000 7f4a20c4a700 1 -- 172.21.15.39:0/2672516672 shutdown_connections 2024-05-09T05:36:13.925 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.931+0000 7f4a20c4a700 1 -- 172.21.15.39:0/2672516672 wait complete. 2024-05-09T05:36:13.927 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.932+0000 7f4a20c4a700 1 Processor -- start 2024-05-09T05:36:13.927 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.932+0000 7f4a20c4a700 1 -- start start 2024-05-09T05:36:13.927 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.932+0000 7f4a20c4a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a1c1034c0 0x7f4a1c199b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:13.927 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.932+0000 7f4a20c4a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4a1c107df0 0x7f4a1c19a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:13.927 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.932+0000 7f4a20c4a700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a1c108740 0x7f4a1c19a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:13.927 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.932+0000 7f4a20c4a700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f4a1c1133e0 con 0x7f4a1c107df0 2024-05-09T05:36:13.927 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.932+0000 7f4a20c4a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f4a1c113260 con 0x7f4a1c1034c0 2024-05-09T05:36:13.927 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.932+0000 7f4a20c4a700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4a1c113560 con 0x7f4a1c108740 2024-05-09T05:36:13.927 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.932+0000 7f4a19d9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4a1c107df0 0x7f4a1c19a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:13.928 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.932+0000 7f4a19d9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4a1c107df0 0x7f4a1c19a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55972/0 (socket says 172.21.15.39:55972) 2024-05-09T05:36:13.928 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.932+0000 7f4a19d9b700 1 -- 172.21.15.39:0/1613494606 learned_addr learned my addr 172.21.15.39:0/1613494606 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:36:13.928 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.932+0000 7f4a1a59c700 1 --2- 172.21.15.39:0/1613494606 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a1c1034c0 0x7f4a1c199b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:13.928 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.933+0000 7f4a1ad9d700 1 --2- 172.21.15.39:0/1613494606 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a1c108740 0x7f4a1c19a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:13.928 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.933+0000 7f4a19d9b700 1 -- 172.21.15.39:0/1613494606 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a1c108740 msgr2=0x7f4a1c19a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:13.928 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.933+0000 7f4a19d9b700 1 --2- 172.21.15.39:0/1613494606 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a1c108740 0x7f4a1c19a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:13.928 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.933+0000 7f4a19d9b700 1 -- 172.21.15.39:0/1613494606 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a1c1034c0 msgr2=0x7f4a1c199b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:13.928 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.933+0000 7f4a19d9b700 1 --2- 172.21.15.39:0/1613494606 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a1c1034c0 0x7f4a1c199b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:13.928 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.933+0000 7f4a19d9b700 1 -- 172.21.15.39:0/1613494606 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a1c1a9210 con 0x7f4a1c107df0 2024-05-09T05:36:13.928 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.933+0000 7f4a19d9b700 1 --2- 172.21.15.39:0/1613494606 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4a1c107df0 0x7f4a1c19a050 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c009f50 tx=0x7f4a0c0037c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:36:13.928 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.933+0000 7f4a0b7fe700 1 -- 172.21.15.39:0/1613494606 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a0c027070 con 0x7f4a1c107df0 2024-05-09T05:36:13.928 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.933+0000 7f4a20c4a700 1 -- 172.21.15.39:0/1613494606 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a1c1a94a0 con 0x7f4a1c107df0 2024-05-09T05:36:13.928 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.933+0000 7f4a0b7fe700 1 -- 172.21.15.39:0/1613494606 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4a0c004090 con 0x7f4a1c107df0 2024-05-09T05:36:13.929 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.933+0000 7f4a0b7fe700 1 -- 172.21.15.39:0/1613494606 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a0c022e60 con 0x7f4a1c107df0 2024-05-09T05:36:13.929 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.933+0000 7f4a20c4a700 1 -- 172.21.15.39:0/1613494606 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a1c1a9950 con 0x7f4a1c107df0 2024-05-09T05:36:13.929 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.934+0000 7f4a20c4a700 1 -- 172.21.15.39:0/1613494606 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f49fc001030 con 0x7f4a1c107df0 2024-05-09T05:36:13.930 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.936+0000 7f4a0b7fe700 1 -- 172.21.15.39:0/1613494606 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f4a0c02a070 con 0x7f4a1c107df0 2024-05-09T05:36:13.931 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.937+0000 7f4a0b7fe700 1 --2- 172.21.15.39:0/1613494606 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f4a040b2910 0x7f4a040b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:13.931 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.937+0000 7f4a0b7fe700 1 -- 172.21.15.39:0/1613494606 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f4a0c0e3a40 con 0x7f4a1c107df0 2024-05-09T05:36:13.931 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.937+0000 7f4a1a59c700 1 --2- 172.21.15.39:0/1613494606 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f4a040b2910 0x7f4a040b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:13.932 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.938+0000 7f4a0b7fe700 1 --2- 172.21.15.39:0/1613494606 >> [v2:172.21.15.39:6826/2944584368,v1:172.21.15.39:6827/2944584368] conn(0x7f4a040bc4a0 0x7f4a040be990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:13.932 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.938+0000 7f4a0b7fe700 1 -- 172.21.15.39:0/1613494606 --> [v2:172.21.15.39:6826/2944584368,v1:172.21.15.39:6827/2944584368] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4a0c00b0b0 con 0x7f4a040bc4a0 2024-05-09T05:36:13.932 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.938+0000 7f4a0b7fe700 1 -- 172.21.15.39:0/1613494606 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f4a0c0e3e90 con 0x7f4a1c107df0 2024-05-09T05:36:13.932 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.938+0000 7f4a1ad9d700 1 --2- 172.21.15.39:0/1613494606 >> [v2:172.21.15.39:6826/2944584368,v1:172.21.15.39:6827/2944584368] conn(0x7f4a040bc4a0 0x7f4a040be990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:13.932 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.938+0000 7f4a1ad9d700 1 --2- 172.21.15.39:0/1613494606 >> [v2:172.21.15.39:6826/2944584368,v1:172.21.15.39:6827/2944584368] conn(0x7f4a040bc4a0 0x7f4a040be990 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:36:13.932 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.938+0000 7f4a1a59c700 1 --2- 172.21.15.39:0/1613494606 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f4a040b2910 0x7f4a040b4e20 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4a10009a10 tx=0x7f4a10009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:36:13.933 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.939+0000 7f4a0b7fe700 1 -- 172.21.15.39:0/1613494606 <== osd.9 v2:172.21.15.39:6826/2944584368 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4a0c00b0b0 con 0x7f4a040bc4a0 2024-05-09T05:36:13.950 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.956+0000 7f4a20c4a700 1 -- 172.21.15.39:0/1613494606 --> [v2:172.21.15.39:6826/2944584368,v1:172.21.15.39:6827/2944584368] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f49fc002e60 con 0x7f4a040bc4a0 2024-05-09T05:36:13.950 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.956+0000 7f4a0b7fe700 1 -- 172.21.15.39:0/1613494606 <== osd.9 v2:172.21.15.39:6826/2944584368 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f49fc002e60 con 0x7f4a040bc4a0 2024-05-09T05:36:13.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.957+0000 7f4a20c4a700 1 -- 172.21.15.39:0/1613494606 >> [v2:172.21.15.39:6826/2944584368,v1:172.21.15.39:6827/2944584368] conn(0x7f4a040bc4a0 msgr2=0x7f4a040be990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:13.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.957+0000 7f4a20c4a700 1 --2- 172.21.15.39:0/1613494606 >> [v2:172.21.15.39:6826/2944584368,v1:172.21.15.39:6827/2944584368] conn(0x7f4a040bc4a0 0x7f4a040be990 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:13.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.957+0000 7f4a20c4a700 1 -- 172.21.15.39:0/1613494606 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f4a040b2910 msgr2=0x7f4a040b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:13.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.957+0000 7f4a20c4a700 1 --2- 172.21.15.39:0/1613494606 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f4a040b2910 0x7f4a040b4e20 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4a10009a10 tx=0x7f4a10009190 comp rx=0 tx=0).stop 2024-05-09T05:36:13.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.957+0000 7f4a20c4a700 1 -- 172.21.15.39:0/1613494606 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4a1c107df0 msgr2=0x7f4a1c19a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:13.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.957+0000 7f4a20c4a700 1 --2- 172.21.15.39:0/1613494606 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4a1c107df0 0x7f4a1c19a050 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c009f50 tx=0x7f4a0c0037c0 comp rx=0 tx=0).stop 2024-05-09T05:36:13.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.957+0000 7f4a1ad9d700 1 -- 172.21.15.39:0/1613494606 reap_dead start 2024-05-09T05:36:13.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.957+0000 7f4a20c4a700 1 -- 172.21.15.39:0/1613494606 shutdown_connections 2024-05-09T05:36:13.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.957+0000 7f4a20c4a700 1 -- 172.21.15.39:0/1613494606 >> 172.21.15.39:0/1613494606 conn(0x7f4a1c0fedf0 msgr2=0x7f4a1c1096a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:36:13.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.957+0000 7f4a20c4a700 1 -- 172.21.15.39:0/1613494606 shutdown_connections 2024-05-09T05:36:13.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:13.957+0000 7f4a20c4a700 1 -- 172.21.15.39:0/1613494606 wait complete. 2024-05-09T05:36:14.481 INFO:teuthology.orchestra.run.smithi039.stdout:55834574931 2024-05-09T05:36:14.481 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-05-09T05:36:14.850 INFO:teuthology.orchestra.run.smithi039.stdout:240518168625 2024-05-09T05:36:14.850 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-05-09T05:36:15.343 INFO:teuthology.orchestra.run.smithi039.stdout:184683593784 2024-05-09T05:36:15.344 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-05-09T05:36:15.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:36:15 smithi039 ceph-mon[30439]: pgmap v336: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-05-09T05:36:15.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:36:15 smithi100 ceph-mon[34353]: pgmap v336: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-05-09T05:36:15.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:36:15 smithi060 ceph-mon[34555]: pgmap v336: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-05-09T05:36:16.596 INFO:teuthology.orchestra.run.smithi039.stdout:266287972395 2024-05-09T05:36:16.596 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-05-09T05:36:16.817 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:16.823+0000 7f5a5298f700 1 -- 172.21.15.39:0/1941753693 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5a4c107df0 msgr2=0x7f5a4c108200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:16.817 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:16.823+0000 7f5a5298f700 1 --2- 172.21.15.39:0/1941753693 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5a4c107df0 0x7f5a4c108200 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f5a400099c0 tx=0x7f5a40009cd0 comp rx=0 tx=0).stop 2024-05-09T05:36:16.817 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:16.823+0000 7f5a5298f700 1 -- 172.21.15.39:0/1941753693 shutdown_connections 2024-05-09T05:36:16.817 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:16.823+0000 7f5a5298f700 1 --2- 172.21.15.39:0/1941753693 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a4c108740 0x7f5a4c1100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:16.817 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:16.823+0000 7f5a5298f700 1 --2- 172.21.15.39:0/1941753693 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5a4c1034c0 0x7f5a4c1038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:16.817 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:16.823+0000 7f5a5298f700 1 --2- 172.21.15.39:0/1941753693 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5a4c107df0 0x7f5a4c108200 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:16.817 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:16.823+0000 7f5a5298f700 1 -- 172.21.15.39:0/1941753693 >> 172.21.15.39:0/1941753693 conn(0x7f5a4c0fedc0 msgr2=0x7f5a4c1011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:36:16.817 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:16.823+0000 7f5a5298f700 1 -- 172.21.15.39:0/1941753693 shutdown_connections 2024-05-09T05:36:16.817 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:16.823+0000 7f5a5298f700 1 -- 172.21.15.39:0/1941753693 wait complete. 2024-05-09T05:36:16.819 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:16.824+0000 7f5a5298f700 1 Processor -- start 2024-05-09T05:36:16.819 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:16.824+0000 7f5a5298f700 1 -- start start 2024-05-09T05:36:16.819 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:16.824+0000 7f5a5298f700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a4c1034c0 0x7f5a4c1a7070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:16.819 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:16.824+0000 7f5a5298f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5a4c107df0 0x7f5a4c1a75b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:16.819 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:16.824+0000 7f5a5298f700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5a4c108740 0x7f5a4c1a1240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:16.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:16.824+0000 7f5a5298f700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f5a4c113350 con 0x7f5a4c108740 2024-05-09T05:36:16.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:16.824+0000 7f5a5298f700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f5a4c1131d0 con 0x7f5a4c107df0 2024-05-09T05:36:16.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:16.824+0000 7f5a5298f700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f5a4c1134d0 con 0x7f5a4c1034c0 2024-05-09T05:36:16.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:16.824+0000 7f5a50f2c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5a4c108740 0x7f5a4c1a1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:16.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:16.824+0000 7f5a50f2c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5a4c108740 0x7f5a4c1a1240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54396/0 (socket says 172.21.15.39:54396) 2024-05-09T05:36:16.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:16.824+0000 7f5a50f2c700 1 -- 172.21.15.39:0/2671869366 learned_addr learned my addr 172.21.15.39:0/2671869366 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:36:16.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:16.825+0000 7f5a4bfff700 1 --2- 172.21.15.39:0/2671869366 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a4c1034c0 0x7f5a4c1a7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:16.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:16.825+0000 7f5a4b7fe700 1 --2- 172.21.15.39:0/2671869366 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5a4c107df0 0x7f5a4c1a75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:16.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:16.825+0000 7f5a50f2c700 1 -- 172.21.15.39:0/2671869366 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a4c1034c0 msgr2=0x7f5a4c1a7070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:16.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:16.825+0000 7f5a50f2c700 1 --2- 172.21.15.39:0/2671869366 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a4c1034c0 0x7f5a4c1a7070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:16.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:16.825+0000 7f5a50f2c700 1 -- 172.21.15.39:0/2671869366 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5a4c107df0 msgr2=0x7f5a4c1a75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:16.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:16.825+0000 7f5a50f2c700 1 --2- 172.21.15.39:0/2671869366 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5a4c107df0 0x7f5a4c1a75b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:16.821 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:16.825+0000 7f5a50f2c700 1 -- 172.21.15.39:0/2671869366 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a4c1a1940 con 0x7f5a4c108740 2024-05-09T05:36:16.821 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:16.825+0000 7f5a4b7fe700 1 --2- 172.21.15.39:0/2671869366 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5a4c107df0 0x7f5a4c1a75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:36:16.821 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:16.825+0000 7f5a50f2c700 1 --2- 172.21.15.39:0/2671869366 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5a4c108740 0x7f5a4c1a1240 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f5a4400ef30 tx=0x7f5a4400c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:36:16.821 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:16.825+0000 7f5a497fa700 1 -- 172.21.15.39:0/2671869366 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a440092e0 con 0x7f5a4c108740 2024-05-09T05:36:16.821 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:16.825+0000 7f5a497fa700 1 -- 172.21.15.39:0/2671869366 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5a44004bb0 con 0x7f5a4c108740 2024-05-09T05:36:16.821 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:16.825+0000 7f5a5298f700 1 -- 172.21.15.39:0/2671869366 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a4c1a1bd0 con 0x7f5a4c108740 2024-05-09T05:36:16.821 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:16.825+0000 7f5a497fa700 1 -- 172.21.15.39:0/2671869366 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a44004280 con 0x7f5a4c108740 2024-05-09T05:36:16.822 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:16.825+0000 7f5a5298f700 1 -- 172.21.15.39:0/2671869366 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a4c1ade90 con 0x7f5a4c108740 2024-05-09T05:36:16.822 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:16.826+0000 7f5a5298f700 1 -- 172.21.15.39:0/2671869366 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5a4c1014f0 con 0x7f5a4c108740 2024-05-09T05:36:16.822 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:16.828+0000 7f5a497fa700 1 -- 172.21.15.39:0/2671869366 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f5a4401b030 con 0x7f5a4c108740 2024-05-09T05:36:16.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:16.829+0000 7f5a497fa700 1 --2- 172.21.15.39:0/2671869366 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f5a340b2990 0x7f5a340b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:16.824 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:16.829+0000 7f5a4bfff700 1 --2- 172.21.15.39:0/2671869366 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f5a340b2990 0x7f5a340b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:16.824 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:16.829+0000 7f5a497fa700 1 -- 172.21.15.39:0/2671869366 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f5a440e2c70 con 0x7f5a4c108740 2024-05-09T05:36:16.824 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:16.830+0000 7f5a497fa700 1 --2- 172.21.15.39:0/2671869366 >> [v2:172.21.15.60:6816/2718201647,v1:172.21.15.60:6817/2718201647] conn(0x7f5a340bc580 0x7f5a340bea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:16.824 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:16.830+0000 7f5a497fa700 1 -- 172.21.15.39:0/2671869366 --> [v2:172.21.15.60:6816/2718201647,v1:172.21.15.60:6817/2718201647] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5a340bf140 con 0x7f5a340bc580 2024-05-09T05:36:16.824 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:16.830+0000 7f5a497fa700 1 -- 172.21.15.39:0/2671869366 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f5a440e30c0 con 0x7f5a4c108740 2024-05-09T05:36:16.824 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:16.830+0000 7f5a4bfff700 1 --2- 172.21.15.39:0/2671869366 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f5a340b2990 0x7f5a340b4ea0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c005fd0 tx=0x7f5a3c005f60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:36:16.824 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:16.830+0000 7f5a4b7fe700 1 --2- 172.21.15.39:0/2671869366 >> [v2:172.21.15.60:6816/2718201647,v1:172.21.15.60:6817/2718201647] conn(0x7f5a340bc580 0x7f5a340bea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:16.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:16.830+0000 7f5a4b7fe700 1 --2- 172.21.15.39:0/2671869366 >> [v2:172.21.15.60:6816/2718201647,v1:172.21.15.60:6817/2718201647] conn(0x7f5a340bc580 0x7f5a340bea70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:36:16.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:16.831+0000 7f5a497fa700 1 -- 172.21.15.39:0/2671869366 <== osd.7 v2:172.21.15.60:6816/2718201647 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5a340bf140 con 0x7f5a340bc580 2024-05-09T05:36:16.842 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:16.848+0000 7f5a5298f700 1 -- 172.21.15.39:0/2671869366 --> [v2:172.21.15.60:6816/2718201647,v1:172.21.15.60:6817/2718201647] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5a4c104970 con 0x7f5a340bc580 2024-05-09T05:36:16.842 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:16.849+0000 7f5a497fa700 1 -- 172.21.15.39:0/2671869366 <== osd.7 v2:172.21.15.60:6816/2718201647 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f5a4c104970 con 0x7f5a340bc580 2024-05-09T05:36:16.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:16.849+0000 7f5a5298f700 1 -- 172.21.15.39:0/2671869366 >> [v2:172.21.15.60:6816/2718201647,v1:172.21.15.60:6817/2718201647] conn(0x7f5a340bc580 msgr2=0x7f5a340bea70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:16.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:16.849+0000 7f5a5298f700 1 --2- 172.21.15.39:0/2671869366 >> [v2:172.21.15.60:6816/2718201647,v1:172.21.15.60:6817/2718201647] conn(0x7f5a340bc580 0x7f5a340bea70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:16.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:16.849+0000 7f5a5298f700 1 -- 172.21.15.39:0/2671869366 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f5a340b2990 msgr2=0x7f5a340b4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:16.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:16.849+0000 7f5a5298f700 1 --2- 172.21.15.39:0/2671869366 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f5a340b2990 0x7f5a340b4ea0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c005fd0 tx=0x7f5a3c005f60 comp rx=0 tx=0).stop 2024-05-09T05:36:16.844 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:16.849+0000 7f5a5298f700 1 -- 172.21.15.39:0/2671869366 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5a4c108740 msgr2=0x7f5a4c1a1240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:16.844 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:16.849+0000 7f5a5298f700 1 --2- 172.21.15.39:0/2671869366 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5a4c108740 0x7f5a4c1a1240 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f5a4400ef30 tx=0x7f5a4400c450 comp rx=0 tx=0).stop 2024-05-09T05:36:16.844 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:16.849+0000 7f5a50f2c700 1 -- 172.21.15.39:0/2671869366 reap_dead start 2024-05-09T05:36:16.844 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:16.849+0000 7f5a5298f700 1 -- 172.21.15.39:0/2671869366 shutdown_connections 2024-05-09T05:36:16.844 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:16.849+0000 7f5a5298f700 1 -- 172.21.15.39:0/2671869366 >> 172.21.15.39:0/2671869366 conn(0x7f5a4c0fedc0 msgr2=0x7f5a4c1096a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:36:16.844 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:16.849+0000 7f5a5298f700 1 -- 172.21.15.39:0/2671869366 shutdown_connections 2024-05-09T05:36:16.844 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:16.849+0000 7f5a5298f700 1 -- 172.21.15.39:0/2671869366 wait complete. 2024-05-09T05:36:17.158 INFO:teuthology.orchestra.run.smithi039.stdout:77309411406 2024-05-09T05:36:17.158 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-05-09T05:36:17.378 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:17.384+0000 7f76fb781700 1 -- 172.21.15.39:0/2328280489 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f76f4109870 msgr2=0x7f76f41111d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:17.378 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:17.384+0000 7f76fb781700 1 --2- 172.21.15.39:0/2328280489 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f76f4109870 0x7f76f41111d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f76ec00b0d0 tx=0x7f76ec00b3e0 comp rx=0 tx=0).stop 2024-05-09T05:36:17.378 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:17.384+0000 7f76fb781700 1 -- 172.21.15.39:0/2328280489 shutdown_connections 2024-05-09T05:36:17.378 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:17.384+0000 7f76fb781700 1 --2- 172.21.15.39:0/2328280489 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f76f4109870 0x7f76f41111d0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:17.378 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:17.384+0000 7f76fb781700 1 --2- 172.21.15.39:0/2328280489 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76f41045f0 0x7f76f4104a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:17.379 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:17.384+0000 7f76fb781700 1 --2- 172.21.15.39:0/2328280489 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76f4108f20 0x7f76f4109330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:17.379 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:17.384+0000 7f76fb781700 1 -- 172.21.15.39:0/2328280489 >> 172.21.15.39:0/2328280489 conn(0x7f76f4100040 msgr2=0x7f76f4102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:36:17.379 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:17.384+0000 7f76fb781700 1 -- 172.21.15.39:0/2328280489 shutdown_connections 2024-05-09T05:36:17.379 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:17.384+0000 7f76fb781700 1 -- 172.21.15.39:0/2328280489 wait complete. 2024-05-09T05:36:17.380 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:17.385+0000 7f76fb781700 1 Processor -- start 2024-05-09T05:36:17.380 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:17.385+0000 7f76fb781700 1 -- start start 2024-05-09T05:36:17.381 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:17.385+0000 7f76fb781700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f76f41045f0 0x7f76f419d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:17.381 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:17.385+0000 7f76fb781700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76f4108f20 0x7f76f419d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:17.381 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:17.385+0000 7f76fb781700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76f4109870 0x7f76f41a18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:17.381 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:17.385+0000 7f76fb781700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f76f41144a0 con 0x7f76f41045f0 2024-05-09T05:36:17.381 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:17.385+0000 7f76fb781700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f76f4114320 con 0x7f76f4109870 2024-05-09T05:36:17.381 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:17.385+0000 7f76fb781700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f76f4114620 con 0x7f76f4108f20 2024-05-09T05:36:17.381 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:17.385+0000 7f76f951d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f76f41045f0 0x7f76f419d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:17.381 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:17.386+0000 7f76f951d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f76f41045f0 0x7f76f419d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54402/0 (socket says 172.21.15.39:54402) 2024-05-09T05:36:17.381 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:17.386+0000 7f76f951d700 1 -- 172.21.15.39:0/3783903259 learned_addr learned my addr 172.21.15.39:0/3783903259 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:36:17.381 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:17.386+0000 7f76f8d1c700 1 --2- 172.21.15.39:0/3783903259 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76f4108f20 0x7f76f419d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:17.381 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:17.386+0000 7f76f9d1e700 1 --2- 172.21.15.39:0/3783903259 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76f4109870 0x7f76f41a18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:17.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:17.386+0000 7f76f951d700 1 -- 172.21.15.39:0/3783903259 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76f4108f20 msgr2=0x7f76f419d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:17.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:17.386+0000 7f76f951d700 1 --2- 172.21.15.39:0/3783903259 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76f4108f20 0x7f76f419d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:17.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:17.386+0000 7f76f951d700 1 -- 172.21.15.39:0/3783903259 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76f4109870 msgr2=0x7f76f41a18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:17.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:17.386+0000 7f76f951d700 1 --2- 172.21.15.39:0/3783903259 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76f4109870 0x7f76f41a18c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:17.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:17.386+0000 7f76f951d700 1 -- 172.21.15.39:0/3783903259 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76f41a1eb0 con 0x7f76f41045f0 2024-05-09T05:36:17.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:17.386+0000 7f76f9d1e700 1 --2- 172.21.15.39:0/3783903259 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76f4109870 0x7f76f41a18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T05:36:17.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:17.386+0000 7f76f951d700 1 --2- 172.21.15.39:0/3783903259 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f76f41045f0 0x7f76f419d090 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f76f000d950 tx=0x7f76f000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:36:17.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:17.386+0000 7f76ea7fc700 1 -- 172.21.15.39:0/3783903259 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76f0016070 con 0x7f76f41045f0 2024-05-09T05:36:17.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:17.386+0000 7f76ea7fc700 1 -- 172.21.15.39:0/3783903259 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f76f0009df0 con 0x7f76f41045f0 2024-05-09T05:36:17.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:17.386+0000 7f76fb781700 1 -- 172.21.15.39:0/3783903259 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76f41a21a0 con 0x7f76f41045f0 2024-05-09T05:36:17.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:17.386+0000 7f76ea7fc700 1 -- 172.21.15.39:0/3783903259 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76f000f3c0 con 0x7f76f41045f0 2024-05-09T05:36:17.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:17.387+0000 7f76fb781700 1 -- 172.21.15.39:0/3783903259 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76f41a26e0 con 0x7f76f41045f0 2024-05-09T05:36:17.383 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:17.387+0000 7f76fb781700 1 -- 172.21.15.39:0/3783903259 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f76f4076cd0 con 0x7f76f41045f0 2024-05-09T05:36:17.383 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:36:17 smithi039 ceph-mon[30439]: pgmap v337: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-05-09T05:36:17.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:17.389+0000 7f76ea7fc700 1 -- 172.21.15.39:0/3783903259 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f76f0019070 con 0x7f76f41045f0 2024-05-09T05:36:17.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:17.390+0000 7f76ea7fc700 1 --2- 172.21.15.39:0/3783903259 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f76e00b2910 0x7f76e00b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:17.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:17.390+0000 7f76f8d1c700 1 --2- 172.21.15.39:0/3783903259 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f76e00b2910 0x7f76e00b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:17.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:17.390+0000 7f76ea7fc700 1 -- 172.21.15.39:0/3783903259 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f76f00e2540 con 0x7f76f41045f0 2024-05-09T05:36:17.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:17.391+0000 7f76ea7fc700 1 --2- 172.21.15.39:0/3783903259 >> [v2:172.21.15.39:6810/2254197543,v1:172.21.15.39:6811/2254197543] conn(0x7f76e00bc500 0x7f76e00be9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:17.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:17.391+0000 7f76ea7fc700 1 -- 172.21.15.39:0/3783903259 --> [v2:172.21.15.39:6810/2254197543,v1:172.21.15.39:6811/2254197543] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f76e00bf0c0 con 0x7f76e00bc500 2024-05-09T05:36:17.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:17.391+0000 7f76ea7fc700 1 -- 172.21.15.39:0/3783903259 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f76f00e2990 con 0x7f76f41045f0 2024-05-09T05:36:17.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:17.391+0000 7f76f8d1c700 1 --2- 172.21.15.39:0/3783903259 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f76e00b2910 0x7f76e00b4e20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f76f410a8f0 tx=0x7f76e400a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:36:17.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:17.391+0000 7f76f9d1e700 1 --2- 172.21.15.39:0/3783903259 >> [v2:172.21.15.39:6810/2254197543,v1:172.21.15.39:6811/2254197543] conn(0x7f76e00bc500 0x7f76e00be9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:17.386 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:17.391+0000 7f76f9d1e700 1 --2- 172.21.15.39:0/3783903259 >> [v2:172.21.15.39:6810/2254197543,v1:172.21.15.39:6811/2254197543] conn(0x7f76e00bc500 0x7f76e00be9f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:36:17.386 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:17.392+0000 7f76ea7fc700 1 -- 172.21.15.39:0/3783903259 <== osd.3 v2:172.21.15.39:6810/2254197543 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f76e00bf0c0 con 0x7f76e00bc500 2024-05-09T05:36:17.408 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:17.415+0000 7f76fb781700 1 -- 172.21.15.39:0/3783903259 --> [v2:172.21.15.39:6810/2254197543,v1:172.21.15.39:6811/2254197543] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f76f4105aa0 con 0x7f76e00bc500 2024-05-09T05:36:17.409 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:17.415+0000 7f76ea7fc700 1 -- 172.21.15.39:0/3783903259 <== osd.3 v2:172.21.15.39:6810/2254197543 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f76f4105aa0 con 0x7f76e00bc500 2024-05-09T05:36:17.409 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:17.415+0000 7f76fb781700 1 -- 172.21.15.39:0/3783903259 >> [v2:172.21.15.39:6810/2254197543,v1:172.21.15.39:6811/2254197543] conn(0x7f76e00bc500 msgr2=0x7f76e00be9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:17.410 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:17.415+0000 7f76fb781700 1 --2- 172.21.15.39:0/3783903259 >> [v2:172.21.15.39:6810/2254197543,v1:172.21.15.39:6811/2254197543] conn(0x7f76e00bc500 0x7f76e00be9f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:17.410 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:17.416+0000 7f76fb781700 1 -- 172.21.15.39:0/3783903259 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f76e00b2910 msgr2=0x7f76e00b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:17.410 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:17.416+0000 7f76fb781700 1 --2- 172.21.15.39:0/3783903259 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f76e00b2910 0x7f76e00b4e20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f76f410a8f0 tx=0x7f76e400a380 comp rx=0 tx=0).stop 2024-05-09T05:36:17.410 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:17.416+0000 7f76fb781700 1 -- 172.21.15.39:0/3783903259 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f76f41045f0 msgr2=0x7f76f419d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:17.410 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:17.416+0000 7f76fb781700 1 --2- 172.21.15.39:0/3783903259 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f76f41045f0 0x7f76f419d090 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f76f000d950 tx=0x7f76f000dc60 comp rx=0 tx=0).stop 2024-05-09T05:36:17.410 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:17.416+0000 7f76f9d1e700 1 -- 172.21.15.39:0/3783903259 reap_dead start 2024-05-09T05:36:17.410 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:17.416+0000 7f76fb781700 1 -- 172.21.15.39:0/3783903259 shutdown_connections 2024-05-09T05:36:17.410 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:17.416+0000 7f76fb781700 1 -- 172.21.15.39:0/3783903259 >> 172.21.15.39:0/3783903259 conn(0x7f76f4100040 msgr2=0x7f76f4110d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:36:17.410 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:17.416+0000 7f76fb781700 1 -- 172.21.15.39:0/3783903259 shutdown_connections 2024-05-09T05:36:17.410 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:17.416+0000 7f76fb781700 1 -- 172.21.15.39:0/3783903259 wait complete. 2024-05-09T05:36:17.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:36:17 smithi100 ceph-mon[34353]: pgmap v337: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-05-09T05:36:17.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:36:17 smithi060 ceph-mon[34555]: pgmap v337: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-05-09T05:36:18.595 INFO:teuthology.orchestra.run.smithi039.stdout:210453397558 2024-05-09T05:36:18.596 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-05-09T05:36:19.076 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T05:36:19.115 INFO:teuthology.orchestra.run.smithi039.stdout:107374182474 2024-05-09T05:36:19.116 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-05-09T05:36:19.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:36:19 smithi100 ceph-mon[34353]: pgmap v338: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-09T05:36:19.710 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:36:19 smithi039 ceph-mon[30439]: pgmap v338: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-09T05:36:19.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:19.733+0000 7f189ae5f700 1 -- 172.21.15.39:0/3580547008 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1894109870 msgr2=0x7f18941111d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:19.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:19.733+0000 7f189ae5f700 1 --2- 172.21.15.39:0/3580547008 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1894109870 0x7f18941111d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f188c00b0d0 tx=0x7f188c00b3e0 comp rx=0 tx=0).stop 2024-05-09T05:36:19.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:19.734+0000 7f189ae5f700 1 -- 172.21.15.39:0/3580547008 shutdown_connections 2024-05-09T05:36:19.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:19.734+0000 7f189ae5f700 1 --2- 172.21.15.39:0/3580547008 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1894109870 0x7f18941111d0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:19.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:19.734+0000 7f189ae5f700 1 --2- 172.21.15.39:0/3580547008 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18941045f0 0x7f1894104a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:19.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:19.734+0000 7f189ae5f700 1 --2- 172.21.15.39:0/3580547008 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1894108f20 0x7f1894109330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:19.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:19.734+0000 7f189ae5f700 1 -- 172.21.15.39:0/3580547008 >> 172.21.15.39:0/3580547008 conn(0x7f1894100040 msgr2=0x7f1894102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:36:19.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:19.734+0000 7f189ae5f700 1 -- 172.21.15.39:0/3580547008 shutdown_connections 2024-05-09T05:36:19.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:19.734+0000 7f189ae5f700 1 -- 172.21.15.39:0/3580547008 wait complete. 2024-05-09T05:36:19.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:19.734+0000 7f189ae5f700 1 Processor -- start 2024-05-09T05:36:19.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:19.734+0000 7f189ae5f700 1 -- start start 2024-05-09T05:36:19.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:19.735+0000 7f189ae5f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18941045f0 0x7f1894075ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:19.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:19.735+0000 7f189ae5f700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1894108f20 0x7f1894076000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:19.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:19.735+0000 7f189ae5f700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1894109870 0x7f1894076540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:19.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:19.735+0000 7f189ae5f700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f1894114590 con 0x7f1894109870 2024-05-09T05:36:19.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:19.735+0000 7f189ae5f700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f1894114410 con 0x7f18941045f0 2024-05-09T05:36:19.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:19.735+0000 7f189ae5f700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1894114710 con 0x7f1894108f20 2024-05-09T05:36:19.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:19.735+0000 7f18993fc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1894109870 0x7f1894076540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:19.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:19.735+0000 7f18993fc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1894109870 0x7f1894076540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54424/0 (socket says 172.21.15.39:54424) 2024-05-09T05:36:19.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:19.735+0000 7f18993fc700 1 -- 172.21.15.39:0/2797405989 learned_addr learned my addr 172.21.15.39:0/2797405989 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:36:19.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:19.735+0000 7f1898bfb700 1 --2- 172.21.15.39:0/2797405989 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18941045f0 0x7f1894075ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:19.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:19.735+0000 7f1893fff700 1 --2- 172.21.15.39:0/2797405989 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1894108f20 0x7f1894076000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:19.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:19.735+0000 7f18993fc700 1 -- 172.21.15.39:0/2797405989 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1894108f20 msgr2=0x7f1894076000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:19.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:19.735+0000 7f18993fc700 1 --2- 172.21.15.39:0/2797405989 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1894108f20 0x7f1894076000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:19.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:19.735+0000 7f18993fc700 1 -- 172.21.15.39:0/2797405989 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18941045f0 msgr2=0x7f1894075ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:19.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:19.735+0000 7f18993fc700 1 --2- 172.21.15.39:0/2797405989 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18941045f0 0x7f1894075ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:19.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:19.735+0000 7f18993fc700 1 -- 172.21.15.39:0/2797405989 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18941a92e0 con 0x7f1894109870 2024-05-09T05:36:19.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:19.735+0000 7f18993fc700 1 --2- 172.21.15.39:0/2797405989 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1894109870 0x7f1894076540 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f188c009fd0 tx=0x7f188c007a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:36:19.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:19.736+0000 7f1891ffb700 1 -- 172.21.15.39:0/2797405989 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f188c01f070 con 0x7f1894109870 2024-05-09T05:36:19.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:19.736+0000 7f189ae5f700 1 -- 172.21.15.39:0/2797405989 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18941a9570 con 0x7f1894109870 2024-05-09T05:36:19.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:19.736+0000 7f1891ffb700 1 -- 172.21.15.39:0/2797405989 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f188c003c00 con 0x7f1894109870 2024-05-09T05:36:19.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:19.736+0000 7f1891ffb700 1 -- 172.21.15.39:0/2797405989 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f188c01b7b0 con 0x7f1894109870 2024-05-09T05:36:19.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:19.736+0000 7f189ae5f700 1 -- 172.21.15.39:0/2797405989 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18941a99c0 con 0x7f1894109870 2024-05-09T05:36:19.733 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:19.737+0000 7f189ae5f700 1 -- 172.21.15.39:0/2797405989 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1894063ed0 con 0x7f1894109870 2024-05-09T05:36:19.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:19.738+0000 7f1891ffb700 1 -- 172.21.15.39:0/2797405989 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f188c022070 con 0x7f1894109870 2024-05-09T05:36:19.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:19.739+0000 7f1891ffb700 1 --2- 172.21.15.39:0/2797405989 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f18840b2910 0x7f18840b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:19.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:19.739+0000 7f1898bfb700 1 --2- 172.21.15.39:0/2797405989 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f18840b2910 0x7f18840b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:19.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:19.739+0000 7f1891ffb700 1 -- 172.21.15.39:0/2797405989 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f188c00f020 con 0x7f1894109870 2024-05-09T05:36:19.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:19.740+0000 7f1891ffb700 1 --2- 172.21.15.39:0/2797405989 >> [v2:172.21.15.100:6808/658409226,v1:172.21.15.100:6809/658409226] conn(0x7f18840bc4a0 0x7f18840be990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:19.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:19.740+0000 7f1891ffb700 1 -- 172.21.15.39:0/2797405989 --> [v2:172.21.15.100:6808/658409226,v1:172.21.15.100:6809/658409226] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f188c0075c0 con 0x7f18840bc4a0 2024-05-09T05:36:19.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:19.740+0000 7f1891ffb700 1 -- 172.21.15.39:0/2797405989 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f188c0e3ca0 con 0x7f1894109870 2024-05-09T05:36:19.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:19.740+0000 7f1898bfb700 1 --2- 172.21.15.39:0/2797405989 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f18840b2910 0x7f18840b4e20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1888009a10 tx=0x7f1888009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:36:19.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:19.740+0000 7f1893fff700 1 --2- 172.21.15.39:0/2797405989 >> [v2:172.21.15.100:6808/658409226,v1:172.21.15.100:6809/658409226] conn(0x7f18840bc4a0 0x7f18840be990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:19.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:19.741+0000 7f1893fff700 1 --2- 172.21.15.39:0/2797405989 >> [v2:172.21.15.100:6808/658409226,v1:172.21.15.100:6809/658409226] conn(0x7f18840bc4a0 0x7f18840be990 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:36:19.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:19.741+0000 7f1891ffb700 1 -- 172.21.15.39:0/2797405989 <== osd.5 v2:172.21.15.100:6808/658409226 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f188c0075c0 con 0x7f18840bc4a0 2024-05-09T05:36:19.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:19.758+0000 7f189ae5f700 1 -- 172.21.15.39:0/2797405989 --> [v2:172.21.15.100:6808/658409226,v1:172.21.15.100:6809/658409226] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f18940642d0 con 0x7f18840bc4a0 2024-05-09T05:36:19.753 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:19.759+0000 7f1891ffb700 1 -- 172.21.15.39:0/2797405989 <== osd.5 v2:172.21.15.100:6808/658409226 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f18940642d0 con 0x7f18840bc4a0 2024-05-09T05:36:19.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:19.759+0000 7f189ae5f700 1 -- 172.21.15.39:0/2797405989 >> [v2:172.21.15.100:6808/658409226,v1:172.21.15.100:6809/658409226] conn(0x7f18840bc4a0 msgr2=0x7f18840be990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:19.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:19.759+0000 7f189ae5f700 1 --2- 172.21.15.39:0/2797405989 >> [v2:172.21.15.100:6808/658409226,v1:172.21.15.100:6809/658409226] conn(0x7f18840bc4a0 0x7f18840be990 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:19.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:19.759+0000 7f189ae5f700 1 -- 172.21.15.39:0/2797405989 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f18840b2910 msgr2=0x7f18840b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:19.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:19.759+0000 7f189ae5f700 1 --2- 172.21.15.39:0/2797405989 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f18840b2910 0x7f18840b4e20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1888009a10 tx=0x7f1888009190 comp rx=0 tx=0).stop 2024-05-09T05:36:19.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:19.759+0000 7f189ae5f700 1 -- 172.21.15.39:0/2797405989 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1894109870 msgr2=0x7f1894076540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:19.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:19.759+0000 7f189ae5f700 1 --2- 172.21.15.39:0/2797405989 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1894109870 0x7f1894076540 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f188c009fd0 tx=0x7f188c007a20 comp rx=0 tx=0).stop 2024-05-09T05:36:19.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:19.759+0000 7f18993fc700 1 -- 172.21.15.39:0/2797405989 reap_dead start 2024-05-09T05:36:19.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:19.759+0000 7f189ae5f700 1 -- 172.21.15.39:0/2797405989 shutdown_connections 2024-05-09T05:36:19.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:19.760+0000 7f189ae5f700 1 -- 172.21.15.39:0/2797405989 >> 172.21.15.39:0/2797405989 conn(0x7f1894100040 msgr2=0x7f1894108690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:36:19.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:19.760+0000 7f189ae5f700 1 -- 172.21.15.39:0/2797405989 shutdown_connections 2024-05-09T05:36:19.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:19.760+0000 7f189ae5f700 1 -- 172.21.15.39:0/2797405989 wait complete. 2024-05-09T05:36:19.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:36:19 smithi060 ceph-mon[34555]: pgmap v338: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-09T05:36:20.394 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T05:36:20.403 INFO:teuthology.orchestra.run.smithi039.stdout:158913790017 2024-05-09T05:36:20.404 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-05-09T05:36:20.622 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T05:36:20.632 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T05:36:20.634 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T05:36:21.579 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:36:21 smithi039 ceph-mon[30439]: pgmap v339: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-09T05:36:21.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:36:21 smithi100 ceph-mon[34353]: pgmap v339: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-09T05:36:21.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:36:21 smithi060 ceph-mon[34555]: pgmap v339: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-09T05:36:23.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:36:23 smithi039 ceph-mon[30439]: pgmap v340: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-09T05:36:23.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:36:23 smithi100 ceph-mon[34353]: pgmap v340: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-09T05:36:23.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:36:23 smithi060 ceph-mon[34555]: pgmap v340: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-09T05:36:24.071 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T05:36:24.074 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T05:36:24.080 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T05:36:24.080 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T05:36:24.714 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T05:36:24.727 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T05:36:25.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:25.060+0000 7f6dde1d0700 1 -- 172.21.15.39:0/390347154 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6dd81029c0 msgr2=0x7f6dd8102dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:25.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:25.060+0000 7f6dde1d0700 1 --2- 172.21.15.39:0/390347154 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6dd81029c0 0x7f6dd8102dd0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc00aaa0 tx=0x7f6dcc00adb0 comp rx=0 tx=0).stop 2024-05-09T05:36:25.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:25.060+0000 7f6dde1d0700 1 -- 172.21.15.39:0/390347154 shutdown_connections 2024-05-09T05:36:25.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:25.060+0000 7f6dde1d0700 1 --2- 172.21.15.39:0/390347154 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6dd8103310 0x7f6dd810f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:25.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:25.060+0000 7f6dde1d0700 1 --2- 172.21.15.39:0/390347154 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6dd81089f0 0x7f6dd8108e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:25.055 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:25.060+0000 7f6dde1d0700 1 --2- 172.21.15.39:0/390347154 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6dd81029c0 0x7f6dd8102dd0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:25.055 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:25.060+0000 7f6dde1d0700 1 -- 172.21.15.39:0/390347154 >> 172.21.15.39:0/390347154 conn(0x7f6dd80fe520 msgr2=0x7f6dd8100970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:36:25.055 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:25.060+0000 7f6dde1d0700 1 -- 172.21.15.39:0/390347154 shutdown_connections 2024-05-09T05:36:25.055 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:25.060+0000 7f6dde1d0700 1 -- 172.21.15.39:0/390347154 wait complete. 2024-05-09T05:36:25.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:25.061+0000 7f6dde1d0700 1 Processor -- start 2024-05-09T05:36:25.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:25.061+0000 7f6dde1d0700 1 -- start start 2024-05-09T05:36:25.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:25.061+0000 7f6dde1d0700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6dd81029c0 0x7f6dd819ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:25.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:25.061+0000 7f6dde1d0700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6dd8103310 0x7f6dd819b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:25.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:25.061+0000 7f6dde1d0700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6dd81089f0 0x7f6dd819f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:25.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:25.061+0000 7f6dde1d0700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f6dd81122e0 con 0x7f6dd81029c0 2024-05-09T05:36:25.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:25.061+0000 7f6dde1d0700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6dd8112160 con 0x7f6dd8103310 2024-05-09T05:36:25.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:25.061+0000 7f6dde1d0700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6dd8112460 con 0x7f6dd81089f0 2024-05-09T05:36:25.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:25.062+0000 7f6dd77fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6dd81029c0 0x7f6dd819ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:25.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:25.062+0000 7f6dd77fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6dd81029c0 0x7f6dd819ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54430/0 (socket says 172.21.15.39:54430) 2024-05-09T05:36:25.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:25.062+0000 7f6dd77fe700 1 -- 172.21.15.39:0/1095283312 learned_addr learned my addr 172.21.15.39:0/1095283312 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:36:25.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:25.062+0000 7f6dd6ffd700 1 --2- 172.21.15.39:0/1095283312 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6dd8103310 0x7f6dd819b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:25.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:25.062+0000 7f6dd7fff700 1 --2- 172.21.15.39:0/1095283312 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6dd81089f0 0x7f6dd819f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:25.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:25.062+0000 7f6dd77fe700 1 -- 172.21.15.39:0/1095283312 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6dd81089f0 msgr2=0x7f6dd819f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:25.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:25.062+0000 7f6dd77fe700 1 --2- 172.21.15.39:0/1095283312 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6dd81089f0 0x7f6dd819f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:25.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:25.062+0000 7f6dd77fe700 1 -- 172.21.15.39:0/1095283312 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6dd8103310 msgr2=0x7f6dd819b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:25.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:25.062+0000 7f6dd77fe700 1 --2- 172.21.15.39:0/1095283312 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6dd8103310 0x7f6dd819b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:25.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:25.062+0000 7f6dd77fe700 1 -- 172.21.15.39:0/1095283312 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dd819fd40 con 0x7f6dd81029c0 2024-05-09T05:36:25.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:25.062+0000 7f6dd77fe700 1 --2- 172.21.15.39:0/1095283312 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6dd81029c0 0x7f6dd819ae70 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6dc800c970 tx=0x7f6dc800cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:36:25.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:25.062+0000 7f6dd4ff9700 1 -- 172.21.15.39:0/1095283312 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc8007b00 con 0x7f6dd81029c0 2024-05-09T05:36:25.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:25.062+0000 7f6dd4ff9700 1 -- 172.21.15.39:0/1095283312 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6dc8004ce0 con 0x7f6dd81029c0 2024-05-09T05:36:25.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:25.062+0000 7f6dde1d0700 1 -- 172.21.15.39:0/1095283312 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6dd81a0030 con 0x7f6dd81029c0 2024-05-09T05:36:25.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:25.062+0000 7f6dd4ff9700 1 -- 172.21.15.39:0/1095283312 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc80055a0 con 0x7f6dd81029c0 2024-05-09T05:36:25.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:25.062+0000 7f6dde1d0700 1 -- 172.21.15.39:0/1095283312 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6dd81a7950 con 0x7f6dd81029c0 2024-05-09T05:36:25.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:25.063+0000 7f6dde1d0700 1 -- 172.21.15.39:0/1095283312 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6dd80512c0 con 0x7f6dd81029c0 2024-05-09T05:36:25.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:25.065+0000 7f6dd4ff9700 1 -- 172.21.15.39:0/1095283312 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f6dc8007ca0 con 0x7f6dd81029c0 2024-05-09T05:36:25.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:25.066+0000 7f6dd4ff9700 1 --2- 172.21.15.39:0/1095283312 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f6dc00b2990 0x7f6dc00b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:25.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:25.066+0000 7f6dd6ffd700 1 --2- 172.21.15.39:0/1095283312 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f6dc00b2990 0x7f6dc00b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:25.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:25.066+0000 7f6dd4ff9700 1 -- 172.21.15.39:0/1095283312 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f6dc80e23a0 con 0x7f6dd81029c0 2024-05-09T05:36:25.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:25.066+0000 7f6dd6ffd700 1 --2- 172.21.15.39:0/1095283312 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f6dc00b2990 0x7f6dc00b4ea0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6dd8108110 tx=0x7f6dcc00c650 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:36:25.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:25.069+0000 7f6dd4ff9700 1 -- 172.21.15.39:0/1095283312 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f6dc8014030 con 0x7f6dd81029c0 2024-05-09T05:36:25.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:25.287+0000 7f6dde1d0700 1 -- 172.21.15.39:0/1095283312 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f6dd819c1d0 con 0x7f6dd81029c0 2024-05-09T05:36:25.281 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:25.287+0000 7f6dd4ff9700 1 -- 172.21.15.39:0/1095283312 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f6dc80a9ff0 con 0x7f6dd81029c0 2024-05-09T05:36:25.281 INFO:teuthology.orchestra.run.smithi039.stdout:313532612642 2024-05-09T05:36:25.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:25.289+0000 7f6dde1d0700 1 -- 172.21.15.39:0/1095283312 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f6dc00b2990 msgr2=0x7f6dc00b4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:25.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:25.289+0000 7f6dde1d0700 1 --2- 172.21.15.39:0/1095283312 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f6dc00b2990 0x7f6dc00b4ea0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6dd8108110 tx=0x7f6dcc00c650 comp rx=0 tx=0).stop 2024-05-09T05:36:25.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:25.289+0000 7f6dde1d0700 1 -- 172.21.15.39:0/1095283312 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6dd81029c0 msgr2=0x7f6dd819ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:25.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:25.289+0000 7f6dde1d0700 1 --2- 172.21.15.39:0/1095283312 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6dd81029c0 0x7f6dd819ae70 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6dc800c970 tx=0x7f6dc800cd30 comp rx=0 tx=0).stop 2024-05-09T05:36:25.284 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:25.289+0000 7f6dde1d0700 1 -- 172.21.15.39:0/1095283312 shutdown_connections 2024-05-09T05:36:25.284 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:25.289+0000 7f6dde1d0700 1 --2- 172.21.15.39:0/1095283312 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f6dc00b2990 0x7f6dc00b4ea0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:25.284 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:25.289+0000 7f6dde1d0700 1 --2- 172.21.15.39:0/1095283312 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6dd81089f0 0x7f6dd819f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:25.284 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:25.289+0000 7f6dde1d0700 1 --2- 172.21.15.39:0/1095283312 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6dd81029c0 0x7f6dd819ae70 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:25.284 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:25.289+0000 7f6dde1d0700 1 --2- 172.21.15.39:0/1095283312 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6dd8103310 0x7f6dd819b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:25.284 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:25.289+0000 7f6dde1d0700 1 -- 172.21.15.39:0/1095283312 >> 172.21.15.39:0/1095283312 conn(0x7f6dd80fe520 msgr2=0x7f6dd8101120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:36:25.284 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:25.289+0000 7f6dde1d0700 1 -- 172.21.15.39:0/1095283312 shutdown_connections 2024-05-09T05:36:25.284 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:25.289+0000 7f6dde1d0700 1 -- 172.21.15.39:0/1095283312 wait complete. 2024-05-09T05:36:25.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:36:25 smithi039 ceph-mon[30439]: pgmap v341: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-05-09T05:36:25.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:36:25 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/1095283312' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-05-09T05:36:25.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:36:25 smithi100 ceph-mon[34353]: pgmap v341: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-05-09T05:36:25.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:36:25 smithi100 ceph-mon[34353]: from='client.? 172.21.15.39:0/1095283312' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-05-09T05:36:25.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:36:25 smithi060 ceph-mon[34555]: pgmap v341: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-05-09T05:36:25.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:36:25 smithi060 ceph-mon[34555]: from='client.? 172.21.15.39:0/1095283312' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-05-09T05:36:27.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:36:27 smithi039 ceph-mon[30439]: pgmap v342: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-09T05:36:27.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:36:27 smithi100 ceph-mon[34353]: pgmap v342: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-09T05:36:27.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:36:27 smithi060 ceph-mon[34555]: pgmap v342: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-09T05:36:29.264 INFO:tasks.cephadm.ceph_manager.ceph:need seq 313532612639 got 313532612642 for osd.11 2024-05-09T05:36:29.264 DEBUG:teuthology.parallel:result is None 2024-05-09T05:36:29.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:29.454+0000 7f3d06e13700 1 -- 172.21.15.39:0/2085278759 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3d001034c0 msgr2=0x7f3d001038d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:29.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:29.454+0000 7f3d06e13700 1 --2- 172.21.15.39:0/2085278759 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3d001034c0 0x7f3d001038d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f3cf00099c0 tx=0x7f3cf0009cd0 comp rx=0 tx=0).stop 2024-05-09T05:36:29.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:29.454+0000 7f3d06e13700 1 -- 172.21.15.39:0/2085278759 shutdown_connections 2024-05-09T05:36:29.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:29.454+0000 7f3d06e13700 1 --2- 172.21.15.39:0/2085278759 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d00108740 0x7f3d001100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:29.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:29.454+0000 7f3d06e13700 1 --2- 172.21.15.39:0/2085278759 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3d001034c0 0x7f3d001038d0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:29.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:29.454+0000 7f3d06e13700 1 --2- 172.21.15.39:0/2085278759 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d00107df0 0x7f3d00108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:29.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:29.454+0000 7f3d06e13700 1 -- 172.21.15.39:0/2085278759 >> 172.21.15.39:0/2085278759 conn(0x7f3d000fedf0 msgr2=0x7f3d00101210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:36:29.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:29.454+0000 7f3d06e13700 1 -- 172.21.15.39:0/2085278759 shutdown_connections 2024-05-09T05:36:29.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:29.454+0000 7f3d06e13700 1 -- 172.21.15.39:0/2085278759 wait complete. 2024-05-09T05:36:29.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:29.455+0000 7f3d06e13700 1 Processor -- start 2024-05-09T05:36:29.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:29.455+0000 7f3d06e13700 1 -- start start 2024-05-09T05:36:29.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:29.455+0000 7f3d06e13700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d001034c0 0x7f3d0019bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:29.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:29.455+0000 7f3d06e13700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d00107df0 0x7f3d0019c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:29.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:29.455+0000 7f3d06e13700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3d00108740 0x7f3d0019c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:29.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:29.455+0000 7f3d06e13700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f3d00113370 con 0x7f3d00108740 2024-05-09T05:36:29.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:29.455+0000 7f3d06e13700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f3d001131f0 con 0x7f3d00107df0 2024-05-09T05:36:29.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:29.455+0000 7f3d06e13700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3d001134f0 con 0x7f3d001034c0 2024-05-09T05:36:29.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:29.455+0000 7f3d053b0700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3d00108740 0x7f3d0019c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:29.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:29.455+0000 7f3d053b0700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3d00108740 0x7f3d0019c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45272/0 (socket says 172.21.15.39:45272) 2024-05-09T05:36:29.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:29.455+0000 7f3d053b0700 1 -- 172.21.15.39:0/2778496123 learned_addr learned my addr 172.21.15.39:0/2778496123 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:36:29.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:29.455+0000 7f3cf7fff700 1 --2- 172.21.15.39:0/2778496123 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d00107df0 0x7f3d0019c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:29.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:29.455+0000 7f3d04baf700 1 --2- 172.21.15.39:0/2778496123 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d001034c0 0x7f3d0019bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:29.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:29.456+0000 7f3d053b0700 1 -- 172.21.15.39:0/2778496123 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d001034c0 msgr2=0x7f3d0019bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:29.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:29.456+0000 7f3d053b0700 1 --2- 172.21.15.39:0/2778496123 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d001034c0 0x7f3d0019bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:29.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:29.456+0000 7f3d053b0700 1 -- 172.21.15.39:0/2778496123 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d00107df0 msgr2=0x7f3d0019c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:29.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:29.456+0000 7f3d053b0700 1 --2- 172.21.15.39:0/2778496123 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d00107df0 0x7f3d0019c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:29.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:29.456+0000 7f3d053b0700 1 -- 172.21.15.39:0/2778496123 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d001a6fc0 con 0x7f3d00108740 2024-05-09T05:36:29.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:29.456+0000 7f3d053b0700 1 --2- 172.21.15.39:0/2778496123 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3d00108740 0x7f3d0019c710 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f3cf800ef30 tx=0x7f3cf800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:36:29.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:29.456+0000 7f3cf5ffb700 1 -- 172.21.15.39:0/2778496123 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cf80092e0 con 0x7f3d00108740 2024-05-09T05:36:29.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:29.456+0000 7f3cf5ffb700 1 -- 172.21.15.39:0/2778496123 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3cf8004bb0 con 0x7f3d00108740 2024-05-09T05:36:29.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:29.456+0000 7f3d06e13700 1 -- 172.21.15.39:0/2778496123 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d001a7250 con 0x7f3d00108740 2024-05-09T05:36:29.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:29.456+0000 7f3cf5ffb700 1 -- 172.21.15.39:0/2778496123 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cf8004280 con 0x7f3d00108740 2024-05-09T05:36:29.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:29.456+0000 7f3d06e13700 1 -- 172.21.15.39:0/2778496123 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d001a7790 con 0x7f3d00108740 2024-05-09T05:36:29.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:29.457+0000 7f3d06e13700 1 -- 172.21.15.39:0/2778496123 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d000512c0 con 0x7f3d00108740 2024-05-09T05:36:29.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:29.459+0000 7f3cf5ffb700 1 -- 172.21.15.39:0/2778496123 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f3cf801b030 con 0x7f3d00108740 2024-05-09T05:36:29.453 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:29.460+0000 7f3cf5ffb700 1 --2- 172.21.15.39:0/2778496123 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f3ce80b2990 0x7f3ce80b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:29.453 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:29.460+0000 7f3d04baf700 1 --2- 172.21.15.39:0/2778496123 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f3ce80b2990 0x7f3ce80b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:29.453 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:29.460+0000 7f3cf5ffb700 1 -- 172.21.15.39:0/2778496123 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f3cf80e27d0 con 0x7f3d00108740 2024-05-09T05:36:29.454 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:29.460+0000 7f3d04baf700 1 --2- 172.21.15.39:0/2778496123 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f3ce80b2990 0x7f3ce80b4ea0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3cf0003760 tx=0x7f3cf001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:36:29.457 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:29.464+0000 7f3cf5ffb700 1 -- 172.21.15.39:0/2778496123 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f3cf8022020 con 0x7f3d00108740 2024-05-09T05:36:29.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:36:29 smithi100 ceph-mon[34353]: pgmap v343: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-09T05:36:29.682 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:29.688+0000 7f3d06e13700 1 -- 172.21.15.39:0/2778496123 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f3d0002e7b0 con 0x7f3d00108740 2024-05-09T05:36:29.682 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:36:29 smithi039 ceph-mon[30439]: pgmap v343: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-09T05:36:29.682 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:29.689+0000 7f3cf5ffb700 1 -- 172.21.15.39:0/2778496123 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f3cf8010040 con 0x7f3d00108740 2024-05-09T05:36:29.683 INFO:teuthology.orchestra.run.smithi039.stdout:133143986247 2024-05-09T05:36:29.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:29.691+0000 7f3d06e13700 1 -- 172.21.15.39:0/2778496123 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f3ce80b2990 msgr2=0x7f3ce80b4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:29.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:29.691+0000 7f3d06e13700 1 --2- 172.21.15.39:0/2778496123 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f3ce80b2990 0x7f3ce80b4ea0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3cf0003760 tx=0x7f3cf001a040 comp rx=0 tx=0).stop 2024-05-09T05:36:29.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:29.691+0000 7f3d06e13700 1 -- 172.21.15.39:0/2778496123 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3d00108740 msgr2=0x7f3d0019c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:29.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:29.691+0000 7f3d06e13700 1 --2- 172.21.15.39:0/2778496123 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3d00108740 0x7f3d0019c710 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f3cf800ef30 tx=0x7f3cf800c3a0 comp rx=0 tx=0).stop 2024-05-09T05:36:29.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:29.691+0000 7f3d06e13700 1 -- 172.21.15.39:0/2778496123 shutdown_connections 2024-05-09T05:36:29.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:29.691+0000 7f3d06e13700 1 --2- 172.21.15.39:0/2778496123 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f3ce80b2990 0x7f3ce80b4ea0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:29.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:29.691+0000 7f3d06e13700 1 --2- 172.21.15.39:0/2778496123 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3d00108740 0x7f3d0019c710 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:29.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:29.691+0000 7f3d06e13700 1 --2- 172.21.15.39:0/2778496123 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d001034c0 0x7f3d0019bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:29.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:29.691+0000 7f3d06e13700 1 --2- 172.21.15.39:0/2778496123 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d00107df0 0x7f3d0019c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:29.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:29.691+0000 7f3d06e13700 1 -- 172.21.15.39:0/2778496123 >> 172.21.15.39:0/2778496123 conn(0x7f3d000fedf0 msgr2=0x7f3d001070f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:36:29.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:29.692+0000 7f3d06e13700 1 -- 172.21.15.39:0/2778496123 shutdown_connections 2024-05-09T05:36:29.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:29.692+0000 7f3d06e13700 1 -- 172.21.15.39:0/2778496123 wait complete. 2024-05-09T05:36:29.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:36:29 smithi060 ceph-mon[34555]: pgmap v343: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-09T05:36:30.609 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:36:30 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/2778496123' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-05-09T05:36:30.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:36:30 smithi100 ceph-mon[34353]: from='client.? 172.21.15.39:0/2778496123' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-05-09T05:36:30.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:36:30 smithi060 ceph-mon[34555]: from='client.? 172.21.15.39:0/2778496123' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-05-09T05:36:31.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:36:31 smithi100 ceph-mon[34353]: pgmap v344: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-09T05:36:31.682 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:36:31 smithi039 ceph-mon[30439]: pgmap v344: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-09T05:36:31.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:36:31 smithi060 ceph-mon[34555]: pgmap v344: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-09T05:36:32.237 INFO:tasks.cephadm.ceph_manager.ceph:need seq 133143986242 got 133143986247 for osd.4 2024-05-09T05:36:32.237 DEBUG:teuthology.parallel:result is None 2024-05-09T05:36:32.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:32.443+0000 7f84990c1700 1 -- 172.21.15.39:0/214897740 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8494107e30 msgr2=0x7f8494108240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:32.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:32.443+0000 7f84990c1700 1 --2- 172.21.15.39:0/214897740 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8494107e30 0x7f8494108240 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f84880099c0 tx=0x7f8488009cd0 comp rx=0 tx=0).stop 2024-05-09T05:36:32.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:32.443+0000 7f84990c1700 1 -- 172.21.15.39:0/214897740 shutdown_connections 2024-05-09T05:36:32.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:32.443+0000 7f84990c1700 1 --2- 172.21.15.39:0/214897740 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8494108780 0x7f84941100e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:32.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:32.443+0000 7f84990c1700 1 --2- 172.21.15.39:0/214897740 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8494103550 0x7f8494103960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:32.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:32.443+0000 7f84990c1700 1 --2- 172.21.15.39:0/214897740 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8494107e30 0x7f8494108240 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:32.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:32.443+0000 7f84990c1700 1 -- 172.21.15.39:0/214897740 >> 172.21.15.39:0/214897740 conn(0x7f8494078e00 msgr2=0x7f8494079240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:36:32.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:32.443+0000 7f84990c1700 1 -- 172.21.15.39:0/214897740 shutdown_connections 2024-05-09T05:36:32.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:32.443+0000 7f84990c1700 1 -- 172.21.15.39:0/214897740 wait complete. 2024-05-09T05:36:32.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:32.444+0000 7f84990c1700 1 Processor -- start 2024-05-09T05:36:32.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:32.444+0000 7f84990c1700 1 -- start start 2024-05-09T05:36:32.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:32.445+0000 7f84990c1700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8494103550 0x7f849419bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:32.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:32.445+0000 7f84990c1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8494107e30 0x7f849419c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:32.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:32.445+0000 7f84990c1700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8494108780 0x7f849419c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:32.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:32.445+0000 7f84990c1700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f8494113400 con 0x7f8494108780 2024-05-09T05:36:32.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:32.445+0000 7f84990c1700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f8494113280 con 0x7f8494107e30 2024-05-09T05:36:32.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:32.445+0000 7f84990c1700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8494113580 con 0x7f8494103550 2024-05-09T05:36:32.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:32.445+0000 7f8492d9d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8494103550 0x7f849419bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:32.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:32.445+0000 7f849359e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8494108780 0x7f849419c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:32.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:32.445+0000 7f849259c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8494107e30 0x7f849419c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:32.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:32.445+0000 7f8492d9d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8494103550 0x7f849419bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.39:58284/0 (socket says 172.21.15.39:58284) 2024-05-09T05:36:32.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:32.445+0000 7f8492d9d700 1 -- 172.21.15.39:0/678774824 learned_addr learned my addr 172.21.15.39:0/678774824 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:36:32.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:32.445+0000 7f849359e700 1 -- 172.21.15.39:0/678774824 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8494103550 msgr2=0x7f849419bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:32.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:32.445+0000 7f849359e700 1 --2- 172.21.15.39:0/678774824 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8494103550 0x7f849419bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:32.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:32.445+0000 7f849359e700 1 -- 172.21.15.39:0/678774824 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8494107e30 msgr2=0x7f849419c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:32.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:32.445+0000 7f849359e700 1 --2- 172.21.15.39:0/678774824 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8494107e30 0x7f849419c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:32.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:32.445+0000 7f849359e700 1 -- 172.21.15.39:0/678774824 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84941a7090 con 0x7f8494108780 2024-05-09T05:36:32.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:32.445+0000 7f8492d9d700 1 --2- 172.21.15.39:0/678774824 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8494103550 0x7f849419bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T05:36:32.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:32.445+0000 7f849359e700 1 --2- 172.21.15.39:0/678774824 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8494108780 0x7f849419c7e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f848c007f10 tx=0x7f848c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:36:32.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:32.446+0000 7f847bfff700 1 -- 172.21.15.39:0/678774824 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f848c004db0 con 0x7f8494108780 2024-05-09T05:36:32.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:32.446+0000 7f84990c1700 1 -- 172.21.15.39:0/678774824 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84941a7380 con 0x7f8494108780 2024-05-09T05:36:32.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:32.446+0000 7f847bfff700 1 -- 172.21.15.39:0/678774824 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f848c009e20 con 0x7f8494108780 2024-05-09T05:36:32.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:32.446+0000 7f847bfff700 1 -- 172.21.15.39:0/678774824 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f848c015400 con 0x7f8494108780 2024-05-09T05:36:32.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:32.446+0000 7f84990c1700 1 -- 172.21.15.39:0/678774824 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84941a7840 con 0x7f8494108780 2024-05-09T05:36:32.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:32.447+0000 7f84990c1700 1 -- 172.21.15.39:0/678774824 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84941049b0 con 0x7f8494108780 2024-05-09T05:36:32.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:32.448+0000 7f847bfff700 1 -- 172.21.15.39:0/678774824 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f848c005260 con 0x7f8494108780 2024-05-09T05:36:32.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:32.449+0000 7f847bfff700 1 --2- 172.21.15.39:0/678774824 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f847c0b2910 0x7f847c0b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:32.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:32.449+0000 7f8492d9d700 1 --2- 172.21.15.39:0/678774824 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f847c0b2910 0x7f847c0b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:32.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:32.449+0000 7f847bfff700 1 -- 172.21.15.39:0/678774824 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f848c0e1d20 con 0x7f8494108780 2024-05-09T05:36:32.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:32.450+0000 7f8492d9d700 1 --2- 172.21.15.39:0/678774824 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f847c0b2910 0x7f847c0b4e20 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f8484009ea0 tx=0x7f8484009290 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:36:32.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:32.454+0000 7f847bfff700 1 -- 172.21.15.39:0/678774824 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f848c010070 con 0x7f8494108780 2024-05-09T05:36:32.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:32.675+0000 7f84990c1700 1 -- 172.21.15.39:0/678774824 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f849402e5f0 con 0x7f8494108780 2024-05-09T05:36:32.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:32.675+0000 7f847bfff700 1 -- 172.21.15.39:0/678774824 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f848c0a98f0 con 0x7f8494108780 2024-05-09T05:36:32.669 INFO:teuthology.orchestra.run.smithi039.stdout:34359738461 2024-05-09T05:36:32.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:32.678+0000 7f84990c1700 1 -- 172.21.15.39:0/678774824 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f847c0b2910 msgr2=0x7f847c0b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:32.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:32.678+0000 7f84990c1700 1 --2- 172.21.15.39:0/678774824 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f847c0b2910 0x7f847c0b4e20 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f8484009ea0 tx=0x7f8484009290 comp rx=0 tx=0).stop 2024-05-09T05:36:32.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:32.678+0000 7f84990c1700 1 -- 172.21.15.39:0/678774824 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8494108780 msgr2=0x7f849419c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:32.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:32.678+0000 7f84990c1700 1 --2- 172.21.15.39:0/678774824 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8494108780 0x7f849419c7e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f848c007f10 tx=0x7f848c00d3b0 comp rx=0 tx=0).stop 2024-05-09T05:36:32.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:32.678+0000 7f84990c1700 1 -- 172.21.15.39:0/678774824 shutdown_connections 2024-05-09T05:36:32.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:32.678+0000 7f84990c1700 1 --2- 172.21.15.39:0/678774824 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f847c0b2910 0x7f847c0b4e20 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:32.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:32.678+0000 7f84990c1700 1 --2- 172.21.15.39:0/678774824 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8494108780 0x7f849419c7e0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:32.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:32.678+0000 7f84990c1700 1 --2- 172.21.15.39:0/678774824 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8494103550 0x7f849419bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:32.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:32.678+0000 7f84990c1700 1 --2- 172.21.15.39:0/678774824 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8494107e30 0x7f849419c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:32.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:32.678+0000 7f84990c1700 1 -- 172.21.15.39:0/678774824 >> 172.21.15.39:0/678774824 conn(0x7f8494078e00 msgr2=0x7f8494100f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:36:32.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:32.678+0000 7f84990c1700 1 -- 172.21.15.39:0/678774824 shutdown_connections 2024-05-09T05:36:32.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:32.678+0000 7f84990c1700 1 -- 172.21.15.39:0/678774824 wait complete. 2024-05-09T05:36:33.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:36:33 smithi039 ceph-mon[30439]: pgmap v345: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-09T05:36:33.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:36:33 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/678774824' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-05-09T05:36:33.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:36:33 smithi100 ceph-mon[34353]: pgmap v345: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-09T05:36:33.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:36:33 smithi100 ceph-mon[34353]: from='client.? 172.21.15.39:0/678774824' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-05-09T05:36:33.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:36:33 smithi060 ceph-mon[34555]: pgmap v345: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-09T05:36:33.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:36:33 smithi060 ceph-mon[34555]: from='client.? 172.21.15.39:0/678774824' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-05-09T05:36:34.126 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:34.132+0000 7ff1008f9700 1 -- 172.21.15.39:0/3118542929 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff0fc108740 msgr2=0x7ff0fc1100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:34.126 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:34.132+0000 7ff1008f9700 1 --2- 172.21.15.39:0/3118542929 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff0fc108740 0x7ff0fc1100a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7ff0f400b0d0 tx=0x7ff0f400b3e0 comp rx=0 tx=0).stop 2024-05-09T05:36:34.126 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:34.132+0000 7ff1008f9700 1 -- 172.21.15.39:0/3118542929 shutdown_connections 2024-05-09T05:36:34.126 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:34.132+0000 7ff1008f9700 1 --2- 172.21.15.39:0/3118542929 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff0fc108740 0x7ff0fc1100a0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:34.126 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:34.132+0000 7ff1008f9700 1 --2- 172.21.15.39:0/3118542929 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0fc1034c0 0x7ff0fc1038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:34.126 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:34.132+0000 7ff1008f9700 1 --2- 172.21.15.39:0/3118542929 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0fc107df0 0x7ff0fc108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:34.126 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:34.132+0000 7ff1008f9700 1 -- 172.21.15.39:0/3118542929 >> 172.21.15.39:0/3118542929 conn(0x7ff0fc0fedc0 msgr2=0x7ff0fc1011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:36:34.127 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:34.132+0000 7ff1008f9700 1 -- 172.21.15.39:0/3118542929 shutdown_connections 2024-05-09T05:36:34.127 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:34.132+0000 7ff1008f9700 1 -- 172.21.15.39:0/3118542929 wait complete. 2024-05-09T05:36:34.128 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:34.133+0000 7ff1008f9700 1 Processor -- start 2024-05-09T05:36:34.128 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:34.133+0000 7ff1008f9700 1 -- start start 2024-05-09T05:36:34.129 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:34.133+0000 7ff1008f9700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0fc1034c0 0x7ff0fc19bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:34.129 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:34.133+0000 7ff1008f9700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff0fc107df0 0x7ff0fc19c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:34.129 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:34.133+0000 7ff1008f9700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0fc108740 0x7ff0fc19c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:34.129 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:34.133+0000 7ff1008f9700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7ff0fc113370 con 0x7ff0fc107df0 2024-05-09T05:36:34.129 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:34.133+0000 7ff1008f9700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff0fc1131f0 con 0x7ff0fc108740 2024-05-09T05:36:34.129 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:34.133+0000 7ff1008f9700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff0fc1134f0 con 0x7ff0fc1034c0 2024-05-09T05:36:34.129 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:34.133+0000 7ff0f9d9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff0fc107df0 0x7ff0fc19c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:34.129 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:34.133+0000 7ff0f9d9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff0fc107df0 0x7ff0fc19c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45300/0 (socket says 172.21.15.39:45300) 2024-05-09T05:36:34.129 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:34.133+0000 7ff0f9d9b700 1 -- 172.21.15.39:0/670031655 learned_addr learned my addr 172.21.15.39:0/670031655 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:36:34.129 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:34.133+0000 7ff0fa59c700 1 --2- 172.21.15.39:0/670031655 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0fc1034c0 0x7ff0fc19bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:34.129 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:34.134+0000 7ff0fad9d700 1 --2- 172.21.15.39:0/670031655 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0fc108740 0x7ff0fc19c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:34.129 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:34.134+0000 7ff0f9d9b700 1 -- 172.21.15.39:0/670031655 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0fc1034c0 msgr2=0x7ff0fc19bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:34.129 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:34.134+0000 7ff0f9d9b700 1 --2- 172.21.15.39:0/670031655 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0fc1034c0 0x7ff0fc19bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:34.130 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:34.134+0000 7ff0f9d9b700 1 -- 172.21.15.39:0/670031655 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0fc108740 msgr2=0x7ff0fc19c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:34.130 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:34.134+0000 7ff0f9d9b700 1 --2- 172.21.15.39:0/670031655 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0fc108740 0x7ff0fc19c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:34.130 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:34.134+0000 7ff0f9d9b700 1 -- 172.21.15.39:0/670031655 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0fc1a6f60 con 0x7ff0fc107df0 2024-05-09T05:36:34.130 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:34.134+0000 7ff0f9d9b700 1 --2- 172.21.15.39:0/670031655 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff0fc107df0 0x7ff0fc19c130 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7ff0f000d980 tx=0x7ff0f000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:36:34.130 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:34.134+0000 7ff0eb7fe700 1 -- 172.21.15.39:0/670031655 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0f0017070 con 0x7ff0fc107df0 2024-05-09T05:36:34.130 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:34.134+0000 7ff1008f9700 1 -- 172.21.15.39:0/670031655 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0fc1a7250 con 0x7ff0fc107df0 2024-05-09T05:36:34.130 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:34.134+0000 7ff0eb7fe700 1 -- 172.21.15.39:0/670031655 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff0f0009de0 con 0x7ff0fc107df0 2024-05-09T05:36:34.130 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:34.134+0000 7ff0eb7fe700 1 -- 172.21.15.39:0/670031655 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0f000f3c0 con 0x7ff0fc107df0 2024-05-09T05:36:34.130 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:34.134+0000 7ff1008f9700 1 -- 172.21.15.39:0/670031655 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0fc1a77e0 con 0x7ff0fc107df0 2024-05-09T05:36:34.130 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:34.135+0000 7ff1008f9700 1 -- 172.21.15.39:0/670031655 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0fc0512c0 con 0x7ff0fc107df0 2024-05-09T05:36:34.131 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:34.137+0000 7ff0eb7fe700 1 -- 172.21.15.39:0/670031655 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7ff0f0009930 con 0x7ff0fc107df0 2024-05-09T05:36:34.131 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:34.137+0000 7ff0eb7fe700 1 --2- 172.21.15.39:0/670031655 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7ff0e40b2910 0x7ff0e40b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:34.131 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:34.138+0000 7ff0fa59c700 1 --2- 172.21.15.39:0/670031655 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7ff0e40b2910 0x7ff0e40b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:34.131 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:34.138+0000 7ff0eb7fe700 1 -- 172.21.15.39:0/670031655 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7ff0f00e21c0 con 0x7ff0fc107df0 2024-05-09T05:36:34.132 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:34.138+0000 7ff0fa59c700 1 --2- 172.21.15.39:0/670031655 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7ff0e40b2910 0x7ff0e40b4e20 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec005950 tx=0x7ff0ec00a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:36:34.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:34.141+0000 7ff0eb7fe700 1 -- 172.21.15.39:0/670031655 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7ff0f00a9d90 con 0x7ff0fc107df0 2024-05-09T05:36:34.358 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:34.365+0000 7ff1008f9700 1 -- 172.21.15.39:0/670031655 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7ff0fc02e5f0 con 0x7ff0fc107df0 2024-05-09T05:36:34.359 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:34.365+0000 7ff0eb7fe700 1 -- 172.21.15.39:0/670031655 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff0f00a9690 con 0x7ff0fc107df0 2024-05-09T05:36:34.359 INFO:teuthology.orchestra.run.smithi039.stdout:77309411411 2024-05-09T05:36:34.361 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:34.367+0000 7ff1008f9700 1 -- 172.21.15.39:0/670031655 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7ff0e40b2910 msgr2=0x7ff0e40b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:34.361 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:34.367+0000 7ff1008f9700 1 --2- 172.21.15.39:0/670031655 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7ff0e40b2910 0x7ff0e40b4e20 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec005950 tx=0x7ff0ec00a300 comp rx=0 tx=0).stop 2024-05-09T05:36:34.361 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:34.367+0000 7ff1008f9700 1 -- 172.21.15.39:0/670031655 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff0fc107df0 msgr2=0x7ff0fc19c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:34.361 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:34.367+0000 7ff1008f9700 1 --2- 172.21.15.39:0/670031655 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff0fc107df0 0x7ff0fc19c130 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7ff0f000d980 tx=0x7ff0f000dc90 comp rx=0 tx=0).stop 2024-05-09T05:36:34.361 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:34.367+0000 7ff1008f9700 1 -- 172.21.15.39:0/670031655 shutdown_connections 2024-05-09T05:36:34.361 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:34.367+0000 7ff1008f9700 1 --2- 172.21.15.39:0/670031655 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7ff0e40b2910 0x7ff0e40b4e20 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:34.362 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:34.367+0000 7ff1008f9700 1 --2- 172.21.15.39:0/670031655 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0fc108740 0x7ff0fc19c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:34.362 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:34.367+0000 7ff1008f9700 1 --2- 172.21.15.39:0/670031655 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff0fc1034c0 0x7ff0fc19bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:34.362 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:34.367+0000 7ff1008f9700 1 --2- 172.21.15.39:0/670031655 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff0fc107df0 0x7ff0fc19c130 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:34.362 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:34.367+0000 7ff1008f9700 1 -- 172.21.15.39:0/670031655 >> 172.21.15.39:0/670031655 conn(0x7ff0fc0fedc0 msgr2=0x7ff0fc107560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:36:34.362 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:34.368+0000 7ff1008f9700 1 -- 172.21.15.39:0/670031655 shutdown_connections 2024-05-09T05:36:34.362 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:34.368+0000 7ff1008f9700 1 -- 172.21.15.39:0/670031655 wait complete. 2024-05-09T05:36:34.605 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:36:34 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/670031655' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-05-09T05:36:34.631 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738456 got 34359738461 for osd.0 2024-05-09T05:36:34.631 DEBUG:teuthology.parallel:result is None 2024-05-09T05:36:34.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:36:34 smithi100 ceph-mon[34353]: from='client.? 172.21.15.39:0/670031655' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-05-09T05:36:34.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:36:34 smithi060 ceph-mon[34555]: from='client.? 172.21.15.39:0/670031655' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-05-09T05:36:35.564 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:36:35 smithi039 ceph-mon[30439]: pgmap v346: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-09T05:36:35.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:36:35 smithi100 ceph-mon[34353]: pgmap v346: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-09T05:36:35.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:36:35 smithi060 ceph-mon[34555]: pgmap v346: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-09T05:36:35.955 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411406 got 77309411411 for osd.2 2024-05-09T05:36:35.955 DEBUG:teuthology.parallel:result is None 2024-05-09T05:36:36.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.170+0000 7f124fcd0700 1 -- 172.21.15.39:0/4206276963 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1248108f30 msgr2=0x7f1248109340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:36.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.170+0000 7f124fcd0700 1 --2- 172.21.15.39:0/4206276963 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1248108f30 0x7f1248109340 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f123c0099c0 tx=0x7f123c009cd0 comp rx=0 tx=0).stop 2024-05-09T05:36:36.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.170+0000 7f124fcd0700 1 -- 172.21.15.39:0/4206276963 shutdown_connections 2024-05-09T05:36:36.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.170+0000 7f124fcd0700 1 --2- 172.21.15.39:0/4206276963 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1248109880 0x7f12481111e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:36.165 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.170+0000 7f124fcd0700 1 --2- 172.21.15.39:0/4206276963 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1248104650 0x7f1248104a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:36.165 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.170+0000 7f124fcd0700 1 --2- 172.21.15.39:0/4206276963 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1248108f30 0x7f1248109340 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:36.165 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.170+0000 7f124fcd0700 1 -- 172.21.15.39:0/4206276963 >> 172.21.15.39:0/4206276963 conn(0x7f1248079f00 msgr2=0x7f124807a340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:36:36.165 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.170+0000 7f124fcd0700 1 -- 172.21.15.39:0/4206276963 shutdown_connections 2024-05-09T05:36:36.165 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.170+0000 7f124fcd0700 1 -- 172.21.15.39:0/4206276963 wait complete. 2024-05-09T05:36:36.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.171+0000 7f124fcd0700 1 Processor -- start 2024-05-09T05:36:36.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.171+0000 7f124fcd0700 1 -- start start 2024-05-09T05:36:36.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.171+0000 7f124fcd0700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1248104650 0x7f124819ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:36.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.171+0000 7f124fcd0700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1248108f30 0x7f124819b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:36.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.171+0000 7f124fcd0700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1248109880 0x7f124819f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:36.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.172+0000 7f124fcd0700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f12481144e0 con 0x7f1248108f30 2024-05-09T05:36:36.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.172+0000 7f124fcd0700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f1248114360 con 0x7f1248109880 2024-05-09T05:36:36.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.172+0000 7f124fcd0700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1248114660 con 0x7f1248104650 2024-05-09T05:36:36.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.172+0000 7f124d26b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1248108f30 0x7f124819b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:36.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.172+0000 7f124d26b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1248108f30 0x7f124819b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45314/0 (socket says 172.21.15.39:45314) 2024-05-09T05:36:36.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.172+0000 7f124d26b700 1 -- 172.21.15.39:0/227249368 learned_addr learned my addr 172.21.15.39:0/227249368 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:36:36.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.172+0000 7f124da6c700 1 --2- 172.21.15.39:0/227249368 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1248104650 0x7f124819ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:36.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.172+0000 7f124e26d700 1 --2- 172.21.15.39:0/227249368 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1248109880 0x7f124819f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:36.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.172+0000 7f124d26b700 1 -- 172.21.15.39:0/227249368 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1248104650 msgr2=0x7f124819ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:36.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.172+0000 7f124d26b700 1 --2- 172.21.15.39:0/227249368 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1248104650 0x7f124819ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:36.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.172+0000 7f124d26b700 1 -- 172.21.15.39:0/227249368 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1248109880 msgr2=0x7f124819f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:36.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.172+0000 7f124d26b700 1 --2- 172.21.15.39:0/227249368 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1248109880 0x7f124819f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:36.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.172+0000 7f124d26b700 1 -- 172.21.15.39:0/227249368 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f124819fd20 con 0x7f1248108f30 2024-05-09T05:36:36.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.172+0000 7f124d26b700 1 --2- 172.21.15.39:0/227249368 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1248108f30 0x7f124819b3f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f123c006010 tx=0x7f123c0047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:36:36.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.172+0000 7f123affd700 1 -- 172.21.15.39:0/227249368 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f123c027070 con 0x7f1248108f30 2024-05-09T05:36:36.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.172+0000 7f123affd700 1 -- 172.21.15.39:0/227249368 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f123c003f20 con 0x7f1248108f30 2024-05-09T05:36:36.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.172+0000 7f124fcd0700 1 -- 172.21.15.39:0/227249368 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f124819ffb0 con 0x7f1248108f30 2024-05-09T05:36:36.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.172+0000 7f123affd700 1 -- 172.21.15.39:0/227249368 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f123c022c60 con 0x7f1248108f30 2024-05-09T05:36:36.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.173+0000 7f124fcd0700 1 -- 172.21.15.39:0/227249368 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12481a0490 con 0x7f1248108f30 2024-05-09T05:36:36.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.173+0000 7f124fcd0700 1 -- 172.21.15.39:0/227249368 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12480512c0 con 0x7f1248108f30 2024-05-09T05:36:36.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.175+0000 7f123affd700 1 -- 172.21.15.39:0/227249368 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f123c02a070 con 0x7f1248108f30 2024-05-09T05:36:36.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.176+0000 7f123affd700 1 --2- 172.21.15.39:0/227249368 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f12340b2910 0x7f12340b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:36.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.176+0000 7f124da6c700 1 --2- 172.21.15.39:0/227249368 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f12340b2910 0x7f12340b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:36.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.176+0000 7f123affd700 1 -- 172.21.15.39:0/227249368 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f123c022e00 con 0x7f1248108f30 2024-05-09T05:36:36.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.176+0000 7f124da6c700 1 --2- 172.21.15.39:0/227249368 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f12340b2910 0x7f12340b4e20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f1244005950 tx=0x7f124400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:36:36.173 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.179+0000 7f123affd700 1 -- 172.21.15.39:0/227249368 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f123c031080 con 0x7f1248108f30 2024-05-09T05:36:36.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.397+0000 7f124fcd0700 1 -- 172.21.15.39:0/227249368 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f124802e5f0 con 0x7f1248108f30 2024-05-09T05:36:36.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.397+0000 7f123affd700 1 -- 172.21.15.39:0/227249368 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f123c013070 con 0x7f1248108f30 2024-05-09T05:36:36.391 INFO:teuthology.orchestra.run.smithi039.stdout:107374182478 2024-05-09T05:36:36.394 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.400+0000 7f124fcd0700 1 -- 172.21.15.39:0/227249368 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f12340b2910 msgr2=0x7f12340b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:36.394 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.400+0000 7f124fcd0700 1 --2- 172.21.15.39:0/227249368 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f12340b2910 0x7f12340b4e20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f1244005950 tx=0x7f124400b410 comp rx=0 tx=0).stop 2024-05-09T05:36:36.394 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.400+0000 7f124fcd0700 1 -- 172.21.15.39:0/227249368 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1248108f30 msgr2=0x7f124819b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:36.394 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.400+0000 7f124fcd0700 1 --2- 172.21.15.39:0/227249368 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1248108f30 0x7f124819b3f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f123c006010 tx=0x7f123c0047b0 comp rx=0 tx=0).stop 2024-05-09T05:36:36.394 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.400+0000 7f124fcd0700 1 -- 172.21.15.39:0/227249368 shutdown_connections 2024-05-09T05:36:36.394 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.400+0000 7f124fcd0700 1 --2- 172.21.15.39:0/227249368 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f12340b2910 0x7f12340b4e20 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:36.394 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.400+0000 7f124fcd0700 1 --2- 172.21.15.39:0/227249368 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1248109880 0x7f124819f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:36.394 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.400+0000 7f124fcd0700 1 --2- 172.21.15.39:0/227249368 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1248104650 0x7f124819ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:36.394 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.400+0000 7f124fcd0700 1 --2- 172.21.15.39:0/227249368 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1248108f30 0x7f124819b3f0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:36.395 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.400+0000 7f124fcd0700 1 -- 172.21.15.39:0/227249368 >> 172.21.15.39:0/227249368 conn(0x7f1248079f00 msgr2=0x7f1248102050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:36:36.395 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.400+0000 7f124fcd0700 1 -- 172.21.15.39:0/227249368 shutdown_connections 2024-05-09T05:36:36.395 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.400+0000 7f124fcd0700 1 -- 172.21.15.39:0/227249368 wait complete. 2024-05-09T05:36:36.403 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T05:36:36.436 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.442+0000 7ff61a002700 1 -- 172.21.15.39:0/1824695093 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff6141034c0 msgr2=0x7ff6141038d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:36.436 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.442+0000 7ff61a002700 1 --2- 172.21.15.39:0/1824695093 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff6141034c0 0x7ff6141038d0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff6040099c0 tx=0x7ff604009cd0 comp rx=0 tx=0).stop 2024-05-09T05:36:36.436 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.442+0000 7ff61a002700 1 -- 172.21.15.39:0/1824695093 shutdown_connections 2024-05-09T05:36:36.436 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.442+0000 7ff61a002700 1 --2- 172.21.15.39:0/1824695093 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff614108740 0x7ff6141100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:36.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.442+0000 7ff61a002700 1 --2- 172.21.15.39:0/1824695093 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff6141034c0 0x7ff6141038d0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:36.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.442+0000 7ff61a002700 1 --2- 172.21.15.39:0/1824695093 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff614107df0 0x7ff614108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:36.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.442+0000 7ff61a002700 1 -- 172.21.15.39:0/1824695093 >> 172.21.15.39:0/1824695093 conn(0x7ff6140fedc0 msgr2=0x7ff6141011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:36:36.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.443+0000 7ff61a002700 1 -- 172.21.15.39:0/1824695093 shutdown_connections 2024-05-09T05:36:36.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.443+0000 7ff61a002700 1 -- 172.21.15.39:0/1824695093 wait complete. 2024-05-09T05:36:36.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.443+0000 7ff61a002700 1 Processor -- start 2024-05-09T05:36:36.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.443+0000 7ff61a002700 1 -- start start 2024-05-09T05:36:36.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.444+0000 7ff61a002700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6141034c0 0x7ff61419ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:36.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.444+0000 7ff61a002700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff614107df0 0x7ff61419b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:36.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.444+0000 7ff61a002700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff614108740 0x7ff61419f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:36.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.444+0000 7ff61a002700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7ff614113370 con 0x7ff614107df0 2024-05-09T05:36:36.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.444+0000 7ff612ffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff614107df0 0x7ff61419b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:36.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.444+0000 7ff61a002700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff6141131f0 con 0x7ff614108740 2024-05-09T05:36:36.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.444+0000 7ff61a002700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff6141134f0 con 0x7ff6141034c0 2024-05-09T05:36:36.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.444+0000 7ff612ffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff614107df0 0x7ff61419b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45328/0 (socket says 172.21.15.39:45328) 2024-05-09T05:36:36.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.444+0000 7ff612ffd700 1 -- 172.21.15.39:0/735089195 learned_addr learned my addr 172.21.15.39:0/735089195 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:36:36.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.444+0000 7ff6137fe700 1 --2- 172.21.15.39:0/735089195 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6141034c0 0x7ff61419ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:36.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.444+0000 7ff613fff700 1 --2- 172.21.15.39:0/735089195 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff614108740 0x7ff61419f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:36.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.444+0000 7ff612ffd700 1 -- 172.21.15.39:0/735089195 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6141034c0 msgr2=0x7ff61419ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:36.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.444+0000 7ff612ffd700 1 --2- 172.21.15.39:0/735089195 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6141034c0 0x7ff61419ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:36.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.444+0000 7ff612ffd700 1 -- 172.21.15.39:0/735089195 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff614108740 msgr2=0x7ff61419f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:36.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.444+0000 7ff612ffd700 1 --2- 172.21.15.39:0/735089195 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff614108740 0x7ff61419f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:36.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.444+0000 7ff612ffd700 1 -- 172.21.15.39:0/735089195 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff61419fd00 con 0x7ff614107df0 2024-05-09T05:36:36.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.444+0000 7ff613fff700 1 --2- 172.21.15.39:0/735089195 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff614108740 0x7ff61419f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:36:36.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.445+0000 7ff612ffd700 1 --2- 172.21.15.39:0/735089195 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff614107df0 0x7ff61419b3d0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff60800ed30 tx=0x7ff60800c5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:36:36.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.445+0000 7ff610ff9700 1 -- 172.21.15.39:0/735089195 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff60800cbc0 con 0x7ff614107df0 2024-05-09T05:36:36.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.445+0000 7ff610ff9700 1 -- 172.21.15.39:0/735089195 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff60800cd60 con 0x7ff614107df0 2024-05-09T05:36:36.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.445+0000 7ff61a002700 1 -- 172.21.15.39:0/735089195 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff61419fff0 con 0x7ff614107df0 2024-05-09T05:36:36.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.445+0000 7ff610ff9700 1 -- 172.21.15.39:0/735089195 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff608010430 con 0x7ff614107df0 2024-05-09T05:36:36.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.445+0000 7ff61a002700 1 -- 172.21.15.39:0/735089195 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6141a7910 con 0x7ff614107df0 2024-05-09T05:36:36.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.447+0000 7ff61a002700 1 -- 172.21.15.39:0/735089195 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6140512c0 con 0x7ff614107df0 2024-05-09T05:36:36.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.448+0000 7ff610ff9700 1 -- 172.21.15.39:0/735089195 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7ff608004d70 con 0x7ff614107df0 2024-05-09T05:36:36.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.449+0000 7ff610ff9700 1 --2- 172.21.15.39:0/735089195 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7ff5fc0b2990 0x7ff5fc0b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:36.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.449+0000 7ff6137fe700 1 --2- 172.21.15.39:0/735089195 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7ff5fc0b2990 0x7ff5fc0b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:36.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.449+0000 7ff610ff9700 1 -- 172.21.15.39:0/735089195 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7ff6080e2760 con 0x7ff614107df0 2024-05-09T05:36:36.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.449+0000 7ff6137fe700 1 --2- 172.21.15.39:0/735089195 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7ff5fc0b2990 0x7ff5fc0b4ea0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff604000c00 tx=0x7ff60401a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:36:36.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.453+0000 7ff610ff9700 1 -- 172.21.15.39:0/735089195 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7ff6080aa330 con 0x7ff614107df0 2024-05-09T05:36:36.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.668+0000 7ff61a002700 1 -- 172.21.15.39:0/735089195 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7ff61419c190 con 0x7ff614107df0 2024-05-09T05:36:36.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.669+0000 7ff610ff9700 1 -- 172.21.15.39:0/735089195 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7ff6080a9c30 con 0x7ff614107df0 2024-05-09T05:36:36.663 INFO:teuthology.orchestra.run.smithi039.stdout:184683593791 2024-05-09T05:36:36.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.671+0000 7ff61a002700 1 -- 172.21.15.39:0/735089195 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7ff5fc0b2990 msgr2=0x7ff5fc0b4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:36.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.671+0000 7ff61a002700 1 --2- 172.21.15.39:0/735089195 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7ff5fc0b2990 0x7ff5fc0b4ea0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff604000c00 tx=0x7ff60401a040 comp rx=0 tx=0).stop 2024-05-09T05:36:36.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.671+0000 7ff61a002700 1 -- 172.21.15.39:0/735089195 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff614107df0 msgr2=0x7ff61419b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:36.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.671+0000 7ff61a002700 1 --2- 172.21.15.39:0/735089195 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff614107df0 0x7ff61419b3d0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff60800ed30 tx=0x7ff60800c5b0 comp rx=0 tx=0).stop 2024-05-09T05:36:36.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.671+0000 7ff61a002700 1 -- 172.21.15.39:0/735089195 shutdown_connections 2024-05-09T05:36:36.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.671+0000 7ff61a002700 1 --2- 172.21.15.39:0/735089195 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7ff5fc0b2990 0x7ff5fc0b4ea0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:36.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.671+0000 7ff61a002700 1 --2- 172.21.15.39:0/735089195 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff614108740 0x7ff61419f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:36.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.671+0000 7ff61a002700 1 --2- 172.21.15.39:0/735089195 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6141034c0 0x7ff61419ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:36.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.671+0000 7ff61a002700 1 --2- 172.21.15.39:0/735089195 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff614107df0 0x7ff61419b3d0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:36.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.671+0000 7ff61a002700 1 -- 172.21.15.39:0/735089195 >> 172.21.15.39:0/735089195 conn(0x7ff6140fedc0 msgr2=0x7ff6141063a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:36:36.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.671+0000 7ff61a002700 1 -- 172.21.15.39:0/735089195 shutdown_connections 2024-05-09T05:36:36.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:36.671+0000 7ff61a002700 1 -- 172.21.15.39:0/735089195 wait complete. 2024-05-09T05:36:36.677 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:36:36 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/227249368' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-05-09T05:36:36.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:36:36 smithi060 ceph-mon[34555]: from='client.? 172.21.15.39:0/227249368' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-05-09T05:36:36.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:36:36 smithi100 ceph-mon[34353]: from='client.? 172.21.15.39:0/227249368' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-05-09T05:36:37.609 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:36:37 smithi039 ceph-mon[30439]: pgmap v347: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-09T05:36:37.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:36:37 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/735089195' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-05-09T05:36:37.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:37.666+0000 7f2406fe2700 1 -- 172.21.15.39:0/2764800574 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2400103550 msgr2=0x7f2400103960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:37.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:37.666+0000 7f2406fe2700 1 --2- 172.21.15.39:0/2764800574 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2400103550 0x7f2400103960 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f23f000b0d0 tx=0x7f23f000b3e0 comp rx=0 tx=0).stop 2024-05-09T05:36:37.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:37.666+0000 7f2406fe2700 1 -- 172.21.15.39:0/2764800574 shutdown_connections 2024-05-09T05:36:37.661 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:37.666+0000 7f2406fe2700 1 --2- 172.21.15.39:0/2764800574 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2400108780 0x7f24001100e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:37.661 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:37.666+0000 7f2406fe2700 1 --2- 172.21.15.39:0/2764800574 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2400103550 0x7f2400103960 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:37.661 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:37.666+0000 7f2406fe2700 1 --2- 172.21.15.39:0/2764800574 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2400107e30 0x7f2400108240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:37.661 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:37.666+0000 7f2406fe2700 1 -- 172.21.15.39:0/2764800574 >> 172.21.15.39:0/2764800574 conn(0x7f2400078e00 msgr2=0x7f2400079240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:36:37.661 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:37.666+0000 7f2406fe2700 1 -- 172.21.15.39:0/2764800574 shutdown_connections 2024-05-09T05:36:37.661 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:37.667+0000 7f2406fe2700 1 -- 172.21.15.39:0/2764800574 wait complete. 2024-05-09T05:36:37.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:37.667+0000 7f2406fe2700 1 Processor -- start 2024-05-09T05:36:37.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:37.667+0000 7f2406fe2700 1 -- start start 2024-05-09T05:36:37.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:37.668+0000 7f2406fe2700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2400103550 0x7f240019ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:37.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:37.668+0000 7f2406fe2700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2400107e30 0x7f240019b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:37.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:37.668+0000 7f2406fe2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2400108780 0x7f240019f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:37.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:37.668+0000 7f2406fe2700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f24001133b0 con 0x7f2400107e30 2024-05-09T05:36:37.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:37.668+0000 7f2406fe2700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f2400113230 con 0x7f2400108780 2024-05-09T05:36:37.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:37.668+0000 7f2406fe2700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2400113530 con 0x7f2400103550 2024-05-09T05:36:37.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:37.668+0000 7f23fffff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2400107e30 0x7f240019b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:37.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:37.668+0000 7f23fffff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2400107e30 0x7f240019b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:33122/0 (socket says 172.21.15.39:33122) 2024-05-09T05:36:37.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:37.668+0000 7f23fffff700 1 -- 172.21.15.39:0/3895645235 learned_addr learned my addr 172.21.15.39:0/3895645235 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:36:37.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:37.668+0000 7f2404d7e700 1 --2- 172.21.15.39:0/3895645235 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2400103550 0x7f240019ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:37.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:37.668+0000 7f240557f700 1 --2- 172.21.15.39:0/3895645235 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2400108780 0x7f240019f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:37.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:37.668+0000 7f23fffff700 1 -- 172.21.15.39:0/3895645235 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2400103550 msgr2=0x7f240019ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:37.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:37.668+0000 7f23fffff700 1 --2- 172.21.15.39:0/3895645235 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2400103550 0x7f240019ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:37.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:37.668+0000 7f23fffff700 1 -- 172.21.15.39:0/3895645235 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2400108780 msgr2=0x7f240019f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:37.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:37.668+0000 7f23fffff700 1 --2- 172.21.15.39:0/3895645235 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2400108780 0x7f240019f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:37.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:37.668+0000 7f23fffff700 1 -- 172.21.15.39:0/3895645235 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f240019fd00 con 0x7f2400107e30 2024-05-09T05:36:37.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:37.668+0000 7f23fffff700 1 --2- 172.21.15.39:0/3895645235 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2400107e30 0x7f240019b3d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f23e800c8f0 tx=0x7f23e800cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:36:37.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:37.668+0000 7f23fdffb700 1 -- 172.21.15.39:0/3895645235 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23e8007940 con 0x7f2400107e30 2024-05-09T05:36:37.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:37.668+0000 7f23fdffb700 1 -- 172.21.15.39:0/3895645235 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f23e800f450 con 0x7f2400107e30 2024-05-09T05:36:37.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:37.668+0000 7f2406fe2700 1 -- 172.21.15.39:0/3895645235 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f240019fff0 con 0x7f2400107e30 2024-05-09T05:36:37.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:37.668+0000 7f23fdffb700 1 -- 172.21.15.39:0/3895645235 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23e8018660 con 0x7f2400107e30 2024-05-09T05:36:37.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:37.669+0000 7f2406fe2700 1 -- 172.21.15.39:0/3895645235 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24001a7910 con 0x7f2400107e30 2024-05-09T05:36:37.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:37.670+0000 7f2406fe2700 1 -- 172.21.15.39:0/3895645235 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24000512c0 con 0x7f2400107e30 2024-05-09T05:36:37.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:37.671+0000 7f23fdffb700 1 -- 172.21.15.39:0/3895645235 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f23e800f890 con 0x7f2400107e30 2024-05-09T05:36:37.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:37.672+0000 7f23fdffb700 1 --2- 172.21.15.39:0/3895645235 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f23ec0b2910 0x7f23ec0b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:37.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:37.672+0000 7f2404d7e700 1 --2- 172.21.15.39:0/3895645235 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f23ec0b2910 0x7f23ec0b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:37.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:37.672+0000 7f23fdffb700 1 -- 172.21.15.39:0/3895645235 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f23e80e2250 con 0x7f2400107e30 2024-05-09T05:36:37.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:37.672+0000 7f2404d7e700 1 --2- 172.21.15.39:0/3895645235 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f23ec0b2910 0x7f23ec0b4e20 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f23f0009900 tx=0x7f23f000b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:36:37.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:37.677+0000 7f23fdffb700 1 -- 172.21.15.39:0/3895645235 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f23e8014030 con 0x7f2400107e30 2024-05-09T05:36:37.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:36:37 smithi060 ceph-mon[34555]: pgmap v347: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-09T05:36:37.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:36:37 smithi060 ceph-mon[34555]: from='client.? 172.21.15.39:0/735089195' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-05-09T05:36:37.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:37.900+0000 7f2406fe2700 1 -- 172.21.15.39:0/3895645235 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f240019c190 con 0x7f2400107e30 2024-05-09T05:36:37.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:37.900+0000 7f23fdffb700 1 -- 172.21.15.39:0/3895645235 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f23e80a9e20 con 0x7f2400107e30 2024-05-09T05:36:37.894 INFO:teuthology.orchestra.run.smithi039.stdout:55834574935 2024-05-09T05:36:37.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:37.902+0000 7f2406fe2700 1 -- 172.21.15.39:0/3895645235 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f23ec0b2910 msgr2=0x7f23ec0b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:37.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:37.902+0000 7f2406fe2700 1 --2- 172.21.15.39:0/3895645235 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f23ec0b2910 0x7f23ec0b4e20 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f23f0009900 tx=0x7f23f000b040 comp rx=0 tx=0).stop 2024-05-09T05:36:37.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:37.902+0000 7f2406fe2700 1 -- 172.21.15.39:0/3895645235 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2400107e30 msgr2=0x7f240019b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:37.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:37.902+0000 7f2406fe2700 1 --2- 172.21.15.39:0/3895645235 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2400107e30 0x7f240019b3d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f23e800c8f0 tx=0x7f23e800cc00 comp rx=0 tx=0).stop 2024-05-09T05:36:37.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:37.903+0000 7f2406fe2700 1 -- 172.21.15.39:0/3895645235 shutdown_connections 2024-05-09T05:36:37.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:37.903+0000 7f2406fe2700 1 --2- 172.21.15.39:0/3895645235 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f23ec0b2910 0x7f23ec0b4e20 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:37.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:37.903+0000 7f2406fe2700 1 --2- 172.21.15.39:0/3895645235 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2400108780 0x7f240019f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:37.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:37.903+0000 7f2406fe2700 1 --2- 172.21.15.39:0/3895645235 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2400103550 0x7f240019ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:37.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:37.903+0000 7f2406fe2700 1 --2- 172.21.15.39:0/3895645235 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2400107e30 0x7f240019b3d0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:37.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:37.903+0000 7f2406fe2700 1 -- 172.21.15.39:0/3895645235 >> 172.21.15.39:0/3895645235 conn(0x7f2400078e00 msgr2=0x7f2400075d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:36:37.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:37.903+0000 7f2406fe2700 1 -- 172.21.15.39:0/3895645235 shutdown_connections 2024-05-09T05:36:37.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:37.903+0000 7f2406fe2700 1 -- 172.21.15.39:0/3895645235 wait complete. 2024-05-09T05:36:37.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:36:37 smithi100 ceph-mon[34353]: pgmap v347: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-09T05:36:37.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:36:37 smithi100 ceph-mon[34353]: from='client.? 172.21.15.39:0/735089195' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-05-09T05:36:38.518 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:38.524+0000 7f660ca19700 1 -- 172.21.15.39:0/3285943828 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6608102870 msgr2=0x7f6608102c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:38.518 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:38.524+0000 7f660ca19700 1 --2- 172.21.15.39:0/3285943828 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6608102870 0x7f6608102c80 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f65fc009990 tx=0x7f65fc009ca0 comp rx=0 tx=0).stop 2024-05-09T05:36:38.518 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:38.524+0000 7f660ca19700 1 -- 172.21.15.39:0/3285943828 shutdown_connections 2024-05-09T05:36:38.518 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:38.524+0000 7f660ca19700 1 --2- 172.21.15.39:0/3285943828 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66081031c0 0x7f6608111160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:38.518 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:38.524+0000 7f660ca19700 1 --2- 172.21.15.39:0/3285943828 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f66081092d0 0x7f66081096e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:38.518 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:38.524+0000 7f660ca19700 1 --2- 172.21.15.39:0/3285943828 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6608102870 0x7f6608102c80 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:38.519 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:38.524+0000 7f660ca19700 1 -- 172.21.15.39:0/3285943828 >> 172.21.15.39:0/3285943828 conn(0x7f66080fe540 msgr2=0x7f6608100990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:36:38.519 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:38.524+0000 7f660ca19700 1 -- 172.21.15.39:0/3285943828 shutdown_connections 2024-05-09T05:36:38.519 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:38.524+0000 7f660ca19700 1 -- 172.21.15.39:0/3285943828 wait complete. 2024-05-09T05:36:38.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:38.525+0000 7f660ca19700 1 Processor -- start 2024-05-09T05:36:38.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:38.525+0000 7f660ca19700 1 -- start start 2024-05-09T05:36:38.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:38.525+0000 7f660ca19700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6608102870 0x7f6608103a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:38.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:38.525+0000 7f660ca19700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66081031c0 0x7f6608103f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:38.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:38.525+0000 7f660ca19700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f66081092d0 0x7f66081044d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:38.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:38.525+0000 7f660ca19700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f6608114590 con 0x7f6608102870 2024-05-09T05:36:38.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:38.525+0000 7f660ca19700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6608114410 con 0x7f66081031c0 2024-05-09T05:36:38.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:38.525+0000 7f660ca19700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6608114710 con 0x7f66081092d0 2024-05-09T05:36:38.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:38.526+0000 7f660659c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6608102870 0x7f6608103a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:38.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:38.526+0000 7f660659c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6608102870 0x7f6608103a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:33136/0 (socket says 172.21.15.39:33136) 2024-05-09T05:36:38.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:38.526+0000 7f660659c700 1 -- 172.21.15.39:0/3872894386 learned_addr learned my addr 172.21.15.39:0/3872894386 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:36:38.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:38.526+0000 7f6605d9b700 1 --2- 172.21.15.39:0/3872894386 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66081031c0 0x7f6608103f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:38.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:38.526+0000 7f6606d9d700 1 --2- 172.21.15.39:0/3872894386 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f66081092d0 0x7f66081044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:38.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:38.526+0000 7f660659c700 1 -- 172.21.15.39:0/3872894386 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f66081092d0 msgr2=0x7f66081044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:38.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:38.526+0000 7f660659c700 1 --2- 172.21.15.39:0/3872894386 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f66081092d0 0x7f66081044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:38.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:38.526+0000 7f660659c700 1 -- 172.21.15.39:0/3872894386 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66081031c0 msgr2=0x7f6608103f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:38.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:38.526+0000 7f660659c700 1 --2- 172.21.15.39:0/3872894386 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66081031c0 0x7f6608103f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:38.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:38.526+0000 7f660659c700 1 -- 172.21.15.39:0/3872894386 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66081a9210 con 0x7f6608102870 2024-05-09T05:36:38.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:38.526+0000 7f6606d9d700 1 --2- 172.21.15.39:0/3872894386 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f66081092d0 0x7f66081044d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T05:36:38.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:38.526+0000 7f660659c700 1 --2- 172.21.15.39:0/3872894386 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6608102870 0x7f6608103a50 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f65f800c9e0 tx=0x7f65f800cda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:36:38.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:38.526+0000 7f65f77fe700 1 -- 172.21.15.39:0/3872894386 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f8007aa0 con 0x7f6608102870 2024-05-09T05:36:38.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:38.526+0000 7f660ca19700 1 -- 172.21.15.39:0/3872894386 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66081a9500 con 0x7f6608102870 2024-05-09T05:36:38.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:38.526+0000 7f65f77fe700 1 -- 172.21.15.39:0/3872894386 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f65f8007c40 con 0x7f6608102870 2024-05-09T05:36:38.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:38.526+0000 7f65f77fe700 1 -- 172.21.15.39:0/3872894386 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f8018660 con 0x7f6608102870 2024-05-09T05:36:38.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:38.526+0000 7f660ca19700 1 -- 172.21.15.39:0/3872894386 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66081a9a40 con 0x7f6608102870 2024-05-09T05:36:38.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:38.527+0000 7f660ca19700 1 -- 172.21.15.39:0/3872894386 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66080512c0 con 0x7f6608102870 2024-05-09T05:36:38.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:38.530+0000 7f65f77fe700 1 -- 172.21.15.39:0/3872894386 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f65f8018800 con 0x7f6608102870 2024-05-09T05:36:38.524 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:38.530+0000 7f65f77fe700 1 --2- 172.21.15.39:0/3872894386 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f65f00b2910 0x7f65f00b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:38.524 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:38.531+0000 7f6605d9b700 1 --2- 172.21.15.39:0/3872894386 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f65f00b2910 0x7f65f00b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:38.524 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:38.531+0000 7f65f77fe700 1 -- 172.21.15.39:0/3872894386 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f65f80e2530 con 0x7f6608102870 2024-05-09T05:36:38.524 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:38.531+0000 7f6605d9b700 1 --2- 172.21.15.39:0/3872894386 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f65f00b2910 0x7f65f00b4e20 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f65fc006010 tx=0x7f65fc01a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:36:38.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:38.535+0000 7f65f77fe700 1 -- 172.21.15.39:0/3872894386 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f65f8054df0 con 0x7f6608102870 2024-05-09T05:36:38.593 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:36:38 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/3895645235' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-05-09T05:36:38.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:38.751+0000 7f660ca19700 1 -- 172.21.15.39:0/3872894386 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f6608104f80 con 0x7f6608102870 2024-05-09T05:36:38.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:38.752+0000 7f65f77fe700 1 -- 172.21.15.39:0/3872894386 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f65f8014030 con 0x7f6608102870 2024-05-09T05:36:38.746 INFO:teuthology.orchestra.run.smithi039.stdout:287762808874 2024-05-09T05:36:38.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:38.754+0000 7f660ca19700 1 -- 172.21.15.39:0/3872894386 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f65f00b2910 msgr2=0x7f65f00b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:38.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:38.754+0000 7f660ca19700 1 --2- 172.21.15.39:0/3872894386 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f65f00b2910 0x7f65f00b4e20 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f65fc006010 tx=0x7f65fc01a040 comp rx=0 tx=0).stop 2024-05-09T05:36:38.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:38.754+0000 7f660ca19700 1 -- 172.21.15.39:0/3872894386 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6608102870 msgr2=0x7f6608103a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:38.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:38.754+0000 7f660ca19700 1 --2- 172.21.15.39:0/3872894386 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6608102870 0x7f6608103a50 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f65f800c9e0 tx=0x7f65f800cda0 comp rx=0 tx=0).stop 2024-05-09T05:36:38.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:38.754+0000 7f660ca19700 1 -- 172.21.15.39:0/3872894386 shutdown_connections 2024-05-09T05:36:38.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:38.754+0000 7f660ca19700 1 --2- 172.21.15.39:0/3872894386 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f65f00b2910 0x7f65f00b4e20 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:38.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:38.754+0000 7f660ca19700 1 --2- 172.21.15.39:0/3872894386 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f66081092d0 0x7f66081044d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:38.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:38.754+0000 7f660ca19700 1 --2- 172.21.15.39:0/3872894386 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6608102870 0x7f6608103a50 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:38.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:38.754+0000 7f660ca19700 1 --2- 172.21.15.39:0/3872894386 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66081031c0 0x7f6608103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:38.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:38.754+0000 7f660ca19700 1 -- 172.21.15.39:0/3872894386 >> 172.21.15.39:0/3872894386 conn(0x7f66080fe540 msgr2=0x7f6608107200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:36:38.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:38.754+0000 7f660ca19700 1 -- 172.21.15.39:0/3872894386 shutdown_connections 2024-05-09T05:36:38.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:38.754+0000 7f660ca19700 1 -- 172.21.15.39:0/3872894386 wait complete. 2024-05-09T05:36:38.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:36:38 smithi060 ceph-mon[34555]: from='client.? 172.21.15.39:0/3895645235' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-05-09T05:36:38.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:36:38 smithi100 ceph-mon[34353]: from='client.? 172.21.15.39:0/3895645235' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-05-09T05:36:39.743 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:36:39 smithi039 ceph-mon[30439]: pgmap v348: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-09T05:36:39.744 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:36:39 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/3872894386' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-05-09T05:36:39.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:36:39 smithi060 ceph-mon[34555]: pgmap v348: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-09T05:36:39.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:36:39 smithi060 ceph-mon[34555]: from='client.? 172.21.15.39:0/3872894386' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-05-09T05:36:39.824 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:36:39 smithi100 ceph-mon[34353]: pgmap v348: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-09T05:36:39.825 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:36:39 smithi100 ceph-mon[34353]: from='client.? 172.21.15.39:0/3872894386' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-05-09T05:36:40.604 INFO:tasks.cephadm.ceph_manager.ceph:need seq 184683593784 got 184683593791 for osd.6 2024-05-09T05:36:40.604 DEBUG:teuthology.parallel:result is None 2024-05-09T05:36:40.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:40.816+0000 7febcf2a2700 1 -- 172.21.15.39:0/361513624 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7febc8108740 msgr2=0x7febc81100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:40.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:40.816+0000 7febcf2a2700 1 --2- 172.21.15.39:0/361513624 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7febc8108740 0x7febc81100a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7febc000b0d0 tx=0x7febc000b3e0 comp rx=0 tx=0).stop 2024-05-09T05:36:40.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:40.816+0000 7febcf2a2700 1 -- 172.21.15.39:0/361513624 shutdown_connections 2024-05-09T05:36:40.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:40.816+0000 7febcf2a2700 1 --2- 172.21.15.39:0/361513624 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7febc8108740 0x7febc81100a0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:40.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:40.816+0000 7febcf2a2700 1 --2- 172.21.15.39:0/361513624 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7febc81034c0 0x7febc81038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:40.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:40.816+0000 7febcf2a2700 1 --2- 172.21.15.39:0/361513624 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7febc8107df0 0x7febc8108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:40.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:40.816+0000 7febcf2a2700 1 -- 172.21.15.39:0/361513624 >> 172.21.15.39:0/361513624 conn(0x7febc80fedc0 msgr2=0x7febc81011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:36:40.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:40.816+0000 7febcf2a2700 1 -- 172.21.15.39:0/361513624 shutdown_connections 2024-05-09T05:36:40.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:40.816+0000 7febcf2a2700 1 -- 172.21.15.39:0/361513624 wait complete. 2024-05-09T05:36:40.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:40.817+0000 7febcf2a2700 1 Processor -- start 2024-05-09T05:36:40.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:40.817+0000 7febcf2a2700 1 -- start start 2024-05-09T05:36:40.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:40.817+0000 7febcf2a2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7febc81034c0 0x7febc81999e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:40.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:40.817+0000 7febcf2a2700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7febc8107df0 0x7febc8199f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:40.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:40.817+0000 7febcf2a2700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7febc8108740 0x7febc819a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:40.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:40.817+0000 7febcf2a2700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7febc8113370 con 0x7febc8107df0 2024-05-09T05:36:40.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:40.817+0000 7febcf2a2700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7febc81131f0 con 0x7febc81034c0 2024-05-09T05:36:40.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:40.817+0000 7febcf2a2700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7febc81134f0 con 0x7febc8108740 2024-05-09T05:36:40.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:40.817+0000 7febcc83d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7febc8107df0 0x7febc8199f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:40.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:40.817+0000 7febcc83d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7febc8107df0 0x7febc8199f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:33168/0 (socket says 172.21.15.39:33168) 2024-05-09T05:36:40.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:40.817+0000 7febcc83d700 1 -- 172.21.15.39:0/3355201580 learned_addr learned my addr 172.21.15.39:0/3355201580 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:36:40.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:40.817+0000 7febcd03e700 1 --2- 172.21.15.39:0/3355201580 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7febc81034c0 0x7febc81999e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:40.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:40.817+0000 7febcd83f700 1 --2- 172.21.15.39:0/3355201580 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7febc8108740 0x7febc819a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:40.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:40.817+0000 7febcc83d700 1 -- 172.21.15.39:0/3355201580 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7febc8108740 msgr2=0x7febc819a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:40.814 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:40.817+0000 7febcc83d700 1 --2- 172.21.15.39:0/3355201580 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7febc8108740 0x7febc819a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:40.814 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:40.817+0000 7febcc83d700 1 -- 172.21.15.39:0/3355201580 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7febc81034c0 msgr2=0x7febc81999e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:40.814 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:40.817+0000 7febcc83d700 1 --2- 172.21.15.39:0/3355201580 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7febc81034c0 0x7febc81999e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:40.814 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:40.817+0000 7febcc83d700 1 -- 172.21.15.39:0/3355201580 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febc81a9060 con 0x7febc8107df0 2024-05-09T05:36:40.814 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:40.818+0000 7febcc83d700 1 --2- 172.21.15.39:0/3355201580 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7febc8107df0 0x7febc8199f20 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7febb800ca10 tx=0x7febb800cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:36:40.814 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:40.818+0000 7febbe7fc700 1 -- 172.21.15.39:0/3355201580 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febb8007a60 con 0x7febc8107df0 2024-05-09T05:36:40.814 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:40.818+0000 7febcf2a2700 1 -- 172.21.15.39:0/3355201580 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febc81a9350 con 0x7febc8107df0 2024-05-09T05:36:40.814 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:40.818+0000 7febbe7fc700 1 -- 172.21.15.39:0/3355201580 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7febb8007c00 con 0x7febc8107df0 2024-05-09T05:36:40.814 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:40.818+0000 7febbe7fc700 1 -- 172.21.15.39:0/3355201580 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febb8018660 con 0x7febc8107df0 2024-05-09T05:36:40.814 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:40.818+0000 7febcf2a2700 1 -- 172.21.15.39:0/3355201580 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febc81a9890 con 0x7febc8107df0 2024-05-09T05:36:40.814 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:40.819+0000 7febcf2a2700 1 -- 172.21.15.39:0/3355201580 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febc8104970 con 0x7febc8107df0 2024-05-09T05:36:40.815 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:40.821+0000 7febbe7fc700 1 -- 172.21.15.39:0/3355201580 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7febb800f450 con 0x7febc8107df0 2024-05-09T05:36:40.815 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:40.821+0000 7febbe7fc700 1 --2- 172.21.15.39:0/3355201580 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7febb40b2910 0x7febb40b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:40.815 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:40.822+0000 7febcd03e700 1 --2- 172.21.15.39:0/3355201580 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7febb40b2910 0x7febb40b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:40.815 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:40.822+0000 7febbe7fc700 1 -- 172.21.15.39:0/3355201580 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7febb80e2560 con 0x7febc8107df0 2024-05-09T05:36:40.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:40.822+0000 7febcd03e700 1 --2- 172.21.15.39:0/3355201580 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7febb40b2910 0x7febb40b4e20 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7febc4007be0 tx=0x7febc40073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:36:40.818 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:40.825+0000 7febbe7fc700 1 -- 172.21.15.39:0/3355201580 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7febb8014030 con 0x7febc8107df0 2024-05-09T05:36:41.032 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:41.038+0000 7febcf2a2700 1 -- 172.21.15.39:0/3355201580 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7febc806bc30 con 0x7febc8107df0 2024-05-09T05:36:41.032 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:41.039+0000 7febbe7fc700 1 -- 172.21.15.39:0/3355201580 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7febc806bc30 con 0x7febc8107df0 2024-05-09T05:36:41.033 INFO:teuthology.orchestra.run.smithi039.stdout:266287972400 2024-05-09T05:36:41.035 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:41.041+0000 7febcf2a2700 1 -- 172.21.15.39:0/3355201580 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7febb40b2910 msgr2=0x7febb40b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:41.035 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:41.041+0000 7febcf2a2700 1 --2- 172.21.15.39:0/3355201580 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7febb40b2910 0x7febb40b4e20 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7febc4007be0 tx=0x7febc40073d0 comp rx=0 tx=0).stop 2024-05-09T05:36:41.035 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:41.041+0000 7febcf2a2700 1 -- 172.21.15.39:0/3355201580 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7febc8107df0 msgr2=0x7febc8199f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:41.035 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:41.041+0000 7febcf2a2700 1 --2- 172.21.15.39:0/3355201580 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7febc8107df0 0x7febc8199f20 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7febb800ca10 tx=0x7febb800cd20 comp rx=0 tx=0).stop 2024-05-09T05:36:41.035 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:41.041+0000 7febcf2a2700 1 -- 172.21.15.39:0/3355201580 shutdown_connections 2024-05-09T05:36:41.035 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:41.041+0000 7febcf2a2700 1 --2- 172.21.15.39:0/3355201580 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7febb40b2910 0x7febb40b4e20 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:41.035 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:41.041+0000 7febcf2a2700 1 --2- 172.21.15.39:0/3355201580 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7febc8108740 0x7febc819a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:41.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:41.041+0000 7febcf2a2700 1 --2- 172.21.15.39:0/3355201580 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7febc81034c0 0x7febc81999e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:41.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:41.041+0000 7febcf2a2700 1 --2- 172.21.15.39:0/3355201580 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7febc8107df0 0x7febc8199f20 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:41.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:41.041+0000 7febcf2a2700 1 -- 172.21.15.39:0/3355201580 >> 172.21.15.39:0/3355201580 conn(0x7febc80fedc0 msgr2=0x7febc8107560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:36:41.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:41.041+0000 7febcf2a2700 1 -- 172.21.15.39:0/3355201580 shutdown_connections 2024-05-09T05:36:41.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:41.041+0000 7febcf2a2700 1 -- 172.21.15.39:0/3355201580 wait complete. 2024-05-09T05:36:41.766 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:36:41 smithi039 ceph-mon[30439]: pgmap v349: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-09T05:36:41.766 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:36:41 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/3355201580' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-05-09T05:36:41.794 INFO:tasks.cephadm.ceph_manager.ceph:need seq 266287972395 got 266287972400 for osd.9 2024-05-09T05:36:41.794 DEBUG:teuthology.parallel:result is None 2024-05-09T05:36:41.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:36:41 smithi060 ceph-mon[34555]: pgmap v349: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-09T05:36:41.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:36:41 smithi060 ceph-mon[34555]: from='client.? 172.21.15.39:0/3355201580' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-05-09T05:36:41.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:36:41 smithi100 ceph-mon[34353]: pgmap v349: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-09T05:36:41.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:36:41 smithi100 ceph-mon[34353]: from='client.? 172.21.15.39:0/3355201580' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-05-09T05:36:42.113 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574931 got 55834574935 for osd.1 2024-05-09T05:36:42.113 DEBUG:teuthology.parallel:result is None 2024-05-09T05:36:42.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:42.487+0000 7fedc56eb700 1 -- 172.21.15.39:0/3704529414 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fedc0108740 msgr2=0x7fedc01100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:42.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:42.487+0000 7fedc56eb700 1 --2- 172.21.15.39:0/3704529414 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fedc0108740 0x7fedc01100a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fedb80099c0 tx=0x7fedb8009cd0 comp rx=0 tx=0).stop 2024-05-09T05:36:42.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:42.487+0000 7fedc56eb700 1 -- 172.21.15.39:0/3704529414 shutdown_connections 2024-05-09T05:36:42.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:42.487+0000 7fedc56eb700 1 --2- 172.21.15.39:0/3704529414 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fedc0108740 0x7fedc01100a0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:42.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:42.487+0000 7fedc56eb700 1 --2- 172.21.15.39:0/3704529414 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fedc01034c0 0x7fedc01038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:42.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:42.487+0000 7fedc56eb700 1 --2- 172.21.15.39:0/3704529414 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fedc0107df0 0x7fedc0108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:42.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:42.487+0000 7fedc56eb700 1 -- 172.21.15.39:0/3704529414 >> 172.21.15.39:0/3704529414 conn(0x7fedc00fedc0 msgr2=0x7fedc01011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:36:42.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:42.487+0000 7fedc56eb700 1 -- 172.21.15.39:0/3704529414 shutdown_connections 2024-05-09T05:36:42.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:42.487+0000 7fedc56eb700 1 -- 172.21.15.39:0/3704529414 wait complete. 2024-05-09T05:36:42.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:42.488+0000 7fedc56eb700 1 Processor -- start 2024-05-09T05:36:42.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:42.488+0000 7fedc56eb700 1 -- start start 2024-05-09T05:36:42.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:42.489+0000 7fedc56eb700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fedc01034c0 0x7fedc00ff2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:42.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:42.489+0000 7fedc56eb700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fedc0107df0 0x7fedc00ff7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:42.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:42.489+0000 7fedc56eb700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fedc0108740 0x7fedc00ffd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:42.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:42.489+0000 7fedc56eb700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fedc0113370 con 0x7fedc01034c0 2024-05-09T05:36:42.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:42.489+0000 7fedc56eb700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fedc01131f0 con 0x7fedc0108740 2024-05-09T05:36:42.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:42.489+0000 7fedc56eb700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fedc01134f0 con 0x7fedc0107df0 2024-05-09T05:36:42.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:42.489+0000 7fedbeffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fedc01034c0 0x7fedc00ff2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:42.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:42.489+0000 7fedbeffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fedc01034c0 0x7fedc00ff2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:33176/0 (socket says 172.21.15.39:33176) 2024-05-09T05:36:42.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:42.489+0000 7fedbeffd700 1 -- 172.21.15.39:0/1755339309 learned_addr learned my addr 172.21.15.39:0/1755339309 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:36:42.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:42.489+0000 7fedbf7fe700 1 --2- 172.21.15.39:0/1755339309 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fedc0108740 0x7fedc00ffd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:42.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:42.489+0000 7fedbe7fc700 1 --2- 172.21.15.39:0/1755339309 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fedc0107df0 0x7fedc00ff7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:42.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:42.489+0000 7fedbeffd700 1 -- 172.21.15.39:0/1755339309 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fedc0107df0 msgr2=0x7fedc00ff7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:42.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:42.489+0000 7fedbeffd700 1 --2- 172.21.15.39:0/1755339309 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fedc0107df0 0x7fedc00ff7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:42.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:42.489+0000 7fedbeffd700 1 -- 172.21.15.39:0/1755339309 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fedc0108740 msgr2=0x7fedc00ffd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:42.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:42.489+0000 7fedbeffd700 1 --2- 172.21.15.39:0/1755339309 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fedc0108740 0x7fedc00ffd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:42.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:42.489+0000 7fedbeffd700 1 -- 172.21.15.39:0/1755339309 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedc01a9120 con 0x7fedc01034c0 2024-05-09T05:36:42.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:42.489+0000 7fedbf7fe700 1 --2- 172.21.15.39:0/1755339309 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fedc0108740 0x7fedc00ffd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T05:36:42.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:42.489+0000 7fedbeffd700 1 --2- 172.21.15.39:0/1755339309 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fedc01034c0 0x7fedc00ff2a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fedb00060b0 tx=0x7fedb0007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:36:42.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:42.489+0000 7fedb7fff700 1 -- 172.21.15.39:0/1755339309 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedb001a070 con 0x7fedc01034c0 2024-05-09T05:36:42.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:42.490+0000 7fedc56eb700 1 -- 172.21.15.39:0/1755339309 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedc01a9410 con 0x7fedc01034c0 2024-05-09T05:36:42.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:42.490+0000 7fedb7fff700 1 -- 172.21.15.39:0/1755339309 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fedb000de20 con 0x7fedc01034c0 2024-05-09T05:36:42.485 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:42.490+0000 7fedb7fff700 1 -- 172.21.15.39:0/1755339309 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedb0014720 con 0x7fedc01034c0 2024-05-09T05:36:42.485 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:42.490+0000 7fedc56eb700 1 -- 172.21.15.39:0/1755339309 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedc01a99a0 con 0x7fedc01034c0 2024-05-09T05:36:42.485 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:42.491+0000 7fedc56eb700 1 -- 172.21.15.39:0/1755339309 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedc00512c0 con 0x7fedc01034c0 2024-05-09T05:36:42.485 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:42.492+0000 7fedb7fff700 1 -- 172.21.15.39:0/1755339309 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fedb001d070 con 0x7fedc01034c0 2024-05-09T05:36:42.486 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:42.493+0000 7fedb7fff700 1 --2- 172.21.15.39:0/1755339309 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fedac0b2910 0x7fedac0b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:42.486 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:42.493+0000 7fedbe7fc700 1 --2- 172.21.15.39:0/1755339309 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fedac0b2910 0x7fedac0b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:42.486 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:42.493+0000 7fedb7fff700 1 -- 172.21.15.39:0/1755339309 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7fedb00e2170 con 0x7fedc01034c0 2024-05-09T05:36:42.486 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:42.494+0000 7fedbe7fc700 1 --2- 172.21.15.39:0/1755339309 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fedac0b2910 0x7fedac0b4e20 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7feda8005fd0 tx=0x7feda800af20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:36:42.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:42.497+0000 7fedb7fff700 1 -- 172.21.15.39:0/1755339309 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fedb0010070 con 0x7fedc01034c0 2024-05-09T05:36:42.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:42.717+0000 7fedc56eb700 1 -- 172.21.15.39:0/1755339309 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7fedc01007d0 con 0x7fedc01034c0 2024-05-09T05:36:42.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:42.717+0000 7fedb7fff700 1 -- 172.21.15.39:0/1755339309 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fedb00a9d40 con 0x7fedc01034c0 2024-05-09T05:36:42.710 INFO:teuthology.orchestra.run.smithi039.stdout:240518168631 2024-05-09T05:36:42.713 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:42.720+0000 7fedc56eb700 1 -- 172.21.15.39:0/1755339309 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fedac0b2910 msgr2=0x7fedac0b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:42.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:42.720+0000 7fedc56eb700 1 --2- 172.21.15.39:0/1755339309 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fedac0b2910 0x7fedac0b4e20 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7feda8005fd0 tx=0x7feda800af20 comp rx=0 tx=0).stop 2024-05-09T05:36:42.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:42.720+0000 7fedc56eb700 1 -- 172.21.15.39:0/1755339309 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fedc01034c0 msgr2=0x7fedc00ff2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:42.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:42.720+0000 7fedc56eb700 1 --2- 172.21.15.39:0/1755339309 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fedc01034c0 0x7fedc00ff2a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fedb00060b0 tx=0x7fedb0007f90 comp rx=0 tx=0).stop 2024-05-09T05:36:42.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:42.720+0000 7fedc56eb700 1 -- 172.21.15.39:0/1755339309 shutdown_connections 2024-05-09T05:36:42.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:42.720+0000 7fedc56eb700 1 --2- 172.21.15.39:0/1755339309 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fedac0b2910 0x7fedac0b4e20 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:42.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:42.720+0000 7fedc56eb700 1 --2- 172.21.15.39:0/1755339309 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fedc0108740 0x7fedc00ffd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:42.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:42.720+0000 7fedc56eb700 1 --2- 172.21.15.39:0/1755339309 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fedc01034c0 0x7fedc00ff2a0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:42.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:42.720+0000 7fedc56eb700 1 --2- 172.21.15.39:0/1755339309 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fedc0107df0 0x7fedc00ff7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:42.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:42.720+0000 7fedc56eb700 1 -- 172.21.15.39:0/1755339309 >> 172.21.15.39:0/1755339309 conn(0x7fedc00fedc0 msgr2=0x7fedc006b950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:36:42.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:42.720+0000 7fedc56eb700 1 -- 172.21.15.39:0/1755339309 shutdown_connections 2024-05-09T05:36:42.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:42.720+0000 7fedc56eb700 1 -- 172.21.15.39:0/1755339309 wait complete. 2024-05-09T05:36:42.768 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:42.775+0000 7fefb867c700 1 -- 172.21.15.39:0/2319834854 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fefb0104610 msgr2=0x7fefb0104a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:42.768 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:42.775+0000 7fefb867c700 1 --2- 172.21.15.39:0/2319834854 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fefb0104610 0x7fefb0104a20 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fefac0099c0 tx=0x7fefac009cd0 comp rx=0 tx=0).stop 2024-05-09T05:36:42.768 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:42.775+0000 7fefb867c700 1 -- 172.21.15.39:0/2319834854 shutdown_connections 2024-05-09T05:36:42.768 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:42.775+0000 7fefb867c700 1 --2- 172.21.15.39:0/2319834854 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fefb0109890 0x7fefb01111f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:42.768 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:42.775+0000 7fefb867c700 1 --2- 172.21.15.39:0/2319834854 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fefb0104610 0x7fefb0104a20 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:42.768 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:42.775+0000 7fefb867c700 1 --2- 172.21.15.39:0/2319834854 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fefb0108f40 0x7fefb0109350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:42.768 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:42.775+0000 7fefb867c700 1 -- 172.21.15.39:0/2319834854 >> 172.21.15.39:0/2319834854 conn(0x7fefb007af70 msgr2=0x7fefb007b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:36:42.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:42.775+0000 7fefb867c700 1 -- 172.21.15.39:0/2319834854 shutdown_connections 2024-05-09T05:36:42.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:42.775+0000 7fefb867c700 1 -- 172.21.15.39:0/2319834854 wait complete. 2024-05-09T05:36:42.770 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:42.776+0000 7fefb867c700 1 Processor -- start 2024-05-09T05:36:42.770 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:42.776+0000 7fefb867c700 1 -- start start 2024-05-09T05:36:42.770 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:42.776+0000 7fefb867c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fefb0104610 0x7fefb019ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:42.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:42.776+0000 7fefb867c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fefb0108f40 0x7fefb019b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:42.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:42.776+0000 7fefb867c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fefb0109890 0x7fefb019f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:42.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:42.776+0000 7fefb867c700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fefb0114510 con 0x7fefb0108f40 2024-05-09T05:36:42.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:42.776+0000 7fefb867c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fefb0114390 con 0x7fefb0104610 2024-05-09T05:36:42.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:42.776+0000 7fefb867c700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fefb0114690 con 0x7fefb0109890 2024-05-09T05:36:42.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:42.777+0000 7fefb5c17700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fefb0108f40 0x7fefb019b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:42.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:42.777+0000 7fefb5c17700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fefb0108f40 0x7fefb019b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:33192/0 (socket says 172.21.15.39:33192) 2024-05-09T05:36:42.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:42.777+0000 7fefb5c17700 1 -- 172.21.15.39:0/2065574408 learned_addr learned my addr 172.21.15.39:0/2065574408 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:36:42.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:42.777+0000 7fefb6c19700 1 --2- 172.21.15.39:0/2065574408 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fefb0109890 0x7fefb019f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:42.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:42.777+0000 7fefb6418700 1 --2- 172.21.15.39:0/2065574408 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fefb0104610 0x7fefb019ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:42.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:42.777+0000 7fefb5c17700 1 -- 172.21.15.39:0/2065574408 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fefb0109890 msgr2=0x7fefb019f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:42.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:42.777+0000 7fefb5c17700 1 --2- 172.21.15.39:0/2065574408 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fefb0109890 0x7fefb019f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:42.771 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:42.777+0000 7fefb5c17700 1 -- 172.21.15.39:0/2065574408 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fefb0104610 msgr2=0x7fefb019ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:42.772 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:42.777+0000 7fefb5c17700 1 --2- 172.21.15.39:0/2065574408 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fefb0104610 0x7fefb019ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:42.772 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:42.777+0000 7fefb5c17700 1 -- 172.21.15.39:0/2065574408 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefb019fd50 con 0x7fefb0108f40 2024-05-09T05:36:42.772 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:42.777+0000 7fefb6c19700 1 --2- 172.21.15.39:0/2065574408 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fefb0109890 0x7fefb019f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T05:36:42.772 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:42.777+0000 7fefb5c17700 1 --2- 172.21.15.39:0/2065574408 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fefb0108f40 0x7fefb019b420 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fefa000d950 tx=0x7fefa000dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:36:42.772 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:42.777+0000 7fefa77fe700 1 -- 172.21.15.39:0/2065574408 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefa0016070 con 0x7fefb0108f40 2024-05-09T05:36:42.772 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:42.778+0000 7fefb867c700 1 -- 172.21.15.39:0/2065574408 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefb01a0040 con 0x7fefb0108f40 2024-05-09T05:36:42.772 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:42.778+0000 7fefa77fe700 1 -- 172.21.15.39:0/2065574408 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fefa000de30 con 0x7fefb0108f40 2024-05-09T05:36:42.772 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:42.778+0000 7fefa77fe700 1 -- 172.21.15.39:0/2065574408 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefa0005350 con 0x7fefb0108f40 2024-05-09T05:36:42.772 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:42.778+0000 7fefb867c700 1 -- 172.21.15.39:0/2065574408 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefb00759f0 con 0x7fefb0108f40 2024-05-09T05:36:42.772 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:42.779+0000 7fefb867c700 1 -- 172.21.15.39:0/2065574408 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fefb00512c0 con 0x7fefb0108f40 2024-05-09T05:36:42.773 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:42.780+0000 7fefa77fe700 1 -- 172.21.15.39:0/2065574408 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fefa00054f0 con 0x7fefb0108f40 2024-05-09T05:36:42.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:42.782+0000 7fefa77fe700 1 --2- 172.21.15.39:0/2065574408 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fef9c0b2990 0x7fef9c0b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:42.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:42.782+0000 7fefb6418700 1 --2- 172.21.15.39:0/2065574408 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fef9c0b2990 0x7fef9c0b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:42.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:42.782+0000 7fefa77fe700 1 -- 172.21.15.39:0/2065574408 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7fefa00e1f20 con 0x7fefb0108f40 2024-05-09T05:36:42.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:42.783+0000 7fefb6418700 1 --2- 172.21.15.39:0/2065574408 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fef9c0b2990 0x7fef9c0b4ea0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fefac003800 tx=0x7fefac01a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:36:42.778 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:42.786+0000 7fefa77fe700 1 -- 172.21.15.39:0/2065574408 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fefa001f070 con 0x7fefb0108f40 2024-05-09T05:36:42.995 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:43.003+0000 7fefb867c700 1 -- 172.21.15.39:0/2065574408 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fefb002e5f0 con 0x7fefb0108f40 2024-05-09T05:36:42.996 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:43.003+0000 7fefa77fe700 1 -- 172.21.15.39:0/2065574408 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fefa00a9af0 con 0x7fefb0108f40 2024-05-09T05:36:42.996 INFO:teuthology.orchestra.run.smithi039.stdout:158913790021 2024-05-09T05:36:42.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:43.006+0000 7fefb867c700 1 -- 172.21.15.39:0/2065574408 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fef9c0b2990 msgr2=0x7fef9c0b4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:42.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:43.006+0000 7fefb867c700 1 --2- 172.21.15.39:0/2065574408 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fef9c0b2990 0x7fef9c0b4ea0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fefac003800 tx=0x7fefac01a040 comp rx=0 tx=0).stop 2024-05-09T05:36:42.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:43.006+0000 7fefb867c700 1 -- 172.21.15.39:0/2065574408 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fefb0108f40 msgr2=0x7fefb019b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:42.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:43.006+0000 7fefb867c700 1 --2- 172.21.15.39:0/2065574408 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fefb0108f40 0x7fefb019b420 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fefa000d950 tx=0x7fefa000dd10 comp rx=0 tx=0).stop 2024-05-09T05:36:42.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:43.006+0000 7fefb867c700 1 -- 172.21.15.39:0/2065574408 shutdown_connections 2024-05-09T05:36:42.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:43.006+0000 7fefb867c700 1 --2- 172.21.15.39:0/2065574408 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fef9c0b2990 0x7fef9c0b4ea0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:42.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:43.006+0000 7fefb867c700 1 --2- 172.21.15.39:0/2065574408 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fefb0109890 0x7fefb019f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:42.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:43.006+0000 7fefb867c700 1 --2- 172.21.15.39:0/2065574408 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fefb0104610 0x7fefb019ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:42.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:43.006+0000 7fefb867c700 1 --2- 172.21.15.39:0/2065574408 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fefb0108f40 0x7fefb019b420 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:42.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:43.006+0000 7fefb867c700 1 -- 172.21.15.39:0/2065574408 >> 172.21.15.39:0/2065574408 conn(0x7fefb007af70 msgr2=0x7fefb01019e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:36:42.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:43.006+0000 7fefb867c700 1 -- 172.21.15.39:0/2065574408 shutdown_connections 2024-05-09T05:36:42.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:43.006+0000 7fefb867c700 1 -- 172.21.15.39:0/2065574408 wait complete. 2024-05-09T05:36:43.603 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182474 got 107374182478 for osd.3 2024-05-09T05:36:43.603 DEBUG:teuthology.parallel:result is None 2024-05-09T05:36:43.685 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:36:43 smithi039 ceph-mon[30439]: pgmap v350: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-09T05:36:43.685 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:36:43 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/1755339309' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-05-09T05:36:43.685 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:36:43 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/2065574408' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-05-09T05:36:43.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:36:43 smithi060 ceph-mon[34555]: pgmap v350: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-09T05:36:43.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:36:43 smithi060 ceph-mon[34555]: from='client.? 172.21.15.39:0/1755339309' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-05-09T05:36:43.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:36:43 smithi060 ceph-mon[34555]: from='client.? 172.21.15.39:0/2065574408' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-05-09T05:36:43.802 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:43.809+0000 7f61ea5bb700 1 -- 172.21.15.39:0/2769521490 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f61e4107df0 msgr2=0x7f61e4108200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:43.802 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:43.809+0000 7f61ea5bb700 1 --2- 172.21.15.39:0/2769521490 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f61e4107df0 0x7f61e4108200 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f61d80099c0 tx=0x7f61d8009cd0 comp rx=0 tx=0).stop 2024-05-09T05:36:43.802 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:43.809+0000 7f61ea5bb700 1 -- 172.21.15.39:0/2769521490 shutdown_connections 2024-05-09T05:36:43.803 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:43.809+0000 7f61ea5bb700 1 --2- 172.21.15.39:0/2769521490 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f61e4108740 0x7f61e41100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:43.803 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:43.809+0000 7f61ea5bb700 1 --2- 172.21.15.39:0/2769521490 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61e41034c0 0x7f61e41038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:43.803 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:43.809+0000 7f61ea5bb700 1 --2- 172.21.15.39:0/2769521490 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f61e4107df0 0x7f61e4108200 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:43.803 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:43.809+0000 7f61ea5bb700 1 -- 172.21.15.39:0/2769521490 >> 172.21.15.39:0/2769521490 conn(0x7f61e40fedf0 msgr2=0x7f61e4101210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:36:43.803 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:43.809+0000 7f61ea5bb700 1 -- 172.21.15.39:0/2769521490 shutdown_connections 2024-05-09T05:36:43.803 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:43.809+0000 7f61ea5bb700 1 -- 172.21.15.39:0/2769521490 wait complete. 2024-05-09T05:36:43.804 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:43.810+0000 7f61ea5bb700 1 Processor -- start 2024-05-09T05:36:43.804 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:43.810+0000 7f61ea5bb700 1 -- start start 2024-05-09T05:36:43.805 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:43.810+0000 7f61ea5bb700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f61e41034c0 0x7f61e419adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:43.805 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:43.810+0000 7f61ea5bb700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f61e4107df0 0x7f61e419b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:43.805 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:43.810+0000 7f61ea5bb700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61e4108740 0x7f61e419f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:43.805 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:43.810+0000 7f61ea5bb700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f61e4113370 con 0x7f61e41034c0 2024-05-09T05:36:43.805 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:43.810+0000 7f61ea5bb700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f61e41131f0 con 0x7f61e4108740 2024-05-09T05:36:43.805 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:43.810+0000 7f61ea5bb700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f61e41134f0 con 0x7f61e4107df0 2024-05-09T05:36:43.805 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:43.810+0000 7f61e3fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f61e41034c0 0x7f61e419adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:43.805 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:43.810+0000 7f61e3fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f61e41034c0 0x7f61e419adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:33220/0 (socket says 172.21.15.39:33220) 2024-05-09T05:36:43.805 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:43.810+0000 7f61e3fff700 1 -- 172.21.15.39:0/475593063 learned_addr learned my addr 172.21.15.39:0/475593063 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:36:43.805 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:43.810+0000 7f61e8b58700 1 --2- 172.21.15.39:0/475593063 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61e4108740 0x7f61e419f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:43.805 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:43.810+0000 7f61e37fe700 1 --2- 172.21.15.39:0/475593063 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f61e4107df0 0x7f61e419b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:43.805 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:43.811+0000 7f61e3fff700 1 -- 172.21.15.39:0/475593063 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f61e4107df0 msgr2=0x7f61e419b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:43.805 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:43.811+0000 7f61e3fff700 1 --2- 172.21.15.39:0/475593063 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f61e4107df0 0x7f61e419b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:43.806 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:43.811+0000 7f61e3fff700 1 -- 172.21.15.39:0/475593063 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61e4108740 msgr2=0x7f61e419f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:43.806 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:43.811+0000 7f61e3fff700 1 --2- 172.21.15.39:0/475593063 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61e4108740 0x7f61e419f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:43.806 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:43.811+0000 7f61e3fff700 1 -- 172.21.15.39:0/475593063 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61e419fcc0 con 0x7f61e41034c0 2024-05-09T05:36:43.806 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:43.811+0000 7f61e3fff700 1 --2- 172.21.15.39:0/475593063 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f61e41034c0 0x7f61e419adf0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f61d400d950 tx=0x7f61d400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:36:43.806 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:43.811+0000 7f61e17fa700 1 -- 172.21.15.39:0/475593063 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61d4016070 con 0x7f61e41034c0 2024-05-09T05:36:43.806 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:43.811+0000 7f61e17fa700 1 -- 172.21.15.39:0/475593063 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f61d400fd40 con 0x7f61e41034c0 2024-05-09T05:36:43.806 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:43.811+0000 7f61ea5bb700 1 -- 172.21.15.39:0/475593063 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61e419ffb0 con 0x7f61e41034c0 2024-05-09T05:36:43.806 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:43.811+0000 7f61e17fa700 1 -- 172.21.15.39:0/475593063 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61d400e3b0 con 0x7f61e41034c0 2024-05-09T05:36:43.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:43.811+0000 7f61ea5bb700 1 -- 172.21.15.39:0/475593063 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61e41a78d0 con 0x7f61e41034c0 2024-05-09T05:36:43.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:43.812+0000 7f61ea5bb700 1 -- 172.21.15.39:0/475593063 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61e40512c0 con 0x7f61e41034c0 2024-05-09T05:36:43.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:43.814+0000 7f61e17fa700 1 -- 172.21.15.39:0/475593063 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f61d4019070 con 0x7f61e41034c0 2024-05-09T05:36:43.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:43.815+0000 7f61e17fa700 1 --2- 172.21.15.39:0/475593063 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f61cc0b2910 0x7f61cc0b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:43.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:43.815+0000 7f61e37fe700 1 --2- 172.21.15.39:0/475593063 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f61cc0b2910 0x7f61cc0b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:43.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:43.815+0000 7f61e17fa700 1 -- 172.21.15.39:0/475593063 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f61d40e1e40 con 0x7f61e41034c0 2024-05-09T05:36:43.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:43.816+0000 7f61e37fe700 1 --2- 172.21.15.39:0/475593063 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f61cc0b2910 0x7f61cc0b4e20 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f61d8006010 tx=0x7f61d8000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:36:43.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:43.819+0000 7f61e17fa700 1 -- 172.21.15.39:0/475593063 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f61d40a99b0 con 0x7f61e41034c0 2024-05-09T05:36:43.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:36:43 smithi100 ceph-mon[34353]: pgmap v350: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-09T05:36:43.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:36:43 smithi100 ceph-mon[34353]: from='client.? 172.21.15.39:0/1755339309' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-05-09T05:36:43.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:36:43 smithi100 ceph-mon[34353]: from='client.? 172.21.15.39:0/2065574408' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-05-09T05:36:44.033 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:44.040+0000 7f61ea5bb700 1 -- 172.21.15.39:0/475593063 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f61e402e5f0 con 0x7f61e41034c0 2024-05-09T05:36:44.033 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:44.040+0000 7f61e17fa700 1 -- 172.21.15.39:0/475593063 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f61d40a92b0 con 0x7f61e41034c0 2024-05-09T05:36:44.034 INFO:teuthology.orchestra.run.smithi039.stdout:210453397563 2024-05-09T05:36:44.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:44.042+0000 7f61ea5bb700 1 -- 172.21.15.39:0/475593063 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f61cc0b2910 msgr2=0x7f61cc0b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:44.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:44.042+0000 7f61ea5bb700 1 --2- 172.21.15.39:0/475593063 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f61cc0b2910 0x7f61cc0b4e20 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f61d8006010 tx=0x7f61d8000bc0 comp rx=0 tx=0).stop 2024-05-09T05:36:44.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:44.042+0000 7f61ea5bb700 1 -- 172.21.15.39:0/475593063 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f61e41034c0 msgr2=0x7f61e419adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:44.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:44.042+0000 7f61ea5bb700 1 --2- 172.21.15.39:0/475593063 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f61e41034c0 0x7f61e419adf0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f61d400d950 tx=0x7f61d400dc60 comp rx=0 tx=0).stop 2024-05-09T05:36:44.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:44.042+0000 7f61ea5bb700 1 -- 172.21.15.39:0/475593063 shutdown_connections 2024-05-09T05:36:44.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:44.042+0000 7f61ea5bb700 1 --2- 172.21.15.39:0/475593063 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f61cc0b2910 0x7f61cc0b4e20 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:44.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:44.042+0000 7f61ea5bb700 1 --2- 172.21.15.39:0/475593063 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61e4108740 0x7f61e419f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:44.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:44.042+0000 7f61ea5bb700 1 --2- 172.21.15.39:0/475593063 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f61e41034c0 0x7f61e419adf0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:44.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:44.042+0000 7f61ea5bb700 1 --2- 172.21.15.39:0/475593063 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f61e4107df0 0x7f61e419b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:44.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:44.042+0000 7f61ea5bb700 1 -- 172.21.15.39:0/475593063 >> 172.21.15.39:0/475593063 conn(0x7f61e40fedf0 msgr2=0x7f61e4075d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:36:44.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:44.042+0000 7f61ea5bb700 1 -- 172.21.15.39:0/475593063 shutdown_connections 2024-05-09T05:36:44.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:44.042+0000 7f61ea5bb700 1 -- 172.21.15.39:0/475593063 wait complete. 2024-05-09T05:36:44.207 INFO:tasks.cephadm.ceph_manager.ceph:need seq 287762808867 got 287762808874 for osd.10 2024-05-09T05:36:44.207 DEBUG:teuthology.parallel:result is None 2024-05-09T05:36:44.775 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:36:44 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/475593063' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-05-09T05:36:44.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:36:44 smithi060 ceph-mon[34555]: from='client.? 172.21.15.39:0/475593063' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-05-09T05:36:44.804 INFO:tasks.cephadm.ceph_manager.ceph:need seq 210453397558 got 210453397563 for osd.7 2024-05-09T05:36:44.804 DEBUG:teuthology.parallel:result is None 2024-05-09T05:36:44.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:36:44 smithi100 ceph-mon[34353]: from='client.? 172.21.15.39:0/475593063' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-05-09T05:36:45.426 INFO:tasks.cephadm.ceph_manager.ceph:need seq 240518168625 got 240518168631 for osd.8 2024-05-09T05:36:45.427 DEBUG:teuthology.parallel:result is None 2024-05-09T05:36:45.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:36:45 smithi060 ceph-mon[34555]: pgmap v351: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-05-09T05:36:45.823 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:36:45 smithi039 ceph-mon[30439]: pgmap v351: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-05-09T05:36:45.858 INFO:tasks.cephadm.ceph_manager.ceph:need seq 158913790017 got 158913790021 for osd.5 2024-05-09T05:36:45.858 DEBUG:teuthology.parallel:result is None 2024-05-09T05:36:45.859 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-05-09T05:36:45.859 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph pg dump --format=json 2024-05-09T05:36:45.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:36:45 smithi100 ceph-mon[34353]: pgmap v351: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-05-09T05:36:46.121 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T05:36:47.558 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:36:47 smithi039 ceph-mon[30439]: pgmap v352: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-09T05:36:47.592 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:47.598+0000 7f84f0702700 1 -- 172.21.15.39:0/3258017865 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f84e8107df0 msgr2=0x7f84e8108200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:47.592 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:47.598+0000 7f84f0702700 1 --2- 172.21.15.39:0/3258017865 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f84e8107df0 0x7f84e8108200 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f84d80099c0 tx=0x7f84d8009cd0 comp rx=0 tx=0).stop 2024-05-09T05:36:47.592 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:47.598+0000 7f84f0702700 1 -- 172.21.15.39:0/3258017865 shutdown_connections 2024-05-09T05:36:47.592 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:47.598+0000 7f84f0702700 1 --2- 172.21.15.39:0/3258017865 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84e8108740 0x7f84e81100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:47.592 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:47.598+0000 7f84f0702700 1 --2- 172.21.15.39:0/3258017865 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84e81034c0 0x7f84e81038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:47.592 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:47.598+0000 7f84f0702700 1 --2- 172.21.15.39:0/3258017865 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f84e8107df0 0x7f84e8108200 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:47.593 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:47.598+0000 7f84f0702700 1 -- 172.21.15.39:0/3258017865 >> 172.21.15.39:0/3258017865 conn(0x7f84e80fedc0 msgr2=0x7f84e81011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:36:47.593 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:47.598+0000 7f84f0702700 1 -- 172.21.15.39:0/3258017865 shutdown_connections 2024-05-09T05:36:47.593 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:47.598+0000 7f84f0702700 1 -- 172.21.15.39:0/3258017865 wait complete. 2024-05-09T05:36:47.595 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:47.599+0000 7f84f0702700 1 Processor -- start 2024-05-09T05:36:47.595 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:47.599+0000 7f84f0702700 1 -- start start 2024-05-09T05:36:47.595 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:47.599+0000 7f84f0702700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f84e81034c0 0x7f84e8199d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:47.595 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:47.599+0000 7f84f0702700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84e8107df0 0x7f84e819a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:47.595 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:47.599+0000 7f84f0702700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84e8108740 0x7f84e819e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:47.595 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:47.599+0000 7f84f0702700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f84e8113350 con 0x7f84e81034c0 2024-05-09T05:36:47.595 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:47.599+0000 7f84f0702700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f84e81131d0 con 0x7f84e8108740 2024-05-09T05:36:47.595 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:47.599+0000 7f84f0702700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f84e81134d0 con 0x7f84e8107df0 2024-05-09T05:36:47.596 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:47.599+0000 7f84ee49e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f84e81034c0 0x7f84e8199d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:47.596 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:47.599+0000 7f84ee49e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f84e81034c0 0x7f84e8199d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:59426/0 (socket says 172.21.15.39:59426) 2024-05-09T05:36:47.596 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:47.599+0000 7f84ee49e700 1 -- 172.21.15.39:0/801430657 learned_addr learned my addr 172.21.15.39:0/801430657 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:36:47.596 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:47.600+0000 7f84eec9f700 1 --2- 172.21.15.39:0/801430657 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84e8108740 0x7f84e819e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:47.596 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:47.600+0000 7f84edc9d700 1 --2- 172.21.15.39:0/801430657 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84e8107df0 0x7f84e819a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:47.596 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:47.600+0000 7f84ee49e700 1 -- 172.21.15.39:0/801430657 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84e8107df0 msgr2=0x7f84e819a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:47.596 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:47.600+0000 7f84ee49e700 1 --2- 172.21.15.39:0/801430657 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84e8107df0 0x7f84e819a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:47.596 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:47.600+0000 7f84ee49e700 1 -- 172.21.15.39:0/801430657 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84e8108740 msgr2=0x7f84e819e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:47.596 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:47.600+0000 7f84ee49e700 1 --2- 172.21.15.39:0/801430657 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84e8108740 0x7f84e819e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:47.596 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:47.600+0000 7f84ee49e700 1 -- 172.21.15.39:0/801430657 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84e819eb40 con 0x7f84e81034c0 2024-05-09T05:36:47.596 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:47.600+0000 7f84edc9d700 1 --2- 172.21.15.39:0/801430657 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84e8107df0 0x7f84e819a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T05:36:47.597 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:47.600+0000 7f84ee49e700 1 --2- 172.21.15.39:0/801430657 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f84e81034c0 0x7f84e8199d20 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f84e400c5a0 tx=0x7f84e400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:36:47.597 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:47.600+0000 7f84df7fe700 1 -- 172.21.15.39:0/801430657 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84e4011670 con 0x7f84e81034c0 2024-05-09T05:36:47.597 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:47.600+0000 7f84df7fe700 1 -- 172.21.15.39:0/801430657 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f84e4011cc0 con 0x7f84e81034c0 2024-05-09T05:36:47.597 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:47.600+0000 7f84f0702700 1 -- 172.21.15.39:0/801430657 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84e819ee30 con 0x7f84e81034c0 2024-05-09T05:36:47.597 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:47.600+0000 7f84df7fe700 1 -- 172.21.15.39:0/801430657 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84e401ad30 con 0x7f84e81034c0 2024-05-09T05:36:47.597 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:47.600+0000 7f84f0702700 1 -- 172.21.15.39:0/801430657 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84e819f340 con 0x7f84e81034c0 2024-05-09T05:36:47.597 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:47.601+0000 7f84f0702700 1 -- 172.21.15.39:0/801430657 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84e80512c0 con 0x7f84e81034c0 2024-05-09T05:36:47.598 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:47.603+0000 7f84df7fe700 1 -- 172.21.15.39:0/801430657 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f84e4011810 con 0x7f84e81034c0 2024-05-09T05:36:47.598 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:47.604+0000 7f84df7fe700 1 --2- 172.21.15.39:0/801430657 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f84d40b2910 0x7f84d40b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:47.598 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:47.604+0000 7f84edc9d700 1 --2- 172.21.15.39:0/801430657 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f84d40b2910 0x7f84d40b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:47.598 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:47.604+0000 7f84df7fe700 1 -- 172.21.15.39:0/801430657 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f84e40e4e00 con 0x7f84e81034c0 2024-05-09T05:36:47.598 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:47.604+0000 7f84edc9d700 1 --2- 172.21.15.39:0/801430657 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f84d40b2910 0x7f84d40b4e20 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f84d8000c00 tx=0x7f84d801a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:36:47.600 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:47.607+0000 7f84df7fe700 1 -- 172.21.15.39:0/801430657 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f84e4016030 con 0x7f84e81034c0 2024-05-09T05:36:47.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:36:47 smithi060 ceph-mon[34555]: pgmap v352: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-09T05:36:47.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:47.817+0000 7f84f0702700 1 -- 172.21.15.39:0/801430657 --> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f84e806b6d0 con 0x7f84d40b2910 2024-05-09T05:36:47.818 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:47.825+0000 7f84df7fe700 1 -- 172.21.15.39:0/801430657 <== mgr.14152 v2:172.21.15.39:6800/3184189003 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258709 (secure 0 0 0) 0x7f84e806b6d0 con 0x7f84d40b2910 2024-05-09T05:36:47.823 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-09T05:36:47.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:47.828+0000 7f84f0702700 1 -- 172.21.15.39:0/801430657 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f84d40b2910 msgr2=0x7f84d40b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:47.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:47.828+0000 7f84f0702700 1 --2- 172.21.15.39:0/801430657 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f84d40b2910 0x7f84d40b4e20 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f84d8000c00 tx=0x7f84d801a040 comp rx=0 tx=0).stop 2024-05-09T05:36:47.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:47.828+0000 7f84f0702700 1 -- 172.21.15.39:0/801430657 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f84e81034c0 msgr2=0x7f84e8199d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:47.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:47.828+0000 7f84f0702700 1 --2- 172.21.15.39:0/801430657 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f84e81034c0 0x7f84e8199d20 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f84e400c5a0 tx=0x7f84e400c8b0 comp rx=0 tx=0).stop 2024-05-09T05:36:47.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:47.828+0000 7f84f0702700 1 -- 172.21.15.39:0/801430657 shutdown_connections 2024-05-09T05:36:47.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:47.828+0000 7f84f0702700 1 --2- 172.21.15.39:0/801430657 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f84d40b2910 0x7f84d40b4e20 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:47.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:47.828+0000 7f84f0702700 1 --2- 172.21.15.39:0/801430657 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84e8108740 0x7f84e819e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:47.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:47.828+0000 7f84f0702700 1 --2- 172.21.15.39:0/801430657 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f84e81034c0 0x7f84e8199d20 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:47.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:47.828+0000 7f84f0702700 1 --2- 172.21.15.39:0/801430657 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84e8107df0 0x7f84e819a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:47.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:47.828+0000 7f84f0702700 1 -- 172.21.15.39:0/801430657 >> 172.21.15.39:0/801430657 conn(0x7f84e80fedc0 msgr2=0x7f84e8107560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:36:47.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:47.828+0000 7f84f0702700 1 -- 172.21.15.39:0/801430657 shutdown_connections 2024-05-09T05:36:47.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:47.828+0000 7f84f0702700 1 -- 172.21.15.39:0/801430657 wait complete. 2024-05-09T05:36:47.826 INFO:teuthology.orchestra.run.smithi039.stderr:dumped all 2024-05-09T05:36:47.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:36:47 smithi100 ceph-mon[34353]: pgmap v352: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-09T05:36:48.400 INFO:teuthology.orchestra.run.smithi039.stdout:{"pg_ready":true,"pg_map":{"version":352,"stamp":"2024-05-09T05:36:46.158316+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":654365,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":644,"num_read_kb":403,"num_write":290,"num_write_kb":2262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":2994063,"num_keys_recovered":11,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":234,"ondisk_log_size":234,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":378512,"kb_used_data":12684,"kb_used_omap":18,"kb_used_meta":365677,"kb_avail":1124563312,"statfs":{"total":1151940427776,"available":1151552831488,"internally_reserved":0,"allocated":12988416,"data_stored":7245279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":374453562},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":35,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003451"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.503540+0000","last_change":"2024-05-09T05:34:54.344495+0000","last_active":"2024-05-09T05:35:29.503540+0000","last_peered":"2024-05-09T05:35:29.503540+0000","last_clean":"2024-05-09T05:35:29.503540+0000","last_became_active":"2024-05-09T05:34:54.343680+0000","last_became_peered":"2024-05-09T05:34:54.343680+0000","last_unstale":"2024-05-09T05:35:29.503540+0000","last_undegraded":"2024-05-09T05:35:29.503540+0000","last_fullsized":"2024-05-09T05:35:29.503540+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:46:41.289022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.505470+0000","last_change":"2024-05-09T05:34:54.341618+0000","last_active":"2024-05-09T05:35:29.505470+0000","last_peered":"2024-05-09T05:35:29.505470+0000","last_clean":"2024-05-09T05:35:29.505470+0000","last_became_active":"2024-05-09T05:34:54.341176+0000","last_became_peered":"2024-05-09T05:34:54.341176+0000","last_unstale":"2024-05-09T05:35:29.505470+0000","last_undegraded":"2024-05-09T05:35:29.505470+0000","last_fullsized":"2024-05-09T05:35:29.505470+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:05:45.291132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.506037+0000","last_change":"2024-05-09T05:34:54.337847+0000","last_active":"2024-05-09T05:35:29.506037+0000","last_peered":"2024-05-09T05:35:29.506037+0000","last_clean":"2024-05-09T05:35:29.506037+0000","last_became_active":"2024-05-09T05:34:54.337449+0000","last_became_peered":"2024-05-09T05:34:54.337449+0000","last_unstale":"2024-05-09T05:35:29.506037+0000","last_undegraded":"2024-05-09T05:35:29.506037+0000","last_fullsized":"2024-05-09T05:35:29.506037+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:30:34.140802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.715051+0000","last_change":"2024-05-09T05:34:54.344969+0000","last_active":"2024-05-09T05:35:29.715051+0000","last_peered":"2024-05-09T05:35:29.715051+0000","last_clean":"2024-05-09T05:35:29.715051+0000","last_became_active":"2024-05-09T05:34:54.343975+0000","last_became_peered":"2024-05-09T05:34:54.343975+0000","last_unstale":"2024-05-09T05:35:29.715051+0000","last_undegraded":"2024-05-09T05:35:29.715051+0000","last_fullsized":"2024-05-09T05:35:29.715051+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:46:19.075155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.503160+0000","last_change":"2024-05-09T05:34:54.324335+0000","last_active":"2024-05-09T05:35:29.503160+0000","last_peered":"2024-05-09T05:35:29.503160+0000","last_clean":"2024-05-09T05:35:29.503160+0000","last_became_active":"2024-05-09T05:34:54.323950+0000","last_became_peered":"2024-05-09T05:34:54.323950+0000","last_unstale":"2024-05-09T05:35:29.503160+0000","last_undegraded":"2024-05-09T05:35:29.503160+0000","last_fullsized":"2024-05-09T05:35:29.503160+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:36:08.406518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.502572+0000","last_change":"2024-05-09T05:34:54.334887+0000","last_active":"2024-05-09T05:35:29.502572+0000","last_peered":"2024-05-09T05:35:29.502572+0000","last_clean":"2024-05-09T05:35:29.502572+0000","last_became_active":"2024-05-09T05:34:54.334420+0000","last_became_peered":"2024-05-09T05:34:54.334420+0000","last_unstale":"2024-05-09T05:35:29.502572+0000","last_undegraded":"2024-05-09T05:35:29.502572+0000","last_fullsized":"2024-05-09T05:35:29.502572+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:11:54.882338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.498923+0000","last_change":"2024-05-09T05:34:54.332085+0000","last_active":"2024-05-09T05:35:29.498923+0000","last_peered":"2024-05-09T05:35:29.498923+0000","last_clean":"2024-05-09T05:35:29.498923+0000","last_became_active":"2024-05-09T05:34:54.331648+0000","last_became_peered":"2024-05-09T05:34:54.331648+0000","last_unstale":"2024-05-09T05:35:29.498923+0000","last_undegraded":"2024-05-09T05:35:29.498923+0000","last_fullsized":"2024-05-09T05:35:29.498923+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:01:36.258271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.502103+0000","last_change":"2024-05-09T05:34:54.332924+0000","last_active":"2024-05-09T05:35:29.502103+0000","last_peered":"2024-05-09T05:35:29.502103+0000","last_clean":"2024-05-09T05:35:29.502103+0000","last_became_active":"2024-05-09T05:34:54.332370+0000","last_became_peered":"2024-05-09T05:34:54.332370+0000","last_unstale":"2024-05-09T05:35:29.502103+0000","last_undegraded":"2024-05-09T05:35:29.502103+0000","last_fullsized":"2024-05-09T05:35:29.502103+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:01:59.785668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.500313+0000","last_change":"2024-05-09T05:34:54.339222+0000","last_active":"2024-05-09T05:35:29.500313+0000","last_peered":"2024-05-09T05:35:29.500313+0000","last_clean":"2024-05-09T05:35:29.500313+0000","last_became_active":"2024-05-09T05:34:54.338832+0000","last_became_peered":"2024-05-09T05:34:54.338832+0000","last_unstale":"2024-05-09T05:35:29.500313+0000","last_undegraded":"2024-05-09T05:35:29.500313+0000","last_fullsized":"2024-05-09T05:35:29.500313+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:03:01.416515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.503162+0000","last_change":"2024-05-09T05:34:54.338774+0000","last_active":"2024-05-09T05:35:29.503162+0000","last_peered":"2024-05-09T05:35:29.503162+0000","last_clean":"2024-05-09T05:35:29.503162+0000","last_became_active":"2024-05-09T05:34:54.337259+0000","last_became_peered":"2024-05-09T05:34:54.337259+0000","last_unstale":"2024-05-09T05:35:29.503162+0000","last_undegraded":"2024-05-09T05:35:29.503162+0000","last_fullsized":"2024-05-09T05:35:29.503162+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:51:57.298412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.499221+0000","last_change":"2024-05-09T05:34:54.343973+0000","last_active":"2024-05-09T05:35:29.499221+0000","last_peered":"2024-05-09T05:35:29.499221+0000","last_clean":"2024-05-09T05:35:29.499221+0000","last_became_active":"2024-05-09T05:34:54.338980+0000","last_became_peered":"2024-05-09T05:34:54.338980+0000","last_unstale":"2024-05-09T05:35:29.499221+0000","last_undegraded":"2024-05-09T05:35:29.499221+0000","last_fullsized":"2024-05-09T05:35:29.499221+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:28:11.575715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.715054+0000","last_change":"2024-05-09T05:34:54.348135+0000","last_active":"2024-05-09T05:35:29.715054+0000","last_peered":"2024-05-09T05:35:29.715054+0000","last_clean":"2024-05-09T05:35:29.715054+0000","last_became_active":"2024-05-09T05:34:54.347686+0000","last_became_peered":"2024-05-09T05:34:54.347686+0000","last_unstale":"2024-05-09T05:35:29.715054+0000","last_undegraded":"2024-05-09T05:35:29.715054+0000","last_fullsized":"2024-05-09T05:35:29.715054+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:14:23.462361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.713149+0000","last_change":"2024-05-09T05:34:54.330614+0000","last_active":"2024-05-09T05:35:29.713149+0000","last_peered":"2024-05-09T05:35:29.713149+0000","last_clean":"2024-05-09T05:35:29.713149+0000","last_became_active":"2024-05-09T05:34:54.329739+0000","last_became_peered":"2024-05-09T05:34:54.329739+0000","last_unstale":"2024-05-09T05:35:29.713149+0000","last_undegraded":"2024-05-09T05:35:29.713149+0000","last_fullsized":"2024-05-09T05:35:29.713149+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:42:57.702085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.505437+0000","last_change":"2024-05-09T05:34:54.331920+0000","last_active":"2024-05-09T05:35:29.505437+0000","last_peered":"2024-05-09T05:35:29.505437+0000","last_clean":"2024-05-09T05:35:29.505437+0000","last_became_active":"2024-05-09T05:34:54.331548+0000","last_became_peered":"2024-05-09T05:34:54.331548+0000","last_unstale":"2024-05-09T05:35:29.505437+0000","last_undegraded":"2024-05-09T05:35:29.505437+0000","last_fullsized":"2024-05-09T05:35:29.505437+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:33:23.343863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.505122+0000","last_change":"2024-05-09T05:34:54.344257+0000","last_active":"2024-05-09T05:35:29.505122+0000","last_peered":"2024-05-09T05:35:29.505122+0000","last_clean":"2024-05-09T05:35:29.505122+0000","last_became_active":"2024-05-09T05:34:54.343888+0000","last_became_peered":"2024-05-09T05:34:54.343888+0000","last_unstale":"2024-05-09T05:35:29.505122+0000","last_undegraded":"2024-05-09T05:35:29.505122+0000","last_fullsized":"2024-05-09T05:35:29.505122+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:19:11.952108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.499265+0000","last_change":"2024-05-09T05:34:54.334613+0000","last_active":"2024-05-09T05:35:29.499265+0000","last_peered":"2024-05-09T05:35:29.499265+0000","last_clean":"2024-05-09T05:35:29.499265+0000","last_became_active":"2024-05-09T05:34:54.334225+0000","last_became_peered":"2024-05-09T05:34:54.334225+0000","last_unstale":"2024-05-09T05:35:29.499265+0000","last_undegraded":"2024-05-09T05:35:29.499265+0000","last_fullsized":"2024-05-09T05:35:29.499265+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:21.411510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.503688+0000","last_change":"2024-05-09T05:34:54.343915+0000","last_active":"2024-05-09T05:35:29.503688+0000","last_peered":"2024-05-09T05:35:29.503688+0000","last_clean":"2024-05-09T05:35:29.503688+0000","last_became_active":"2024-05-09T05:34:54.343494+0000","last_became_peered":"2024-05-09T05:34:54.343494+0000","last_unstale":"2024-05-09T05:35:29.503688+0000","last_undegraded":"2024-05-09T05:35:29.503688+0000","last_fullsized":"2024-05-09T05:35:29.503688+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:41:47.961863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.500404+0000","last_change":"2024-05-09T05:34:54.334272+0000","last_active":"2024-05-09T05:35:29.500404+0000","last_peered":"2024-05-09T05:35:29.500404+0000","last_clean":"2024-05-09T05:35:29.500404+0000","last_became_active":"2024-05-09T05:34:54.333949+0000","last_became_peered":"2024-05-09T05:34:54.333949+0000","last_unstale":"2024-05-09T05:35:29.500404+0000","last_undegraded":"2024-05-09T05:35:29.500404+0000","last_fullsized":"2024-05-09T05:35:29.500404+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:36:22.562719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.499988+0000","last_change":"2024-05-09T05:34:54.332763+0000","last_active":"2024-05-09T05:35:29.499988+0000","last_peered":"2024-05-09T05:35:29.499988+0000","last_clean":"2024-05-09T05:35:29.499988+0000","last_became_active":"2024-05-09T05:34:54.332260+0000","last_became_peered":"2024-05-09T05:34:54.332260+0000","last_unstale":"2024-05-09T05:35:29.499988+0000","last_undegraded":"2024-05-09T05:35:29.499988+0000","last_fullsized":"2024-05-09T05:35:29.499988+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:12:25.338294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"81'9","reported_seq":36,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.500519+0000","last_change":"2024-05-09T05:34:51.290514+0000","last_active":"2024-05-09T05:35:29.500519+0000","last_peered":"2024-05-09T05:35:29.500519+0000","last_clean":"2024-05-09T05:35:29.500519+0000","last_became_active":"2024-05-09T05:34:51.290097+0000","last_became_peered":"2024-05-09T05:34:51.290097+0000","last_unstale":"2024-05-09T05:35:29.500519+0000","last_undegraded":"2024-05-09T05:35:29.500519+0000","last_fullsized":"2024-05-09T05:35:29.500519+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:02:59.460307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.502491+0000","last_change":"2024-05-09T05:34:54.334272+0000","last_active":"2024-05-09T05:35:29.502491+0000","last_peered":"2024-05-09T05:35:29.502491+0000","last_clean":"2024-05-09T05:35:29.502491+0000","last_became_active":"2024-05-09T05:34:54.333926+0000","last_became_peered":"2024-05-09T05:34:54.333926+0000","last_unstale":"2024-05-09T05:35:29.502491+0000","last_undegraded":"2024-05-09T05:35:29.502491+0000","last_fullsized":"2024-05-09T05:35:29.502491+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:26:04.058278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"81'2","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.502646+0000","last_change":"2024-05-09T05:34:51.660596+0000","last_active":"2024-05-09T05:35:29.502646+0000","last_peered":"2024-05-09T05:35:29.502646+0000","last_clean":"2024-05-09T05:35:29.502646+0000","last_became_active":"2024-05-09T05:34:51.660214+0000","last_became_peered":"2024-05-09T05:34:51.660214+0000","last_unstale":"2024-05-09T05:35:29.502646+0000","last_undegraded":"2024-05-09T05:35:29.502646+0000","last_fullsized":"2024-05-09T05:35:29.502646+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:36:08.717797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.505824+0000","last_change":"2024-05-09T05:34:54.337863+0000","last_active":"2024-05-09T05:35:29.505824+0000","last_peered":"2024-05-09T05:35:29.505824+0000","last_clean":"2024-05-09T05:35:29.505824+0000","last_became_active":"2024-05-09T05:34:54.337476+0000","last_became_peered":"2024-05-09T05:34:54.337476+0000","last_unstale":"2024-05-09T05:35:29.505824+0000","last_undegraded":"2024-05-09T05:35:29.505824+0000","last_fullsized":"2024-05-09T05:35:29.505824+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:18:23.266499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"81'4","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.503655+0000","last_change":"2024-05-09T05:34:51.294750+0000","last_active":"2024-05-09T05:35:29.503655+0000","last_peered":"2024-05-09T05:35:29.503655+0000","last_clean":"2024-05-09T05:35:29.503655+0000","last_became_active":"2024-05-09T05:34:51.294305+0000","last_became_peered":"2024-05-09T05:34:51.294305+0000","last_unstale":"2024-05-09T05:35:29.503655+0000","last_undegraded":"2024-05-09T05:35:29.503655+0000","last_fullsized":"2024-05-09T05:35:29.503655+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:15:22.877230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.499546+0000","last_change":"2024-05-09T05:34:54.334540+0000","last_active":"2024-05-09T05:35:29.499546+0000","last_peered":"2024-05-09T05:35:29.499546+0000","last_clean":"2024-05-09T05:35:29.499546+0000","last_became_active":"2024-05-09T05:34:54.333416+0000","last_became_peered":"2024-05-09T05:34:54.333416+0000","last_unstale":"2024-05-09T05:35:29.499546+0000","last_undegraded":"2024-05-09T05:35:29.499546+0000","last_fullsized":"2024-05-09T05:35:29.499546+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:37:30.862850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.503293+0000","last_change":"2024-05-09T05:34:51.290377+0000","last_active":"2024-05-09T05:35:29.503293+0000","last_peered":"2024-05-09T05:35:29.503293+0000","last_clean":"2024-05-09T05:35:29.503293+0000","last_became_active":"2024-05-09T05:34:51.289974+0000","last_became_peered":"2024-05-09T05:34:51.289974+0000","last_unstale":"2024-05-09T05:35:29.503293+0000","last_undegraded":"2024-05-09T05:35:29.503293+0000","last_fullsized":"2024-05-09T05:35:29.503293+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:40:04.454876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.505866+0000","last_change":"2024-05-09T05:34:54.338620+0000","last_active":"2024-05-09T05:35:29.505866+0000","last_peered":"2024-05-09T05:35:29.505866+0000","last_clean":"2024-05-09T05:35:29.505866+0000","last_became_active":"2024-05-09T05:34:54.338218+0000","last_became_peered":"2024-05-09T05:34:54.338218+0000","last_unstale":"2024-05-09T05:35:29.505866+0000","last_undegraded":"2024-05-09T05:35:29.505866+0000","last_fullsized":"2024-05-09T05:35:29.505866+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:23:51.484732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"81'5","reported_seq":123,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:36:41.406082+0000","last_change":"2024-05-09T05:34:51.293962+0000","last_active":"2024-05-09T05:36:41.406082+0000","last_peered":"2024-05-09T05:36:41.406082+0000","last_clean":"2024-05-09T05:36:41.406082+0000","last_became_active":"2024-05-09T05:34:51.293567+0000","last_became_peered":"2024-05-09T05:34:51.293567+0000","last_unstale":"2024-05-09T05:36:41.406082+0000","last_undegraded":"2024-05-09T05:36:41.406082+0000","last_fullsized":"2024-05-09T05:36:41.406082+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:29:17.624820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":92,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.502752+0000","last_change":"2024-05-09T05:34:54.325411+0000","last_active":"2024-05-09T05:35:29.502752+0000","last_peered":"2024-05-09T05:35:29.502752+0000","last_clean":"2024-05-09T05:35:29.502752+0000","last_became_active":"2024-05-09T05:34:54.325036+0000","last_became_peered":"2024-05-09T05:34:54.325036+0000","last_unstale":"2024-05-09T05:35:29.502752+0000","last_undegraded":"2024-05-09T05:35:29.502752+0000","last_fullsized":"2024-05-09T05:35:29.502752+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:03:48.507512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"81'3","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.502572+0000","last_change":"2024-05-09T05:34:51.290884+0000","last_active":"2024-05-09T05:35:29.502572+0000","last_peered":"2024-05-09T05:35:29.502572+0000","last_clean":"2024-05-09T05:35:29.502572+0000","last_became_active":"2024-05-09T05:34:51.290459+0000","last_became_peered":"2024-05-09T05:34:51.290459+0000","last_unstale":"2024-05-09T05:35:29.502572+0000","last_undegraded":"2024-05-09T05:35:29.502572+0000","last_fullsized":"2024-05-09T05:35:29.502572+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:29:47.737930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.507517+0000","last_change":"2024-05-09T05:35:29.507517+0000","last_active":"2024-05-09T05:35:29.507517+0000","last_peered":"2024-05-09T05:35:29.507517+0000","last_clean":"2024-05-09T05:35:29.507517+0000","last_became_active":"2024-05-09T05:35:29.507029+0000","last_became_peered":"2024-05-09T05:35:29.507029+0000","last_unstale":"2024-05-09T05:35:29.507517+0000","last_undegraded":"2024-05-09T05:35:29.507517+0000","last_fullsized":"2024-05-09T05:35:29.507517+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:03:23.016919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"81'2","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.713053+0000","last_change":"2024-05-09T05:34:51.286241+0000","last_active":"2024-05-09T05:35:29.713053+0000","last_peered":"2024-05-09T05:35:29.713053+0000","last_clean":"2024-05-09T05:35:29.713053+0000","last_became_active":"2024-05-09T05:34:51.285814+0000","last_became_peered":"2024-05-09T05:34:51.285814+0000","last_unstale":"2024-05-09T05:35:29.713053+0000","last_undegraded":"2024-05-09T05:35:29.713053+0000","last_fullsized":"2024-05-09T05:35:29.713053+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:44:21.937909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.502179+0000","last_change":"2024-05-09T05:34:54.339247+0000","last_active":"2024-05-09T05:35:29.502179+0000","last_peered":"2024-05-09T05:35:29.502179+0000","last_clean":"2024-05-09T05:35:29.502179+0000","last_became_active":"2024-05-09T05:34:54.338899+0000","last_became_peered":"2024-05-09T05:34:54.338899+0000","last_unstale":"2024-05-09T05:35:29.502179+0000","last_undegraded":"2024-05-09T05:35:29.502179+0000","last_fullsized":"2024-05-09T05:35:29.502179+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:54:50.696065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"81'1","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.504543+0000","last_change":"2024-05-09T05:34:51.295297+0000","last_active":"2024-05-09T05:35:29.504543+0000","last_peered":"2024-05-09T05:35:29.504543+0000","last_clean":"2024-05-09T05:35:29.504543+0000","last_became_active":"2024-05-09T05:34:51.294814+0000","last_became_peered":"2024-05-09T05:34:51.294814+0000","last_unstale":"2024-05-09T05:35:29.504543+0000","last_undegraded":"2024-05-09T05:35:29.504543+0000","last_fullsized":"2024-05-09T05:35:29.504543+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:05:57.955453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.500235+0000","last_change":"2024-05-09T05:34:54.335988+0000","last_active":"2024-05-09T05:35:29.500235+0000","last_peered":"2024-05-09T05:35:29.500235+0000","last_clean":"2024-05-09T05:35:29.500235+0000","last_became_active":"2024-05-09T05:34:54.335574+0000","last_became_peered":"2024-05-09T05:34:54.335574+0000","last_unstale":"2024-05-09T05:35:29.500235+0000","last_undegraded":"2024-05-09T05:35:29.500235+0000","last_fullsized":"2024-05-09T05:35:29.500235+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:12:26.453578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"81'3","reported_seq":120,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:36:42.406804+0000","last_change":"2024-05-09T05:34:51.291587+0000","last_active":"2024-05-09T05:36:42.406804+0000","last_peered":"2024-05-09T05:36:42.406804+0000","last_clean":"2024-05-09T05:36:42.406804+0000","last_became_active":"2024-05-09T05:34:51.291084+0000","last_became_peered":"2024-05-09T05:34:51.291084+0000","last_unstale":"2024-05-09T05:36:42.406804+0000","last_undegraded":"2024-05-09T05:36:42.406804+0000","last_fullsized":"2024-05-09T05:36:42.406804+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:37:13.234749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":91,"num_read_kb":91,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.499955+0000","last_change":"2024-05-09T05:34:54.333978+0000","last_active":"2024-05-09T05:35:29.499955+0000","last_peered":"2024-05-09T05:35:29.499955+0000","last_clean":"2024-05-09T05:35:29.499955+0000","last_became_active":"2024-05-09T05:34:54.333497+0000","last_became_peered":"2024-05-09T05:34:54.333497+0000","last_unstale":"2024-05-09T05:35:29.499955+0000","last_undegraded":"2024-05-09T05:35:29.499955+0000","last_fullsized":"2024-05-09T05:35:29.499955+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:24:04.078316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"81'2","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.720038+0000","last_change":"2024-05-09T05:35:29.720038+0000","last_active":"2024-05-09T05:35:29.720038+0000","last_peered":"2024-05-09T05:35:29.720038+0000","last_clean":"2024-05-09T05:35:29.720038+0000","last_became_active":"2024-05-09T05:35:29.716097+0000","last_became_peered":"2024-05-09T05:35:29.716097+0000","last_unstale":"2024-05-09T05:35:29.720038+0000","last_undegraded":"2024-05-09T05:35:29.720038+0000","last_fullsized":"2024-05-09T05:35:29.720038+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:35:50.853791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.505931+0000","last_change":"2024-05-09T05:34:54.345340+0000","last_active":"2024-05-09T05:35:29.505931+0000","last_peered":"2024-05-09T05:35:29.505931+0000","last_clean":"2024-05-09T05:35:29.505931+0000","last_became_active":"2024-05-09T05:34:54.344690+0000","last_became_peered":"2024-05-09T05:34:54.344690+0000","last_unstale":"2024-05-09T05:35:29.505931+0000","last_undegraded":"2024-05-09T05:35:29.505931+0000","last_fullsized":"2024-05-09T05:35:29.505931+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:35:21.222688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"81'4","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.505894+0000","last_change":"2024-05-09T05:34:51.661607+0000","last_active":"2024-05-09T05:35:29.505894+0000","last_peered":"2024-05-09T05:35:29.505894+0000","last_clean":"2024-05-09T05:35:29.505894+0000","last_became_active":"2024-05-09T05:34:51.660514+0000","last_became_peered":"2024-05-09T05:34:51.660514+0000","last_unstale":"2024-05-09T05:35:29.505894+0000","last_undegraded":"2024-05-09T05:35:29.505894+0000","last_fullsized":"2024-05-09T05:35:29.505894+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:29:05.670388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.499915+0000","last_change":"2024-05-09T05:34:54.340465+0000","last_active":"2024-05-09T05:35:29.499915+0000","last_peered":"2024-05-09T05:35:29.499915+0000","last_clean":"2024-05-09T05:35:29.499915+0000","last_became_active":"2024-05-09T05:34:54.339918+0000","last_became_peered":"2024-05-09T05:34:54.339918+0000","last_unstale":"2024-05-09T05:35:29.499915+0000","last_undegraded":"2024-05-09T05:35:29.499915+0000","last_fullsized":"2024-05-09T05:35:29.499915+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:18:03.594387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'29","reported_seq":262,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:36:42.847953+0000","last_change":"2024-05-09T05:35:29.731065+0000","last_active":"2024-05-09T05:36:42.847953+0000","last_peered":"2024-05-09T05:36:42.847953+0000","last_clean":"2024-05-09T05:36:42.847953+0000","last_became_active":"2024-05-09T05:35:29.716353+0000","last_became_peered":"2024-05-09T05:35:29.716353+0000","last_unstale":"2024-05-09T05:36:42.847953+0000","last_undegraded":"2024-05-09T05:36:42.847953+0000","last_fullsized":"2024-05-09T05:36:42.847953+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:50:35.450572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59762,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":186,"num_read_kb":137,"num_write":30,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":42201,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.503455+0000","last_change":"2024-05-09T05:34:54.334616+0000","last_active":"2024-05-09T05:35:29.503455+0000","last_peered":"2024-05-09T05:35:29.503455+0000","last_clean":"2024-05-09T05:35:29.503455+0000","last_became_active":"2024-05-09T05:34:54.334267+0000","last_became_peered":"2024-05-09T05:34:54.334267+0000","last_unstale":"2024-05-09T05:35:29.503455+0000","last_undegraded":"2024-05-09T05:35:29.503455+0000","last_fullsized":"2024-05-09T05:35:29.503455+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:13:03.841458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'6","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.499985+0000","last_change":"2024-05-09T05:34:51.290247+0000","last_active":"2024-05-09T05:35:29.499985+0000","last_peered":"2024-05-09T05:35:29.499985+0000","last_clean":"2024-05-09T05:35:29.499985+0000","last_became_active":"2024-05-09T05:34:51.288599+0000","last_became_peered":"2024-05-09T05:34:51.288599+0000","last_unstale":"2024-05-09T05:35:29.499985+0000","last_undegraded":"2024-05-09T05:35:29.499985+0000","last_fullsized":"2024-05-09T05:35:29.499985+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:57:44.805526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.713082+0000","last_change":"2024-05-09T05:34:54.331768+0000","last_active":"2024-05-09T05:35:29.713082+0000","last_peered":"2024-05-09T05:35:29.713082+0000","last_clean":"2024-05-09T05:35:29.713082+0000","last_became_active":"2024-05-09T05:34:54.331407+0000","last_became_peered":"2024-05-09T05:34:54.331407+0000","last_unstale":"2024-05-09T05:35:29.713082+0000","last_undegraded":"2024-05-09T05:35:29.713082+0000","last_fullsized":"2024-05-09T05:35:29.713082+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:16:43.767055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"81'3","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.505287+0000","last_change":"2024-05-09T05:34:51.294266+0000","last_active":"2024-05-09T05:35:29.505287+0000","last_peered":"2024-05-09T05:35:29.505287+0000","last_clean":"2024-05-09T05:35:29.505287+0000","last_became_active":"2024-05-09T05:34:51.293865+0000","last_became_peered":"2024-05-09T05:34:51.293865+0000","last_unstale":"2024-05-09T05:35:29.505287+0000","last_undegraded":"2024-05-09T05:35:29.505287+0000","last_fullsized":"2024-05-09T05:35:29.505287+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:13:05.775729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.499259+0000","last_change":"2024-05-09T05:34:54.346713+0000","last_active":"2024-05-09T05:35:29.499259+0000","last_peered":"2024-05-09T05:35:29.499259+0000","last_clean":"2024-05-09T05:35:29.499259+0000","last_became_active":"2024-05-09T05:34:54.346361+0000","last_became_peered":"2024-05-09T05:34:54.346361+0000","last_unstale":"2024-05-09T05:35:29.499259+0000","last_undegraded":"2024-05-09T05:35:29.499259+0000","last_fullsized":"2024-05-09T05:35:29.499259+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:29:07.013316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"81'4","reported_seq":123,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:36:41.405640+0000","last_change":"2024-05-09T05:34:51.288809+0000","last_active":"2024-05-09T05:36:41.405640+0000","last_peered":"2024-05-09T05:36:41.405640+0000","last_clean":"2024-05-09T05:36:41.405640+0000","last_became_active":"2024-05-09T05:34:51.288417+0000","last_became_peered":"2024-05-09T05:34:51.288417+0000","last_unstale":"2024-05-09T05:36:41.405640+0000","last_undegraded":"2024-05-09T05:36:41.405640+0000","last_fullsized":"2024-05-09T05:36:41.405640+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:19:53.691145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":94,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.498794+0000","last_change":"2024-05-09T05:34:54.344335+0000","last_active":"2024-05-09T05:35:29.498794+0000","last_peered":"2024-05-09T05:35:29.498794+0000","last_clean":"2024-05-09T05:35:29.498794+0000","last_became_active":"2024-05-09T05:34:54.343938+0000","last_became_peered":"2024-05-09T05:34:54.343938+0000","last_unstale":"2024-05-09T05:35:29.498794+0000","last_undegraded":"2024-05-09T05:35:29.498794+0000","last_fullsized":"2024-05-09T05:35:29.498794+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:10.003294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'15","reported_seq":41,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.502510+0000","last_change":"2024-05-09T05:34:51.660939+0000","last_active":"2024-05-09T05:35:29.502510+0000","last_peered":"2024-05-09T05:35:29.502510+0000","last_clean":"2024-05-09T05:35:29.502510+0000","last_became_active":"2024-05-09T05:34:51.660501+0000","last_became_peered":"2024-05-09T05:34:51.660501+0000","last_unstale":"2024-05-09T05:35:29.502510+0000","last_undegraded":"2024-05-09T05:35:29.502510+0000","last_fullsized":"2024-05-09T05:35:29.502510+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:43:11.626811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.715011+0000","last_change":"2024-05-09T05:35:29.714515+0000","last_active":"2024-05-09T05:35:29.715011+0000","last_peered":"2024-05-09T05:35:29.715011+0000","last_clean":"2024-05-09T05:35:29.715011+0000","last_became_active":"2024-05-09T05:35:29.714125+0000","last_became_peered":"2024-05-09T05:35:29.714125+0000","last_unstale":"2024-05-09T05:35:29.715011+0000","last_undegraded":"2024-05-09T05:35:29.715011+0000","last_fullsized":"2024-05-09T05:35:29.715011+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:20:18.408711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.f","version":"81'2","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.502959+0000","last_change":"2024-05-09T05:34:51.290742+0000","last_active":"2024-05-09T05:35:29.502959+0000","last_peered":"2024-05-09T05:35:29.502959+0000","last_clean":"2024-05-09T05:35:29.502959+0000","last_became_active":"2024-05-09T05:34:51.290371+0000","last_became_peered":"2024-05-09T05:34:51.290371+0000","last_unstale":"2024-05-09T05:35:29.502959+0000","last_undegraded":"2024-05-09T05:35:29.502959+0000","last_fullsized":"2024-05-09T05:35:29.502959+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:38:05.449808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.503624+0000","last_change":"2024-05-09T05:34:54.348128+0000","last_active":"2024-05-09T05:35:29.503624+0000","last_peered":"2024-05-09T05:35:29.503624+0000","last_clean":"2024-05-09T05:35:29.503624+0000","last_became_active":"2024-05-09T05:34:54.347648+0000","last_became_peered":"2024-05-09T05:34:54.347648+0000","last_unstale":"2024-05-09T05:35:29.503624+0000","last_undegraded":"2024-05-09T05:35:29.503624+0000","last_fullsized":"2024-05-09T05:35:29.503624+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:46:19.578003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.500343+0000","last_change":"2024-05-09T05:34:51.661486+0000","last_active":"2024-05-09T05:35:29.500343+0000","last_peered":"2024-05-09T05:35:29.500343+0000","last_clean":"2024-05-09T05:35:29.500343+0000","last_became_active":"2024-05-09T05:34:51.661094+0000","last_became_peered":"2024-05-09T05:34:51.661094+0000","last_unstale":"2024-05-09T05:35:29.500343+0000","last_undegraded":"2024-05-09T05:35:29.500343+0000","last_fullsized":"2024-05-09T05:35:29.500343+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:14:26.675414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"81'1","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.502803+0000","last_change":"2024-05-09T05:34:54.330881+0000","last_active":"2024-05-09T05:35:29.502803+0000","last_peered":"2024-05-09T05:35:29.502803+0000","last_clean":"2024-05-09T05:35:29.502803+0000","last_became_active":"2024-05-09T05:34:54.330412+0000","last_became_peered":"2024-05-09T05:34:54.330412+0000","last_unstale":"2024-05-09T05:35:29.502803+0000","last_undegraded":"2024-05-09T05:35:29.502803+0000","last_fullsized":"2024-05-09T05:35:29.502803+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:21:42.481374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"81'1","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.499020+0000","last_change":"2024-05-09T05:34:51.289479+0000","last_active":"2024-05-09T05:35:29.499020+0000","last_peered":"2024-05-09T05:35:29.499020+0000","last_clean":"2024-05-09T05:35:29.499020+0000","last_became_active":"2024-05-09T05:34:51.286436+0000","last_became_peered":"2024-05-09T05:34:51.286436+0000","last_unstale":"2024-05-09T05:35:29.499020+0000","last_undegraded":"2024-05-09T05:35:29.499020+0000","last_fullsized":"2024-05-09T05:35:29.499020+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:22:59.431456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.506937+0000","last_change":"2024-05-09T05:35:29.506937+0000","last_active":"2024-05-09T05:35:29.506937+0000","last_peered":"2024-05-09T05:35:29.506937+0000","last_clean":"2024-05-09T05:35:29.506937+0000","last_became_active":"2024-05-09T05:35:29.506540+0000","last_became_peered":"2024-05-09T05:35:29.506540+0000","last_unstale":"2024-05-09T05:35:29.506937+0000","last_undegraded":"2024-05-09T05:35:29.506937+0000","last_fullsized":"2024-05-09T05:35:29.506937+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:54:51.868972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.505019+0000","last_change":"2024-05-09T05:34:54.334559+0000","last_active":"2024-05-09T05:35:29.505019+0000","last_peered":"2024-05-09T05:35:29.505019+0000","last_clean":"2024-05-09T05:35:29.505019+0000","last_became_active":"2024-05-09T05:34:54.333599+0000","last_became_peered":"2024-05-09T05:34:54.333599+0000","last_unstale":"2024-05-09T05:35:29.505019+0000","last_undegraded":"2024-05-09T05:35:29.505019+0000","last_fullsized":"2024-05-09T05:35:29.505019+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:36:16.139227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"81'4","reported_seq":123,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:36:44.409512+0000","last_change":"2024-05-09T05:34:51.660563+0000","last_active":"2024-05-09T05:36:44.409512+0000","last_peered":"2024-05-09T05:36:44.409512+0000","last_clean":"2024-05-09T05:36:44.409512+0000","last_became_active":"2024-05-09T05:34:51.660127+0000","last_became_peered":"2024-05-09T05:34:51.660127+0000","last_unstale":"2024-05-09T05:36:44.409512+0000","last_undegraded":"2024-05-09T05:36:44.409512+0000","last_fullsized":"2024-05-09T05:36:44.409512+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:08:56.832264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":93,"num_read_kb":93,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.502524+0000","last_change":"2024-05-09T05:34:54.330774+0000","last_active":"2024-05-09T05:35:29.502524+0000","last_peered":"2024-05-09T05:35:29.502524+0000","last_clean":"2024-05-09T05:35:29.502524+0000","last_became_active":"2024-05-09T05:34:54.329970+0000","last_became_peered":"2024-05-09T05:34:54.329970+0000","last_unstale":"2024-05-09T05:35:29.502524+0000","last_undegraded":"2024-05-09T05:35:29.502524+0000","last_fullsized":"2024-05-09T05:35:29.502524+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:41:30.078744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"81'3","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.714370+0000","last_change":"2024-05-09T05:34:51.289026+0000","last_active":"2024-05-09T05:35:29.714370+0000","last_peered":"2024-05-09T05:35:29.714370+0000","last_clean":"2024-05-09T05:35:29.714370+0000","last_became_active":"2024-05-09T05:34:51.288615+0000","last_became_peered":"2024-05-09T05:34:51.288615+0000","last_unstale":"2024-05-09T05:35:29.714370+0000","last_undegraded":"2024-05-09T05:35:29.714370+0000","last_fullsized":"2024-05-09T05:35:29.714370+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:17:21.395173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":102,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.499012+0000","last_change":"2024-05-09T05:33:24.272408+0000","last_active":"2024-05-09T05:35:29.499012+0000","last_peered":"2024-05-09T05:35:29.499012+0000","last_clean":"2024-05-09T05:35:29.499012+0000","last_became_active":"2024-05-09T05:33:24.266495+0000","last_became_peered":"2024-05-09T05:33:24.266495+0000","last_unstale":"2024-05-09T05:35:29.499012+0000","last_undegraded":"2024-05-09T05:35:29.499012+0000","last_fullsized":"2024-05-09T05:35:29.499012+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:29:56.191070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:29:56.191070+0000","last_clean_scrub_stamp":"2024-05-09T05:29:56.191070+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:45:12.602657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.712943+0000","last_change":"2024-05-09T05:34:54.328200+0000","last_active":"2024-05-09T05:35:29.712943+0000","last_peered":"2024-05-09T05:35:29.712943+0000","last_clean":"2024-05-09T05:35:29.712943+0000","last_became_active":"2024-05-09T05:34:54.327552+0000","last_became_peered":"2024-05-09T05:34:54.327552+0000","last_unstale":"2024-05-09T05:35:29.712943+0000","last_undegraded":"2024-05-09T05:35:29.712943+0000","last_fullsized":"2024-05-09T05:35:29.712943+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:33:13.840266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"81'3","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.499072+0000","last_change":"2024-05-09T05:34:51.292796+0000","last_active":"2024-05-09T05:35:29.499072+0000","last_peered":"2024-05-09T05:35:29.499072+0000","last_clean":"2024-05-09T05:35:29.499072+0000","last_became_active":"2024-05-09T05:34:51.292224+0000","last_became_peered":"2024-05-09T05:34:51.292224+0000","last_unstale":"2024-05-09T05:35:29.499072+0000","last_undegraded":"2024-05-09T05:35:29.499072+0000","last_fullsized":"2024-05-09T05:35:29.499072+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:32:02.925633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"81'1","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.511437+0000","last_change":"2024-05-09T05:35:29.510921+0000","last_active":"2024-05-09T05:35:29.511437+0000","last_peered":"2024-05-09T05:35:29.511437+0000","last_clean":"2024-05-09T05:35:29.511437+0000","last_became_active":"2024-05-09T05:35:29.506757+0000","last_became_peered":"2024-05-09T05:35:29.506757+0000","last_unstale":"2024-05-09T05:35:29.511437+0000","last_undegraded":"2024-05-09T05:35:29.511437+0000","last_fullsized":"2024-05-09T05:35:29.511437+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:13:57.924130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.713266+0000","last_change":"2024-05-09T05:34:54.332133+0000","last_active":"2024-05-09T05:35:29.713266+0000","last_peered":"2024-05-09T05:35:29.713266+0000","last_clean":"2024-05-09T05:35:29.713266+0000","last_became_active":"2024-05-09T05:34:54.331756+0000","last_became_peered":"2024-05-09T05:34:54.331756+0000","last_unstale":"2024-05-09T05:35:29.713266+0000","last_undegraded":"2024-05-09T05:35:29.713266+0000","last_fullsized":"2024-05-09T05:35:29.713266+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:47:54.341410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'12","reported_seq":50,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:34.336121+0000","last_change":"2024-05-09T05:35:29.509840+0000","last_active":"2024-05-09T05:35:34.336121+0000","last_peered":"2024-05-09T05:35:34.336121+0000","last_clean":"2024-05-09T05:35:34.336121+0000","last_became_active":"2024-05-09T05:35:29.505151+0000","last_became_peered":"2024-05-09T05:35:29.505151+0000","last_unstale":"2024-05-09T05:35:34.336121+0000","last_undegraded":"2024-05-09T05:35:34.336121+0000","last_fullsized":"2024-05-09T05:35:34.336121+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:04:38.224022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":11,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.502483+0000","last_change":"2024-05-09T05:34:54.339792+0000","last_active":"2024-05-09T05:35:29.502483+0000","last_peered":"2024-05-09T05:35:29.502483+0000","last_clean":"2024-05-09T05:35:29.502483+0000","last_became_active":"2024-05-09T05:34:54.339415+0000","last_became_peered":"2024-05-09T05:34:54.339415+0000","last_unstale":"2024-05-09T05:35:29.502483+0000","last_undegraded":"2024-05-09T05:35:29.502483+0000","last_fullsized":"2024-05-09T05:35:29.502483+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:08:14.148373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'4","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.714194+0000","last_change":"2024-05-09T05:34:51.284535+0000","last_active":"2024-05-09T05:35:29.714194+0000","last_peered":"2024-05-09T05:35:29.714194+0000","last_clean":"2024-05-09T05:35:29.714194+0000","last_became_active":"2024-05-09T05:34:51.283686+0000","last_became_peered":"2024-05-09T05:34:51.283686+0000","last_unstale":"2024-05-09T05:35:29.714194+0000","last_undegraded":"2024-05-09T05:35:29.714194+0000","last_fullsized":"2024-05-09T05:35:29.714194+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:05:58.544406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.505568+0000","last_change":"2024-05-09T05:34:54.344277+0000","last_active":"2024-05-09T05:35:29.505568+0000","last_peered":"2024-05-09T05:35:29.505568+0000","last_clean":"2024-05-09T05:35:29.505568+0000","last_became_active":"2024-05-09T05:34:54.343903+0000","last_became_peered":"2024-05-09T05:34:54.343903+0000","last_unstale":"2024-05-09T05:35:29.505568+0000","last_undegraded":"2024-05-09T05:35:29.505568+0000","last_fullsized":"2024-05-09T05:35:29.505568+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:33:21.052161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"81'2","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.499295+0000","last_change":"2024-05-09T05:34:51.660277+0000","last_active":"2024-05-09T05:35:29.499295+0000","last_peered":"2024-05-09T05:35:29.499295+0000","last_clean":"2024-05-09T05:35:29.499295+0000","last_became_active":"2024-05-09T05:34:51.659841+0000","last_became_peered":"2024-05-09T05:34:51.659841+0000","last_unstale":"2024-05-09T05:35:29.499295+0000","last_undegraded":"2024-05-09T05:35:29.499295+0000","last_fullsized":"2024-05-09T05:35:29.499295+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:35:41.307477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.502743+0000","last_change":"2024-05-09T05:34:54.330642+0000","last_active":"2024-05-09T05:35:29.502743+0000","last_peered":"2024-05-09T05:35:29.502743+0000","last_clean":"2024-05-09T05:35:29.502743+0000","last_became_active":"2024-05-09T05:34:54.330273+0000","last_became_peered":"2024-05-09T05:34:54.330273+0000","last_unstale":"2024-05-09T05:35:29.502743+0000","last_undegraded":"2024-05-09T05:35:29.502743+0000","last_fullsized":"2024-05-09T05:35:29.502743+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:27:17.520941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"81'3","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.502186+0000","last_change":"2024-05-09T05:34:51.288782+0000","last_active":"2024-05-09T05:35:29.502186+0000","last_peered":"2024-05-09T05:35:29.502186+0000","last_clean":"2024-05-09T05:35:29.502186+0000","last_became_active":"2024-05-09T05:34:51.288333+0000","last_became_peered":"2024-05-09T05:34:51.288333+0000","last_unstale":"2024-05-09T05:35:29.502186+0000","last_undegraded":"2024-05-09T05:35:29.502186+0000","last_fullsized":"2024-05-09T05:35:29.502186+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:13:11.893177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.503206+0000","last_change":"2024-05-09T05:34:54.343920+0000","last_active":"2024-05-09T05:35:29.503206+0000","last_peered":"2024-05-09T05:35:29.503206+0000","last_clean":"2024-05-09T05:35:29.503206+0000","last_became_active":"2024-05-09T05:34:54.343452+0000","last_became_peered":"2024-05-09T05:34:54.343452+0000","last_unstale":"2024-05-09T05:35:29.503206+0000","last_undegraded":"2024-05-09T05:35:29.503206+0000","last_fullsized":"2024-05-09T05:35:29.503206+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:28:56.425068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"81'1","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.499721+0000","last_change":"2024-05-09T05:34:51.290178+0000","last_active":"2024-05-09T05:35:29.499721+0000","last_peered":"2024-05-09T05:35:29.499721+0000","last_clean":"2024-05-09T05:35:29.499721+0000","last_became_active":"2024-05-09T05:34:51.289754+0000","last_became_peered":"2024-05-09T05:34:51.289754+0000","last_unstale":"2024-05-09T05:35:29.499721+0000","last_undegraded":"2024-05-09T05:35:29.499721+0000","last_fullsized":"2024-05-09T05:35:29.499721+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:51:41.221061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.502247+0000","last_change":"2024-05-09T05:34:54.330473+0000","last_active":"2024-05-09T05:35:29.502247+0000","last_peered":"2024-05-09T05:35:29.502247+0000","last_clean":"2024-05-09T05:35:29.502247+0000","last_became_active":"2024-05-09T05:34:54.329898+0000","last_became_peered":"2024-05-09T05:34:54.329898+0000","last_unstale":"2024-05-09T05:35:29.502247+0000","last_undegraded":"2024-05-09T05:35:29.502247+0000","last_fullsized":"2024-05-09T05:35:29.502247+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:26:24.727909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"81'4","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.503014+0000","last_change":"2024-05-09T05:34:51.294321+0000","last_active":"2024-05-09T05:35:29.503014+0000","last_peered":"2024-05-09T05:35:29.503014+0000","last_clean":"2024-05-09T05:35:29.503014+0000","last_became_active":"2024-05-09T05:34:51.293956+0000","last_became_peered":"2024-05-09T05:34:51.293956+0000","last_unstale":"2024-05-09T05:35:29.503014+0000","last_undegraded":"2024-05-09T05:35:29.503014+0000","last_fullsized":"2024-05-09T05:35:29.503014+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:45:10.404120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.499265+0000","last_change":"2024-05-09T05:34:54.335850+0000","last_active":"2024-05-09T05:35:29.499265+0000","last_peered":"2024-05-09T05:35:29.499265+0000","last_clean":"2024-05-09T05:35:29.499265+0000","last_became_active":"2024-05-09T05:34:54.335441+0000","last_became_peered":"2024-05-09T05:34:54.335441+0000","last_unstale":"2024-05-09T05:35:29.499265+0000","last_undegraded":"2024-05-09T05:35:29.499265+0000","last_fullsized":"2024-05-09T05:35:29.499265+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:15:32.379286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"81'3","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.500050+0000","last_change":"2024-05-09T05:34:51.662211+0000","last_active":"2024-05-09T05:35:29.500050+0000","last_peered":"2024-05-09T05:35:29.500050+0000","last_clean":"2024-05-09T05:35:29.500050+0000","last_became_active":"2024-05-09T05:34:51.661446+0000","last_became_peered":"2024-05-09T05:34:51.661446+0000","last_unstale":"2024-05-09T05:35:29.500050+0000","last_undegraded":"2024-05-09T05:35:29.500050+0000","last_fullsized":"2024-05-09T05:35:29.500050+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:35:56.098673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.499357+0000","last_change":"2024-05-09T05:34:54.342030+0000","last_active":"2024-05-09T05:35:29.499357+0000","last_peered":"2024-05-09T05:35:29.499357+0000","last_clean":"2024-05-09T05:35:29.499357+0000","last_became_active":"2024-05-09T05:34:54.338081+0000","last_became_peered":"2024-05-09T05:34:54.338081+0000","last_unstale":"2024-05-09T05:35:29.499357+0000","last_undegraded":"2024-05-09T05:35:29.499357+0000","last_fullsized":"2024-05-09T05:35:29.499357+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:40:55.042110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'1","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.505757+0000","last_change":"2024-05-09T05:34:51.293687+0000","last_active":"2024-05-09T05:35:29.505757+0000","last_peered":"2024-05-09T05:35:29.505757+0000","last_clean":"2024-05-09T05:35:29.505757+0000","last_became_active":"2024-05-09T05:34:51.293298+0000","last_became_peered":"2024-05-09T05:34:51.293298+0000","last_unstale":"2024-05-09T05:35:29.505757+0000","last_undegraded":"2024-05-09T05:35:29.505757+0000","last_fullsized":"2024-05-09T05:35:29.505757+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:39:57.031631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"81'1","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.499302+0000","last_change":"2024-05-09T05:34:54.344843+0000","last_active":"2024-05-09T05:35:29.499302+0000","last_peered":"2024-05-09T05:35:29.499302+0000","last_clean":"2024-05-09T05:35:29.499302+0000","last_became_active":"2024-05-09T05:34:54.339577+0000","last_became_peered":"2024-05-09T05:34:54.339577+0000","last_unstale":"2024-05-09T05:35:29.499302+0000","last_undegraded":"2024-05-09T05:35:29.499302+0000","last_fullsized":"2024-05-09T05:35:29.499302+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:03:42.398424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.713256+0000","last_change":"2024-05-09T05:34:51.292633+0000","last_active":"2024-05-09T05:35:29.713256+0000","last_peered":"2024-05-09T05:35:29.713256+0000","last_clean":"2024-05-09T05:35:29.713256+0000","last_became_active":"2024-05-09T05:34:51.292164+0000","last_became_peered":"2024-05-09T05:34:51.292164+0000","last_unstale":"2024-05-09T05:35:29.713256+0000","last_undegraded":"2024-05-09T05:35:29.713256+0000","last_fullsized":"2024-05-09T05:35:29.713256+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:27:30.527040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.499770+0000","last_change":"2024-05-09T05:34:54.345924+0000","last_active":"2024-05-09T05:35:29.499770+0000","last_peered":"2024-05-09T05:35:29.499770+0000","last_clean":"2024-05-09T05:35:29.499770+0000","last_became_active":"2024-05-09T05:34:54.344885+0000","last_became_peered":"2024-05-09T05:34:54.344885+0000","last_unstale":"2024-05-09T05:35:29.499770+0000","last_undegraded":"2024-05-09T05:35:29.499770+0000","last_fullsized":"2024-05-09T05:35:29.499770+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:59:40.079060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.503292+0000","last_change":"2024-05-09T05:34:54.340599+0000","last_active":"2024-05-09T05:35:29.503292+0000","last_peered":"2024-05-09T05:35:29.503292+0000","last_clean":"2024-05-09T05:35:29.503292+0000","last_became_active":"2024-05-09T05:34:54.340194+0000","last_became_peered":"2024-05-09T05:34:54.340194+0000","last_unstale":"2024-05-09T05:35:29.503292+0000","last_undegraded":"2024-05-09T05:35:29.503292+0000","last_fullsized":"2024-05-09T05:35:29.503292+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:10:15.868670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.499659+0000","last_change":"2024-05-09T05:34:54.334658+0000","last_active":"2024-05-09T05:35:29.499659+0000","last_peered":"2024-05-09T05:35:29.499659+0000","last_clean":"2024-05-09T05:35:29.499659+0000","last_became_active":"2024-05-09T05:34:54.334317+0000","last_became_peered":"2024-05-09T05:34:54.334317+0000","last_unstale":"2024-05-09T05:35:29.499659+0000","last_undegraded":"2024-05-09T05:35:29.499659+0000","last_fullsized":"2024-05-09T05:35:29.499659+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:50:28.262145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.499590+0000","last_change":"2024-05-09T05:34:54.330380+0000","last_active":"2024-05-09T05:35:29.499590+0000","last_peered":"2024-05-09T05:35:29.499590+0000","last_clean":"2024-05-09T05:35:29.499590+0000","last_became_active":"2024-05-09T05:34:54.329984+0000","last_became_peered":"2024-05-09T05:34:54.329984+0000","last_unstale":"2024-05-09T05:35:29.499590+0000","last_undegraded":"2024-05-09T05:35:29.499590+0000","last_fullsized":"2024-05-09T05:35:29.499590+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:10:26.051644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.506217+0000","last_change":"2024-05-09T05:34:54.344755+0000","last_active":"2024-05-09T05:35:29.506217+0000","last_peered":"2024-05-09T05:35:29.506217+0000","last_clean":"2024-05-09T05:35:29.506217+0000","last_became_active":"2024-05-09T05:34:54.343968+0000","last_became_peered":"2024-05-09T05:34:54.343968+0000","last_unstale":"2024-05-09T05:35:29.506217+0000","last_undegraded":"2024-05-09T05:35:29.506217+0000","last_fullsized":"2024-05-09T05:35:29.506217+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:58:32.086079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.713140+0000","last_change":"2024-05-09T05:34:54.335427+0000","last_active":"2024-05-09T05:35:29.713140+0000","last_peered":"2024-05-09T05:35:29.713140+0000","last_clean":"2024-05-09T05:35:29.713140+0000","last_became_active":"2024-05-09T05:34:54.335091+0000","last_became_peered":"2024-05-09T05:34:54.335091+0000","last_unstale":"2024-05-09T05:35:29.713140+0000","last_undegraded":"2024-05-09T05:35:29.713140+0000","last_fullsized":"2024-05-09T05:35:29.713140+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:24:05.939805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.504048+0000","last_change":"2024-05-09T05:34:54.342056+0000","last_active":"2024-05-09T05:35:29.504048+0000","last_peered":"2024-05-09T05:35:29.504048+0000","last_clean":"2024-05-09T05:35:29.504048+0000","last_became_active":"2024-05-09T05:34:54.341655+0000","last_became_peered":"2024-05-09T05:34:54.341655+0000","last_unstale":"2024-05-09T05:35:29.504048+0000","last_undegraded":"2024-05-09T05:35:29.504048+0000","last_fullsized":"2024-05-09T05:35:29.504048+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:19:50.284110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.499971+0000","last_change":"2024-05-09T05:34:54.331670+0000","last_active":"2024-05-09T05:35:29.499971+0000","last_peered":"2024-05-09T05:35:29.499971+0000","last_clean":"2024-05-09T05:35:29.499971+0000","last_became_active":"2024-05-09T05:34:54.330722+0000","last_became_peered":"2024-05-09T05:34:54.330722+0000","last_unstale":"2024-05-09T05:35:29.499971+0000","last_undegraded":"2024-05-09T05:35:29.499971+0000","last_fullsized":"2024-05-09T05:35:29.499971+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:36:10.417933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.502370+0000","last_change":"2024-05-09T05:34:54.336487+0000","last_active":"2024-05-09T05:35:29.502370+0000","last_peered":"2024-05-09T05:35:29.502370+0000","last_clean":"2024-05-09T05:35:29.502370+0000","last_became_active":"2024-05-09T05:34:54.336141+0000","last_became_peered":"2024-05-09T05:34:54.336141+0000","last_unstale":"2024-05-09T05:35:29.502370+0000","last_undegraded":"2024-05-09T05:35:29.502370+0000","last_fullsized":"2024-05-09T05:35:29.502370+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:45:42.541374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.504577+0000","last_change":"2024-05-09T05:34:54.330749+0000","last_active":"2024-05-09T05:35:29.504577+0000","last_peered":"2024-05-09T05:35:29.504577+0000","last_clean":"2024-05-09T05:35:29.504577+0000","last_became_active":"2024-05-09T05:34:54.330279+0000","last_became_peered":"2024-05-09T05:34:54.330279+0000","last_unstale":"2024-05-09T05:35:29.504577+0000","last_undegraded":"2024-05-09T05:35:29.504577+0000","last_fullsized":"2024-05-09T05:35:29.504577+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:49:48.704977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.502153+0000","last_change":"2024-05-09T05:34:54.338296+0000","last_active":"2024-05-09T05:35:29.502153+0000","last_peered":"2024-05-09T05:35:29.502153+0000","last_clean":"2024-05-09T05:35:29.502153+0000","last_became_active":"2024-05-09T05:34:54.337960+0000","last_became_peered":"2024-05-09T05:34:54.337960+0000","last_unstale":"2024-05-09T05:35:29.502153+0000","last_undegraded":"2024-05-09T05:35:29.502153+0000","last_fullsized":"2024-05-09T05:35:29.502153+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:48:46.436082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.500276+0000","last_change":"2024-05-09T05:34:54.334782+0000","last_active":"2024-05-09T05:35:29.500276+0000","last_peered":"2024-05-09T05:35:29.500276+0000","last_clean":"2024-05-09T05:35:29.500276+0000","last_became_active":"2024-05-09T05:34:54.333118+0000","last_became_peered":"2024-05-09T05:34:54.333118+0000","last_unstale":"2024-05-09T05:35:29.500276+0000","last_undegraded":"2024-05-09T05:35:29.500276+0000","last_fullsized":"2024-05-09T05:35:29.500276+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:04:40.473387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.713299+0000","last_change":"2024-05-09T05:34:54.334627+0000","last_active":"2024-05-09T05:35:29.713299+0000","last_peered":"2024-05-09T05:35:29.713299+0000","last_clean":"2024-05-09T05:35:29.713299+0000","last_became_active":"2024-05-09T05:34:54.333966+0000","last_became_peered":"2024-05-09T05:34:54.333966+0000","last_unstale":"2024-05-09T05:35:29.713299+0000","last_undegraded":"2024-05-09T05:35:29.713299+0000","last_fullsized":"2024-05-09T05:35:29.713299+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:15:57.733926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.507005+0000","last_change":"2024-05-09T05:35:29.507005+0000","last_active":"2024-05-09T05:35:29.507005+0000","last_peered":"2024-05-09T05:35:29.507005+0000","last_clean":"2024-05-09T05:35:29.507005+0000","last_became_active":"2024-05-09T05:35:29.506521+0000","last_became_peered":"2024-05-09T05:35:29.506521+0000","last_unstale":"2024-05-09T05:35:29.507005+0000","last_undegraded":"2024-05-09T05:35:29.507005+0000","last_fullsized":"2024-05-09T05:35:29.507005+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:58:24.605073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":63763,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":568,"num_read_kb":339,"num_write":165,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":42223,"num_keys_recovered":11,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":191289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":140,"ondisk_log_size":140,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612647,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":905216,"data_stored":440786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808876,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":41056,"kb_used_data":1560,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704096,"statfs":{"total":95995035648,"available":95952994304,"internally_reserved":0,"allocated":1597440,"data_stored":1092398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":40434112},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972401,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32072,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713080,"statfs":{"total":95995035648,"available":95962193920,"internally_reserved":0,"allocated":917504,"data_stored":441000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168631,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32072,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713080,"statfs":{"total":95995035648,"available":95962193920,"internally_reserved":0,"allocated":913408,"data_stored":440898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397564,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36820,"kb_used_data":1476,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708332,"statfs":{"total":95995035648,"available":95957331968,"internally_reserved":0,"allocated":1511424,"data_stored":1032850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593793,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":440389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574937,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":966656,"data_stored":499944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738464,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32084,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713068,"statfs":{"total":95995035648,"available":95962181632,"internally_reserved":0,"allocated":925696,"data_stored":441660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411413,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":921600,"data_stored":441532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182480,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":921600,"data_stored":440700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986250,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":978944,"data_stored":500979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790022,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36832,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708320,"statfs":{"total":95995035648,"available":95957319680,"internally_reserved":0,"allocated":1523712,"data_stored":1032143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":59762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":60797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":61731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T05:36:48.404 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph pg dump --format=json 2024-05-09T05:36:48.658 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T05:36:49.745 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:36:49 smithi039 ceph-mon[30439]: from='client.14928 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-09T05:36:49.745 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:36:49 smithi039 ceph-mon[30439]: pgmap v353: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-09T05:36:49.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:36:49 smithi060 ceph-mon[34555]: from='client.14928 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-09T05:36:49.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:36:49 smithi060 ceph-mon[34555]: pgmap v353: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-09T05:36:49.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:36:49 smithi100 ceph-mon[34353]: from='client.14928 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-09T05:36:49.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:36:49 smithi100 ceph-mon[34353]: pgmap v353: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-09T05:36:50.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:50.313+0000 7fac7e4dc700 1 -- 172.21.15.39:0/1711915826 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fac78102790 msgr2=0x7fac78102ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:50.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:50.313+0000 7fac7e4dc700 1 --2- 172.21.15.39:0/1711915826 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fac78102790 0x7fac78102ba0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fac6c009990 tx=0x7fac6c009ca0 comp rx=0 tx=0).stop 2024-05-09T05:36:50.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:50.313+0000 7fac7e4dc700 1 -- 172.21.15.39:0/1711915826 shutdown_connections 2024-05-09T05:36:50.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:50.313+0000 7fac7e4dc700 1 --2- 172.21.15.39:0/1711915826 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac781030e0 0x7fac78111170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:50.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:50.313+0000 7fac7e4dc700 1 --2- 172.21.15.39:0/1711915826 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac78109300 0x7fac78109710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:50.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:50.313+0000 7fac7e4dc700 1 --2- 172.21.15.39:0/1711915826 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fac78102790 0x7fac78102ba0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:50.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:50.313+0000 7fac7e4dc700 1 -- 172.21.15.39:0/1711915826 >> 172.21.15.39:0/1711915826 conn(0x7fac780fe4e0 msgr2=0x7fac78100930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:36:50.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:50.313+0000 7fac7e4dc700 1 -- 172.21.15.39:0/1711915826 shutdown_connections 2024-05-09T05:36:50.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:50.313+0000 7fac7e4dc700 1 -- 172.21.15.39:0/1711915826 wait complete. 2024-05-09T05:36:50.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:50.314+0000 7fac7e4dc700 1 Processor -- start 2024-05-09T05:36:50.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:50.314+0000 7fac7e4dc700 1 -- start start 2024-05-09T05:36:50.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:50.314+0000 7fac7e4dc700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac78102790 0x7fac7819afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:50.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:50.314+0000 7fac7e4dc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fac781030e0 0x7fac7819b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:50.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:50.314+0000 7fac7e4dc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac78109300 0x7fac7819f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:50.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:50.314+0000 7fac7e4dc700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fac781145f0 con 0x7fac781030e0 2024-05-09T05:36:50.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:50.314+0000 7fac7e4dc700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fac78114470 con 0x7fac78109300 2024-05-09T05:36:50.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:50.315+0000 7fac7e4dc700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fac78114770 con 0x7fac78102790 2024-05-09T05:36:50.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:50.315+0000 7fac777fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fac781030e0 0x7fac7819b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:50.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:50.315+0000 7fac777fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fac781030e0 0x7fac7819b560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:59436/0 (socket says 172.21.15.39:59436) 2024-05-09T05:36:50.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:50.315+0000 7fac777fe700 1 -- 172.21.15.39:0/1641312737 learned_addr learned my addr 172.21.15.39:0/1641312737 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:36:50.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:50.315+0000 7fac77fff700 1 --2- 172.21.15.39:0/1641312737 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac78102790 0x7fac7819afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:50.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:50.315+0000 7fac7ca79700 1 --2- 172.21.15.39:0/1641312737 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac78109300 0x7fac7819f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:50.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:50.315+0000 7fac777fe700 1 -- 172.21.15.39:0/1641312737 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac78102790 msgr2=0x7fac7819afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:50.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:50.315+0000 7fac777fe700 1 --2- 172.21.15.39:0/1641312737 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac78102790 0x7fac7819afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:50.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:50.315+0000 7fac777fe700 1 -- 172.21.15.39:0/1641312737 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac78109300 msgr2=0x7fac7819f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:50.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:50.315+0000 7fac777fe700 1 --2- 172.21.15.39:0/1641312737 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac78109300 0x7fac7819f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:50.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:50.315+0000 7fac777fe700 1 -- 172.21.15.39:0/1641312737 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac7819fe90 con 0x7fac781030e0 2024-05-09T05:36:50.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:50.315+0000 7fac777fe700 1 --2- 172.21.15.39:0/1641312737 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fac781030e0 0x7fac7819b560 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fac6c000c00 tx=0x7fac6c0047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:36:50.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:50.315+0000 7fac757fa700 1 -- 172.21.15.39:0/1641312737 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac6c027070 con 0x7fac781030e0 2024-05-09T05:36:50.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:50.315+0000 7fac7e4dc700 1 -- 172.21.15.39:0/1641312737 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac781a0120 con 0x7fac781030e0 2024-05-09T05:36:50.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:50.315+0000 7fac757fa700 1 -- 172.21.15.39:0/1641312737 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fac6c0040e0 con 0x7fac781030e0 2024-05-09T05:36:50.312 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:50.315+0000 7fac757fa700 1 -- 172.21.15.39:0/1641312737 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac6c00f460 con 0x7fac781030e0 2024-05-09T05:36:50.312 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:50.315+0000 7fac7e4dc700 1 -- 172.21.15.39:0/1641312737 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac781a7aa0 con 0x7fac781030e0 2024-05-09T05:36:50.312 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:50.317+0000 7fac7e4dc700 1 -- 172.21.15.39:0/1641312737 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac780512c0 con 0x7fac781030e0 2024-05-09T05:36:50.312 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:50.319+0000 7fac757fa700 1 -- 172.21.15.39:0/1641312737 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fac6c02a070 con 0x7fac781030e0 2024-05-09T05:36:50.313 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:50.319+0000 7fac757fa700 1 --2- 172.21.15.39:0/1641312737 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fac600b2910 0x7fac600b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:50.313 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:50.320+0000 7fac77fff700 1 --2- 172.21.15.39:0/1641312737 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fac600b2910 0x7fac600b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:50.313 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:50.320+0000 7fac757fa700 1 -- 172.21.15.39:0/1641312737 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7fac6c0e3820 con 0x7fac781030e0 2024-05-09T05:36:50.313 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:50.320+0000 7fac77fff700 1 --2- 172.21.15.39:0/1641312737 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fac600b2910 0x7fac600b4e20 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fac7806ca50 tx=0x7fac6800a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:36:50.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:50.323+0000 7fac757fa700 1 -- 172.21.15.39:0/1641312737 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fac6c031080 con 0x7fac781030e0 2024-05-09T05:36:50.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:50.533+0000 7fac7e4dc700 1 -- 172.21.15.39:0/1641312737 --> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fac7819c320 con 0x7fac600b2910 2024-05-09T05:36:50.534 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:50.541+0000 7fac757fa700 1 -- 172.21.15.39:0/1641312737 <== mgr.14152 v2:172.21.15.39:6800/3184189003 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258709 (secure 0 0 0) 0x7fac7819c320 con 0x7fac600b2910 2024-05-09T05:36:50.537 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-09T05:36:50.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:50.544+0000 7fac7e4dc700 1 -- 172.21.15.39:0/1641312737 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fac600b2910 msgr2=0x7fac600b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:50.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:50.544+0000 7fac7e4dc700 1 --2- 172.21.15.39:0/1641312737 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fac600b2910 0x7fac600b4e20 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fac7806ca50 tx=0x7fac6800a380 comp rx=0 tx=0).stop 2024-05-09T05:36:50.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:50.544+0000 7fac7e4dc700 1 -- 172.21.15.39:0/1641312737 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fac781030e0 msgr2=0x7fac7819b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:50.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:50.544+0000 7fac7e4dc700 1 --2- 172.21.15.39:0/1641312737 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fac781030e0 0x7fac7819b560 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fac6c000c00 tx=0x7fac6c0047b0 comp rx=0 tx=0).stop 2024-05-09T05:36:50.540 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:50.544+0000 7fac7e4dc700 1 -- 172.21.15.39:0/1641312737 shutdown_connections 2024-05-09T05:36:50.540 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:50.544+0000 7fac7e4dc700 1 --2- 172.21.15.39:0/1641312737 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fac600b2910 0x7fac600b4e20 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:50.540 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:50.544+0000 7fac7e4dc700 1 --2- 172.21.15.39:0/1641312737 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac78109300 0x7fac7819f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:50.540 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:50.544+0000 7fac7e4dc700 1 --2- 172.21.15.39:0/1641312737 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac78102790 0x7fac7819afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:50.540 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:50.544+0000 7fac7e4dc700 1 --2- 172.21.15.39:0/1641312737 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fac781030e0 0x7fac7819b560 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:50.540 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:50.544+0000 7fac7e4dc700 1 -- 172.21.15.39:0/1641312737 >> 172.21.15.39:0/1641312737 conn(0x7fac780fe4e0 msgr2=0x7fac781071d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:36:50.540 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:50.544+0000 7fac7e4dc700 1 -- 172.21.15.39:0/1641312737 shutdown_connections 2024-05-09T05:36:50.540 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:50.544+0000 7fac7e4dc700 1 -- 172.21.15.39:0/1641312737 wait complete. 2024-05-09T05:36:50.540 INFO:teuthology.orchestra.run.smithi039.stderr:dumped all 2024-05-09T05:36:51.100 INFO:teuthology.orchestra.run.smithi039.stdout:{"pg_ready":true,"pg_map":{"version":354,"stamp":"2024-05-09T05:36:50.159468+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":654365,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":669,"num_read_kb":413,"num_write":290,"num_write_kb":2262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":2994063,"num_keys_recovered":11,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":234,"ondisk_log_size":234,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":378512,"kb_used_data":12684,"kb_used_omap":18,"kb_used_meta":365677,"kb_avail":1124563312,"statfs":{"total":1151940427776,"available":1151552831488,"internally_reserved":0,"allocated":12988416,"data_stored":7245279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":374453562},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":40,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003535"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.503540+0000","last_change":"2024-05-09T05:34:54.344495+0000","last_active":"2024-05-09T05:35:29.503540+0000","last_peered":"2024-05-09T05:35:29.503540+0000","last_clean":"2024-05-09T05:35:29.503540+0000","last_became_active":"2024-05-09T05:34:54.343680+0000","last_became_peered":"2024-05-09T05:34:54.343680+0000","last_unstale":"2024-05-09T05:35:29.503540+0000","last_undegraded":"2024-05-09T05:35:29.503540+0000","last_fullsized":"2024-05-09T05:35:29.503540+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:46:41.289022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.505470+0000","last_change":"2024-05-09T05:34:54.341618+0000","last_active":"2024-05-09T05:35:29.505470+0000","last_peered":"2024-05-09T05:35:29.505470+0000","last_clean":"2024-05-09T05:35:29.505470+0000","last_became_active":"2024-05-09T05:34:54.341176+0000","last_became_peered":"2024-05-09T05:34:54.341176+0000","last_unstale":"2024-05-09T05:35:29.505470+0000","last_undegraded":"2024-05-09T05:35:29.505470+0000","last_fullsized":"2024-05-09T05:35:29.505470+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:05:45.291132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.506037+0000","last_change":"2024-05-09T05:34:54.337847+0000","last_active":"2024-05-09T05:35:29.506037+0000","last_peered":"2024-05-09T05:35:29.506037+0000","last_clean":"2024-05-09T05:35:29.506037+0000","last_became_active":"2024-05-09T05:34:54.337449+0000","last_became_peered":"2024-05-09T05:34:54.337449+0000","last_unstale":"2024-05-09T05:35:29.506037+0000","last_undegraded":"2024-05-09T05:35:29.506037+0000","last_fullsized":"2024-05-09T05:35:29.506037+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:30:34.140802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.715051+0000","last_change":"2024-05-09T05:34:54.344969+0000","last_active":"2024-05-09T05:35:29.715051+0000","last_peered":"2024-05-09T05:35:29.715051+0000","last_clean":"2024-05-09T05:35:29.715051+0000","last_became_active":"2024-05-09T05:34:54.343975+0000","last_became_peered":"2024-05-09T05:34:54.343975+0000","last_unstale":"2024-05-09T05:35:29.715051+0000","last_undegraded":"2024-05-09T05:35:29.715051+0000","last_fullsized":"2024-05-09T05:35:29.715051+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:46:19.075155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.503160+0000","last_change":"2024-05-09T05:34:54.324335+0000","last_active":"2024-05-09T05:35:29.503160+0000","last_peered":"2024-05-09T05:35:29.503160+0000","last_clean":"2024-05-09T05:35:29.503160+0000","last_became_active":"2024-05-09T05:34:54.323950+0000","last_became_peered":"2024-05-09T05:34:54.323950+0000","last_unstale":"2024-05-09T05:35:29.503160+0000","last_undegraded":"2024-05-09T05:35:29.503160+0000","last_fullsized":"2024-05-09T05:35:29.503160+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:36:08.406518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.502572+0000","last_change":"2024-05-09T05:34:54.334887+0000","last_active":"2024-05-09T05:35:29.502572+0000","last_peered":"2024-05-09T05:35:29.502572+0000","last_clean":"2024-05-09T05:35:29.502572+0000","last_became_active":"2024-05-09T05:34:54.334420+0000","last_became_peered":"2024-05-09T05:34:54.334420+0000","last_unstale":"2024-05-09T05:35:29.502572+0000","last_undegraded":"2024-05-09T05:35:29.502572+0000","last_fullsized":"2024-05-09T05:35:29.502572+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:11:54.882338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.498923+0000","last_change":"2024-05-09T05:34:54.332085+0000","last_active":"2024-05-09T05:35:29.498923+0000","last_peered":"2024-05-09T05:35:29.498923+0000","last_clean":"2024-05-09T05:35:29.498923+0000","last_became_active":"2024-05-09T05:34:54.331648+0000","last_became_peered":"2024-05-09T05:34:54.331648+0000","last_unstale":"2024-05-09T05:35:29.498923+0000","last_undegraded":"2024-05-09T05:35:29.498923+0000","last_fullsized":"2024-05-09T05:35:29.498923+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:01:36.258271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.502103+0000","last_change":"2024-05-09T05:34:54.332924+0000","last_active":"2024-05-09T05:35:29.502103+0000","last_peered":"2024-05-09T05:35:29.502103+0000","last_clean":"2024-05-09T05:35:29.502103+0000","last_became_active":"2024-05-09T05:34:54.332370+0000","last_became_peered":"2024-05-09T05:34:54.332370+0000","last_unstale":"2024-05-09T05:35:29.502103+0000","last_undegraded":"2024-05-09T05:35:29.502103+0000","last_fullsized":"2024-05-09T05:35:29.502103+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:01:59.785668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.500313+0000","last_change":"2024-05-09T05:34:54.339222+0000","last_active":"2024-05-09T05:35:29.500313+0000","last_peered":"2024-05-09T05:35:29.500313+0000","last_clean":"2024-05-09T05:35:29.500313+0000","last_became_active":"2024-05-09T05:34:54.338832+0000","last_became_peered":"2024-05-09T05:34:54.338832+0000","last_unstale":"2024-05-09T05:35:29.500313+0000","last_undegraded":"2024-05-09T05:35:29.500313+0000","last_fullsized":"2024-05-09T05:35:29.500313+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:03:01.416515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.503162+0000","last_change":"2024-05-09T05:34:54.338774+0000","last_active":"2024-05-09T05:35:29.503162+0000","last_peered":"2024-05-09T05:35:29.503162+0000","last_clean":"2024-05-09T05:35:29.503162+0000","last_became_active":"2024-05-09T05:34:54.337259+0000","last_became_peered":"2024-05-09T05:34:54.337259+0000","last_unstale":"2024-05-09T05:35:29.503162+0000","last_undegraded":"2024-05-09T05:35:29.503162+0000","last_fullsized":"2024-05-09T05:35:29.503162+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:51:57.298412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.499221+0000","last_change":"2024-05-09T05:34:54.343973+0000","last_active":"2024-05-09T05:35:29.499221+0000","last_peered":"2024-05-09T05:35:29.499221+0000","last_clean":"2024-05-09T05:35:29.499221+0000","last_became_active":"2024-05-09T05:34:54.338980+0000","last_became_peered":"2024-05-09T05:34:54.338980+0000","last_unstale":"2024-05-09T05:35:29.499221+0000","last_undegraded":"2024-05-09T05:35:29.499221+0000","last_fullsized":"2024-05-09T05:35:29.499221+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:28:11.575715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.715054+0000","last_change":"2024-05-09T05:34:54.348135+0000","last_active":"2024-05-09T05:35:29.715054+0000","last_peered":"2024-05-09T05:35:29.715054+0000","last_clean":"2024-05-09T05:35:29.715054+0000","last_became_active":"2024-05-09T05:34:54.347686+0000","last_became_peered":"2024-05-09T05:34:54.347686+0000","last_unstale":"2024-05-09T05:35:29.715054+0000","last_undegraded":"2024-05-09T05:35:29.715054+0000","last_fullsized":"2024-05-09T05:35:29.715054+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:14:23.462361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.713149+0000","last_change":"2024-05-09T05:34:54.330614+0000","last_active":"2024-05-09T05:35:29.713149+0000","last_peered":"2024-05-09T05:35:29.713149+0000","last_clean":"2024-05-09T05:35:29.713149+0000","last_became_active":"2024-05-09T05:34:54.329739+0000","last_became_peered":"2024-05-09T05:34:54.329739+0000","last_unstale":"2024-05-09T05:35:29.713149+0000","last_undegraded":"2024-05-09T05:35:29.713149+0000","last_fullsized":"2024-05-09T05:35:29.713149+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:42:57.702085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.505437+0000","last_change":"2024-05-09T05:34:54.331920+0000","last_active":"2024-05-09T05:35:29.505437+0000","last_peered":"2024-05-09T05:35:29.505437+0000","last_clean":"2024-05-09T05:35:29.505437+0000","last_became_active":"2024-05-09T05:34:54.331548+0000","last_became_peered":"2024-05-09T05:34:54.331548+0000","last_unstale":"2024-05-09T05:35:29.505437+0000","last_undegraded":"2024-05-09T05:35:29.505437+0000","last_fullsized":"2024-05-09T05:35:29.505437+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:33:23.343863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.505122+0000","last_change":"2024-05-09T05:34:54.344257+0000","last_active":"2024-05-09T05:35:29.505122+0000","last_peered":"2024-05-09T05:35:29.505122+0000","last_clean":"2024-05-09T05:35:29.505122+0000","last_became_active":"2024-05-09T05:34:54.343888+0000","last_became_peered":"2024-05-09T05:34:54.343888+0000","last_unstale":"2024-05-09T05:35:29.505122+0000","last_undegraded":"2024-05-09T05:35:29.505122+0000","last_fullsized":"2024-05-09T05:35:29.505122+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:19:11.952108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.499265+0000","last_change":"2024-05-09T05:34:54.334613+0000","last_active":"2024-05-09T05:35:29.499265+0000","last_peered":"2024-05-09T05:35:29.499265+0000","last_clean":"2024-05-09T05:35:29.499265+0000","last_became_active":"2024-05-09T05:34:54.334225+0000","last_became_peered":"2024-05-09T05:34:54.334225+0000","last_unstale":"2024-05-09T05:35:29.499265+0000","last_undegraded":"2024-05-09T05:35:29.499265+0000","last_fullsized":"2024-05-09T05:35:29.499265+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:21.411510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.503688+0000","last_change":"2024-05-09T05:34:54.343915+0000","last_active":"2024-05-09T05:35:29.503688+0000","last_peered":"2024-05-09T05:35:29.503688+0000","last_clean":"2024-05-09T05:35:29.503688+0000","last_became_active":"2024-05-09T05:34:54.343494+0000","last_became_peered":"2024-05-09T05:34:54.343494+0000","last_unstale":"2024-05-09T05:35:29.503688+0000","last_undegraded":"2024-05-09T05:35:29.503688+0000","last_fullsized":"2024-05-09T05:35:29.503688+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:41:47.961863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.500404+0000","last_change":"2024-05-09T05:34:54.334272+0000","last_active":"2024-05-09T05:35:29.500404+0000","last_peered":"2024-05-09T05:35:29.500404+0000","last_clean":"2024-05-09T05:35:29.500404+0000","last_became_active":"2024-05-09T05:34:54.333949+0000","last_became_peered":"2024-05-09T05:34:54.333949+0000","last_unstale":"2024-05-09T05:35:29.500404+0000","last_undegraded":"2024-05-09T05:35:29.500404+0000","last_fullsized":"2024-05-09T05:35:29.500404+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:36:22.562719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.499988+0000","last_change":"2024-05-09T05:34:54.332763+0000","last_active":"2024-05-09T05:35:29.499988+0000","last_peered":"2024-05-09T05:35:29.499988+0000","last_clean":"2024-05-09T05:35:29.499988+0000","last_became_active":"2024-05-09T05:34:54.332260+0000","last_became_peered":"2024-05-09T05:34:54.332260+0000","last_unstale":"2024-05-09T05:35:29.499988+0000","last_undegraded":"2024-05-09T05:35:29.499988+0000","last_fullsized":"2024-05-09T05:35:29.499988+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:12:25.338294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"81'9","reported_seq":36,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.500519+0000","last_change":"2024-05-09T05:34:51.290514+0000","last_active":"2024-05-09T05:35:29.500519+0000","last_peered":"2024-05-09T05:35:29.500519+0000","last_clean":"2024-05-09T05:35:29.500519+0000","last_became_active":"2024-05-09T05:34:51.290097+0000","last_became_peered":"2024-05-09T05:34:51.290097+0000","last_unstale":"2024-05-09T05:35:29.500519+0000","last_undegraded":"2024-05-09T05:35:29.500519+0000","last_fullsized":"2024-05-09T05:35:29.500519+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:02:59.460307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.502491+0000","last_change":"2024-05-09T05:34:54.334272+0000","last_active":"2024-05-09T05:35:29.502491+0000","last_peered":"2024-05-09T05:35:29.502491+0000","last_clean":"2024-05-09T05:35:29.502491+0000","last_became_active":"2024-05-09T05:34:54.333926+0000","last_became_peered":"2024-05-09T05:34:54.333926+0000","last_unstale":"2024-05-09T05:35:29.502491+0000","last_undegraded":"2024-05-09T05:35:29.502491+0000","last_fullsized":"2024-05-09T05:35:29.502491+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:26:04.058278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"81'2","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.502646+0000","last_change":"2024-05-09T05:34:51.660596+0000","last_active":"2024-05-09T05:35:29.502646+0000","last_peered":"2024-05-09T05:35:29.502646+0000","last_clean":"2024-05-09T05:35:29.502646+0000","last_became_active":"2024-05-09T05:34:51.660214+0000","last_became_peered":"2024-05-09T05:34:51.660214+0000","last_unstale":"2024-05-09T05:35:29.502646+0000","last_undegraded":"2024-05-09T05:35:29.502646+0000","last_fullsized":"2024-05-09T05:35:29.502646+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:36:08.717797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.505824+0000","last_change":"2024-05-09T05:34:54.337863+0000","last_active":"2024-05-09T05:35:29.505824+0000","last_peered":"2024-05-09T05:35:29.505824+0000","last_clean":"2024-05-09T05:35:29.505824+0000","last_became_active":"2024-05-09T05:34:54.337476+0000","last_became_peered":"2024-05-09T05:34:54.337476+0000","last_unstale":"2024-05-09T05:35:29.505824+0000","last_undegraded":"2024-05-09T05:35:29.505824+0000","last_fullsized":"2024-05-09T05:35:29.505824+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:18:23.266499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"81'4","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.503655+0000","last_change":"2024-05-09T05:34:51.294750+0000","last_active":"2024-05-09T05:35:29.503655+0000","last_peered":"2024-05-09T05:35:29.503655+0000","last_clean":"2024-05-09T05:35:29.503655+0000","last_became_active":"2024-05-09T05:34:51.294305+0000","last_became_peered":"2024-05-09T05:34:51.294305+0000","last_unstale":"2024-05-09T05:35:29.503655+0000","last_undegraded":"2024-05-09T05:35:29.503655+0000","last_fullsized":"2024-05-09T05:35:29.503655+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:15:22.877230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.499546+0000","last_change":"2024-05-09T05:34:54.334540+0000","last_active":"2024-05-09T05:35:29.499546+0000","last_peered":"2024-05-09T05:35:29.499546+0000","last_clean":"2024-05-09T05:35:29.499546+0000","last_became_active":"2024-05-09T05:34:54.333416+0000","last_became_peered":"2024-05-09T05:34:54.333416+0000","last_unstale":"2024-05-09T05:35:29.499546+0000","last_undegraded":"2024-05-09T05:35:29.499546+0000","last_fullsized":"2024-05-09T05:35:29.499546+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:37:30.862850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.503293+0000","last_change":"2024-05-09T05:34:51.290377+0000","last_active":"2024-05-09T05:35:29.503293+0000","last_peered":"2024-05-09T05:35:29.503293+0000","last_clean":"2024-05-09T05:35:29.503293+0000","last_became_active":"2024-05-09T05:34:51.289974+0000","last_became_peered":"2024-05-09T05:34:51.289974+0000","last_unstale":"2024-05-09T05:35:29.503293+0000","last_undegraded":"2024-05-09T05:35:29.503293+0000","last_fullsized":"2024-05-09T05:35:29.503293+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:40:04.454876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.505866+0000","last_change":"2024-05-09T05:34:54.338620+0000","last_active":"2024-05-09T05:35:29.505866+0000","last_peered":"2024-05-09T05:35:29.505866+0000","last_clean":"2024-05-09T05:35:29.505866+0000","last_became_active":"2024-05-09T05:34:54.338218+0000","last_became_peered":"2024-05-09T05:34:54.338218+0000","last_unstale":"2024-05-09T05:35:29.505866+0000","last_undegraded":"2024-05-09T05:35:29.505866+0000","last_fullsized":"2024-05-09T05:35:29.505866+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:23:51.484732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"81'5","reported_seq":128,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:36:46.412998+0000","last_change":"2024-05-09T05:34:51.293962+0000","last_active":"2024-05-09T05:36:46.412998+0000","last_peered":"2024-05-09T05:36:46.412998+0000","last_clean":"2024-05-09T05:36:46.412998+0000","last_became_active":"2024-05-09T05:34:51.293567+0000","last_became_peered":"2024-05-09T05:34:51.293567+0000","last_unstale":"2024-05-09T05:36:46.412998+0000","last_undegraded":"2024-05-09T05:36:46.412998+0000","last_fullsized":"2024-05-09T05:36:46.412998+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:29:17.624820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":97,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.502752+0000","last_change":"2024-05-09T05:34:54.325411+0000","last_active":"2024-05-09T05:35:29.502752+0000","last_peered":"2024-05-09T05:35:29.502752+0000","last_clean":"2024-05-09T05:35:29.502752+0000","last_became_active":"2024-05-09T05:34:54.325036+0000","last_became_peered":"2024-05-09T05:34:54.325036+0000","last_unstale":"2024-05-09T05:35:29.502752+0000","last_undegraded":"2024-05-09T05:35:29.502752+0000","last_fullsized":"2024-05-09T05:35:29.502752+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:03:48.507512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"81'3","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.502572+0000","last_change":"2024-05-09T05:34:51.290884+0000","last_active":"2024-05-09T05:35:29.502572+0000","last_peered":"2024-05-09T05:35:29.502572+0000","last_clean":"2024-05-09T05:35:29.502572+0000","last_became_active":"2024-05-09T05:34:51.290459+0000","last_became_peered":"2024-05-09T05:34:51.290459+0000","last_unstale":"2024-05-09T05:35:29.502572+0000","last_undegraded":"2024-05-09T05:35:29.502572+0000","last_fullsized":"2024-05-09T05:35:29.502572+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:29:47.737930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.507517+0000","last_change":"2024-05-09T05:35:29.507517+0000","last_active":"2024-05-09T05:35:29.507517+0000","last_peered":"2024-05-09T05:35:29.507517+0000","last_clean":"2024-05-09T05:35:29.507517+0000","last_became_active":"2024-05-09T05:35:29.507029+0000","last_became_peered":"2024-05-09T05:35:29.507029+0000","last_unstale":"2024-05-09T05:35:29.507517+0000","last_undegraded":"2024-05-09T05:35:29.507517+0000","last_fullsized":"2024-05-09T05:35:29.507517+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:03:23.016919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"81'2","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.713053+0000","last_change":"2024-05-09T05:34:51.286241+0000","last_active":"2024-05-09T05:35:29.713053+0000","last_peered":"2024-05-09T05:35:29.713053+0000","last_clean":"2024-05-09T05:35:29.713053+0000","last_became_active":"2024-05-09T05:34:51.285814+0000","last_became_peered":"2024-05-09T05:34:51.285814+0000","last_unstale":"2024-05-09T05:35:29.713053+0000","last_undegraded":"2024-05-09T05:35:29.713053+0000","last_fullsized":"2024-05-09T05:35:29.713053+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:44:21.937909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.502179+0000","last_change":"2024-05-09T05:34:54.339247+0000","last_active":"2024-05-09T05:35:29.502179+0000","last_peered":"2024-05-09T05:35:29.502179+0000","last_clean":"2024-05-09T05:35:29.502179+0000","last_became_active":"2024-05-09T05:34:54.338899+0000","last_became_peered":"2024-05-09T05:34:54.338899+0000","last_unstale":"2024-05-09T05:35:29.502179+0000","last_undegraded":"2024-05-09T05:35:29.502179+0000","last_fullsized":"2024-05-09T05:35:29.502179+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:54:50.696065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"81'1","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.504543+0000","last_change":"2024-05-09T05:34:51.295297+0000","last_active":"2024-05-09T05:35:29.504543+0000","last_peered":"2024-05-09T05:35:29.504543+0000","last_clean":"2024-05-09T05:35:29.504543+0000","last_became_active":"2024-05-09T05:34:51.294814+0000","last_became_peered":"2024-05-09T05:34:51.294814+0000","last_unstale":"2024-05-09T05:35:29.504543+0000","last_undegraded":"2024-05-09T05:35:29.504543+0000","last_fullsized":"2024-05-09T05:35:29.504543+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:05:57.955453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.500235+0000","last_change":"2024-05-09T05:34:54.335988+0000","last_active":"2024-05-09T05:35:29.500235+0000","last_peered":"2024-05-09T05:35:29.500235+0000","last_clean":"2024-05-09T05:35:29.500235+0000","last_became_active":"2024-05-09T05:34:54.335574+0000","last_became_peered":"2024-05-09T05:34:54.335574+0000","last_unstale":"2024-05-09T05:35:29.500235+0000","last_undegraded":"2024-05-09T05:35:29.500235+0000","last_fullsized":"2024-05-09T05:35:29.500235+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:12:26.453578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"81'3","reported_seq":125,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:36:47.413672+0000","last_change":"2024-05-09T05:34:51.291587+0000","last_active":"2024-05-09T05:36:47.413672+0000","last_peered":"2024-05-09T05:36:47.413672+0000","last_clean":"2024-05-09T05:36:47.413672+0000","last_became_active":"2024-05-09T05:34:51.291084+0000","last_became_peered":"2024-05-09T05:34:51.291084+0000","last_unstale":"2024-05-09T05:36:47.413672+0000","last_undegraded":"2024-05-09T05:36:47.413672+0000","last_fullsized":"2024-05-09T05:36:47.413672+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:37:13.234749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":96,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.499955+0000","last_change":"2024-05-09T05:34:54.333978+0000","last_active":"2024-05-09T05:35:29.499955+0000","last_peered":"2024-05-09T05:35:29.499955+0000","last_clean":"2024-05-09T05:35:29.499955+0000","last_became_active":"2024-05-09T05:34:54.333497+0000","last_became_peered":"2024-05-09T05:34:54.333497+0000","last_unstale":"2024-05-09T05:35:29.499955+0000","last_undegraded":"2024-05-09T05:35:29.499955+0000","last_fullsized":"2024-05-09T05:35:29.499955+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:24:04.078316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"81'2","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.720038+0000","last_change":"2024-05-09T05:35:29.720038+0000","last_active":"2024-05-09T05:35:29.720038+0000","last_peered":"2024-05-09T05:35:29.720038+0000","last_clean":"2024-05-09T05:35:29.720038+0000","last_became_active":"2024-05-09T05:35:29.716097+0000","last_became_peered":"2024-05-09T05:35:29.716097+0000","last_unstale":"2024-05-09T05:35:29.720038+0000","last_undegraded":"2024-05-09T05:35:29.720038+0000","last_fullsized":"2024-05-09T05:35:29.720038+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:35:50.853791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.505931+0000","last_change":"2024-05-09T05:34:54.345340+0000","last_active":"2024-05-09T05:35:29.505931+0000","last_peered":"2024-05-09T05:35:29.505931+0000","last_clean":"2024-05-09T05:35:29.505931+0000","last_became_active":"2024-05-09T05:34:54.344690+0000","last_became_peered":"2024-05-09T05:34:54.344690+0000","last_unstale":"2024-05-09T05:35:29.505931+0000","last_undegraded":"2024-05-09T05:35:29.505931+0000","last_fullsized":"2024-05-09T05:35:29.505931+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:35:21.222688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"81'4","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.505894+0000","last_change":"2024-05-09T05:34:51.661607+0000","last_active":"2024-05-09T05:35:29.505894+0000","last_peered":"2024-05-09T05:35:29.505894+0000","last_clean":"2024-05-09T05:35:29.505894+0000","last_became_active":"2024-05-09T05:34:51.660514+0000","last_became_peered":"2024-05-09T05:34:51.660514+0000","last_unstale":"2024-05-09T05:35:29.505894+0000","last_undegraded":"2024-05-09T05:35:29.505894+0000","last_fullsized":"2024-05-09T05:35:29.505894+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:29:05.670388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.499915+0000","last_change":"2024-05-09T05:34:54.340465+0000","last_active":"2024-05-09T05:35:29.499915+0000","last_peered":"2024-05-09T05:35:29.499915+0000","last_clean":"2024-05-09T05:35:29.499915+0000","last_became_active":"2024-05-09T05:34:54.339918+0000","last_became_peered":"2024-05-09T05:34:54.339918+0000","last_unstale":"2024-05-09T05:35:29.499915+0000","last_undegraded":"2024-05-09T05:35:29.499915+0000","last_fullsized":"2024-05-09T05:35:29.499915+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:18:03.594387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'29","reported_seq":272,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:36:47.856436+0000","last_change":"2024-05-09T05:35:29.731065+0000","last_active":"2024-05-09T05:36:47.856436+0000","last_peered":"2024-05-09T05:36:47.856436+0000","last_clean":"2024-05-09T05:36:47.856436+0000","last_became_active":"2024-05-09T05:35:29.716353+0000","last_became_peered":"2024-05-09T05:35:29.716353+0000","last_unstale":"2024-05-09T05:36:47.856436+0000","last_undegraded":"2024-05-09T05:36:47.856436+0000","last_fullsized":"2024-05-09T05:36:47.856436+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:50:35.450572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59762,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":196,"num_read_kb":142,"num_write":30,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":42201,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.503455+0000","last_change":"2024-05-09T05:34:54.334616+0000","last_active":"2024-05-09T05:35:29.503455+0000","last_peered":"2024-05-09T05:35:29.503455+0000","last_clean":"2024-05-09T05:35:29.503455+0000","last_became_active":"2024-05-09T05:34:54.334267+0000","last_became_peered":"2024-05-09T05:34:54.334267+0000","last_unstale":"2024-05-09T05:35:29.503455+0000","last_undegraded":"2024-05-09T05:35:29.503455+0000","last_fullsized":"2024-05-09T05:35:29.503455+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:13:03.841458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'6","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.499985+0000","last_change":"2024-05-09T05:34:51.290247+0000","last_active":"2024-05-09T05:35:29.499985+0000","last_peered":"2024-05-09T05:35:29.499985+0000","last_clean":"2024-05-09T05:35:29.499985+0000","last_became_active":"2024-05-09T05:34:51.288599+0000","last_became_peered":"2024-05-09T05:34:51.288599+0000","last_unstale":"2024-05-09T05:35:29.499985+0000","last_undegraded":"2024-05-09T05:35:29.499985+0000","last_fullsized":"2024-05-09T05:35:29.499985+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:57:44.805526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.713082+0000","last_change":"2024-05-09T05:34:54.331768+0000","last_active":"2024-05-09T05:35:29.713082+0000","last_peered":"2024-05-09T05:35:29.713082+0000","last_clean":"2024-05-09T05:35:29.713082+0000","last_became_active":"2024-05-09T05:34:54.331407+0000","last_became_peered":"2024-05-09T05:34:54.331407+0000","last_unstale":"2024-05-09T05:35:29.713082+0000","last_undegraded":"2024-05-09T05:35:29.713082+0000","last_fullsized":"2024-05-09T05:35:29.713082+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:16:43.767055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"81'3","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.505287+0000","last_change":"2024-05-09T05:34:51.294266+0000","last_active":"2024-05-09T05:35:29.505287+0000","last_peered":"2024-05-09T05:35:29.505287+0000","last_clean":"2024-05-09T05:35:29.505287+0000","last_became_active":"2024-05-09T05:34:51.293865+0000","last_became_peered":"2024-05-09T05:34:51.293865+0000","last_unstale":"2024-05-09T05:35:29.505287+0000","last_undegraded":"2024-05-09T05:35:29.505287+0000","last_fullsized":"2024-05-09T05:35:29.505287+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:13:05.775729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.499259+0000","last_change":"2024-05-09T05:34:54.346713+0000","last_active":"2024-05-09T05:35:29.499259+0000","last_peered":"2024-05-09T05:35:29.499259+0000","last_clean":"2024-05-09T05:35:29.499259+0000","last_became_active":"2024-05-09T05:34:54.346361+0000","last_became_peered":"2024-05-09T05:34:54.346361+0000","last_unstale":"2024-05-09T05:35:29.499259+0000","last_undegraded":"2024-05-09T05:35:29.499259+0000","last_fullsized":"2024-05-09T05:35:29.499259+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:29:07.013316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"81'4","reported_seq":128,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:36:46.412624+0000","last_change":"2024-05-09T05:34:51.288809+0000","last_active":"2024-05-09T05:36:46.412624+0000","last_peered":"2024-05-09T05:36:46.412624+0000","last_clean":"2024-05-09T05:36:46.412624+0000","last_became_active":"2024-05-09T05:34:51.288417+0000","last_became_peered":"2024-05-09T05:34:51.288417+0000","last_unstale":"2024-05-09T05:36:46.412624+0000","last_undegraded":"2024-05-09T05:36:46.412624+0000","last_fullsized":"2024-05-09T05:36:46.412624+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:19:53.691145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":99,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.498794+0000","last_change":"2024-05-09T05:34:54.344335+0000","last_active":"2024-05-09T05:35:29.498794+0000","last_peered":"2024-05-09T05:35:29.498794+0000","last_clean":"2024-05-09T05:35:29.498794+0000","last_became_active":"2024-05-09T05:34:54.343938+0000","last_became_peered":"2024-05-09T05:34:54.343938+0000","last_unstale":"2024-05-09T05:35:29.498794+0000","last_undegraded":"2024-05-09T05:35:29.498794+0000","last_fullsized":"2024-05-09T05:35:29.498794+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:00:10.003294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'15","reported_seq":41,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.502510+0000","last_change":"2024-05-09T05:34:51.660939+0000","last_active":"2024-05-09T05:35:29.502510+0000","last_peered":"2024-05-09T05:35:29.502510+0000","last_clean":"2024-05-09T05:35:29.502510+0000","last_became_active":"2024-05-09T05:34:51.660501+0000","last_became_peered":"2024-05-09T05:34:51.660501+0000","last_unstale":"2024-05-09T05:35:29.502510+0000","last_undegraded":"2024-05-09T05:35:29.502510+0000","last_fullsized":"2024-05-09T05:35:29.502510+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:43:11.626811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.715011+0000","last_change":"2024-05-09T05:35:29.714515+0000","last_active":"2024-05-09T05:35:29.715011+0000","last_peered":"2024-05-09T05:35:29.715011+0000","last_clean":"2024-05-09T05:35:29.715011+0000","last_became_active":"2024-05-09T05:35:29.714125+0000","last_became_peered":"2024-05-09T05:35:29.714125+0000","last_unstale":"2024-05-09T05:35:29.715011+0000","last_undegraded":"2024-05-09T05:35:29.715011+0000","last_fullsized":"2024-05-09T05:35:29.715011+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:20:18.408711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.f","version":"81'2","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.502959+0000","last_change":"2024-05-09T05:34:51.290742+0000","last_active":"2024-05-09T05:35:29.502959+0000","last_peered":"2024-05-09T05:35:29.502959+0000","last_clean":"2024-05-09T05:35:29.502959+0000","last_became_active":"2024-05-09T05:34:51.290371+0000","last_became_peered":"2024-05-09T05:34:51.290371+0000","last_unstale":"2024-05-09T05:35:29.502959+0000","last_undegraded":"2024-05-09T05:35:29.502959+0000","last_fullsized":"2024-05-09T05:35:29.502959+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:38:05.449808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.503624+0000","last_change":"2024-05-09T05:34:54.348128+0000","last_active":"2024-05-09T05:35:29.503624+0000","last_peered":"2024-05-09T05:35:29.503624+0000","last_clean":"2024-05-09T05:35:29.503624+0000","last_became_active":"2024-05-09T05:34:54.347648+0000","last_became_peered":"2024-05-09T05:34:54.347648+0000","last_unstale":"2024-05-09T05:35:29.503624+0000","last_undegraded":"2024-05-09T05:35:29.503624+0000","last_fullsized":"2024-05-09T05:35:29.503624+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:46:19.578003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.500343+0000","last_change":"2024-05-09T05:34:51.661486+0000","last_active":"2024-05-09T05:35:29.500343+0000","last_peered":"2024-05-09T05:35:29.500343+0000","last_clean":"2024-05-09T05:35:29.500343+0000","last_became_active":"2024-05-09T05:34:51.661094+0000","last_became_peered":"2024-05-09T05:34:51.661094+0000","last_unstale":"2024-05-09T05:35:29.500343+0000","last_undegraded":"2024-05-09T05:35:29.500343+0000","last_fullsized":"2024-05-09T05:35:29.500343+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:14:26.675414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"81'1","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.502803+0000","last_change":"2024-05-09T05:34:54.330881+0000","last_active":"2024-05-09T05:35:29.502803+0000","last_peered":"2024-05-09T05:35:29.502803+0000","last_clean":"2024-05-09T05:35:29.502803+0000","last_became_active":"2024-05-09T05:34:54.330412+0000","last_became_peered":"2024-05-09T05:34:54.330412+0000","last_unstale":"2024-05-09T05:35:29.502803+0000","last_undegraded":"2024-05-09T05:35:29.502803+0000","last_fullsized":"2024-05-09T05:35:29.502803+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:21:42.481374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"81'1","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.499020+0000","last_change":"2024-05-09T05:34:51.289479+0000","last_active":"2024-05-09T05:35:29.499020+0000","last_peered":"2024-05-09T05:35:29.499020+0000","last_clean":"2024-05-09T05:35:29.499020+0000","last_became_active":"2024-05-09T05:34:51.286436+0000","last_became_peered":"2024-05-09T05:34:51.286436+0000","last_unstale":"2024-05-09T05:35:29.499020+0000","last_undegraded":"2024-05-09T05:35:29.499020+0000","last_fullsized":"2024-05-09T05:35:29.499020+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:22:59.431456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.506937+0000","last_change":"2024-05-09T05:35:29.506937+0000","last_active":"2024-05-09T05:35:29.506937+0000","last_peered":"2024-05-09T05:35:29.506937+0000","last_clean":"2024-05-09T05:35:29.506937+0000","last_became_active":"2024-05-09T05:35:29.506540+0000","last_became_peered":"2024-05-09T05:35:29.506540+0000","last_unstale":"2024-05-09T05:35:29.506937+0000","last_undegraded":"2024-05-09T05:35:29.506937+0000","last_fullsized":"2024-05-09T05:35:29.506937+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:54:51.868972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.505019+0000","last_change":"2024-05-09T05:34:54.334559+0000","last_active":"2024-05-09T05:35:29.505019+0000","last_peered":"2024-05-09T05:35:29.505019+0000","last_clean":"2024-05-09T05:35:29.505019+0000","last_became_active":"2024-05-09T05:34:54.333599+0000","last_became_peered":"2024-05-09T05:34:54.333599+0000","last_unstale":"2024-05-09T05:35:29.505019+0000","last_undegraded":"2024-05-09T05:35:29.505019+0000","last_fullsized":"2024-05-09T05:35:29.505019+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:36:16.139227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"81'4","reported_seq":123,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:36:44.409512+0000","last_change":"2024-05-09T05:34:51.660563+0000","last_active":"2024-05-09T05:36:44.409512+0000","last_peered":"2024-05-09T05:36:44.409512+0000","last_clean":"2024-05-09T05:36:44.409512+0000","last_became_active":"2024-05-09T05:34:51.660127+0000","last_became_peered":"2024-05-09T05:34:51.660127+0000","last_unstale":"2024-05-09T05:36:44.409512+0000","last_undegraded":"2024-05-09T05:36:44.409512+0000","last_fullsized":"2024-05-09T05:36:44.409512+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:08:56.832264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":93,"num_read_kb":93,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.502524+0000","last_change":"2024-05-09T05:34:54.330774+0000","last_active":"2024-05-09T05:35:29.502524+0000","last_peered":"2024-05-09T05:35:29.502524+0000","last_clean":"2024-05-09T05:35:29.502524+0000","last_became_active":"2024-05-09T05:34:54.329970+0000","last_became_peered":"2024-05-09T05:34:54.329970+0000","last_unstale":"2024-05-09T05:35:29.502524+0000","last_undegraded":"2024-05-09T05:35:29.502524+0000","last_fullsized":"2024-05-09T05:35:29.502524+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:41:30.078744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"81'3","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.714370+0000","last_change":"2024-05-09T05:34:51.289026+0000","last_active":"2024-05-09T05:35:29.714370+0000","last_peered":"2024-05-09T05:35:29.714370+0000","last_clean":"2024-05-09T05:35:29.714370+0000","last_became_active":"2024-05-09T05:34:51.288615+0000","last_became_peered":"2024-05-09T05:34:51.288615+0000","last_unstale":"2024-05-09T05:35:29.714370+0000","last_undegraded":"2024-05-09T05:35:29.714370+0000","last_fullsized":"2024-05-09T05:35:29.714370+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:17:21.395173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":102,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.499012+0000","last_change":"2024-05-09T05:33:24.272408+0000","last_active":"2024-05-09T05:35:29.499012+0000","last_peered":"2024-05-09T05:35:29.499012+0000","last_clean":"2024-05-09T05:35:29.499012+0000","last_became_active":"2024-05-09T05:33:24.266495+0000","last_became_peered":"2024-05-09T05:33:24.266495+0000","last_unstale":"2024-05-09T05:35:29.499012+0000","last_undegraded":"2024-05-09T05:35:29.499012+0000","last_fullsized":"2024-05-09T05:35:29.499012+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:29:56.191070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:29:56.191070+0000","last_clean_scrub_stamp":"2024-05-09T05:29:56.191070+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:45:12.602657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.712943+0000","last_change":"2024-05-09T05:34:54.328200+0000","last_active":"2024-05-09T05:35:29.712943+0000","last_peered":"2024-05-09T05:35:29.712943+0000","last_clean":"2024-05-09T05:35:29.712943+0000","last_became_active":"2024-05-09T05:34:54.327552+0000","last_became_peered":"2024-05-09T05:34:54.327552+0000","last_unstale":"2024-05-09T05:35:29.712943+0000","last_undegraded":"2024-05-09T05:35:29.712943+0000","last_fullsized":"2024-05-09T05:35:29.712943+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:33:13.840266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"81'3","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.499072+0000","last_change":"2024-05-09T05:34:51.292796+0000","last_active":"2024-05-09T05:35:29.499072+0000","last_peered":"2024-05-09T05:35:29.499072+0000","last_clean":"2024-05-09T05:35:29.499072+0000","last_became_active":"2024-05-09T05:34:51.292224+0000","last_became_peered":"2024-05-09T05:34:51.292224+0000","last_unstale":"2024-05-09T05:35:29.499072+0000","last_undegraded":"2024-05-09T05:35:29.499072+0000","last_fullsized":"2024-05-09T05:35:29.499072+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:32:02.925633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"81'1","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.511437+0000","last_change":"2024-05-09T05:35:29.510921+0000","last_active":"2024-05-09T05:35:29.511437+0000","last_peered":"2024-05-09T05:35:29.511437+0000","last_clean":"2024-05-09T05:35:29.511437+0000","last_became_active":"2024-05-09T05:35:29.506757+0000","last_became_peered":"2024-05-09T05:35:29.506757+0000","last_unstale":"2024-05-09T05:35:29.511437+0000","last_undegraded":"2024-05-09T05:35:29.511437+0000","last_fullsized":"2024-05-09T05:35:29.511437+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:13:57.924130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.713266+0000","last_change":"2024-05-09T05:34:54.332133+0000","last_active":"2024-05-09T05:35:29.713266+0000","last_peered":"2024-05-09T05:35:29.713266+0000","last_clean":"2024-05-09T05:35:29.713266+0000","last_became_active":"2024-05-09T05:34:54.331756+0000","last_became_peered":"2024-05-09T05:34:54.331756+0000","last_unstale":"2024-05-09T05:35:29.713266+0000","last_undegraded":"2024-05-09T05:35:29.713266+0000","last_fullsized":"2024-05-09T05:35:29.713266+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:47:54.341410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'12","reported_seq":50,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:34.336121+0000","last_change":"2024-05-09T05:35:29.509840+0000","last_active":"2024-05-09T05:35:34.336121+0000","last_peered":"2024-05-09T05:35:34.336121+0000","last_clean":"2024-05-09T05:35:34.336121+0000","last_became_active":"2024-05-09T05:35:29.505151+0000","last_became_peered":"2024-05-09T05:35:29.505151+0000","last_unstale":"2024-05-09T05:35:34.336121+0000","last_undegraded":"2024-05-09T05:35:34.336121+0000","last_fullsized":"2024-05-09T05:35:34.336121+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:04:38.224022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":11,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.502483+0000","last_change":"2024-05-09T05:34:54.339792+0000","last_active":"2024-05-09T05:35:29.502483+0000","last_peered":"2024-05-09T05:35:29.502483+0000","last_clean":"2024-05-09T05:35:29.502483+0000","last_became_active":"2024-05-09T05:34:54.339415+0000","last_became_peered":"2024-05-09T05:34:54.339415+0000","last_unstale":"2024-05-09T05:35:29.502483+0000","last_undegraded":"2024-05-09T05:35:29.502483+0000","last_fullsized":"2024-05-09T05:35:29.502483+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:08:14.148373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'4","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.714194+0000","last_change":"2024-05-09T05:34:51.284535+0000","last_active":"2024-05-09T05:35:29.714194+0000","last_peered":"2024-05-09T05:35:29.714194+0000","last_clean":"2024-05-09T05:35:29.714194+0000","last_became_active":"2024-05-09T05:34:51.283686+0000","last_became_peered":"2024-05-09T05:34:51.283686+0000","last_unstale":"2024-05-09T05:35:29.714194+0000","last_undegraded":"2024-05-09T05:35:29.714194+0000","last_fullsized":"2024-05-09T05:35:29.714194+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:05:58.544406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.505568+0000","last_change":"2024-05-09T05:34:54.344277+0000","last_active":"2024-05-09T05:35:29.505568+0000","last_peered":"2024-05-09T05:35:29.505568+0000","last_clean":"2024-05-09T05:35:29.505568+0000","last_became_active":"2024-05-09T05:34:54.343903+0000","last_became_peered":"2024-05-09T05:34:54.343903+0000","last_unstale":"2024-05-09T05:35:29.505568+0000","last_undegraded":"2024-05-09T05:35:29.505568+0000","last_fullsized":"2024-05-09T05:35:29.505568+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:33:21.052161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"81'2","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.499295+0000","last_change":"2024-05-09T05:34:51.660277+0000","last_active":"2024-05-09T05:35:29.499295+0000","last_peered":"2024-05-09T05:35:29.499295+0000","last_clean":"2024-05-09T05:35:29.499295+0000","last_became_active":"2024-05-09T05:34:51.659841+0000","last_became_peered":"2024-05-09T05:34:51.659841+0000","last_unstale":"2024-05-09T05:35:29.499295+0000","last_undegraded":"2024-05-09T05:35:29.499295+0000","last_fullsized":"2024-05-09T05:35:29.499295+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:35:41.307477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.502743+0000","last_change":"2024-05-09T05:34:54.330642+0000","last_active":"2024-05-09T05:35:29.502743+0000","last_peered":"2024-05-09T05:35:29.502743+0000","last_clean":"2024-05-09T05:35:29.502743+0000","last_became_active":"2024-05-09T05:34:54.330273+0000","last_became_peered":"2024-05-09T05:34:54.330273+0000","last_unstale":"2024-05-09T05:35:29.502743+0000","last_undegraded":"2024-05-09T05:35:29.502743+0000","last_fullsized":"2024-05-09T05:35:29.502743+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:27:17.520941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"81'3","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.502186+0000","last_change":"2024-05-09T05:34:51.288782+0000","last_active":"2024-05-09T05:35:29.502186+0000","last_peered":"2024-05-09T05:35:29.502186+0000","last_clean":"2024-05-09T05:35:29.502186+0000","last_became_active":"2024-05-09T05:34:51.288333+0000","last_became_peered":"2024-05-09T05:34:51.288333+0000","last_unstale":"2024-05-09T05:35:29.502186+0000","last_undegraded":"2024-05-09T05:35:29.502186+0000","last_fullsized":"2024-05-09T05:35:29.502186+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:13:11.893177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.503206+0000","last_change":"2024-05-09T05:34:54.343920+0000","last_active":"2024-05-09T05:35:29.503206+0000","last_peered":"2024-05-09T05:35:29.503206+0000","last_clean":"2024-05-09T05:35:29.503206+0000","last_became_active":"2024-05-09T05:34:54.343452+0000","last_became_peered":"2024-05-09T05:34:54.343452+0000","last_unstale":"2024-05-09T05:35:29.503206+0000","last_undegraded":"2024-05-09T05:35:29.503206+0000","last_fullsized":"2024-05-09T05:35:29.503206+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:28:56.425068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"81'1","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.499721+0000","last_change":"2024-05-09T05:34:51.290178+0000","last_active":"2024-05-09T05:35:29.499721+0000","last_peered":"2024-05-09T05:35:29.499721+0000","last_clean":"2024-05-09T05:35:29.499721+0000","last_became_active":"2024-05-09T05:34:51.289754+0000","last_became_peered":"2024-05-09T05:34:51.289754+0000","last_unstale":"2024-05-09T05:35:29.499721+0000","last_undegraded":"2024-05-09T05:35:29.499721+0000","last_fullsized":"2024-05-09T05:35:29.499721+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:51:41.221061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.502247+0000","last_change":"2024-05-09T05:34:54.330473+0000","last_active":"2024-05-09T05:35:29.502247+0000","last_peered":"2024-05-09T05:35:29.502247+0000","last_clean":"2024-05-09T05:35:29.502247+0000","last_became_active":"2024-05-09T05:34:54.329898+0000","last_became_peered":"2024-05-09T05:34:54.329898+0000","last_unstale":"2024-05-09T05:35:29.502247+0000","last_undegraded":"2024-05-09T05:35:29.502247+0000","last_fullsized":"2024-05-09T05:35:29.502247+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:26:24.727909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"81'4","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.503014+0000","last_change":"2024-05-09T05:34:51.294321+0000","last_active":"2024-05-09T05:35:29.503014+0000","last_peered":"2024-05-09T05:35:29.503014+0000","last_clean":"2024-05-09T05:35:29.503014+0000","last_became_active":"2024-05-09T05:34:51.293956+0000","last_became_peered":"2024-05-09T05:34:51.293956+0000","last_unstale":"2024-05-09T05:35:29.503014+0000","last_undegraded":"2024-05-09T05:35:29.503014+0000","last_fullsized":"2024-05-09T05:35:29.503014+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T14:45:10.404120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.499265+0000","last_change":"2024-05-09T05:34:54.335850+0000","last_active":"2024-05-09T05:35:29.499265+0000","last_peered":"2024-05-09T05:35:29.499265+0000","last_clean":"2024-05-09T05:35:29.499265+0000","last_became_active":"2024-05-09T05:34:54.335441+0000","last_became_peered":"2024-05-09T05:34:54.335441+0000","last_unstale":"2024-05-09T05:35:29.499265+0000","last_undegraded":"2024-05-09T05:35:29.499265+0000","last_fullsized":"2024-05-09T05:35:29.499265+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:15:32.379286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"81'3","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.500050+0000","last_change":"2024-05-09T05:34:51.662211+0000","last_active":"2024-05-09T05:35:29.500050+0000","last_peered":"2024-05-09T05:35:29.500050+0000","last_clean":"2024-05-09T05:35:29.500050+0000","last_became_active":"2024-05-09T05:34:51.661446+0000","last_became_peered":"2024-05-09T05:34:51.661446+0000","last_unstale":"2024-05-09T05:35:29.500050+0000","last_undegraded":"2024-05-09T05:35:29.500050+0000","last_fullsized":"2024-05-09T05:35:29.500050+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:35:56.098673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.499357+0000","last_change":"2024-05-09T05:34:54.342030+0000","last_active":"2024-05-09T05:35:29.499357+0000","last_peered":"2024-05-09T05:35:29.499357+0000","last_clean":"2024-05-09T05:35:29.499357+0000","last_became_active":"2024-05-09T05:34:54.338081+0000","last_became_peered":"2024-05-09T05:34:54.338081+0000","last_unstale":"2024-05-09T05:35:29.499357+0000","last_undegraded":"2024-05-09T05:35:29.499357+0000","last_fullsized":"2024-05-09T05:35:29.499357+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:40:55.042110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'1","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.505757+0000","last_change":"2024-05-09T05:34:51.293687+0000","last_active":"2024-05-09T05:35:29.505757+0000","last_peered":"2024-05-09T05:35:29.505757+0000","last_clean":"2024-05-09T05:35:29.505757+0000","last_became_active":"2024-05-09T05:34:51.293298+0000","last_became_peered":"2024-05-09T05:34:51.293298+0000","last_unstale":"2024-05-09T05:35:29.505757+0000","last_undegraded":"2024-05-09T05:35:29.505757+0000","last_fullsized":"2024-05-09T05:35:29.505757+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:39:57.031631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"81'1","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.499302+0000","last_change":"2024-05-09T05:34:54.344843+0000","last_active":"2024-05-09T05:35:29.499302+0000","last_peered":"2024-05-09T05:35:29.499302+0000","last_clean":"2024-05-09T05:35:29.499302+0000","last_became_active":"2024-05-09T05:34:54.339577+0000","last_became_peered":"2024-05-09T05:34:54.339577+0000","last_unstale":"2024-05-09T05:35:29.499302+0000","last_undegraded":"2024-05-09T05:35:29.499302+0000","last_fullsized":"2024-05-09T05:35:29.499302+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:03:42.398424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.713256+0000","last_change":"2024-05-09T05:34:51.292633+0000","last_active":"2024-05-09T05:35:29.713256+0000","last_peered":"2024-05-09T05:35:29.713256+0000","last_clean":"2024-05-09T05:35:29.713256+0000","last_became_active":"2024-05-09T05:34:51.292164+0000","last_became_peered":"2024-05-09T05:34:51.292164+0000","last_unstale":"2024-05-09T05:35:29.713256+0000","last_undegraded":"2024-05-09T05:35:29.713256+0000","last_fullsized":"2024-05-09T05:35:29.713256+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:50.264499+0000","last_clean_scrub_stamp":"2024-05-09T05:34:50.264499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:27:30.527040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.499770+0000","last_change":"2024-05-09T05:34:54.345924+0000","last_active":"2024-05-09T05:35:29.499770+0000","last_peered":"2024-05-09T05:35:29.499770+0000","last_clean":"2024-05-09T05:35:29.499770+0000","last_became_active":"2024-05-09T05:34:54.344885+0000","last_became_peered":"2024-05-09T05:34:54.344885+0000","last_unstale":"2024-05-09T05:35:29.499770+0000","last_undegraded":"2024-05-09T05:35:29.499770+0000","last_fullsized":"2024-05-09T05:35:29.499770+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T16:59:40.079060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.503292+0000","last_change":"2024-05-09T05:34:54.340599+0000","last_active":"2024-05-09T05:35:29.503292+0000","last_peered":"2024-05-09T05:35:29.503292+0000","last_clean":"2024-05-09T05:35:29.503292+0000","last_became_active":"2024-05-09T05:34:54.340194+0000","last_became_peered":"2024-05-09T05:34:54.340194+0000","last_unstale":"2024-05-09T05:35:29.503292+0000","last_undegraded":"2024-05-09T05:35:29.503292+0000","last_fullsized":"2024-05-09T05:35:29.503292+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:10:15.868670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.499659+0000","last_change":"2024-05-09T05:34:54.334658+0000","last_active":"2024-05-09T05:35:29.499659+0000","last_peered":"2024-05-09T05:35:29.499659+0000","last_clean":"2024-05-09T05:35:29.499659+0000","last_became_active":"2024-05-09T05:34:54.334317+0000","last_became_peered":"2024-05-09T05:34:54.334317+0000","last_unstale":"2024-05-09T05:35:29.499659+0000","last_undegraded":"2024-05-09T05:35:29.499659+0000","last_fullsized":"2024-05-09T05:35:29.499659+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:50:28.262145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.499590+0000","last_change":"2024-05-09T05:34:54.330380+0000","last_active":"2024-05-09T05:35:29.499590+0000","last_peered":"2024-05-09T05:35:29.499590+0000","last_clean":"2024-05-09T05:35:29.499590+0000","last_became_active":"2024-05-09T05:34:54.329984+0000","last_became_peered":"2024-05-09T05:34:54.329984+0000","last_unstale":"2024-05-09T05:35:29.499590+0000","last_undegraded":"2024-05-09T05:35:29.499590+0000","last_fullsized":"2024-05-09T05:35:29.499590+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:10:26.051644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.506217+0000","last_change":"2024-05-09T05:34:54.344755+0000","last_active":"2024-05-09T05:35:29.506217+0000","last_peered":"2024-05-09T05:35:29.506217+0000","last_clean":"2024-05-09T05:35:29.506217+0000","last_became_active":"2024-05-09T05:34:54.343968+0000","last_became_peered":"2024-05-09T05:34:54.343968+0000","last_unstale":"2024-05-09T05:35:29.506217+0000","last_undegraded":"2024-05-09T05:35:29.506217+0000","last_fullsized":"2024-05-09T05:35:29.506217+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T15:58:32.086079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.713140+0000","last_change":"2024-05-09T05:34:54.335427+0000","last_active":"2024-05-09T05:35:29.713140+0000","last_peered":"2024-05-09T05:35:29.713140+0000","last_clean":"2024-05-09T05:35:29.713140+0000","last_became_active":"2024-05-09T05:34:54.335091+0000","last_became_peered":"2024-05-09T05:34:54.335091+0000","last_unstale":"2024-05-09T05:35:29.713140+0000","last_undegraded":"2024-05-09T05:35:29.713140+0000","last_fullsized":"2024-05-09T05:35:29.713140+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:24:05.939805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.504048+0000","last_change":"2024-05-09T05:34:54.342056+0000","last_active":"2024-05-09T05:35:29.504048+0000","last_peered":"2024-05-09T05:35:29.504048+0000","last_clean":"2024-05-09T05:35:29.504048+0000","last_became_active":"2024-05-09T05:34:54.341655+0000","last_became_peered":"2024-05-09T05:34:54.341655+0000","last_unstale":"2024-05-09T05:35:29.504048+0000","last_undegraded":"2024-05-09T05:35:29.504048+0000","last_fullsized":"2024-05-09T05:35:29.504048+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:19:50.284110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.499971+0000","last_change":"2024-05-09T05:34:54.331670+0000","last_active":"2024-05-09T05:35:29.499971+0000","last_peered":"2024-05-09T05:35:29.499971+0000","last_clean":"2024-05-09T05:35:29.499971+0000","last_became_active":"2024-05-09T05:34:54.330722+0000","last_became_peered":"2024-05-09T05:34:54.330722+0000","last_unstale":"2024-05-09T05:35:29.499971+0000","last_undegraded":"2024-05-09T05:35:29.499971+0000","last_fullsized":"2024-05-09T05:35:29.499971+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:36:10.417933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.502370+0000","last_change":"2024-05-09T05:34:54.336487+0000","last_active":"2024-05-09T05:35:29.502370+0000","last_peered":"2024-05-09T05:35:29.502370+0000","last_clean":"2024-05-09T05:35:29.502370+0000","last_became_active":"2024-05-09T05:34:54.336141+0000","last_became_peered":"2024-05-09T05:34:54.336141+0000","last_unstale":"2024-05-09T05:35:29.502370+0000","last_undegraded":"2024-05-09T05:35:29.502370+0000","last_fullsized":"2024-05-09T05:35:29.502370+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:45:42.541374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.504577+0000","last_change":"2024-05-09T05:34:54.330749+0000","last_active":"2024-05-09T05:35:29.504577+0000","last_peered":"2024-05-09T05:35:29.504577+0000","last_clean":"2024-05-09T05:35:29.504577+0000","last_became_active":"2024-05-09T05:34:54.330279+0000","last_became_peered":"2024-05-09T05:34:54.330279+0000","last_unstale":"2024-05-09T05:35:29.504577+0000","last_undegraded":"2024-05-09T05:35:29.504577+0000","last_fullsized":"2024-05-09T05:35:29.504577+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:49:48.704977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.502153+0000","last_change":"2024-05-09T05:34:54.338296+0000","last_active":"2024-05-09T05:35:29.502153+0000","last_peered":"2024-05-09T05:35:29.502153+0000","last_clean":"2024-05-09T05:35:29.502153+0000","last_became_active":"2024-05-09T05:34:54.337960+0000","last_became_peered":"2024-05-09T05:34:54.337960+0000","last_unstale":"2024-05-09T05:35:29.502153+0000","last_undegraded":"2024-05-09T05:35:29.502153+0000","last_fullsized":"2024-05-09T05:35:29.502153+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T12:48:46.436082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.500276+0000","last_change":"2024-05-09T05:34:54.334782+0000","last_active":"2024-05-09T05:35:29.500276+0000","last_peered":"2024-05-09T05:35:29.500276+0000","last_clean":"2024-05-09T05:35:29.500276+0000","last_became_active":"2024-05-09T05:34:54.333118+0000","last_became_peered":"2024-05-09T05:34:54.333118+0000","last_unstale":"2024-05-09T05:35:29.500276+0000","last_undegraded":"2024-05-09T05:35:29.500276+0000","last_fullsized":"2024-05-09T05:35:29.500276+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:04:40.473387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.713299+0000","last_change":"2024-05-09T05:34:54.334627+0000","last_active":"2024-05-09T05:35:29.713299+0000","last_peered":"2024-05-09T05:35:29.713299+0000","last_clean":"2024-05-09T05:35:29.713299+0000","last_became_active":"2024-05-09T05:34:54.333966+0000","last_became_peered":"2024-05-09T05:34:54.333966+0000","last_unstale":"2024-05-09T05:35:29.713299+0000","last_undegraded":"2024-05-09T05:35:29.713299+0000","last_fullsized":"2024-05-09T05:35:29.713299+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T17:15:57.733926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-05-09T05:35:29.507005+0000","last_change":"2024-05-09T05:35:29.507005+0000","last_active":"2024-05-09T05:35:29.507005+0000","last_peered":"2024-05-09T05:35:29.507005+0000","last_clean":"2024-05-09T05:35:29.507005+0000","last_became_active":"2024-05-09T05:35:29.506521+0000","last_became_peered":"2024-05-09T05:35:29.506521+0000","last_unstale":"2024-05-09T05:35:29.507005+0000","last_undegraded":"2024-05-09T05:35:29.507005+0000","last_fullsized":"2024-05-09T05:35:29.507005+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T05:34:53.289284+0000","last_clean_scrub_stamp":"2024-05-09T05:34:53.289284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T13:58:24.605073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":63763,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":593,"num_read_kb":349,"num_write":165,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":42223,"num_keys_recovered":11,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":191289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":140,"ondisk_log_size":140,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612648,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":905216,"data_stored":440786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808877,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":41056,"kb_used_data":1560,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704096,"statfs":{"total":95995035648,"available":95952994304,"internally_reserved":0,"allocated":1597440,"data_stored":1092398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":40434112},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972402,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32072,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713080,"statfs":{"total":95995035648,"available":95962193920,"internally_reserved":0,"allocated":917504,"data_stored":441000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168632,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32072,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713080,"statfs":{"total":95995035648,"available":95962193920,"internally_reserved":0,"allocated":913408,"data_stored":440898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397564,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36820,"kb_used_data":1476,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708332,"statfs":{"total":95995035648,"available":95957331968,"internally_reserved":0,"allocated":1511424,"data_stored":1032850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593793,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":440389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574938,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":966656,"data_stored":499944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738465,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32084,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713068,"statfs":{"total":95995035648,"available":95962181632,"internally_reserved":0,"allocated":925696,"data_stored":441660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411414,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":921600,"data_stored":441532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182481,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":921600,"data_stored":440700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986251,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":978944,"data_stored":500979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790023,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36832,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708320,"statfs":{"total":95995035648,"available":95957319680,"internally_reserved":0,"allocated":1523712,"data_stored":1032143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":59762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":60797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":61731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T05:36:51.105 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-05-09T05:36:51.105 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-05-09T05:36:51.105 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-05-09T05:36:51.106 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph health --format=json 2024-05-09T05:36:51.362 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T05:36:51.739 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:36:51 smithi039 ceph-mon[30439]: pgmap v354: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-09T05:36:51.739 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:36:51 smithi039 ceph-mon[30439]: from='client.14934 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-09T05:36:51.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:36:51 smithi060 ceph-mon[34555]: pgmap v354: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-09T05:36:51.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:36:51 smithi060 ceph-mon[34555]: from='client.14934 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-09T05:36:51.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:36:51 smithi100 ceph-mon[34353]: pgmap v354: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-09T05:36:51.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:36:51 smithi100 ceph-mon[34353]: from='client.14934 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-09T05:36:52.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:53.000+0000 7ff303a3b700 1 -- 172.21.15.39:0/2558578977 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff2fc1089f0 msgr2=0x7ff2fc108e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:52.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:53.000+0000 7ff303a3b700 1 --2- 172.21.15.39:0/2558578977 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff2fc1089f0 0x7ff2fc108e00 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff2f8009990 tx=0x7ff2f8009ca0 comp rx=0 tx=0).stop 2024-05-09T05:36:52.994 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:53.000+0000 7ff303a3b700 1 -- 172.21.15.39:0/2558578977 shutdown_connections 2024-05-09T05:36:52.995 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:53.000+0000 7ff303a3b700 1 --2- 172.21.15.39:0/2558578977 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff2fc103310 0x7ff2fc10f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:52.995 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:53.000+0000 7ff303a3b700 1 --2- 172.21.15.39:0/2558578977 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff2fc1089f0 0x7ff2fc108e00 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:52.995 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:53.000+0000 7ff303a3b700 1 --2- 172.21.15.39:0/2558578977 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2fc1029c0 0x7ff2fc102dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:52.995 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:53.000+0000 7ff303a3b700 1 -- 172.21.15.39:0/2558578977 >> 172.21.15.39:0/2558578977 conn(0x7ff2fc0fe520 msgr2=0x7ff2fc100970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:36:52.995 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:53.000+0000 7ff303a3b700 1 -- 172.21.15.39:0/2558578977 shutdown_connections 2024-05-09T05:36:52.995 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:53.000+0000 7ff303a3b700 1 -- 172.21.15.39:0/2558578977 wait complete. 2024-05-09T05:36:52.997 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:53.001+0000 7ff303a3b700 1 Processor -- start 2024-05-09T05:36:52.997 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:53.001+0000 7ff303a3b700 1 -- start start 2024-05-09T05:36:52.997 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:53.002+0000 7ff303a3b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff2fc1029c0 0x7ff2fc199d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:52.997 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:53.002+0000 7ff303a3b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2fc103310 0x7ff2fc19a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:52.997 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:53.002+0000 7ff303a3b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff2fc1089f0 0x7ff2fc19e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:52.997 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:53.002+0000 7ff303a3b700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7ff2fc112b20 con 0x7ff2fc1029c0 2024-05-09T05:36:52.997 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:53.002+0000 7ff303a3b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff2fc1129a0 con 0x7ff2fc103310 2024-05-09T05:36:52.997 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:53.002+0000 7ff303a3b700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff2fc112ca0 con 0x7ff2fc1089f0 2024-05-09T05:36:52.997 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:53.002+0000 7ff3017d7700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff2fc1029c0 0x7ff2fc199d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:52.997 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:53.002+0000 7ff3017d7700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff2fc1029c0 0x7ff2fc199d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:59458/0 (socket says 172.21.15.39:59458) 2024-05-09T05:36:52.997 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:53.002+0000 7ff3017d7700 1 -- 172.21.15.39:0/3648679943 learned_addr learned my addr 172.21.15.39:0/3648679943 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:36:52.997 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:53.002+0000 7ff300fd6700 1 --2- 172.21.15.39:0/3648679943 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2fc103310 0x7ff2fc19a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:52.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:53.002+0000 7ff301fd8700 1 --2- 172.21.15.39:0/3648679943 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff2fc1089f0 0x7ff2fc19e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:52.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:53.002+0000 7ff3017d7700 1 -- 172.21.15.39:0/3648679943 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff2fc1089f0 msgr2=0x7ff2fc19e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:52.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:53.002+0000 7ff3017d7700 1 --2- 172.21.15.39:0/3648679943 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff2fc1089f0 0x7ff2fc19e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:52.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:53.002+0000 7ff3017d7700 1 -- 172.21.15.39:0/3648679943 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2fc103310 msgr2=0x7ff2fc19a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:52.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:53.002+0000 7ff3017d7700 1 --2- 172.21.15.39:0/3648679943 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2fc103310 0x7ff2fc19a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:52.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:53.002+0000 7ff3017d7700 1 -- 172.21.15.39:0/3648679943 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2fc19ec30 con 0x7ff2fc1029c0 2024-05-09T05:36:52.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:53.002+0000 7ff3017d7700 1 --2- 172.21.15.39:0/3648679943 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff2fc1029c0 0x7ff2fc199d60 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff2f8000c00 tx=0x7ff2f80047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:36:52.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:53.002+0000 7ff2f27fc700 1 -- 172.21.15.39:0/3648679943 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f8027070 con 0x7ff2fc1029c0 2024-05-09T05:36:53.000 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:53.003+0000 7ff303a3b700 1 -- 172.21.15.39:0/3648679943 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2fc19eec0 con 0x7ff2fc1029c0 2024-05-09T05:36:53.000 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:53.003+0000 7ff2f27fc700 1 -- 172.21.15.39:0/3648679943 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff2f8003f20 con 0x7ff2fc1029c0 2024-05-09T05:36:53.000 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:53.003+0000 7ff2f27fc700 1 -- 172.21.15.39:0/3648679943 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f8022c70 con 0x7ff2fc1029c0 2024-05-09T05:36:53.000 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:53.003+0000 7ff303a3b700 1 -- 172.21.15.39:0/3648679943 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2fc19f3a0 con 0x7ff2fc1029c0 2024-05-09T05:36:53.001 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:53.004+0000 7ff303a3b700 1 -- 172.21.15.39:0/3648679943 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2fc0512c0 con 0x7ff2fc1029c0 2024-05-09T05:36:53.001 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:53.005+0000 7ff2f27fc700 1 -- 172.21.15.39:0/3648679943 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7ff2f802a070 con 0x7ff2fc1029c0 2024-05-09T05:36:53.001 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:53.006+0000 7ff2f27fc700 1 --2- 172.21.15.39:0/3648679943 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7ff2e80b2910 0x7ff2e80b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:53.001 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:53.006+0000 7ff300fd6700 1 --2- 172.21.15.39:0/3648679943 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7ff2e80b2910 0x7ff2e80b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:53.001 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:53.006+0000 7ff2f27fc700 1 -- 172.21.15.39:0/3648679943 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7ff2f80e35e0 con 0x7ff2fc1029c0 2024-05-09T05:36:53.001 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:53.007+0000 7ff300fd6700 1 --2- 172.21.15.39:0/3648679943 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7ff2e80b2910 0x7ff2e80b4e20 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc101f30 tx=0x7ff2ec00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:36:53.003 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:53.010+0000 7ff2f27fc700 1 -- 172.21.15.39:0/3648679943 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7ff2f8031080 con 0x7ff2fc1029c0 2024-05-09T05:36:53.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:53.275+0000 7ff303a3b700 1 -- 172.21.15.39:0/3648679943 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ff2fc1132e0 con 0x7ff2fc1029c0 2024-05-09T05:36:53.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:53.275+0000 7ff2f27fc700 1 -- 172.21.15.39:0/3648679943 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7ff2f8013070 con 0x7ff2fc1029c0 2024-05-09T05:36:53.269 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-09T05:36:53.269 INFO:teuthology.orchestra.run.smithi039.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-05-09T05:36:53.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:53.277+0000 7ff303a3b700 1 -- 172.21.15.39:0/3648679943 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7ff2e80b2910 msgr2=0x7ff2e80b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:53.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:53.277+0000 7ff303a3b700 1 --2- 172.21.15.39:0/3648679943 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7ff2e80b2910 0x7ff2e80b4e20 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc101f30 tx=0x7ff2ec00b410 comp rx=0 tx=0).stop 2024-05-09T05:36:53.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:53.278+0000 7ff303a3b700 1 -- 172.21.15.39:0/3648679943 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff2fc1029c0 msgr2=0x7ff2fc199d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:53.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:53.278+0000 7ff303a3b700 1 --2- 172.21.15.39:0/3648679943 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff2fc1029c0 0x7ff2fc199d60 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff2f8000c00 tx=0x7ff2f80047b0 comp rx=0 tx=0).stop 2024-05-09T05:36:53.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:53.278+0000 7ff303a3b700 1 -- 172.21.15.39:0/3648679943 shutdown_connections 2024-05-09T05:36:53.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:53.278+0000 7ff303a3b700 1 --2- 172.21.15.39:0/3648679943 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7ff2e80b2910 0x7ff2e80b4e20 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:53.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:53.278+0000 7ff303a3b700 1 --2- 172.21.15.39:0/3648679943 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff2fc1089f0 0x7ff2fc19e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:53.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:53.278+0000 7ff303a3b700 1 --2- 172.21.15.39:0/3648679943 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff2fc1029c0 0x7ff2fc199d60 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:53.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:53.278+0000 7ff303a3b700 1 --2- 172.21.15.39:0/3648679943 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2fc103310 0x7ff2fc19a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:53.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:53.278+0000 7ff303a3b700 1 -- 172.21.15.39:0/3648679943 >> 172.21.15.39:0/3648679943 conn(0x7ff2fc0fe520 msgr2=0x7ff2fc1064d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:36:53.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:53.278+0000 7ff303a3b700 1 -- 172.21.15.39:0/3648679943 shutdown_connections 2024-05-09T05:36:53.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:53.278+0000 7ff303a3b700 1 -- 172.21.15.39:0/3648679943 wait complete. 2024-05-09T05:36:53.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:36:53 smithi039 ceph-mon[30439]: pgmap v355: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-09T05:36:53.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:36:53 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/3648679943' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-05-09T05:36:53.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:36:53 smithi060 ceph-mon[34555]: pgmap v355: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-09T05:36:53.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:36:53 smithi060 ceph-mon[34555]: from='client.? 172.21.15.39:0/3648679943' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-05-09T05:36:53.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:36:53 smithi100 ceph-mon[34353]: pgmap v355: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-09T05:36:53.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:36:53 smithi100 ceph-mon[34353]: from='client.? 172.21.15.39:0/3648679943' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-05-09T05:36:53.937 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-05-09T05:36:53.938 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-09T05:36:54.196 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T05:36:54.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:36:54 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:36:54.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:36:54 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:36:54.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:36:54 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:36:55.685 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:36:55 smithi039 ceph-mon[30439]: pgmap v356: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-05-09T05:36:55.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:36:55 smithi060 ceph-mon[34555]: pgmap v356: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-05-09T05:36:55.804 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:55.810+0000 7f91245d5700 1 -- 172.21.15.39:0/286003744 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f911c108760 msgr2=0x7f911c1100c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:55.804 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:55.810+0000 7f91245d5700 1 --2- 172.21.15.39:0/286003744 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f911c108760 0x7f911c1100c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f911400b0d0 tx=0x7f911400b3e0 comp rx=0 tx=0).stop 2024-05-09T05:36:55.804 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:55.811+0000 7f91245d5700 1 -- 172.21.15.39:0/286003744 shutdown_connections 2024-05-09T05:36:55.805 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:55.811+0000 7f91245d5700 1 --2- 172.21.15.39:0/286003744 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f911c108760 0x7f911c1100c0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:55.805 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:55.811+0000 7f91245d5700 1 --2- 172.21.15.39:0/286003744 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f911c1034e0 0x7f911c1038f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:55.805 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:55.811+0000 7f91245d5700 1 --2- 172.21.15.39:0/286003744 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f911c107e10 0x7f911c108220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:55.805 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:55.811+0000 7f91245d5700 1 -- 172.21.15.39:0/286003744 >> 172.21.15.39:0/286003744 conn(0x7f911c0fef30 msgr2=0x7f911c101350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:36:55.805 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:55.811+0000 7f91245d5700 1 -- 172.21.15.39:0/286003744 shutdown_connections 2024-05-09T05:36:55.805 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:55.811+0000 7f91245d5700 1 -- 172.21.15.39:0/286003744 wait complete. 2024-05-09T05:36:55.806 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:55.812+0000 7f91245d5700 1 Processor -- start 2024-05-09T05:36:55.806 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:55.812+0000 7f91245d5700 1 -- start start 2024-05-09T05:36:55.806 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:55.812+0000 7f91245d5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f911c1034e0 0x7f911c199a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:55.806 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:55.812+0000 7f91245d5700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f911c107e10 0x7f911c199fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:55.806 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:55.812+0000 7f91245d5700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f911c108760 0x7f911c19ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:55.806 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:55.812+0000 7f91245d5700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f911c113390 con 0x7f911c108760 2024-05-09T05:36:55.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:55.812+0000 7f91245d5700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f911c113210 con 0x7f911c1034e0 2024-05-09T05:36:55.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:55.812+0000 7f91245d5700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f911c113510 con 0x7f911c107e10 2024-05-09T05:36:55.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:55.812+0000 7f9122b72700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f911c108760 0x7f911c19ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:55.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:55.812+0000 7f9122b72700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f911c108760 0x7f911c19ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:59478/0 (socket says 172.21.15.39:59478) 2024-05-09T05:36:55.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:55.812+0000 7f9122b72700 1 -- 172.21.15.39:0/2960307240 learned_addr learned my addr 172.21.15.39:0/2960307240 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:36:55.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:55.812+0000 7f9122371700 1 --2- 172.21.15.39:0/2960307240 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f911c1034e0 0x7f911c199a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:55.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:55.812+0000 7f9121b70700 1 --2- 172.21.15.39:0/2960307240 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f911c107e10 0x7f911c199fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:55.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:55.812+0000 7f9122b72700 1 -- 172.21.15.39:0/2960307240 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f911c107e10 msgr2=0x7f911c199fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:55.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:55.812+0000 7f9122b72700 1 --2- 172.21.15.39:0/2960307240 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f911c107e10 0x7f911c199fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:55.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:55.812+0000 7f9122b72700 1 -- 172.21.15.39:0/2960307240 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f911c1034e0 msgr2=0x7f911c199a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:55.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:55.812+0000 7f9122b72700 1 --2- 172.21.15.39:0/2960307240 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f911c1034e0 0x7f911c199a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:55.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:55.813+0000 7f9122b72700 1 -- 172.21.15.39:0/2960307240 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f911c19a870 con 0x7f911c108760 2024-05-09T05:36:55.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:55.813+0000 7f9122b72700 1 --2- 172.21.15.39:0/2960307240 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f911c108760 0x7f911c19ead0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f9114007a00 tx=0x7f9114007a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:36:55.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:55.817+0000 7f91137fe700 1 -- 172.21.15.39:0/2960307240 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f911401f070 con 0x7f911c108760 2024-05-09T05:36:55.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:55.817+0000 7f91245d5700 1 -- 172.21.15.39:0/2960307240 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f911c19f0d0 con 0x7f911c108760 2024-05-09T05:36:55.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:55.817+0000 7f91137fe700 1 -- 172.21.15.39:0/2960307240 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9114004c50 con 0x7f911c108760 2024-05-09T05:36:55.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:55.817+0000 7f91137fe700 1 -- 172.21.15.39:0/2960307240 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f911401b690 con 0x7f911c108760 2024-05-09T05:36:55.811 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:55.817+0000 7f91245d5700 1 -- 172.21.15.39:0/2960307240 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f911c19f5b0 con 0x7f911c108760 2024-05-09T05:36:55.812 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:55.819+0000 7f91245d5700 1 -- 172.21.15.39:0/2960307240 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9100005330 con 0x7f911c108760 2024-05-09T05:36:55.813 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:55.820+0000 7f91137fe700 1 -- 172.21.15.39:0/2960307240 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f9114022070 con 0x7f911c108760 2024-05-09T05:36:55.814 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:55.821+0000 7f91137fe700 1 --2- 172.21.15.39:0/2960307240 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f91080b2910 0x7f91080b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:55.815 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:55.821+0000 7f9122371700 1 --2- 172.21.15.39:0/2960307240 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f91080b2910 0x7f91080b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:55.815 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:55.821+0000 7f91137fe700 1 -- 172.21.15.39:0/2960307240 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f911400f020 con 0x7f911c108760 2024-05-09T05:36:55.815 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:55.822+0000 7f9122371700 1 --2- 172.21.15.39:0/2960307240 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f91080b2910 0x7f91080b4e20 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f910c009c60 tx=0x7f910c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:36:55.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:55.826+0000 7f91137fe700 1 -- 172.21.15.39:0/2960307240 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f9114029020 con 0x7f911c108760 2024-05-09T05:36:55.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:36:55 smithi100 ceph-mon[34353]: pgmap v356: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-05-09T05:36:56.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:56.092+0000 7f91245d5700 1 -- 172.21.15.39:0/2960307240 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f91000058f0 con 0x7f911c108760 2024-05-09T05:36:56.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:56.092+0000 7f91137fe700 1 -- 172.21.15.39:0/2960307240 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11865 (secure 0 0 0) 0x7f91140ab080 con 0x7f911c108760 2024-05-09T05:36:56.086 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-09T05:36:56.087 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/1997969267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":1997969267},{"type":"v1","addr":"172.21.15.39:6835","nonce":1997969267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/283022063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":283022063},{"type":"v1","addr":"172.21.15.39:6837","nonce":283022063}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14604,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6839/669632573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":669632573},{"type":"v1","addr":"172.21.15.39:6839","nonce":669632573}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14616,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6841/2202260395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6840","nonce":2202260395},{"type":"v1","addr":"172.21.15.39:6841","nonce":2202260395}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24433,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/1308189973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":1308189973},{"type":"v1","addr":"172.21.15.100:6833","nonce":1308189973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24434,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/2789974692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2789974692},{"type":"v1","addr":"172.21.15.60:6833","nonce":2789974692}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-09T05:34:56.202280+0000","modified":"2024-05-09T05:35:16.063547+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24502,"mds_2":24487},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24461":{"gid":24461,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6835/924472374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":924472374},{"type":"v1","addr":"172.21.15.60:6835","nonce":924472374}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24479":{"gid":24479,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6837/3588840930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":3588840930},{"type":"v1","addr":"172.21.15.60:6837","nonce":3588840930}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.100:6835/2595255386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2595255386},{"type":"v1","addr":"172.21.15.100:6835","nonce":2595255386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":13,"addr":"172.21.15.100:6837/3676209932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":3676209932},{"type":"v1","addr":"172.21.15.100:6837","nonce":3676209932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":12,"addr":"172.21.15.100:6839/1395178742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1395178742},{"type":"v1","addr":"172.21.15.100:6839","nonce":1395178742}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.60:6839/1418956667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":1418956667},{"type":"v1","addr":"172.21.15.60:6839","nonce":1418956667}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24487,24502,24509]},"id":1}]} 2024-05-09T05:36:56.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:56.095+0000 7f91245d5700 1 -- 172.21.15.39:0/2960307240 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f91080b2910 msgr2=0x7f91080b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:56.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:56.095+0000 7f91245d5700 1 --2- 172.21.15.39:0/2960307240 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f91080b2910 0x7f91080b4e20 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f910c009c60 tx=0x7f910c009260 comp rx=0 tx=0).stop 2024-05-09T05:36:56.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:56.095+0000 7f91245d5700 1 -- 172.21.15.39:0/2960307240 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f911c108760 msgr2=0x7f911c19ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:56.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:56.095+0000 7f91245d5700 1 --2- 172.21.15.39:0/2960307240 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f911c108760 0x7f911c19ead0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f9114007a00 tx=0x7f9114007a30 comp rx=0 tx=0).stop 2024-05-09T05:36:56.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:56.095+0000 7f91245d5700 1 -- 172.21.15.39:0/2960307240 shutdown_connections 2024-05-09T05:36:56.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:56.095+0000 7f91245d5700 1 --2- 172.21.15.39:0/2960307240 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f91080b2910 0x7f91080b4e20 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:56.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:56.095+0000 7f91245d5700 1 --2- 172.21.15.39:0/2960307240 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f911c108760 0x7f911c19ead0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:56.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:56.095+0000 7f91245d5700 1 --2- 172.21.15.39:0/2960307240 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f911c1034e0 0x7f911c199a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:56.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:56.095+0000 7f91245d5700 1 --2- 172.21.15.39:0/2960307240 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f911c107e10 0x7f911c199fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:56.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:56.095+0000 7f91245d5700 1 -- 172.21.15.39:0/2960307240 >> 172.21.15.39:0/2960307240 conn(0x7f911c0fef30 msgr2=0x7f911c107580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:36:56.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:56.095+0000 7f91245d5700 1 -- 172.21.15.39:0/2960307240 shutdown_connections 2024-05-09T05:36:56.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:56.095+0000 7f91245d5700 1 -- 172.21.15.39:0/2960307240 wait complete. 2024-05-09T05:36:56.090 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 24 2024-05-09T05:36:56.839 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-09T05:36:57.110 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:36:56 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:36:57.110 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:36:56 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:36:57.110 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:36:56 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/2960307240' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T05:36:57.110 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:36:56 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:36:57.110 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:36:56 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:36:57.110 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:36:56 smithi039 ceph-mon[30439]: pgmap v357: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-09T05:36:57.173 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:36:56 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:36:57.173 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:36:56 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:36:57.173 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:36:56 smithi100 ceph-mon[34353]: from='client.? 172.21.15.39:0/2960307240' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T05:36:57.173 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:36:56 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:36:57.174 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:36:56 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:36:57.174 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:36:56 smithi100 ceph-mon[34353]: pgmap v357: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-09T05:36:57.235 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T05:36:57.296 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:36:56 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:36:57.296 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:36:56 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:36:57.296 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:36:56 smithi060 ceph-mon[34555]: from='client.? 172.21.15.39:0/2960307240' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T05:36:57.296 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:36:56 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:36:57.296 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:36:56 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:36:57.296 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:36:56 smithi060 ceph-mon[34555]: pgmap v357: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-09T05:36:58.778 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:58.783+0000 7f91ce1e5700 1 -- 172.21.15.39:0/3630654055 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f91c8108760 msgr2=0x7f91c81100c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:58.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:58.783+0000 7f91ce1e5700 1 --2- 172.21.15.39:0/3630654055 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f91c8108760 0x7f91c81100c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f91c000b0d0 tx=0x7f91c000b3e0 comp rx=0 tx=0).stop 2024-05-09T05:36:58.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:58.783+0000 7f91ce1e5700 1 -- 172.21.15.39:0/3630654055 shutdown_connections 2024-05-09T05:36:58.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:58.783+0000 7f91ce1e5700 1 --2- 172.21.15.39:0/3630654055 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f91c8108760 0x7f91c81100c0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:58.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:58.783+0000 7f91ce1e5700 1 --2- 172.21.15.39:0/3630654055 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91c81034e0 0x7f91c81038f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:58.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:58.783+0000 7f91ce1e5700 1 --2- 172.21.15.39:0/3630654055 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91c8107e10 0x7f91c8108220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:58.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:58.783+0000 7f91ce1e5700 1 -- 172.21.15.39:0/3630654055 >> 172.21.15.39:0/3630654055 conn(0x7f91c80fef30 msgr2=0x7f91c8101350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:36:58.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:58.783+0000 7f91ce1e5700 1 -- 172.21.15.39:0/3630654055 shutdown_connections 2024-05-09T05:36:58.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:58.783+0000 7f91ce1e5700 1 -- 172.21.15.39:0/3630654055 wait complete. 2024-05-09T05:36:58.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:58.784+0000 7f91ce1e5700 1 Processor -- start 2024-05-09T05:36:58.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:58.784+0000 7f91ce1e5700 1 -- start start 2024-05-09T05:36:58.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:58.784+0000 7f91ce1e5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91c81034e0 0x7f91c819bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:58.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:58.784+0000 7f91ce1e5700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f91c8107e10 0x7f91c819c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:58.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:58.784+0000 7f91ce1e5700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91c8108760 0x7f91c81a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:58.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:58.784+0000 7f91ce1e5700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f91c8113390 con 0x7f91c8107e10 2024-05-09T05:36:58.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:58.784+0000 7f91ce1e5700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f91c8113210 con 0x7f91c81034e0 2024-05-09T05:36:58.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:58.784+0000 7f91ce1e5700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f91c8113510 con 0x7f91c8108760 2024-05-09T05:36:58.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:58.785+0000 7f91beffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f91c8107e10 0x7f91c819c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:58.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:58.785+0000 7f91beffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f91c8107e10 0x7f91c819c1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53426/0 (socket says 172.21.15.39:53426) 2024-05-09T05:36:58.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:58.785+0000 7f91beffd700 1 -- 172.21.15.39:0/4261804993 learned_addr learned my addr 172.21.15.39:0/4261804993 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:36:58.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:58.785+0000 7f91c77fe700 1 --2- 172.21.15.39:0/4261804993 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91c81034e0 0x7f91c819bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:58.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:58.785+0000 7f91c7fff700 1 --2- 172.21.15.39:0/4261804993 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91c8108760 0x7f91c81a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:58.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:58.785+0000 7f91beffd700 1 -- 172.21.15.39:0/4261804993 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91c8108760 msgr2=0x7f91c81a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:58.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:58.785+0000 7f91beffd700 1 --2- 172.21.15.39:0/4261804993 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91c8108760 0x7f91c81a6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:58.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:58.785+0000 7f91beffd700 1 -- 172.21.15.39:0/4261804993 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91c81034e0 msgr2=0x7f91c819bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:58.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:58.785+0000 7f91beffd700 1 --2- 172.21.15.39:0/4261804993 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91c81034e0 0x7f91c819bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:58.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:58.785+0000 7f91beffd700 1 -- 172.21.15.39:0/4261804993 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91c819caa0 con 0x7f91c8107e10 2024-05-09T05:36:58.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:58.785+0000 7f91beffd700 1 --2- 172.21.15.39:0/4261804993 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f91c8107e10 0x7f91c819c1f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f91b000e970 tx=0x7f91b000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:36:58.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:58.785+0000 7f91c57fa700 1 -- 172.21.15.39:0/4261804993 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91b000cbd0 con 0x7f91c8107e10 2024-05-09T05:36:58.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:58.785+0000 7f91c57fa700 1 -- 172.21.15.39:0/4261804993 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f91b000cd70 con 0x7f91c8107e10 2024-05-09T05:36:58.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:58.786+0000 7f91ce1e5700 1 -- 172.21.15.39:0/4261804993 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91c81a7390 con 0x7f91c8107e10 2024-05-09T05:36:58.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:58.786+0000 7f91c57fa700 1 -- 172.21.15.39:0/4261804993 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91b0005680 con 0x7f91c8107e10 2024-05-09T05:36:58.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:58.786+0000 7f91ce1e5700 1 -- 172.21.15.39:0/4261804993 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91c81a78d0 con 0x7f91c8107e10 2024-05-09T05:36:58.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:58.787+0000 7f91ce1e5700 1 -- 172.21.15.39:0/4261804993 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91c80512c0 con 0x7f91c8107e10 2024-05-09T05:36:58.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:58.788+0000 7f91c57fa700 1 -- 172.21.15.39:0/4261804993 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f91b0004830 con 0x7f91c8107e10 2024-05-09T05:36:58.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:58.789+0000 7f91c57fa700 1 --2- 172.21.15.39:0/4261804993 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f91b40b2990 0x7f91b40b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:36:58.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:58.789+0000 7f91c77fe700 1 --2- 172.21.15.39:0/4261804993 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f91b40b2990 0x7f91b40b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:36:58.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:58.789+0000 7f91c57fa700 1 -- 172.21.15.39:0/4261804993 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f91b00e2510 con 0x7f91c8107e10 2024-05-09T05:36:58.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:58.790+0000 7f91c77fe700 1 --2- 172.21.15.39:0/4261804993 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f91b40b2990 0x7f91b40b4ea0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f91b8009c60 tx=0x7f91b8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:36:58.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:58.794+0000 7f91c57fa700 1 -- 172.21.15.39:0/4261804993 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f91b00aa080 con 0x7f91c8107e10 2024-05-09T05:36:59.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:59.114+0000 7f91ce1e5700 1 -- 172.21.15.39:0/4261804993 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f91c806c690 con 0x7f91c8107e10 2024-05-09T05:36:59.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:59.115+0000 7f91c57fa700 1 -- 172.21.15.39:0/4261804993 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11865 (secure 0 0 0) 0x7f91b00a9980 con 0x7f91c8107e10 2024-05-09T05:36:59.109 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-09T05:36:59.109 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/1997969267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":1997969267},{"type":"v1","addr":"172.21.15.39:6835","nonce":1997969267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/283022063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":283022063},{"type":"v1","addr":"172.21.15.39:6837","nonce":283022063}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14604,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6839/669632573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":669632573},{"type":"v1","addr":"172.21.15.39:6839","nonce":669632573}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14616,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6841/2202260395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6840","nonce":2202260395},{"type":"v1","addr":"172.21.15.39:6841","nonce":2202260395}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24433,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/1308189973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":1308189973},{"type":"v1","addr":"172.21.15.100:6833","nonce":1308189973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24434,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/2789974692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2789974692},{"type":"v1","addr":"172.21.15.60:6833","nonce":2789974692}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-09T05:34:56.202280+0000","modified":"2024-05-09T05:35:16.063547+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24502,"mds_2":24487},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24461":{"gid":24461,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6835/924472374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":924472374},{"type":"v1","addr":"172.21.15.60:6835","nonce":924472374}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24479":{"gid":24479,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6837/3588840930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":3588840930},{"type":"v1","addr":"172.21.15.60:6837","nonce":3588840930}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.100:6835/2595255386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2595255386},{"type":"v1","addr":"172.21.15.100:6835","nonce":2595255386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":13,"addr":"172.21.15.100:6837/3676209932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":3676209932},{"type":"v1","addr":"172.21.15.100:6837","nonce":3676209932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":12,"addr":"172.21.15.100:6839/1395178742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1395178742},{"type":"v1","addr":"172.21.15.100:6839","nonce":1395178742}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.60:6839/1418956667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":1418956667},{"type":"v1","addr":"172.21.15.60:6839","nonce":1418956667}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24487,24502,24509]},"id":1}]} 2024-05-09T05:36:59.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:59.118+0000 7f91ce1e5700 1 -- 172.21.15.39:0/4261804993 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f91b40b2990 msgr2=0x7f91b40b4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:59.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:59.118+0000 7f91ce1e5700 1 --2- 172.21.15.39:0/4261804993 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f91b40b2990 0x7f91b40b4ea0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f91b8009c60 tx=0x7f91b8009260 comp rx=0 tx=0).stop 2024-05-09T05:36:59.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:59.118+0000 7f91ce1e5700 1 -- 172.21.15.39:0/4261804993 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f91c8107e10 msgr2=0x7f91c819c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:36:59.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:59.118+0000 7f91ce1e5700 1 --2- 172.21.15.39:0/4261804993 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f91c8107e10 0x7f91c819c1f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f91b000e970 tx=0x7f91b000ec80 comp rx=0 tx=0).stop 2024-05-09T05:36:59.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:59.118+0000 7f91ce1e5700 1 -- 172.21.15.39:0/4261804993 shutdown_connections 2024-05-09T05:36:59.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:59.118+0000 7f91ce1e5700 1 --2- 172.21.15.39:0/4261804993 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f91b40b2990 0x7f91b40b4ea0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:59.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:59.118+0000 7f91ce1e5700 1 --2- 172.21.15.39:0/4261804993 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91c8108760 0x7f91c81a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:59.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:59.118+0000 7f91ce1e5700 1 --2- 172.21.15.39:0/4261804993 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91c81034e0 0x7f91c819bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:59.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:59.118+0000 7f91ce1e5700 1 --2- 172.21.15.39:0/4261804993 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f91c8107e10 0x7f91c819c1f0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:36:59.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:59.118+0000 7f91ce1e5700 1 -- 172.21.15.39:0/4261804993 >> 172.21.15.39:0/4261804993 conn(0x7f91c80fef30 msgr2=0x7f91c8107580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:36:59.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:59.118+0000 7f91ce1e5700 1 -- 172.21.15.39:0/4261804993 shutdown_connections 2024-05-09T05:36:59.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:36:59.118+0000 7f91ce1e5700 1 -- 172.21.15.39:0/4261804993 wait complete. 2024-05-09T05:36:59.113 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 24 2024-05-09T05:36:59.360 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:36:59 smithi039 ceph-mon[30439]: pgmap v358: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-05-09T05:36:59.360 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:36:59 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:36:59.360 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:36:59 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:36:59.360 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:36:59 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/4261804993' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T05:36:59.546 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:36:59 smithi060 ceph-mon[34555]: pgmap v358: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-05-09T05:36:59.546 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:36:59 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:36:59.546 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:36:59 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:36:59.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:36:59 smithi060 ceph-mon[34555]: from='client.? 172.21.15.39:0/4261804993' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T05:36:59.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:36:59 smithi100 ceph-mon[34353]: pgmap v358: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-05-09T05:36:59.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:36:59 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:36:59.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:36:59 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:36:59.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:36:59 smithi100 ceph-mon[34353]: from='client.? 172.21.15.39:0/4261804993' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T05:36:59.769 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-09T05:37:00.056 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T05:37:00.494 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:37:00 smithi039 ceph-mon[30439]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-05-09T05:37:00.494 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:37:00 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:37:00.494 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:37:00 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:37:00.495 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:37:00 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:37:00.546 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:37:00 smithi060 ceph-mon[34555]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-05-09T05:37:00.546 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:37:00 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:37:00.546 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:37:00 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:37:00.546 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:37:00 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:37:00.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:37:00 smithi100 ceph-mon[34353]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-05-09T05:37:00.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:37:00 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:37:00.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:37:00 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:37:00.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:37:00 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:37:01.509 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:37:01 smithi039 ceph-mon[30439]: pgmap v359: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 341 B/s wr, 6 op/s 2024-05-09T05:37:01.546 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:37:01 smithi060 ceph-mon[34555]: pgmap v359: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 341 B/s wr, 6 op/s 2024-05-09T05:37:01.625 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:01.631+0000 7fae2596a700 1 -- 172.21.15.39:0/2504256958 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fae20104650 msgr2=0x7fae20104a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:01.625 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:01.631+0000 7fae2596a700 1 --2- 172.21.15.39:0/2504256958 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fae20104650 0x7fae20104a60 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fae100099c0 tx=0x7fae10009cd0 comp rx=0 tx=0).stop 2024-05-09T05:37:01.625 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:01.631+0000 7fae2596a700 1 -- 172.21.15.39:0/2504256958 shutdown_connections 2024-05-09T05:37:01.625 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:01.631+0000 7fae2596a700 1 --2- 172.21.15.39:0/2504256958 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae20109880 0x7fae201111e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:01.625 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:01.631+0000 7fae2596a700 1 --2- 172.21.15.39:0/2504256958 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fae20104650 0x7fae20104a60 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:01.625 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:01.631+0000 7fae2596a700 1 --2- 172.21.15.39:0/2504256958 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae20108f30 0x7fae20109340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:01.625 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:01.631+0000 7fae2596a700 1 -- 172.21.15.39:0/2504256958 >> 172.21.15.39:0/2504256958 conn(0x7fae20079f00 msgr2=0x7fae2007a340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:37:01.625 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:01.631+0000 7fae2596a700 1 -- 172.21.15.39:0/2504256958 shutdown_connections 2024-05-09T05:37:01.625 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:01.631+0000 7fae2596a700 1 -- 172.21.15.39:0/2504256958 wait complete. 2024-05-09T05:37:01.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:01.632+0000 7fae2596a700 1 Processor -- start 2024-05-09T05:37:01.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:01.632+0000 7fae2596a700 1 -- start start 2024-05-09T05:37:01.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:01.632+0000 7fae2596a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae20104650 0x7fae2019d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:01.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:01.632+0000 7fae2596a700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae20108f30 0x7fae2019d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:01.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:01.632+0000 7fae2596a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fae20109880 0x7fae201a19e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:01.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:01.632+0000 7fae2596a700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fae20114520 con 0x7fae20109880 2024-05-09T05:37:01.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:01.632+0000 7fae2596a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fae201143a0 con 0x7fae20104650 2024-05-09T05:37:01.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:01.632+0000 7fae2596a700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fae201146a0 con 0x7fae20108f30 2024-05-09T05:37:01.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:01.633+0000 7fae1f7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fae20109880 0x7fae201a19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:01.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:01.633+0000 7fae1f7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fae20109880 0x7fae201a19e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53456/0 (socket says 172.21.15.39:53456) 2024-05-09T05:37:01.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:01.633+0000 7fae1f7fe700 1 -- 172.21.15.39:0/3406601646 learned_addr learned my addr 172.21.15.39:0/3406601646 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:37:01.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:01.633+0000 7fae1effd700 1 --2- 172.21.15.39:0/3406601646 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae20104650 0x7fae2019d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:01.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:01.633+0000 7fae1e7fc700 1 --2- 172.21.15.39:0/3406601646 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae20108f30 0x7fae2019d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:01.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:01.633+0000 7fae1f7fe700 1 -- 172.21.15.39:0/3406601646 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae20108f30 msgr2=0x7fae2019d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:01.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:01.633+0000 7fae1f7fe700 1 --2- 172.21.15.39:0/3406601646 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae20108f30 0x7fae2019d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:01.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:01.633+0000 7fae1f7fe700 1 -- 172.21.15.39:0/3406601646 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae20104650 msgr2=0x7fae2019d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:01.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:01.633+0000 7fae1f7fe700 1 --2- 172.21.15.39:0/3406601646 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae20104650 0x7fae2019d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:01.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:01.633+0000 7fae1f7fe700 1 -- 172.21.15.39:0/3406601646 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae201a2080 con 0x7fae20109880 2024-05-09T05:37:01.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:01.633+0000 7fae1f7fe700 1 --2- 172.21.15.39:0/3406601646 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fae20109880 0x7fae201a19e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fae18007ee0 tx=0x7fae1800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:37:01.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:01.633+0000 7fae24968700 1 -- 172.21.15.39:0/3406601646 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae18004bb0 con 0x7fae20109880 2024-05-09T05:37:01.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:01.633+0000 7fae24968700 1 -- 172.21.15.39:0/3406601646 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fae18004d50 con 0x7fae20109880 2024-05-09T05:37:01.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:01.633+0000 7fae2596a700 1 -- 172.21.15.39:0/3406601646 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae201a2370 con 0x7fae20109880 2024-05-09T05:37:01.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:01.633+0000 7fae24968700 1 -- 172.21.15.39:0/3406601646 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae18005920 con 0x7fae20109880 2024-05-09T05:37:01.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:01.633+0000 7fae2596a700 1 -- 172.21.15.39:0/3406601646 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae201a9c90 con 0x7fae20109880 2024-05-09T05:37:01.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:01.635+0000 7fae2596a700 1 -- 172.21.15.39:0/3406601646 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae200512c0 con 0x7fae20109880 2024-05-09T05:37:01.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:01.636+0000 7fae24968700 1 -- 172.21.15.39:0/3406601646 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fae1801a020 con 0x7fae20109880 2024-05-09T05:37:01.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:01.637+0000 7fae24968700 1 --2- 172.21.15.39:0/3406601646 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fae080b2900 0x7fae080b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:01.630 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:01.637+0000 7fae1effd700 1 --2- 172.21.15.39:0/3406601646 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fae080b2900 0x7fae080b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:01.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:01.637+0000 7fae24968700 1 -- 172.21.15.39:0/3406601646 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7fae180e1670 con 0x7fae20109880 2024-05-09T05:37:01.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:01.637+0000 7fae1effd700 1 --2- 172.21.15.39:0/3406601646 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fae080b2900 0x7fae080b4e10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fae10009990 tx=0x7fae10000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:37:01.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:01.640+0000 7fae24968700 1 -- 172.21.15.39:0/3406601646 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fae18010070 con 0x7fae20109880 2024-05-09T05:37:01.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:37:01 smithi100 ceph-mon[34353]: pgmap v359: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 341 B/s wr, 6 op/s 2024-05-09T05:37:01.852 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:01.858+0000 7fae2596a700 1 -- 172.21.15.39:0/3406601646 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fae201a9e60 con 0x7fae20109880 2024-05-09T05:37:01.853 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:01.860+0000 7fae24968700 1 -- 172.21.15.39:0/3406601646 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+22602 (secure 0 0 0) 0x7fae180a93a0 con 0x7fae20109880 2024-05-09T05:37:01.854 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-09T05:37:01.854 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":83,"fsid":"86d4cc60-0dc4-11ef-bc97-c7b262605968","created":"2024-05-09T05:26:33.514203+0000","modified":"2024-05-09T05:35:29.485823+0000","last_up_change":"2024-05-09T05:33:48.776015+0000","last_in_change":"2024-05-09T05:33:28.117875+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T05:29:56.122407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-09T05:34:49.964521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-09T05:34:52.915301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3491bbda-3a9b-40d2-8627-87d15660f864","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":1056276932},{"type":"v1","addr":"172.21.15.39:6803","nonce":1056276932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":1056276932},{"type":"v1","addr":"172.21.15.39:6805","nonce":1056276932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":1056276932},{"type":"v1","addr":"172.21.15.39:6809","nonce":1056276932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":1056276932},{"type":"v1","addr":"172.21.15.39:6807","nonce":1056276932}]},"public_addr":"172.21.15.39:6803/1056276932","cluster_addr":"172.21.15.39:6805/1056276932","heartbeat_back_addr":"172.21.15.39:6809/1056276932","heartbeat_front_addr":"172.21.15.39:6807/1056276932","state":["exists","up"]},{"osd":1,"uuid":"ec2bd2d0-2975-402c-9df8-3469dfd6070f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":4245630636},{"type":"v1","addr":"172.21.15.60:6801","nonce":4245630636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":4245630636},{"type":"v1","addr":"172.21.15.60:6803","nonce":4245630636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":4245630636},{"type":"v1","addr":"172.21.15.60:6807","nonce":4245630636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":4245630636},{"type":"v1","addr":"172.21.15.60:6805","nonce":4245630636}]},"public_addr":"172.21.15.60:6801/4245630636","cluster_addr":"172.21.15.60:6803/4245630636","heartbeat_back_addr":"172.21.15.60:6807/4245630636","heartbeat_front_addr":"172.21.15.60:6805/4245630636","state":["exists","up"]},{"osd":2,"uuid":"9efaf6dd-086e-4095-b92e-cbbecf738523","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":4141597693},{"type":"v1","addr":"172.21.15.100:6801","nonce":4141597693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":4141597693},{"type":"v1","addr":"172.21.15.100:6803","nonce":4141597693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":4141597693},{"type":"v1","addr":"172.21.15.100:6807","nonce":4141597693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":4141597693},{"type":"v1","addr":"172.21.15.100:6805","nonce":4141597693}]},"public_addr":"172.21.15.100:6801/4141597693","cluster_addr":"172.21.15.100:6803/4141597693","heartbeat_back_addr":"172.21.15.100:6807/4141597693","heartbeat_front_addr":"172.21.15.100:6805/4141597693","state":["exists","up"]},{"osd":3,"uuid":"1ebe1a25-541d-4b54-bed8-4f0ec51b2432","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":2254197543},{"type":"v1","addr":"172.21.15.39:6811","nonce":2254197543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":2254197543},{"type":"v1","addr":"172.21.15.39:6813","nonce":2254197543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2254197543},{"type":"v1","addr":"172.21.15.39:6817","nonce":2254197543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":2254197543},{"type":"v1","addr":"172.21.15.39:6815","nonce":2254197543}]},"public_addr":"172.21.15.39:6811/2254197543","cluster_addr":"172.21.15.39:6813/2254197543","heartbeat_back_addr":"172.21.15.39:6817/2254197543","heartbeat_front_addr":"172.21.15.39:6815/2254197543","state":["exists","up"]},{"osd":4,"uuid":"d52450a3-8a97-4746-a857-35aec69aac44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":649037162},{"type":"v1","addr":"172.21.15.60:6809","nonce":649037162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":649037162},{"type":"v1","addr":"172.21.15.60:6811","nonce":649037162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":649037162},{"type":"v1","addr":"172.21.15.60:6815","nonce":649037162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":649037162},{"type":"v1","addr":"172.21.15.60:6813","nonce":649037162}]},"public_addr":"172.21.15.60:6809/649037162","cluster_addr":"172.21.15.60:6811/649037162","heartbeat_back_addr":"172.21.15.60:6815/649037162","heartbeat_front_addr":"172.21.15.60:6813/649037162","state":["exists","up"]},{"osd":5,"uuid":"b35bf704-898d-40f7-b575-90267764a5b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":658409226},{"type":"v1","addr":"172.21.15.100:6809","nonce":658409226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":658409226},{"type":"v1","addr":"172.21.15.100:6811","nonce":658409226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":658409226},{"type":"v1","addr":"172.21.15.100:6815","nonce":658409226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":658409226},{"type":"v1","addr":"172.21.15.100:6813","nonce":658409226}]},"public_addr":"172.21.15.100:6809/658409226","cluster_addr":"172.21.15.100:6811/658409226","heartbeat_back_addr":"172.21.15.100:6815/658409226","heartbeat_front_addr":"172.21.15.100:6813/658409226","state":["exists","up"]},{"osd":6,"uuid":"49eae2f5-1dad-4c2c-89f4-efa1dd1faefb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":237628491},{"type":"v1","addr":"172.21.15.39:6819","nonce":237628491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":237628491},{"type":"v1","addr":"172.21.15.39:6821","nonce":237628491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":237628491},{"type":"v1","addr":"172.21.15.39:6825","nonce":237628491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":237628491},{"type":"v1","addr":"172.21.15.39:6823","nonce":237628491}]},"public_addr":"172.21.15.39:6819/237628491","cluster_addr":"172.21.15.39:6821/237628491","heartbeat_back_addr":"172.21.15.39:6825/237628491","heartbeat_front_addr":"172.21.15.39:6823/237628491","state":["exists","up"]},{"osd":7,"uuid":"60ccae54-535c-4a13-98d0-881c00b5e870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":2718201647},{"type":"v1","addr":"172.21.15.60:6817","nonce":2718201647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":2718201647},{"type":"v1","addr":"172.21.15.60:6819","nonce":2718201647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":2718201647},{"type":"v1","addr":"172.21.15.60:6823","nonce":2718201647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":2718201647},{"type":"v1","addr":"172.21.15.60:6821","nonce":2718201647}]},"public_addr":"172.21.15.60:6817/2718201647","cluster_addr":"172.21.15.60:6819/2718201647","heartbeat_back_addr":"172.21.15.60:6823/2718201647","heartbeat_front_addr":"172.21.15.60:6821/2718201647","state":["exists","up"]},{"osd":8,"uuid":"edd52a21-0066-429f-9e98-15d1a74c53b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":1757558317},{"type":"v1","addr":"172.21.15.100:6817","nonce":1757558317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":1757558317},{"type":"v1","addr":"172.21.15.100:6819","nonce":1757558317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":1757558317},{"type":"v1","addr":"172.21.15.100:6823","nonce":1757558317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":1757558317},{"type":"v1","addr":"172.21.15.100:6821","nonce":1757558317}]},"public_addr":"172.21.15.100:6817/1757558317","cluster_addr":"172.21.15.100:6819/1757558317","heartbeat_back_addr":"172.21.15.100:6823/1757558317","heartbeat_front_addr":"172.21.15.100:6821/1757558317","state":["exists","up"]},{"osd":9,"uuid":"03fb7543-3386-49a4-b165-1007f07d88d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":2944584368},{"type":"v1","addr":"172.21.15.39:6827","nonce":2944584368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":2944584368},{"type":"v1","addr":"172.21.15.39:6829","nonce":2944584368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":2944584368},{"type":"v1","addr":"172.21.15.39:6833","nonce":2944584368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":2944584368},{"type":"v1","addr":"172.21.15.39:6831","nonce":2944584368}]},"public_addr":"172.21.15.39:6827/2944584368","cluster_addr":"172.21.15.39:6829/2944584368","heartbeat_back_addr":"172.21.15.39:6833/2944584368","heartbeat_front_addr":"172.21.15.39:6831/2944584368","state":["exists","up"]},{"osd":10,"uuid":"c1cadd6c-fcc4-4d76-b07e-0f392066a8d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1940670367},{"type":"v1","addr":"172.21.15.60:6825","nonce":1940670367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":1940670367},{"type":"v1","addr":"172.21.15.60:6827","nonce":1940670367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":1940670367},{"type":"v1","addr":"172.21.15.60:6831","nonce":1940670367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":1940670367},{"type":"v1","addr":"172.21.15.60:6829","nonce":1940670367}]},"public_addr":"172.21.15.60:6825/1940670367","cluster_addr":"172.21.15.60:6827/1940670367","heartbeat_back_addr":"172.21.15.60:6831/1940670367","heartbeat_front_addr":"172.21.15.60:6829/1940670367","state":["exists","up"]},{"osd":11,"uuid":"56806877-9ce2-41e2-9506-ce67897fa09b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":3318561029},{"type":"v1","addr":"172.21.15.100:6825","nonce":3318561029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":3318561029},{"type":"v1","addr":"172.21.15.100:6827","nonce":3318561029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":3318561029},{"type":"v1","addr":"172.21.15.100:6831","nonce":3318561029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":3318561029},{"type":"v1","addr":"172.21.15.100:6829","nonce":3318561029}]},"public_addr":"172.21.15.100:6825/3318561029","cluster_addr":"172.21.15.100:6827/3318561029","heartbeat_back_addr":"172.21.15.100:6831/3318561029","heartbeat_front_addr":"172.21.15.100:6829/3318561029","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:29:03.565705+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:29:28.380764+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:29:53.300224+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:30:20.046517+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:30:45.557983+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:31:10.397933+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:31:37.644428+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:32:02.325329+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:32:27.699044+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:32:54.436305+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:33:20.691300+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:33:46.806146+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.39:6801/4091500272":"2024-05-10T05:27:28.034010+0000","172.21.15.39:6800/4091500272":"2024-05-10T05:27:28.034010+0000","172.21.15.39:0/782312916":"2024-05-10T05:27:28.034010+0000","172.21.15.39:0/1899316433":"2024-05-10T05:27:28.034010+0000","172.21.15.39:0/1613215795":"2024-05-10T05:27:00.650123+0000","172.21.15.39:0/2870431271":"2024-05-10T05:27:00.650123+0000","172.21.15.39:0/438945726":"2024-05-10T05:27:00.650123+0000","172.21.15.39:6800/499609328":"2024-05-10T05:27:00.650123+0000","172.21.15.39:6801/499609328":"2024-05-10T05:27:00.650123+0000","172.21.15.39:0/1698165886":"2024-05-10T05:27:28.034010+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T05:37:01.857 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:01.862+0000 7fae2596a700 1 -- 172.21.15.39:0/3406601646 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fae080b2900 msgr2=0x7fae080b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:01.857 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:01.863+0000 7fae2596a700 1 --2- 172.21.15.39:0/3406601646 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fae080b2900 0x7fae080b4e10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fae10009990 tx=0x7fae10000bc0 comp rx=0 tx=0).stop 2024-05-09T05:37:01.857 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:01.863+0000 7fae2596a700 1 -- 172.21.15.39:0/3406601646 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fae20109880 msgr2=0x7fae201a19e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:01.857 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:01.863+0000 7fae2596a700 1 --2- 172.21.15.39:0/3406601646 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fae20109880 0x7fae201a19e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fae18007ee0 tx=0x7fae1800d3b0 comp rx=0 tx=0).stop 2024-05-09T05:37:01.857 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:01.863+0000 7fae2596a700 1 -- 172.21.15.39:0/3406601646 shutdown_connections 2024-05-09T05:37:01.857 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:01.863+0000 7fae2596a700 1 --2- 172.21.15.39:0/3406601646 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fae080b2900 0x7fae080b4e10 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:01.857 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:01.863+0000 7fae2596a700 1 --2- 172.21.15.39:0/3406601646 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fae20109880 0x7fae201a19e0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:01.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:01.863+0000 7fae2596a700 1 --2- 172.21.15.39:0/3406601646 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae20104650 0x7fae2019d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:01.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:01.863+0000 7fae2596a700 1 --2- 172.21.15.39:0/3406601646 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae20108f30 0x7fae2019d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:01.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:01.863+0000 7fae2596a700 1 -- 172.21.15.39:0/3406601646 >> 172.21.15.39:0/3406601646 conn(0x7fae20079f00 msgr2=0x7fae20102900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:37:01.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:01.863+0000 7fae2596a700 1 -- 172.21.15.39:0/3406601646 shutdown_connections 2024-05-09T05:37:01.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:01.863+0000 7fae2596a700 1 -- 172.21.15.39:0/3406601646 wait complete. 2024-05-09T05:37:02.464 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:37:02 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/3406601646' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T05:37:02.492 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-09T05:37:02.546 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:37:02 smithi060 ceph-mon[34555]: from='client.? 172.21.15.39:0/3406601646' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T05:37:02.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:37:02 smithi100 ceph-mon[34353]: from='client.? 172.21.15.39:0/3406601646' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T05:37:02.745 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T05:37:03.546 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:37:03 smithi060 ceph-mon[34555]: pgmap v360: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 426 B/s wr, 5 op/s 2024-05-09T05:37:03.570 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:37:03 smithi039 ceph-mon[30439]: pgmap v360: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 426 B/s wr, 5 op/s 2024-05-09T05:37:03.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:37:03 smithi100 ceph-mon[34353]: pgmap v360: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 426 B/s wr, 5 op/s 2024-05-09T05:37:04.419 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:04.425+0000 7fdeb436a700 1 -- 172.21.15.39:0/219692363 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdeac1045d0 msgr2=0x7fdeac1049e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:04.419 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:04.425+0000 7fdeb436a700 1 --2- 172.21.15.39:0/219692363 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdeac1045d0 0x7fdeac1049e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fdea80099c0 tx=0x7fdea8009cd0 comp rx=0 tx=0).stop 2024-05-09T05:37:04.419 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:04.425+0000 7fdeb436a700 1 -- 172.21.15.39:0/219692363 shutdown_connections 2024-05-09T05:37:04.419 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:04.425+0000 7fdeb436a700 1 --2- 172.21.15.39:0/219692363 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdeac109850 0x7fdeac1111b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:04.419 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:04.425+0000 7fdeb436a700 1 --2- 172.21.15.39:0/219692363 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdeac1045d0 0x7fdeac1049e0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:04.419 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:04.425+0000 7fdeb436a700 1 --2- 172.21.15.39:0/219692363 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdeac108f00 0x7fdeac109310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:04.419 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:04.425+0000 7fdeb436a700 1 -- 172.21.15.39:0/219692363 >> 172.21.15.39:0/219692363 conn(0x7fdeac0ffea0 msgr2=0x7fdeac1022f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:37:04.419 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:04.425+0000 7fdeb436a700 1 -- 172.21.15.39:0/219692363 shutdown_connections 2024-05-09T05:37:04.420 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:04.425+0000 7fdeb436a700 1 -- 172.21.15.39:0/219692363 wait complete. 2024-05-09T05:37:04.420 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:04.425+0000 7fdeb436a700 1 Processor -- start 2024-05-09T05:37:04.420 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:04.426+0000 7fdeb436a700 1 -- start start 2024-05-09T05:37:04.421 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:04.426+0000 7fdeb436a700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdeac1045d0 0x7fdeac19cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:04.421 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:04.426+0000 7fdeb436a700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdeac108f00 0x7fdeac19d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:04.421 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:04.426+0000 7fdeb436a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdeac109850 0x7fdeac1a17e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:04.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:04.426+0000 7fdeb436a700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fdeac1144a0 con 0x7fdeac108f00 2024-05-09T05:37:04.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:04.426+0000 7fdeb436a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fdeac114320 con 0x7fdeac109850 2024-05-09T05:37:04.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:04.426+0000 7fdeb436a700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fdeac114620 con 0x7fdeac1045d0 2024-05-09T05:37:04.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:04.426+0000 7fdeb1905700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdeac108f00 0x7fdeac19d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:04.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:04.426+0000 7fdeb1905700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdeac108f00 0x7fdeac19d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:53474/0 (socket says 172.21.15.39:53474) 2024-05-09T05:37:04.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:04.426+0000 7fdeb1905700 1 -- 172.21.15.39:0/1944619480 learned_addr learned my addr 172.21.15.39:0/1944619480 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:37:04.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:04.426+0000 7fdeb2106700 1 --2- 172.21.15.39:0/1944619480 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdeac1045d0 0x7fdeac19cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:04.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:04.426+0000 7fdeb2907700 1 --2- 172.21.15.39:0/1944619480 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdeac109850 0x7fdeac1a17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:04.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:04.427+0000 7fdeb1905700 1 -- 172.21.15.39:0/1944619480 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdeac1045d0 msgr2=0x7fdeac19cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:04.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:04.427+0000 7fdeb1905700 1 --2- 172.21.15.39:0/1944619480 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdeac1045d0 0x7fdeac19cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:04.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:04.427+0000 7fdeb1905700 1 -- 172.21.15.39:0/1944619480 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdeac109850 msgr2=0x7fdeac1a17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:04.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:04.427+0000 7fdeb1905700 1 --2- 172.21.15.39:0/1944619480 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdeac109850 0x7fdeac1a17e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:04.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:04.427+0000 7fdeb1905700 1 -- 172.21.15.39:0/1944619480 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdeac1a1e80 con 0x7fdeac108f00 2024-05-09T05:37:04.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:04.427+0000 7fdeb2106700 1 --2- 172.21.15.39:0/1944619480 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdeac1045d0 0x7fdeac19cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T05:37:04.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:04.427+0000 7fdeb2907700 1 --2- 172.21.15.39:0/1944619480 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdeac109850 0x7fdeac1a17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T05:37:04.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:04.427+0000 7fdeb1905700 1 --2- 172.21.15.39:0/1944619480 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdeac108f00 0x7fdeac19d550 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fdea000d980 tx=0x7fdea000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:37:04.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:04.427+0000 7fde9f7fe700 1 -- 172.21.15.39:0/1944619480 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdea0017070 con 0x7fdeac108f00 2024-05-09T05:37:04.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:04.427+0000 7fdeb436a700 1 -- 172.21.15.39:0/1944619480 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdeac1a2170 con 0x7fdeac108f00 2024-05-09T05:37:04.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:04.427+0000 7fde9f7fe700 1 -- 172.21.15.39:0/1944619480 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdea0009de0 con 0x7fdeac108f00 2024-05-09T05:37:04.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:04.427+0000 7fde9f7fe700 1 -- 172.21.15.39:0/1944619480 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdea000f3c0 con 0x7fdeac108f00 2024-05-09T05:37:04.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:04.427+0000 7fdeb436a700 1 -- 172.21.15.39:0/1944619480 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdeac1a9a90 con 0x7fdeac108f00 2024-05-09T05:37:04.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:04.428+0000 7fdeb436a700 1 -- 172.21.15.39:0/1944619480 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdeac0512c0 con 0x7fdeac108f00 2024-05-09T05:37:04.424 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:04.430+0000 7fde9f7fe700 1 -- 172.21.15.39:0/1944619480 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fdea0009930 con 0x7fdeac108f00 2024-05-09T05:37:04.424 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:04.431+0000 7fde9f7fe700 1 --2- 172.21.15.39:0/1944619480 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fde980b2880 0x7fde980b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:04.424 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:04.431+0000 7fdeb2106700 1 --2- 172.21.15.39:0/1944619480 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fde980b2880 0x7fde980b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:04.424 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:04.431+0000 7fde9f7fe700 1 -- 172.21.15.39:0/1944619480 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7fdea00e1d30 con 0x7fdeac108f00 2024-05-09T05:37:04.425 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:04.431+0000 7fdeb2106700 1 --2- 172.21.15.39:0/1944619480 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fde980b2880 0x7fde980b4d90 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fdea8009990 tx=0x7fdea801a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:37:04.427 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:04.434+0000 7fde9f7fe700 1 -- 172.21.15.39:0/1944619480 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fdea00a9a60 con 0x7fdeac108f00 2024-05-09T05:37:04.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:04.694+0000 7fdeb436a700 1 -- 172.21.15.39:0/1944619480 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdeac1a9cc0 con 0x7fdeac108f00 2024-05-09T05:37:04.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:04.694+0000 7fde9f7fe700 1 -- 172.21.15.39:0/1944619480 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11865 (secure 0 0 0) 0x7fdea00a9360 con 0x7fdeac108f00 2024-05-09T05:37:04.688 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-09T05:37:04.688 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/1997969267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":1997969267},{"type":"v1","addr":"172.21.15.39:6835","nonce":1997969267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/283022063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":283022063},{"type":"v1","addr":"172.21.15.39:6837","nonce":283022063}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14604,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6839/669632573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":669632573},{"type":"v1","addr":"172.21.15.39:6839","nonce":669632573}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14616,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6841/2202260395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6840","nonce":2202260395},{"type":"v1","addr":"172.21.15.39:6841","nonce":2202260395}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24433,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/1308189973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":1308189973},{"type":"v1","addr":"172.21.15.100:6833","nonce":1308189973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24434,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/2789974692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2789974692},{"type":"v1","addr":"172.21.15.60:6833","nonce":2789974692}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-09T05:34:56.202280+0000","modified":"2024-05-09T05:35:16.063547+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24502,"mds_2":24487},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24461":{"gid":24461,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6835/924472374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":924472374},{"type":"v1","addr":"172.21.15.60:6835","nonce":924472374}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24479":{"gid":24479,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6837/3588840930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":3588840930},{"type":"v1","addr":"172.21.15.60:6837","nonce":3588840930}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.100:6835/2595255386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2595255386},{"type":"v1","addr":"172.21.15.100:6835","nonce":2595255386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":13,"addr":"172.21.15.100:6837/3676209932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":3676209932},{"type":"v1","addr":"172.21.15.100:6837","nonce":3676209932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":12,"addr":"172.21.15.100:6839/1395178742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1395178742},{"type":"v1","addr":"172.21.15.100:6839","nonce":1395178742}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.60:6839/1418956667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":1418956667},{"type":"v1","addr":"172.21.15.60:6839","nonce":1418956667}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24487,24502,24509]},"id":1}]} 2024-05-09T05:37:04.690 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:04.697+0000 7fdeb436a700 1 -- 172.21.15.39:0/1944619480 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fde980b2880 msgr2=0x7fde980b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:04.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:04.697+0000 7fdeb436a700 1 --2- 172.21.15.39:0/1944619480 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fde980b2880 0x7fde980b4d90 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fdea8009990 tx=0x7fdea801a040 comp rx=0 tx=0).stop 2024-05-09T05:37:04.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:04.697+0000 7fdeb436a700 1 -- 172.21.15.39:0/1944619480 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdeac108f00 msgr2=0x7fdeac19d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:04.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:04.697+0000 7fdeb436a700 1 --2- 172.21.15.39:0/1944619480 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdeac108f00 0x7fdeac19d550 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fdea000d980 tx=0x7fdea000dc90 comp rx=0 tx=0).stop 2024-05-09T05:37:04.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:04.697+0000 7fdeb436a700 1 -- 172.21.15.39:0/1944619480 shutdown_connections 2024-05-09T05:37:04.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:04.697+0000 7fdeb436a700 1 --2- 172.21.15.39:0/1944619480 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fde980b2880 0x7fde980b4d90 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:04.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:04.697+0000 7fdeb436a700 1 --2- 172.21.15.39:0/1944619480 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdeac109850 0x7fdeac1a17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:04.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:04.697+0000 7fdeb436a700 1 --2- 172.21.15.39:0/1944619480 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdeac1045d0 0x7fdeac19cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:04.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:04.697+0000 7fdeb436a700 1 --2- 172.21.15.39:0/1944619480 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdeac108f00 0x7fdeac19d550 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:04.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:04.697+0000 7fdeb436a700 1 -- 172.21.15.39:0/1944619480 >> 172.21.15.39:0/1944619480 conn(0x7fdeac0ffea0 msgr2=0x7fdeac10a7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:37:04.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:04.697+0000 7fdeb436a700 1 -- 172.21.15.39:0/1944619480 shutdown_connections 2024-05-09T05:37:04.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:04.697+0000 7fdeb436a700 1 -- 172.21.15.39:0/1944619480 wait complete. 2024-05-09T05:37:04.692 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 24 2024-05-09T05:37:05.274 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:37:05 smithi039 ceph-mon[30439]: pgmap v361: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-05-09T05:37:05.274 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:37:05 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/1944619480' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T05:37:05.276 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-05-09T05:34:56.202280+0000', 'modified': '2024-05-09T05:35:16.063547+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24509, 'mds_1': 24502, 'mds_2': 24487}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24461': {'gid': 24461, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.60:6835/924472374', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6834', 'nonce': 924472374}, {'type': 'v1', 'addr': '172.21.15.60:6835', 'nonce': 924472374}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24479': {'gid': 24479, 'name': 'h', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.60:6837/3588840930', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6836', 'nonce': 3588840930}, {'type': 'v1', 'addr': '172.21.15.60:6837', 'nonce': 3588840930}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24481': {'gid': 24481, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.100:6835/2595255386', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.100:6834', 'nonce': 2595255386}, {'type': 'v1', 'addr': '172.21.15.100:6835', 'nonce': 2595255386}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24487': {'gid': 24487, 'name': 'c', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 13, 'addr': '172.21.15.100:6837/3676209932', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.100:6836', 'nonce': 3676209932}, {'type': 'v1', 'addr': '172.21.15.100:6837', 'nonce': 3676209932}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24502': {'gid': 24502, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.100:6839/1395178742', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.100:6838', 'nonce': 1395178742}, {'type': 'v1', 'addr': '172.21.15.100:6839', 'nonce': 1395178742}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24509': {'gid': 24509, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.60:6839/1418956667', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6838', 'nonce': 1418956667}, {'type': 'v1', 'addr': '172.21.15.60:6839', 'nonce': 1418956667}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24509, 'qdb_cluster': [24487, 24502, 24509]} 2024-05-09T05:37:05.276 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-05-09T05:37:05.276 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph tell mds.c status 2024-05-09T05:37:05.530 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T05:37:05.546 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:37:05 smithi060 ceph-mon[34555]: pgmap v361: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-05-09T05:37:05.546 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:37:05 smithi060 ceph-mon[34555]: from='client.? 172.21.15.39:0/1944619480' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T05:37:05.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:37:05 smithi100 ceph-mon[34353]: pgmap v361: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-05-09T05:37:05.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:37:05 smithi100 ceph-mon[34353]: from='client.? 172.21.15.39:0/1944619480' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T05:37:07.196 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.201+0000 7ff6eef40700 1 -- 172.21.15.39:0/3117376083 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff6e8107df0 msgr2=0x7ff6e8108200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:07.196 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.201+0000 7ff6eef40700 1 --2- 172.21.15.39:0/3117376083 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff6e8107df0 0x7ff6e8108200 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff6d40099c0 tx=0x7ff6d4009cd0 comp rx=0 tx=0).stop 2024-05-09T05:37:07.196 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.201+0000 7ff6eef40700 1 -- 172.21.15.39:0/3117376083 shutdown_connections 2024-05-09T05:37:07.196 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.201+0000 7ff6eef40700 1 --2- 172.21.15.39:0/3117376083 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6e8108740 0x7ff6e81100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:07.196 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.201+0000 7ff6eef40700 1 --2- 172.21.15.39:0/3117376083 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6e81034c0 0x7ff6e81038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:07.196 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.201+0000 7ff6eef40700 1 --2- 172.21.15.39:0/3117376083 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff6e8107df0 0x7ff6e8108200 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:07.196 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.201+0000 7ff6eef40700 1 -- 172.21.15.39:0/3117376083 >> 172.21.15.39:0/3117376083 conn(0x7ff6e80fedc0 msgr2=0x7ff6e81011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:37:07.196 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.202+0000 7ff6eef40700 1 -- 172.21.15.39:0/3117376083 shutdown_connections 2024-05-09T05:37:07.196 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.202+0000 7ff6eef40700 1 -- 172.21.15.39:0/3117376083 wait complete. 2024-05-09T05:37:07.196 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.202+0000 7ff6eef40700 1 Processor -- start 2024-05-09T05:37:07.196 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.202+0000 7ff6eef40700 1 -- start start 2024-05-09T05:37:07.199 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.203+0000 7ff6eef40700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff6e81034c0 0x7ff6e819bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:07.199 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.203+0000 7ff6eef40700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6e8107df0 0x7ff6e819c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:07.199 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.203+0000 7ff6eef40700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6e8108740 0x7ff6e819c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:07.199 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.203+0000 7ff6eef40700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7ff6e81133c0 con 0x7ff6e81034c0 2024-05-09T05:37:07.199 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.203+0000 7ff6eef40700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff6e8113240 con 0x7ff6e8108740 2024-05-09T05:37:07.199 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.203+0000 7ff6eef40700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff6e8113540 con 0x7ff6e8107df0 2024-05-09T05:37:07.199 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.203+0000 7ff6eccdc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff6e81034c0 0x7ff6e819bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:07.199 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.203+0000 7ff6eccdc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff6e81034c0 0x7ff6e819bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45518/0 (socket says 172.21.15.39:45518) 2024-05-09T05:37:07.199 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.203+0000 7ff6eccdc700 1 -- 172.21.15.39:0/3119308579 learned_addr learned my addr 172.21.15.39:0/3119308579 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:37:07.199 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.203+0000 7ff6e7fff700 1 --2- 172.21.15.39:0/3119308579 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6e8107df0 0x7ff6e819c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:07.200 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.203+0000 7ff6ed4dd700 1 --2- 172.21.15.39:0/3119308579 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6e8108740 0x7ff6e819c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:07.200 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.203+0000 7ff6eccdc700 1 -- 172.21.15.39:0/3119308579 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6e8107df0 msgr2=0x7ff6e819c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:07.200 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.203+0000 7ff6eccdc700 1 --2- 172.21.15.39:0/3119308579 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6e8107df0 0x7ff6e819c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:07.200 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.203+0000 7ff6eccdc700 1 -- 172.21.15.39:0/3119308579 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6e8108740 msgr2=0x7ff6e819c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:07.200 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.203+0000 7ff6eccdc700 1 --2- 172.21.15.39:0/3119308579 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6e8108740 0x7ff6e819c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:07.200 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.203+0000 7ff6eccdc700 1 -- 172.21.15.39:0/3119308579 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6e81a6fc0 con 0x7ff6e81034c0 2024-05-09T05:37:07.200 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.203+0000 7ff6ed4dd700 1 --2- 172.21.15.39:0/3119308579 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6e8108740 0x7ff6e819c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:37:07.200 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.203+0000 7ff6eccdc700 1 --2- 172.21.15.39:0/3119308579 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff6e81034c0 0x7ff6e819bce0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc00b530 tx=0x7ff6dc00b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:37:07.200 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.203+0000 7ff6e5ffb700 1 -- 172.21.15.39:0/3119308579 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6dc015020 con 0x7ff6e81034c0 2024-05-09T05:37:07.200 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.204+0000 7ff6e5ffb700 1 -- 172.21.15.39:0/3119308579 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff6dc011ce0 con 0x7ff6e81034c0 2024-05-09T05:37:07.200 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.204+0000 7ff6eef40700 1 -- 172.21.15.39:0/3119308579 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6e81a72b0 con 0x7ff6e81034c0 2024-05-09T05:37:07.200 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.204+0000 7ff6e5ffb700 1 -- 172.21.15.39:0/3119308579 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6dc010d20 con 0x7ff6e81034c0 2024-05-09T05:37:07.200 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.204+0000 7ff6eef40700 1 -- 172.21.15.39:0/3119308579 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6e81a77c0 con 0x7ff6e81034c0 2024-05-09T05:37:07.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.206+0000 7ff6e5ffb700 1 -- 172.21.15.39:0/3119308579 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7ff6dc018020 con 0x7ff6e81034c0 2024-05-09T05:37:07.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.207+0000 7ff6e5ffb700 1 --2- 172.21.15.39:0/3119308579 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7ff6d80b2880 0x7ff6d80b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:07.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.207+0000 7ff6e7fff700 1 --2- 172.21.15.39:0/3119308579 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7ff6d80b2880 0x7ff6d80b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:07.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.207+0000 7ff6e5ffb700 1 -- 172.21.15.39:0/3119308579 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7ff6dc0e1a40 con 0x7ff6e81034c0 2024-05-09T05:37:07.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.207+0000 7ff6e7fff700 1 --2- 172.21.15.39:0/3119308579 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7ff6d80b2880 0x7ff6d80b4d90 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff6d4000c00 tx=0x7ff6d401a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:37:07.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.207+0000 7ff6fd956b80 1 Processor -- start 2024-05-09T05:37:07.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.208+0000 7ff6fd956b80 1 -- start start 2024-05-09T05:37:07.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.208+0000 7ff6fd956b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ba287b7cb0 0x55ba288c01f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:07.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.208+0000 7ff6fd956b80 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ba2873d450 0x55ba288c0730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:07.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.208+0000 7ff6fd956b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ba288ba3b0 0x55ba288ba7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:07.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.208+0000 7ff6fd956b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55ba287dd050 con 0x55ba287b7cb0 2024-05-09T05:37:07.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.208+0000 7ff6fd956b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55ba28782950 con 0x55ba288ba3b0 2024-05-09T05:37:07.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.208+0000 7ff6fd956b80 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55ba287d9010 con 0x55ba2873d450 2024-05-09T05:37:07.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.208+0000 7ff6eccdc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ba287b7cb0 0x55ba288c01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:07.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.208+0000 7ff6eccdc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ba287b7cb0 0x55ba288c01f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45534/0 (socket says 172.21.15.39:45534) 2024-05-09T05:37:07.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.208+0000 7ff6eccdc700 1 -- 172.21.15.39:0/895741644 learned_addr learned my addr 172.21.15.39:0/895741644 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:37:07.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.208+0000 7ff6e7fff700 1 --2- 172.21.15.39:0/895741644 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ba2873d450 0x55ba288c0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:07.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.208+0000 7ff6ed4dd700 1 --2- 172.21.15.39:0/895741644 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ba288ba3b0 0x55ba288ba7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:07.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.208+0000 7ff6eccdc700 1 -- 172.21.15.39:0/895741644 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ba2873d450 msgr2=0x55ba288c0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:37:07.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.208+0000 7ff6eccdc700 1 --2- 172.21.15.39:0/895741644 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ba2873d450 0x55ba288c0730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:07.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.208+0000 7ff6eccdc700 1 -- 172.21.15.39:0/895741644 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ba288ba3b0 msgr2=0x55ba288ba7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:37:07.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.208+0000 7ff6eccdc700 1 --2- 172.21.15.39:0/895741644 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ba288ba3b0 0x55ba288ba7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:07.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.208+0000 7ff6eccdc700 1 -- 172.21.15.39:0/895741644 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba287734b0 con 0x55ba287b7cb0 2024-05-09T05:37:07.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.208+0000 7ff6e7fff700 1 --2- 172.21.15.39:0/895741644 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ba2873d450 0x55ba288c0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T05:37:07.209 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.208+0000 7ff6eccdc700 1 --2- 172.21.15.39:0/895741644 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ba287b7cb0 0x55ba288c01f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc0a8d70 tx=0x7ff6dc0107c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e65f04edb700b397 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:37:07.209 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.209+0000 7ff6d2ffd700 1 -- 172.21.15.39:0/895741644 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6dc0a9070 con 0x55ba287b7cb0 2024-05-09T05:37:07.209 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.209+0000 7ff6d2ffd700 1 -- 172.21.15.39:0/895741644 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff6dc0ad420 con 0x55ba287b7cb0 2024-05-09T05:37:07.209 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.209+0000 7ff6d2ffd700 1 -- 172.21.15.39:0/895741644 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6dc0b1c40 con 0x55ba287b7cb0 2024-05-09T05:37:07.209 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.210+0000 7ff6fd956b80 1 -- 172.21.15.39:0/895741644 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ba287b7cb0 msgr2=0x55ba288c01f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:07.209 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.210+0000 7ff6fd956b80 1 --2- 172.21.15.39:0/895741644 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ba287b7cb0 0x55ba288c01f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc0a8d70 tx=0x7ff6dc0107c0 comp rx=0 tx=0).stop 2024-05-09T05:37:07.209 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.210+0000 7ff6fd956b80 1 -- 172.21.15.39:0/895741644 shutdown_connections 2024-05-09T05:37:07.209 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.210+0000 7ff6fd956b80 1 --2- 172.21.15.39:0/895741644 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ba288ba3b0 0x55ba288ba7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:07.209 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.210+0000 7ff6fd956b80 1 --2- 172.21.15.39:0/895741644 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ba287b7cb0 0x55ba288c01f0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:07.209 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.210+0000 7ff6fd956b80 1 --2- 172.21.15.39:0/895741644 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ba2873d450 0x55ba288c0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:07.209 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.210+0000 7ff6fd956b80 1 -- 172.21.15.39:0/895741644 >> 172.21.15.39:0/895741644 conn(0x55ba28740f20 msgr2=0x55ba288b51d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:37:07.209 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.210+0000 7ff6fd956b80 1 -- 172.21.15.39:0/895741644 shutdown_connections 2024-05-09T05:37:07.210 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.210+0000 7ff6fd956b80 1 -- 172.21.15.39:0/895741644 wait complete. 2024-05-09T05:37:07.210 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.210+0000 7ff6fd956b80 1 -- start start 2024-05-09T05:37:07.210 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.210+0000 7ff6fd956b80 1 Processor -- start 2024-05-09T05:37:07.210 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.211+0000 7ff6fd956b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ba2873d450 0x55ba288c3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:07.210 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.211+0000 7ff6fd956b80 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ba287b7cb0 0x55ba288c4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:07.210 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.211+0000 7ff6fd956b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ba288ba3b0 0x55ba288c4a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:07.210 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.211+0000 7ff6fd956b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55ba288bb110 con 0x55ba2873d450 2024-05-09T05:37:07.210 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.211+0000 7ff6fd956b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55ba28777ad0 con 0x55ba288ba3b0 2024-05-09T05:37:07.210 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.211+0000 7ff6fd956b80 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55ba288cb3e0 con 0x55ba287b7cb0 2024-05-09T05:37:07.210 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.211+0000 7ff6fd956b80 10 client.0 _ll_register_callbacks cb 0x55ba2864e670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T05:37:07.210 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.211+0000 7ff6eccdc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ba2873d450 0x55ba288c3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:07.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.211+0000 7ff6eccdc700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ba2873d450 0x55ba288c3fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45546/0 (socket says 172.21.15.39:45546) 2024-05-09T05:37:07.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.211+0000 7ff6eccdc700 1 -- 172.21.15.39:0/1493058544 learned_addr learned my addr 172.21.15.39:0/1493058544 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:37:07.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.211+0000 7ff6ed4dd700 1 --2- 172.21.15.39:0/1493058544 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ba288ba3b0 0x55ba288c4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:07.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.211+0000 7ff6e7fff700 1 --2- 172.21.15.39:0/1493058544 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ba287b7cb0 0x55ba288c4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:07.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.211+0000 7ff6eccdc700 1 -- 172.21.15.39:0/1493058544 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ba287b7cb0 msgr2=0x55ba288c4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:37:07.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.211+0000 7ff6eccdc700 1 --2- 172.21.15.39:0/1493058544 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ba287b7cb0 0x55ba288c4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:07.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.211+0000 7ff6eccdc700 1 -- 172.21.15.39:0/1493058544 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ba288ba3b0 msgr2=0x55ba288c4a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:37:07.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.211+0000 7ff6eccdc700 1 --2- 172.21.15.39:0/1493058544 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ba288ba3b0 0x55ba288c4a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:07.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.211+0000 7ff6eccdc700 1 -- 172.21.15.39:0/1493058544 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba28658440 con 0x55ba2873d450 2024-05-09T05:37:07.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.211+0000 7ff6e7fff700 1 --2- 172.21.15.39:0/1493058544 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ba287b7cb0 0x55ba288c4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T05:37:07.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.211+0000 7ff6ed4dd700 1 --2- 172.21.15.39:0/1493058544 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ba288ba3b0 0x55ba288c4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T05:37:07.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.211+0000 7ff6eccdc700 1 --2- 172.21.15.39:0/1493058544 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ba2873d450 0x55ba288c3fd0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc0a62e0 tx=0x7ff6dc0ad300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8895eb1f32a92b9b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:37:07.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.212+0000 7ff6c7fff700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-05-09T05:37:07.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.212+0000 7ff6c7fff700 1 -- 172.21.15.39:0/1493058544 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6dc0a94e0 con 0x55ba2873d450 2024-05-09T05:37:07.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.212+0000 7ff6c7fff700 1 -- 172.21.15.39:0/1493058544 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7ff6dc0b1a40 con 0x55ba2873d450 2024-05-09T05:37:07.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.212+0000 7ff6fd956b80 1 -- 172.21.15.39:0/1493058544 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff6dc0ad420 con 0x55ba2873d450 2024-05-09T05:37:07.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.212+0000 7ff6c7fff700 1 -- 172.21.15.39:0/1493058544 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ff6dc0b1c40 con 0x55ba2873d450 2024-05-09T05:37:07.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.212+0000 7ff6fd956b80 10 client.14976 fetch_fsmap learned FSMap version 24 2024-05-09T05:37:07.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.212+0000 7ff6fd956b80 1 -- 172.21.15.39:0/1493058544 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55ba288d5db0 con 0x55ba2873d450 2024-05-09T05:37:07.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.212+0000 7ff6c7fff700 1 -- 172.21.15.39:0/1493058544 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff6dc0ad420 con 0x55ba2873d450 2024-05-09T05:37:07.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.212+0000 7ff6c7fff700 1 -- 172.21.15.39:0/1493058544 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7ff6dc0a7d40 con 0x55ba2873d450 2024-05-09T05:37:07.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.212+0000 7ff6fd956b80 10 client.14976 fetch_fsmap finished waiting for FSMap version 24 2024-05-09T05:37:07.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.212+0000 7ff6fd956b80 10 client.14976 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-09T05:37:07.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.212+0000 7ff6fd956b80 20 client.14976 populate_metadata read hostname 'smithi039' 2024-05-09T05:37:07.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.212+0000 7ff6fd956b80 1 --2- 172.21.15.39:0/1493058544 >> [v2:172.21.15.100:6836/3676209932,v1:172.21.15.100:6837/3676209932] conn(0x55ba288d7100 0x55ba288d9200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:07.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.212+0000 7ff6fd956b80 4 client.14976 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T05:37:07.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.212+0000 7ff6fd956b80 1 -- 172.21.15.39:0/1493058544 --> [v2:172.21.15.100:6836/3676209932,v1:172.21.15.100:6837/3676209932] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ba287eaa30 con 0x55ba288d7100 2024-05-09T05:37:07.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.213+0000 7ff6e7fff700 1 --2- 172.21.15.39:0/1493058544 >> [v2:172.21.15.100:6836/3676209932,v1:172.21.15.100:6837/3676209932] conn(0x55ba288d7100 0x55ba288d9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:07.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.213+0000 7ff6c7fff700 10 client.14976 ms_handle_connect on v2:172.21.15.100:6836/3676209932 2024-05-09T05:37:07.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.213+0000 7ff6e7fff700 1 --2- 172.21.15.39:0/1493058544 >> [v2:172.21.15.100:6836/3676209932,v1:172.21.15.100:6837/3676209932] conn(0x55ba288d7100 0x55ba288d9200 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=be9d312b099c49ca server_cookie=ee96cf9023d2767e in_seq=0 out_seq=0 2024-05-09T05:37:07.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.214+0000 7ff6c7fff700 1 -- 172.21.15.39:0/1493058544 <== mds.2 v2:172.21.15.100:6836/3676209932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55ba287eaa30 con 0x55ba288d7100 2024-05-09T05:37:07.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.214+0000 7ff6c7fff700 10 client.14976 handle_command_reply: tid=0 2024-05-09T05:37:07.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.214+0000 7ff6fd956b80 1 client.14976 shutdown 2024-05-09T05:37:07.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.214+0000 7ff6fd956b80 1 -- 172.21.15.39:0/1493058544 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ba2873d450 msgr2=0x55ba288c3fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:07.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.214+0000 7ff6fd956b80 1 --2- 172.21.15.39:0/1493058544 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ba2873d450 0x55ba288c3fd0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc0a62e0 tx=0x7ff6dc0ad300 comp rx=0 tx=0).stop 2024-05-09T05:37:07.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.214+0000 7ff6fd956b80 1 -- 172.21.15.39:0/1493058544 shutdown_connections 2024-05-09T05:37:07.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.215+0000 7ff6fd956b80 1 --2- 172.21.15.39:0/1493058544 >> [v2:172.21.15.100:6836/3676209932,v1:172.21.15.100:6837/3676209932] conn(0x55ba288d7100 0x55ba288d9200 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:07.215 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.215+0000 7ff6fd956b80 1 --2- 172.21.15.39:0/1493058544 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ba288ba3b0 0x55ba288c4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:07.215 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.215+0000 7ff6fd956b80 1 --2- 172.21.15.39:0/1493058544 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ba2873d450 0x55ba288c3fd0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:07.215 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.215+0000 7ff6fd956b80 1 --2- 172.21.15.39:0/1493058544 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ba287b7cb0 0x55ba288c4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:07.215 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.215+0000 7ff6c7fff700 0 client.14976 ms_handle_reset on v2:172.21.15.100:6836/3676209932 2024-05-09T05:37:07.215 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.215+0000 7ff6fd956b80 1 -- 172.21.15.39:0/1493058544 >> 172.21.15.39:0/1493058544 conn(0x55ba28740f20 msgr2=0x55ba288aefa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:37:07.215 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.215+0000 7ff6fd956b80 1 -- 172.21.15.39:0/1493058544 shutdown_connections 2024-05-09T05:37:07.215 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.215+0000 7ff6fd956b80 1 -- 172.21.15.39:0/1493058544 wait complete. 2024-05-09T05:37:07.215 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.215+0000 7ff6fd956b80 20 client.14976 trim_cache size 0 max 16384 2024-05-09T05:37:07.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.236+0000 7ff6fd956b80 1 Processor -- start 2024-05-09T05:37:07.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.236+0000 7ff6fd956b80 1 -- start start 2024-05-09T05:37:07.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.236+0000 7ff6fd956b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ba2873d450 0x55ba288af610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:07.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.236+0000 7ff6fd956b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ba287b7cb0 0x55ba288b9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:07.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.236+0000 7ff6fd956b80 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ba288ba3b0 0x55ba288c4890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:07.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.236+0000 7ff6fd956b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55ba288d7590 con 0x55ba287b7cb0 2024-05-09T05:37:07.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.236+0000 7ff6fd956b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55ba288d7c60 con 0x55ba2873d450 2024-05-09T05:37:07.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.236+0000 7ff6fd956b80 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55ba288d82e0 con 0x55ba288ba3b0 2024-05-09T05:37:07.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.236+0000 7ff6e7fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ba287b7cb0 0x55ba288b9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:07.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.236+0000 7ff6e7fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ba287b7cb0 0x55ba288b9dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45558/0 (socket says 172.21.15.39:45558) 2024-05-09T05:37:07.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.236+0000 7ff6e7fff700 1 -- 172.21.15.39:0/3616269161 learned_addr learned my addr 172.21.15.39:0/3616269161 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:37:07.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.237+0000 7ff6ed4dd700 1 --2- 172.21.15.39:0/3616269161 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ba288ba3b0 0x55ba288c4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:07.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.237+0000 7ff6eccdc700 1 --2- 172.21.15.39:0/3616269161 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ba2873d450 0x55ba288af610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:07.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.237+0000 7ff6e7fff700 1 -- 172.21.15.39:0/3616269161 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ba288ba3b0 msgr2=0x55ba288c4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:37:07.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.237+0000 7ff6e7fff700 1 --2- 172.21.15.39:0/3616269161 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ba288ba3b0 0x55ba288c4890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:07.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.237+0000 7ff6e7fff700 1 -- 172.21.15.39:0/3616269161 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ba2873d450 msgr2=0x55ba288af610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:37:07.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.237+0000 7ff6e7fff700 1 --2- 172.21.15.39:0/3616269161 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ba2873d450 0x55ba288af610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:07.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.237+0000 7ff6e7fff700 1 -- 172.21.15.39:0/3616269161 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba288c6d90 con 0x55ba287b7cb0 2024-05-09T05:37:07.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.237+0000 7ff6eccdc700 1 --2- 172.21.15.39:0/3616269161 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ba2873d450 0x55ba288af610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:37:07.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.237+0000 7ff6e7fff700 1 --2- 172.21.15.39:0/3616269161 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ba287b7cb0 0x55ba288b9dd0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7ff6e8076ab0 tx=0x7ff6d401d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c95a9c459250c76 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:37:07.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.237+0000 7ff6d27fc700 1 -- 172.21.15.39:0/3616269161 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d400fe50 con 0x55ba287b7cb0 2024-05-09T05:37:07.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.237+0000 7ff6d27fc700 1 -- 172.21.15.39:0/3616269161 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff6d4033680 con 0x55ba287b7cb0 2024-05-09T05:37:07.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.237+0000 7ff6d27fc700 1 -- 172.21.15.39:0/3616269161 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d4022990 con 0x55ba287b7cb0 2024-05-09T05:37:07.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.238+0000 7ff6fd956b80 1 -- 172.21.15.39:0/3616269161 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ba287b7cb0 msgr2=0x55ba288b9dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:07.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.238+0000 7ff6fd956b80 1 --2- 172.21.15.39:0/3616269161 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ba287b7cb0 0x55ba288b9dd0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7ff6e8076ab0 tx=0x7ff6d401d000 comp rx=0 tx=0).stop 2024-05-09T05:37:07.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.238+0000 7ff6fd956b80 1 -- 172.21.15.39:0/3616269161 shutdown_connections 2024-05-09T05:37:07.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.238+0000 7ff6fd956b80 1 --2- 172.21.15.39:0/3616269161 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ba288ba3b0 0x55ba288c4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:07.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.238+0000 7ff6fd956b80 1 --2- 172.21.15.39:0/3616269161 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ba2873d450 0x55ba288af610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:07.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.238+0000 7ff6fd956b80 1 --2- 172.21.15.39:0/3616269161 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ba287b7cb0 0x55ba288b9dd0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:07.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.238+0000 7ff6fd956b80 1 -- 172.21.15.39:0/3616269161 >> 172.21.15.39:0/3616269161 conn(0x55ba28740f20 msgr2=0x55ba288c2790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:37:07.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.238+0000 7ff6fd956b80 1 -- 172.21.15.39:0/3616269161 shutdown_connections 2024-05-09T05:37:07.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.238+0000 7ff6fd956b80 1 -- 172.21.15.39:0/3616269161 wait complete. 2024-05-09T05:37:07.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.238+0000 7ff6fd956b80 1 -- start start 2024-05-09T05:37:07.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.238+0000 7ff6fd956b80 1 Processor -- start 2024-05-09T05:37:07.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.239+0000 7ff6fd956b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ba2873d450 0x55ba288e28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:07.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.239+0000 7ff6fd956b80 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ba287b7cb0 0x55ba288dcbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:07.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.239+0000 7ff6fd956b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ba288ba3b0 0x55ba288dd130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:07.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.239+0000 7ff6fd956b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55ba288d9080 con 0x55ba288ba3b0 2024-05-09T05:37:07.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.239+0000 7ff6fd956b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55ba288d89b0 con 0x55ba2873d450 2024-05-09T05:37:07.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.239+0000 7ff6fd956b80 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55ba288d9750 con 0x55ba287b7cb0 2024-05-09T05:37:07.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.239+0000 7ff6fd956b80 10 client.0 _ll_register_callbacks cb 0x55ba2864e670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T05:37:07.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.239+0000 7ff6ed4dd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ba288ba3b0 0x55ba288dd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:07.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.239+0000 7ff6ed4dd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ba288ba3b0 0x55ba288dd130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45562/0 (socket says 172.21.15.39:45562) 2024-05-09T05:37:07.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.239+0000 7ff6ed4dd700 1 -- 172.21.15.39:0/3073413764 learned_addr learned my addr 172.21.15.39:0/3073413764 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:37:07.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.239+0000 7ff6eccdc700 1 --2- 172.21.15.39:0/3073413764 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ba2873d450 0x55ba288e28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:07.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.239+0000 7ff6e7fff700 1 --2- 172.21.15.39:0/3073413764 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ba287b7cb0 0x55ba288dcbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:07.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.239+0000 7ff6ed4dd700 1 -- 172.21.15.39:0/3073413764 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ba287b7cb0 msgr2=0x55ba288dcbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:37:07.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.239+0000 7ff6ed4dd700 1 --2- 172.21.15.39:0/3073413764 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ba287b7cb0 0x55ba288dcbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:07.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.239+0000 7ff6ed4dd700 1 -- 172.21.15.39:0/3073413764 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ba2873d450 msgr2=0x55ba288e28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:37:07.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.239+0000 7ff6ed4dd700 1 --2- 172.21.15.39:0/3073413764 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ba2873d450 0x55ba288e28a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:07.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.239+0000 7ff6ed4dd700 1 -- 172.21.15.39:0/3073413764 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba288b1980 con 0x55ba288ba3b0 2024-05-09T05:37:07.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.239+0000 7ff6eccdc700 1 --2- 172.21.15.39:0/3073413764 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ba2873d450 0x55ba288e28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T05:37:07.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.240+0000 7ff6ed4dd700 1 --2- 172.21.15.39:0/3073413764 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ba288ba3b0 0x55ba288dd130 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ff6e0012fd0 tx=0x7ff6e0014620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7174d18312fc557d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:37:07.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.240+0000 7ff6c7fff700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-05-09T05:37:07.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.240+0000 7ff6c7fff700 1 -- 172.21.15.39:0/3073413764 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6e0014e30 con 0x55ba288ba3b0 2024-05-09T05:37:07.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.240+0000 7ff6c7fff700 1 -- 172.21.15.39:0/3073413764 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7ff6e0016420 con 0x55ba288ba3b0 2024-05-09T05:37:07.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.240+0000 7ff6fd956b80 1 -- 172.21.15.39:0/3073413764 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff6d4033680 con 0x55ba288ba3b0 2024-05-09T05:37:07.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.240+0000 7ff6c7fff700 1 -- 172.21.15.39:0/3073413764 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ff6e0016620 con 0x55ba288ba3b0 2024-05-09T05:37:07.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.240+0000 7ff6fd956b80 10 client.14982 fetch_fsmap learned FSMap version 24 2024-05-09T05:37:07.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.240+0000 7ff6fd956b80 1 -- 172.21.15.39:0/3073413764 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55ba28943c50 con 0x55ba288ba3b0 2024-05-09T05:37:07.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.240+0000 7ff6c7fff700 1 -- 172.21.15.39:0/3073413764 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff6d4033680 con 0x55ba288ba3b0 2024-05-09T05:37:07.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.240+0000 7ff6c7fff700 1 -- 172.21.15.39:0/3073413764 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7ff6e0020980 con 0x55ba288ba3b0 2024-05-09T05:37:07.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.240+0000 7ff6fd956b80 10 client.14982 fetch_fsmap finished waiting for FSMap version 24 2024-05-09T05:37:07.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.241+0000 7ff6fd956b80 10 client.14982 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-09T05:37:07.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.241+0000 7ff6fd956b80 20 client.14982 populate_metadata read hostname 'smithi039' 2024-05-09T05:37:07.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.241+0000 7ff6fd956b80 1 --2- 172.21.15.39:0/3073413764 >> [v2:172.21.15.100:6836/3676209932,v1:172.21.15.100:6837/3676209932] conn(0x55ba28946130 0x55ba289475a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:07.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.241+0000 7ff6fd956b80 4 client.14982 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-09T05:37:07.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.241+0000 7ff6fd956b80 1 -- 172.21.15.39:0/3073413764 --> [v2:172.21.15.100:6836/3676209932,v1:172.21.15.100:6837/3676209932] -- command(tid 0: {"prefix": "status"}) -- 0x55ba287e4ad0 con 0x55ba28946130 2024-05-09T05:37:07.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.241+0000 7ff6eccdc700 1 --2- 172.21.15.39:0/3073413764 >> [v2:172.21.15.100:6836/3676209932,v1:172.21.15.100:6837/3676209932] conn(0x55ba28946130 0x55ba289475a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:07.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.241+0000 7ff6c7fff700 10 client.14982 ms_handle_connect on v2:172.21.15.100:6836/3676209932 2024-05-09T05:37:07.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.241+0000 7ff6eccdc700 1 --2- 172.21.15.39:0/3073413764 >> [v2:172.21.15.100:6836/3676209932,v1:172.21.15.100:6837/3676209932] conn(0x55ba28946130 0x55ba289475a0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=53992394877aa2c6 server_cookie=3974613529633833 in_seq=0 out_seq=0 2024-05-09T05:37:07.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.242+0000 7ff6c7fff700 1 -- 172.21.15.39:0/3073413764 <== mds.2 v2:172.21.15.100:6836/3676209932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55ba287e4ad0 con 0x55ba28946130 2024-05-09T05:37:07.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.242+0000 7ff6c7fff700 10 client.14982 handle_command_reply: tid=0 2024-05-09T05:37:07.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.242+0000 7ff6fd956b80 1 client.14982 shutdown 2024-05-09T05:37:07.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.242+0000 7ff6fd956b80 1 -- 172.21.15.39:0/3073413764 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ba288ba3b0 msgr2=0x55ba288dd130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:07.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.242+0000 7ff6fd956b80 1 --2- 172.21.15.39:0/3073413764 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ba288ba3b0 0x55ba288dd130 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ff6e0012fd0 tx=0x7ff6e0014620 comp rx=0 tx=0).stop 2024-05-09T05:37:07.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.242+0000 7ff6fd956b80 1 -- 172.21.15.39:0/3073413764 shutdown_connections 2024-05-09T05:37:07.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.242+0000 7ff6fd956b80 1 --2- 172.21.15.39:0/3073413764 >> [v2:172.21.15.100:6836/3676209932,v1:172.21.15.100:6837/3676209932] conn(0x55ba28946130 0x55ba289475a0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:07.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.242+0000 7ff6fd956b80 1 --2- 172.21.15.39:0/3073413764 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55ba288ba3b0 0x55ba288dd130 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:07.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.242+0000 7ff6fd956b80 1 --2- 172.21.15.39:0/3073413764 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ba2873d450 0x55ba288e28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:07.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.242+0000 7ff6fd956b80 1 --2- 172.21.15.39:0/3073413764 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ba287b7cb0 0x55ba288dcbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:07.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.242+0000 7ff6fd956b80 1 -- 172.21.15.39:0/3073413764 >> 172.21.15.39:0/3073413764 conn(0x55ba28740f20 msgr2=0x55ba288b9b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:37:07.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.242+0000 7ff6c7fff700 0 client.14982 ms_handle_reset on v2:172.21.15.100:6836/3676209932 2024-05-09T05:37:07.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.242+0000 7ff6fd956b80 1 -- 172.21.15.39:0/3073413764 shutdown_connections 2024-05-09T05:37:07.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.242+0000 7ff6fd956b80 1 -- 172.21.15.39:0/3073413764 wait complete. 2024-05-09T05:37:07.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.242+0000 7ff6fd956b80 20 client.14982 trim_cache size 0 max 16384 2024-05-09T05:37:07.242 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-05-09T05:37:07.242 INFO:teuthology.orchestra.run.smithi039.stdout: "cluster_fsid": "86d4cc60-0dc4-11ef-bc97-c7b262605968", 2024-05-09T05:37:07.242 INFO:teuthology.orchestra.run.smithi039.stdout: "whoami": 2, 2024-05-09T05:37:07.242 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 24487, 2024-05-09T05:37:07.242 INFO:teuthology.orchestra.run.smithi039.stdout: "want_state": "up:active", 2024-05-09T05:37:07.242 INFO:teuthology.orchestra.run.smithi039.stdout: "state": "up:active", 2024-05-09T05:37:07.242 INFO:teuthology.orchestra.run.smithi039.stdout: "fs_name": "cephfs", 2024-05-09T05:37:07.242 INFO:teuthology.orchestra.run.smithi039.stdout: "rank_uptime": 116.82602418499999, 2024-05-09T05:37:07.242 INFO:teuthology.orchestra.run.smithi039.stdout: "mdsmap_epoch": 24, 2024-05-09T05:37:07.242 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_epoch": 83, 2024-05-09T05:37:07.243 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_epoch_barrier": 81, 2024-05-09T05:37:07.243 INFO:teuthology.orchestra.run.smithi039.stdout: "uptime": 163.645443298 2024-05-09T05:37:07.243 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-05-09T05:37:07.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.243+0000 7ff6eef40700 1 -- 172.21.15.39:0/3119308579 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7ff6d80b2880 msgr2=0x7ff6d80b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:07.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.243+0000 7ff6eef40700 1 --2- 172.21.15.39:0/3119308579 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7ff6d80b2880 0x7ff6d80b4d90 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff6d4000c00 tx=0x7ff6d401a040 comp rx=0 tx=0).stop 2024-05-09T05:37:07.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.243+0000 7ff6eef40700 1 -- 172.21.15.39:0/3119308579 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff6e81034c0 msgr2=0x7ff6e819bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:07.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.243+0000 7ff6eef40700 1 --2- 172.21.15.39:0/3119308579 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff6e81034c0 0x7ff6e819bce0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc00b530 tx=0x7ff6dc00b8f0 comp rx=0 tx=0).stop 2024-05-09T05:37:07.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.243+0000 7ff6eef40700 1 -- 172.21.15.39:0/3119308579 shutdown_connections 2024-05-09T05:37:07.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.243+0000 7ff6eef40700 1 --2- 172.21.15.39:0/3119308579 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7ff6d80b2880 0x7ff6d80b4d90 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:07.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.243+0000 7ff6eef40700 1 --2- 172.21.15.39:0/3119308579 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6e8108740 0x7ff6e819c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:07.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.243+0000 7ff6eef40700 1 --2- 172.21.15.39:0/3119308579 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff6e81034c0 0x7ff6e819bce0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:07.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.243+0000 7ff6eef40700 1 --2- 172.21.15.39:0/3119308579 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6e8107df0 0x7ff6e819c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:07.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.243+0000 7ff6eef40700 1 -- 172.21.15.39:0/3119308579 >> 172.21.15.39:0/3119308579 conn(0x7ff6e80fedc0 msgr2=0x7ff6e81096a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:37:07.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.243+0000 7ff6eef40700 1 -- 172.21.15.39:0/3119308579 shutdown_connections 2024-05-09T05:37:07.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:07.243+0000 7ff6eef40700 1 -- 172.21.15.39:0/3119308579 wait complete. 2024-05-09T05:37:07.546 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:37:07 smithi060 ceph-mon[34555]: pgmap v362: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-05-09T05:37:07.550 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:37:07 smithi039 ceph-mon[30439]: pgmap v362: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-05-09T05:37:07.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:37:07 smithi100 ceph-mon[34353]: pgmap v362: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-05-09T05:37:07.882 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph tell mds.i status 2024-05-09T05:37:08.138 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T05:37:09.480 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:37:09 smithi039 ceph-mon[30439]: pgmap v363: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-05-09T05:37:09.546 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:37:09 smithi060 ceph-mon[34555]: pgmap v363: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-05-09T05:37:09.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:37:09 smithi100 ceph-mon[34353]: pgmap v363: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-05-09T05:37:09.747 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.753+0000 7f593e082700 1 -- 172.21.15.39:0/3570746854 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5938109850 msgr2=0x7f59381111b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:09.747 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.753+0000 7f593e082700 1 --2- 172.21.15.39:0/3570746854 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5938109850 0x7f59381111b0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f593000b0d0 tx=0x7f593000b3e0 comp rx=0 tx=0).stop 2024-05-09T05:37:09.747 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.753+0000 7f593e082700 1 -- 172.21.15.39:0/3570746854 shutdown_connections 2024-05-09T05:37:09.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.753+0000 7f593e082700 1 --2- 172.21.15.39:0/3570746854 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5938109850 0x7f59381111b0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:09.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.753+0000 7f593e082700 1 --2- 172.21.15.39:0/3570746854 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f59381045d0 0x7f59381049e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:09.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.753+0000 7f593e082700 1 --2- 172.21.15.39:0/3570746854 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5938108f00 0x7f5938109310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:09.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.753+0000 7f593e082700 1 -- 172.21.15.39:0/3570746854 >> 172.21.15.39:0/3570746854 conn(0x7f59380ffea0 msgr2=0x7f59381022f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:37:09.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.753+0000 7f593e082700 1 -- 172.21.15.39:0/3570746854 shutdown_connections 2024-05-09T05:37:09.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.753+0000 7f593e082700 1 -- 172.21.15.39:0/3570746854 wait complete. 2024-05-09T05:37:09.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.754+0000 7f593e082700 1 Processor -- start 2024-05-09T05:37:09.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.754+0000 7f593e082700 1 -- start start 2024-05-09T05:37:09.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.754+0000 7f593e082700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f59381045d0 0x7f593819ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:09.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.754+0000 7f593e082700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5938108f00 0x7f593819b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:09.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.754+0000 7f593e082700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5938109850 0x7f593819f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:09.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.754+0000 7f593e082700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f5938114480 con 0x7f5938108f00 2024-05-09T05:37:09.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.754+0000 7f593e082700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f5938114300 con 0x7f5938109850 2024-05-09T05:37:09.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.754+0000 7f593e082700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f5938114600 con 0x7f59381045d0 2024-05-09T05:37:09.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.754+0000 7f5936ffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5938108f00 0x7f593819b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:09.750 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.754+0000 7f5936ffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5938108f00 0x7f593819b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45588/0 (socket says 172.21.15.39:45588) 2024-05-09T05:37:09.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.755+0000 7f5936ffd700 1 -- 172.21.15.39:0/3778479100 learned_addr learned my addr 172.21.15.39:0/3778479100 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:37:09.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.755+0000 7f5937fff700 1 --2- 172.21.15.39:0/3778479100 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5938109850 0x7f593819f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:09.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.755+0000 7f59377fe700 1 --2- 172.21.15.39:0/3778479100 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f59381045d0 0x7f593819ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:09.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.755+0000 7f5936ffd700 1 -- 172.21.15.39:0/3778479100 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f59381045d0 msgr2=0x7f593819ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:09.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.755+0000 7f5936ffd700 1 --2- 172.21.15.39:0/3778479100 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f59381045d0 0x7f593819ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:09.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.755+0000 7f5936ffd700 1 -- 172.21.15.39:0/3778479100 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5938109850 msgr2=0x7f593819f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:09.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.755+0000 7f5936ffd700 1 --2- 172.21.15.39:0/3778479100 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5938109850 0x7f593819f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:09.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.755+0000 7f5936ffd700 1 -- 172.21.15.39:0/3778479100 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f593819fc60 con 0x7f5938108f00 2024-05-09T05:37:09.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.755+0000 7f5937fff700 1 --2- 172.21.15.39:0/3778479100 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5938109850 0x7f593819f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T05:37:09.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.755+0000 7f5936ffd700 1 --2- 172.21.15.39:0/3778479100 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5938108f00 0x7f593819b330 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f592c00d980 tx=0x7f592c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:37:09.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.755+0000 7f5934ff9700 1 -- 172.21.15.39:0/3778479100 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f592c017070 con 0x7f5938108f00 2024-05-09T05:37:09.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.755+0000 7f5934ff9700 1 -- 172.21.15.39:0/3778479100 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f592c00fd40 con 0x7f5938108f00 2024-05-09T05:37:09.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.755+0000 7f593e082700 1 -- 172.21.15.39:0/3778479100 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f593819ff50 con 0x7f5938108f00 2024-05-09T05:37:09.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.755+0000 7f5934ff9700 1 -- 172.21.15.39:0/3778479100 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f592c00e3b0 con 0x7f5938108f00 2024-05-09T05:37:09.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.756+0000 7f593e082700 1 -- 172.21.15.39:0/3778479100 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59381a7870 con 0x7f5938108f00 2024-05-09T05:37:09.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.759+0000 7f5934ff9700 1 -- 172.21.15.39:0/3778479100 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f592c010610 con 0x7f5938108f00 2024-05-09T05:37:09.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.759+0000 7f5934ff9700 1 --2- 172.21.15.39:0/3778479100 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f59200b2900 0x7f59200b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:09.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.759+0000 7f594ca98b80 1 Processor -- start 2024-05-09T05:37:09.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.760+0000 7f594ca98b80 1 -- start start 2024-05-09T05:37:09.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.760+0000 7f59377fe700 1 --2- 172.21.15.39:0/3778479100 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f59200b2900 0x7f59200b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:09.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.760+0000 7f5934ff9700 1 -- 172.21.15.39:0/3778479100 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f592c0e1b60 con 0x7f5938108f00 2024-05-09T05:37:09.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.760+0000 7f594ca98b80 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562df5c29cb0 0x562df5d30a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:09.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.760+0000 7f594ca98b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562df5baf450 0x562df5d30fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:09.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.760+0000 7f594ca98b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562df5d35190 0x562df5d355a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:09.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.760+0000 7f594ca98b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x562df5c4f050 con 0x562df5baf450 2024-05-09T05:37:09.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.760+0000 7f594ca98b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x562df5bf4950 con 0x562df5d35190 2024-05-09T05:37:09.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.760+0000 7f594ca98b80 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x562df5c4b010 con 0x562df5c29cb0 2024-05-09T05:37:09.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.760+0000 7f59377fe700 1 --2- 172.21.15.39:0/3778479100 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f59200b2900 0x7f59200b4e10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5928005950 tx=0x7f592800a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:37:09.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.760+0000 7f5936ffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562df5baf450 0x562df5d30fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:09.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.760+0000 7f5936ffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562df5baf450 0x562df5d30fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45604/0 (socket says 172.21.15.39:45604) 2024-05-09T05:37:09.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.760+0000 7f5936ffd700 1 -- 172.21.15.39:0/1096870843 learned_addr learned my addr 172.21.15.39:0/1096870843 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:37:09.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.760+0000 7f5937fff700 1 --2- 172.21.15.39:0/1096870843 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562df5d35190 0x562df5d355a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:09.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.760+0000 7f59377fe700 1 --2- 172.21.15.39:0/1096870843 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562df5c29cb0 0x562df5d30a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:09.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.760+0000 7f5936ffd700 1 -- 172.21.15.39:0/1096870843 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562df5c29cb0 msgr2=0x562df5d30a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:37:09.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.760+0000 7f5936ffd700 1 --2- 172.21.15.39:0/1096870843 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562df5c29cb0 0x562df5d30a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:09.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.760+0000 7f5936ffd700 1 -- 172.21.15.39:0/1096870843 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562df5d35190 msgr2=0x562df5d355a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:37:09.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.760+0000 7f5936ffd700 1 --2- 172.21.15.39:0/1096870843 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562df5d35190 0x562df5d355a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:09.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.761+0000 7f5936ffd700 1 -- 172.21.15.39:0/1096870843 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562df5be54b0 con 0x562df5baf450 2024-05-09T05:37:09.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.761+0000 7f5937fff700 1 --2- 172.21.15.39:0/1096870843 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562df5d35190 0x562df5d355a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T05:37:09.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.761+0000 7f5936ffd700 1 --2- 172.21.15.39:0/1096870843 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562df5baf450 0x562df5d30fe0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f592c0a5210 tx=0x7f592c0a8980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b05f1e8b2822b748 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:37:09.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.761+0000 7f591dffb700 1 -- 172.21.15.39:0/1096870843 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f592c020040 con 0x562df5baf450 2024-05-09T05:37:09.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.761+0000 7f591dffb700 1 -- 172.21.15.39:0/1096870843 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f592c0a9190 con 0x562df5baf450 2024-05-09T05:37:09.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.761+0000 7f591dffb700 1 -- 172.21.15.39:0/1096870843 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f592c0b1d60 con 0x562df5baf450 2024-05-09T05:37:09.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.762+0000 7f594ca98b80 1 -- 172.21.15.39:0/1096870843 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562df5baf450 msgr2=0x562df5d30fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:09.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.762+0000 7f594ca98b80 1 --2- 172.21.15.39:0/1096870843 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562df5baf450 0x562df5d30fe0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f592c0a5210 tx=0x7f592c0a8980 comp rx=0 tx=0).stop 2024-05-09T05:37:09.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.762+0000 7f594ca98b80 1 -- 172.21.15.39:0/1096870843 shutdown_connections 2024-05-09T05:37:09.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.762+0000 7f594ca98b80 1 --2- 172.21.15.39:0/1096870843 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562df5d35190 0x562df5d355a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:09.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.762+0000 7f594ca98b80 1 --2- 172.21.15.39:0/1096870843 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562df5c29cb0 0x562df5d30a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:09.764 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.762+0000 7f594ca98b80 1 --2- 172.21.15.39:0/1096870843 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562df5baf450 0x562df5d30fe0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:09.764 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.762+0000 7f594ca98b80 1 -- 172.21.15.39:0/1096870843 >> 172.21.15.39:0/1096870843 conn(0x562df5bb2f20 msgr2=0x562df5d271d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:37:09.764 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.762+0000 7f594ca98b80 1 -- 172.21.15.39:0/1096870843 shutdown_connections 2024-05-09T05:37:09.764 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.762+0000 7f594ca98b80 1 -- 172.21.15.39:0/1096870843 wait complete. 2024-05-09T05:37:09.764 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.762+0000 7f594ca98b80 1 -- start start 2024-05-09T05:37:09.764 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.763+0000 7f594ca98b80 1 Processor -- start 2024-05-09T05:37:09.764 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.763+0000 7f594ca98b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562df5baf450 0x562df5d3a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:09.764 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.763+0000 7f594ca98b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562df5c29cb0 0x562df5d3a940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:09.764 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.763+0000 7f594ca98b80 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562df5d35190 0x562df5d3ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:09.764 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.763+0000 7f594ca98b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x562df5d35df0 con 0x562df5c29cb0 2024-05-09T05:37:09.764 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.763+0000 7f594ca98b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x562df5be9ad0 con 0x562df5baf450 2024-05-09T05:37:09.764 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.763+0000 7f594ca98b80 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x562df5d35f70 con 0x562df5d35190 2024-05-09T05:37:09.764 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.763+0000 7f594ca98b80 10 client.0 _ll_register_callbacks cb 0x562df5ac0670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T05:37:09.764 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.763+0000 7f5936ffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562df5c29cb0 0x562df5d3a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:09.765 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.763+0000 7f5936ffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562df5c29cb0 0x562df5d3a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45608/0 (socket says 172.21.15.39:45608) 2024-05-09T05:37:09.765 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.763+0000 7f5936ffd700 1 -- 172.21.15.39:0/376452778 learned_addr learned my addr 172.21.15.39:0/376452778 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:37:09.765 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.763+0000 7f59377fe700 1 --2- 172.21.15.39:0/376452778 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562df5baf450 0x562df5d3a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:09.765 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.763+0000 7f5937fff700 1 --2- 172.21.15.39:0/376452778 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562df5d35190 0x562df5d3ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:09.765 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.763+0000 7f5936ffd700 1 -- 172.21.15.39:0/376452778 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562df5d35190 msgr2=0x562df5d3ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:37:09.765 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.763+0000 7f5936ffd700 1 --2- 172.21.15.39:0/376452778 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562df5d35190 0x562df5d3ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:09.765 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.763+0000 7f5936ffd700 1 -- 172.21.15.39:0/376452778 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562df5baf450 msgr2=0x562df5d3a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:37:09.765 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.763+0000 7f5936ffd700 1 --2- 172.21.15.39:0/376452778 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562df5baf450 0x562df5d3a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:09.765 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.763+0000 7f5936ffd700 1 -- 172.21.15.39:0/376452778 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562df5aca440 con 0x562df5c29cb0 2024-05-09T05:37:09.765 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.763+0000 7f5937fff700 1 --2- 172.21.15.39:0/376452778 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562df5d35190 0x562df5d3ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T05:37:09.765 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.764+0000 7f5936ffd700 1 --2- 172.21.15.39:0/376452778 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562df5c29cb0 0x562df5d3a940 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f592c012040 tx=0x7f592c0ad3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4de651eb60d7fa server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:37:09.765 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.764+0000 7f5916ffd700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-05-09T05:37:09.765 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.764+0000 7f5916ffd700 1 -- 172.21.15.39:0/376452778 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f592c0c2070 con 0x562df5c29cb0 2024-05-09T05:37:09.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.764+0000 7f5916ffd700 1 -- 172.21.15.39:0/376452778 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f592c0b1d70 con 0x562df5c29cb0 2024-05-09T05:37:09.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.764+0000 7f594ca98b80 1 -- 172.21.15.39:0/376452778 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f592c0a9190 con 0x562df5c29cb0 2024-05-09T05:37:09.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.764+0000 7f5916ffd700 1 -- 172.21.15.39:0/376452778 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f592c020070 con 0x562df5c29cb0 2024-05-09T05:37:09.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.764+0000 7f594ca98b80 10 client.14994 fetch_fsmap learned FSMap version 24 2024-05-09T05:37:09.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.764+0000 7f594ca98b80 1 -- 172.21.15.39:0/376452778 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x562df5d47ca0 con 0x562df5c29cb0 2024-05-09T05:37:09.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.764+0000 7f5916ffd700 1 -- 172.21.15.39:0/376452778 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f592c0a9190 con 0x562df5c29cb0 2024-05-09T05:37:09.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.764+0000 7f5916ffd700 1 -- 172.21.15.39:0/376452778 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f592c0a83f0 con 0x562df5c29cb0 2024-05-09T05:37:09.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.764+0000 7f594ca98b80 10 client.14994 fetch_fsmap finished waiting for FSMap version 24 2024-05-09T05:37:09.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.764+0000 7f594ca98b80 10 client.14994 resolve_mds: resolved name 'i' to daemon mds.i 2024-05-09T05:37:09.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.764+0000 7f594ca98b80 20 client.14994 populate_metadata read hostname 'smithi039' 2024-05-09T05:37:09.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.764+0000 7f594ca98b80 1 --2- 172.21.15.39:0/376452778 >> [v2:172.21.15.100:6838/1395178742,v1:172.21.15.100:6839/1395178742] conn(0x562df5d49ed0 0x562df5d4b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:09.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.764+0000 7f594ca98b80 4 client.14994 mds_command: new command op to 24502 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T05:37:09.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.765+0000 7f594ca98b80 1 -- 172.21.15.39:0/376452778 --> [v2:172.21.15.100:6838/1395178742,v1:172.21.15.100:6839/1395178742] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562df5c5ca30 con 0x562df5d49ed0 2024-05-09T05:37:09.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.765+0000 7f59377fe700 1 --2- 172.21.15.39:0/376452778 >> [v2:172.21.15.100:6838/1395178742,v1:172.21.15.100:6839/1395178742] conn(0x562df5d49ed0 0x562df5d4b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:09.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.765+0000 7f5916ffd700 10 client.14994 ms_handle_connect on v2:172.21.15.100:6838/1395178742 2024-05-09T05:37:09.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.765+0000 7f59377fe700 1 --2- 172.21.15.39:0/376452778 >> [v2:172.21.15.100:6838/1395178742,v1:172.21.15.100:6839/1395178742] conn(0x562df5d49ed0 0x562df5d4b2d0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=53386e106ea39e3b server_cookie=ba291768d6dfd57 in_seq=0 out_seq=0 2024-05-09T05:37:09.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.766+0000 7f5916ffd700 1 -- 172.21.15.39:0/376452778 <== mds.1 v2:172.21.15.100:6838/1395178742 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x562df5c5ca30 con 0x562df5d49ed0 2024-05-09T05:37:09.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.766+0000 7f5916ffd700 10 client.14994 handle_command_reply: tid=0 2024-05-09T05:37:09.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.766+0000 7f594ca98b80 1 client.14994 shutdown 2024-05-09T05:37:09.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.766+0000 7f594ca98b80 1 -- 172.21.15.39:0/376452778 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562df5c29cb0 msgr2=0x562df5d3a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:09.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.766+0000 7f594ca98b80 1 --2- 172.21.15.39:0/376452778 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562df5c29cb0 0x562df5d3a940 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f592c012040 tx=0x7f592c0ad3d0 comp rx=0 tx=0).stop 2024-05-09T05:37:09.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.767+0000 7f594ca98b80 1 -- 172.21.15.39:0/376452778 shutdown_connections 2024-05-09T05:37:09.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.767+0000 7f594ca98b80 1 --2- 172.21.15.39:0/376452778 >> [v2:172.21.15.100:6838/1395178742,v1:172.21.15.100:6839/1395178742] conn(0x562df5d49ed0 0x562df5d4b2d0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:09.768 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.767+0000 7f594ca98b80 1 --2- 172.21.15.39:0/376452778 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562df5d35190 0x562df5d3ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:09.768 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.767+0000 7f594ca98b80 1 --2- 172.21.15.39:0/376452778 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562df5baf450 0x562df5d3a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:09.768 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.767+0000 7f5916ffd700 0 client.14994 ms_handle_reset on v2:172.21.15.100:6838/1395178742 2024-05-09T05:37:09.768 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.767+0000 7f594ca98b80 1 --2- 172.21.15.39:0/376452778 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562df5c29cb0 0x562df5d3a940 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:09.768 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.767+0000 7f594ca98b80 1 -- 172.21.15.39:0/376452778 >> 172.21.15.39:0/376452778 conn(0x562df5bb2f20 msgr2=0x562df5d20fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:37:09.768 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.767+0000 7f594ca98b80 1 -- 172.21.15.39:0/376452778 shutdown_connections 2024-05-09T05:37:09.768 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.767+0000 7f594ca98b80 1 -- 172.21.15.39:0/376452778 wait complete. 2024-05-09T05:37:09.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.767+0000 7f594ca98b80 20 client.14994 trim_cache size 0 max 16384 2024-05-09T05:37:09.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.788+0000 7f594ca98b80 1 Processor -- start 2024-05-09T05:37:09.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.788+0000 7f594ca98b80 1 -- start start 2024-05-09T05:37:09.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.788+0000 7f594ca98b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562df5baf450 0x562df5d219d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:09.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.788+0000 7f594ca98b80 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562df5c29cb0 0x562df5d3acc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:09.786 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.788+0000 7f594ca98b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562df5d35190 0x562df5d2b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:09.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.788+0000 7f594ca98b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x562df5d49680 con 0x562df5d35190 2024-05-09T05:37:09.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.788+0000 7f594ca98b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x562df5d49d50 con 0x562df5baf450 2024-05-09T05:37:09.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.788+0000 7f594ca98b80 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x562df5d4a3b0 con 0x562df5c29cb0 2024-05-09T05:37:09.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.788+0000 7f5937fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562df5d35190 0x562df5d2b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:09.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.788+0000 7f5937fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562df5d35190 0x562df5d2b3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45618/0 (socket says 172.21.15.39:45618) 2024-05-09T05:37:09.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.788+0000 7f5937fff700 1 -- 172.21.15.39:0/1511861256 learned_addr learned my addr 172.21.15.39:0/1511861256 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:37:09.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.788+0000 7f5936ffd700 1 --2- 172.21.15.39:0/1511861256 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562df5c29cb0 0x562df5d3acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:09.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.789+0000 7f59377fe700 1 --2- 172.21.15.39:0/1511861256 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562df5baf450 0x562df5d219d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:09.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.789+0000 7f5937fff700 1 -- 172.21.15.39:0/1511861256 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562df5c29cb0 msgr2=0x562df5d3acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:37:09.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.789+0000 7f5937fff700 1 --2- 172.21.15.39:0/1511861256 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562df5c29cb0 0x562df5d3acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:09.788 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.789+0000 7f5937fff700 1 -- 172.21.15.39:0/1511861256 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562df5baf450 msgr2=0x562df5d219d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:37:09.788 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.789+0000 7f5937fff700 1 --2- 172.21.15.39:0/1511861256 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562df5baf450 0x562df5d219d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:09.788 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.789+0000 7f5937fff700 1 -- 172.21.15.39:0/1511861256 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562df5d23980 con 0x562df5d35190 2024-05-09T05:37:09.788 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.789+0000 7f59377fe700 1 --2- 172.21.15.39:0/1511861256 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562df5baf450 0x562df5d219d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T05:37:09.788 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.789+0000 7f5937fff700 1 --2- 172.21.15.39:0/1511861256 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562df5d35190 0x562df5d2b3a0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f5930015000 tx=0x7f5930005b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95ecbcc07b077679 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:37:09.788 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.789+0000 7f591d7fa700 1 -- 172.21.15.39:0/1511861256 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5930003c00 con 0x562df5d35190 2024-05-09T05:37:09.788 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.789+0000 7f591d7fa700 1 -- 172.21.15.39:0/1511861256 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5930003da0 con 0x562df5d35190 2024-05-09T05:37:09.788 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.789+0000 7f591d7fa700 1 -- 172.21.15.39:0/1511861256 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59300057b0 con 0x562df5d35190 2024-05-09T05:37:09.788 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.790+0000 7f594ca98b80 1 -- 172.21.15.39:0/1511861256 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562df5d35190 msgr2=0x562df5d2b3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:09.788 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.790+0000 7f594ca98b80 1 --2- 172.21.15.39:0/1511861256 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562df5d35190 0x562df5d2b3a0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f5930015000 tx=0x7f5930005b20 comp rx=0 tx=0).stop 2024-05-09T05:37:09.788 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.790+0000 7f594ca98b80 1 -- 172.21.15.39:0/1511861256 shutdown_connections 2024-05-09T05:37:09.788 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.790+0000 7f594ca98b80 1 --2- 172.21.15.39:0/1511861256 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562df5d35190 0x562df5d2b3a0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:09.788 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.790+0000 7f594ca98b80 1 --2- 172.21.15.39:0/1511861256 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562df5baf450 0x562df5d219d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:09.789 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.790+0000 7f594ca98b80 1 --2- 172.21.15.39:0/1511861256 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562df5c29cb0 0x562df5d3acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:09.789 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.790+0000 7f594ca98b80 1 -- 172.21.15.39:0/1511861256 >> 172.21.15.39:0/1511861256 conn(0x562df5bb2f20 msgr2=0x562df5d39360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:37:09.789 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.790+0000 7f594ca98b80 1 -- 172.21.15.39:0/1511861256 shutdown_connections 2024-05-09T05:37:09.789 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.790+0000 7f594ca98b80 1 -- 172.21.15.39:0/1511861256 wait complete. 2024-05-09T05:37:09.789 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.790+0000 7f594ca98b80 1 -- start start 2024-05-09T05:37:09.789 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.790+0000 7f594ca98b80 1 Processor -- start 2024-05-09T05:37:09.789 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.791+0000 7f594ca98b80 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562df5baf450 0x562df5d54750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:09.789 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.791+0000 7f594ca98b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562df5c29cb0 0x562df5d54c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:09.789 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.791+0000 7f594ca98b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562df5d35190 0x562df5d4f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:09.789 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.791+0000 7f594ca98b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x562df5d4b150 con 0x562df5c29cb0 2024-05-09T05:37:09.789 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.791+0000 7f594ca98b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x562df5d4aa80 con 0x562df5d35190 2024-05-09T05:37:09.789 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.791+0000 7f594ca98b80 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x562df5d4b820 con 0x562df5baf450 2024-05-09T05:37:09.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.791+0000 7f594ca98b80 10 client.0 _ll_register_callbacks cb 0x562df5ac0670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T05:37:09.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.791+0000 7f5936ffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562df5c29cb0 0x562df5d54c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:09.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.791+0000 7f5936ffd700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562df5c29cb0 0x562df5d54c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45628/0 (socket says 172.21.15.39:45628) 2024-05-09T05:37:09.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.791+0000 7f5936ffd700 1 -- 172.21.15.39:0/2501454148 learned_addr learned my addr 172.21.15.39:0/2501454148 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:37:09.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.791+0000 7f59377fe700 1 --2- 172.21.15.39:0/2501454148 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562df5baf450 0x562df5d54750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:09.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.791+0000 7f5937fff700 1 --2- 172.21.15.39:0/2501454148 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562df5d35190 0x562df5d4f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:09.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.791+0000 7f5936ffd700 1 -- 172.21.15.39:0/2501454148 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562df5baf450 msgr2=0x562df5d54750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:37:09.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.791+0000 7f5936ffd700 1 --2- 172.21.15.39:0/2501454148 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562df5baf450 0x562df5d54750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:09.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.791+0000 7f5936ffd700 1 -- 172.21.15.39:0/2501454148 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562df5d35190 msgr2=0x562df5d4f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:37:09.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.791+0000 7f5936ffd700 1 --2- 172.21.15.39:0/2501454148 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562df5d35190 0x562df5d4f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:09.790 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.791+0000 7f5936ffd700 1 -- 172.21.15.39:0/2501454148 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562df5d4fc40 con 0x562df5c29cb0 2024-05-09T05:37:09.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.791+0000 7f5937fff700 1 --2- 172.21.15.39:0/2501454148 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562df5d35190 0x562df5d4f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:37:09.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.791+0000 7f5936ffd700 1 --2- 172.21.15.39:0/2501454148 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562df5c29cb0 0x562df5d54c90 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f592c0a8890 tx=0x7f592c010900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a950bb314122ea07 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:37:09.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.791+0000 7f5916ffd700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-05-09T05:37:09.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.792+0000 7f5916ffd700 1 -- 172.21.15.39:0/2501454148 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f592c0c2070 con 0x562df5c29cb0 2024-05-09T05:37:09.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.792+0000 7f5916ffd700 1 -- 172.21.15.39:0/2501454148 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f592c00f890 con 0x562df5c29cb0 2024-05-09T05:37:09.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.792+0000 7f594ca98b80 1 -- 172.21.15.39:0/2501454148 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5930003da0 con 0x562df5c29cb0 2024-05-09T05:37:09.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.792+0000 7f5916ffd700 1 -- 172.21.15.39:0/2501454148 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f592c0a9190 con 0x562df5c29cb0 2024-05-09T05:37:09.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.792+0000 7f594ca98b80 10 client.15000 fetch_fsmap learned FSMap version 24 2024-05-09T05:37:09.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.792+0000 7f594ca98b80 1 -- 172.21.15.39:0/2501454148 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x562df5db5900 con 0x562df5c29cb0 2024-05-09T05:37:09.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.792+0000 7f5916ffd700 1 -- 172.21.15.39:0/2501454148 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5930003da0 con 0x562df5c29cb0 2024-05-09T05:37:09.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.792+0000 7f5916ffd700 1 -- 172.21.15.39:0/2501454148 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f592c0a7e60 con 0x562df5c29cb0 2024-05-09T05:37:09.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.792+0000 7f594ca98b80 10 client.15000 fetch_fsmap finished waiting for FSMap version 24 2024-05-09T05:37:09.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.792+0000 7f594ca98b80 10 client.15000 resolve_mds: resolved name 'i' to daemon mds.i 2024-05-09T05:37:09.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.792+0000 7f594ca98b80 20 client.15000 populate_metadata read hostname 'smithi039' 2024-05-09T05:37:09.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.792+0000 7f594ca98b80 1 --2- 172.21.15.39:0/2501454148 >> [v2:172.21.15.100:6838/1395178742,v1:172.21.15.100:6839/1395178742] conn(0x562df5db7b30 0x562df5db8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:09.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.792+0000 7f594ca98b80 4 client.15000 mds_command: new command op to 24502 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-09T05:37:09.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.792+0000 7f594ca98b80 1 -- 172.21.15.39:0/2501454148 --> [v2:172.21.15.100:6838/1395178742,v1:172.21.15.100:6839/1395178742] -- command(tid 0: {"prefix": "status"}) -- 0x562df5c56ad0 con 0x562df5db7b30 2024-05-09T05:37:09.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.793+0000 7f59377fe700 1 --2- 172.21.15.39:0/2501454148 >> [v2:172.21.15.100:6838/1395178742,v1:172.21.15.100:6839/1395178742] conn(0x562df5db7b30 0x562df5db8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:09.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.793+0000 7f5916ffd700 10 client.15000 ms_handle_connect on v2:172.21.15.100:6838/1395178742 2024-05-09T05:37:09.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.793+0000 7f59377fe700 1 --2- 172.21.15.39:0/2501454148 >> [v2:172.21.15.100:6838/1395178742,v1:172.21.15.100:6839/1395178742] conn(0x562df5db7b30 0x562df5db8fa0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3e798c69c1fd9806 server_cookie=7b64e116ca599c77 in_seq=0 out_seq=0 2024-05-09T05:37:09.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.793+0000 7f5916ffd700 1 -- 172.21.15.39:0/2501454148 <== mds.1 v2:172.21.15.100:6838/1395178742 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x562df5c56ad0 con 0x562df5db7b30 2024-05-09T05:37:09.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.793+0000 7f5916ffd700 10 client.15000 handle_command_reply: tid=0 2024-05-09T05:37:09.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.793+0000 7f594ca98b80 1 client.15000 shutdown 2024-05-09T05:37:09.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.793+0000 7f594ca98b80 1 -- 172.21.15.39:0/2501454148 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562df5c29cb0 msgr2=0x562df5d54c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:09.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.793+0000 7f594ca98b80 1 --2- 172.21.15.39:0/2501454148 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562df5c29cb0 0x562df5d54c90 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f592c0a8890 tx=0x7f592c010900 comp rx=0 tx=0).stop 2024-05-09T05:37:09.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.793+0000 7f594ca98b80 1 -- 172.21.15.39:0/2501454148 shutdown_connections 2024-05-09T05:37:09.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.793+0000 7f594ca98b80 1 --2- 172.21.15.39:0/2501454148 >> [v2:172.21.15.100:6838/1395178742,v1:172.21.15.100:6839/1395178742] conn(0x562df5db7b30 0x562df5db8fa0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:09.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.793+0000 7f594ca98b80 1 --2- 172.21.15.39:0/2501454148 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562df5d35190 0x562df5d4f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:09.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.793+0000 7f594ca98b80 1 --2- 172.21.15.39:0/2501454148 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562df5baf450 0x562df5d54750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:09.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.793+0000 7f594ca98b80 1 --2- 172.21.15.39:0/2501454148 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x562df5c29cb0 0x562df5d54c90 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:09.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.793+0000 7f594ca98b80 1 -- 172.21.15.39:0/2501454148 >> 172.21.15.39:0/2501454148 conn(0x562df5bb2f20 msgr2=0x562df5d30a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:37:09.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.793+0000 7f5916ffd700 0 client.15000 ms_handle_reset on v2:172.21.15.100:6838/1395178742 2024-05-09T05:37:09.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.794+0000 7f594ca98b80 1 -- 172.21.15.39:0/2501454148 shutdown_connections 2024-05-09T05:37:09.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.794+0000 7f594ca98b80 1 -- 172.21.15.39:0/2501454148 wait complete. 2024-05-09T05:37:09.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.794+0000 7f594ca98b80 20 client.15000 trim_cache size 0 max 16384 2024-05-09T05:37:09.795 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-05-09T05:37:09.795 INFO:teuthology.orchestra.run.smithi039.stdout: "cluster_fsid": "86d4cc60-0dc4-11ef-bc97-c7b262605968", 2024-05-09T05:37:09.795 INFO:teuthology.orchestra.run.smithi039.stdout: "whoami": 1, 2024-05-09T05:37:09.795 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 24502, 2024-05-09T05:37:09.795 INFO:teuthology.orchestra.run.smithi039.stdout: "want_state": "up:active", 2024-05-09T05:37:09.795 INFO:teuthology.orchestra.run.smithi039.stdout: "state": "up:active", 2024-05-09T05:37:09.795 INFO:teuthology.orchestra.run.smithi039.stdout: "fs_name": "cephfs", 2024-05-09T05:37:09.795 INFO:teuthology.orchestra.run.smithi039.stdout: "rank_uptime": 120.38632678899999, 2024-05-09T05:37:09.795 INFO:teuthology.orchestra.run.smithi039.stdout: "mdsmap_epoch": 24, 2024-05-09T05:37:09.795 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_epoch": 83, 2024-05-09T05:37:09.795 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_epoch_barrier": 81, 2024-05-09T05:37:09.795 INFO:teuthology.orchestra.run.smithi039.stdout: "uptime": 160.51825975200001 2024-05-09T05:37:09.796 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-05-09T05:37:09.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.794+0000 7f593e082700 1 -- 172.21.15.39:0/3778479100 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f59200b2900 msgr2=0x7f59200b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:09.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.794+0000 7f593e082700 1 --2- 172.21.15.39:0/3778479100 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f59200b2900 0x7f59200b4e10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5928005950 tx=0x7f592800a300 comp rx=0 tx=0).stop 2024-05-09T05:37:09.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.794+0000 7f593e082700 1 -- 172.21.15.39:0/3778479100 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5938108f00 msgr2=0x7f593819b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:09.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.794+0000 7f593e082700 1 --2- 172.21.15.39:0/3778479100 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5938108f00 0x7f593819b330 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f592c00d980 tx=0x7f592c00dc90 comp rx=0 tx=0).stop 2024-05-09T05:37:09.796 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.794+0000 7f593e082700 1 -- 172.21.15.39:0/3778479100 shutdown_connections 2024-05-09T05:37:09.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.794+0000 7f593e082700 1 --2- 172.21.15.39:0/3778479100 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f59200b2900 0x7f59200b4e10 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:09.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.794+0000 7f593e082700 1 --2- 172.21.15.39:0/3778479100 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5938109850 0x7f593819f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:09.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.794+0000 7f593e082700 1 --2- 172.21.15.39:0/3778479100 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f59381045d0 0x7f593819ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:09.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.794+0000 7f593e082700 1 --2- 172.21.15.39:0/3778479100 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5938108f00 0x7f593819b330 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:09.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.794+0000 7f593e082700 1 -- 172.21.15.39:0/3778479100 >> 172.21.15.39:0/3778479100 conn(0x7f59380ffea0 msgr2=0x7f5938108670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:37:09.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.795+0000 7f593e082700 1 -- 172.21.15.39:0/3778479100 shutdown_connections 2024-05-09T05:37:09.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:09.795+0000 7f593e082700 1 -- 172.21.15.39:0/3778479100 wait complete. 2024-05-09T05:37:10.489 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph tell mds.b status 2024-05-09T05:37:10.743 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T05:37:11.491 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:37:11 smithi039 ceph-mon[30439]: pgmap v364: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 341 B/s wr, 7 op/s 2024-05-09T05:37:11.546 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:37:11 smithi060 ceph-mon[34555]: pgmap v364: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 341 B/s wr, 7 op/s 2024-05-09T05:37:11.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:37:11 smithi100 ceph-mon[34353]: pgmap v364: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 341 B/s wr, 7 op/s 2024-05-09T05:37:12.340 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.346+0000 7f1e50d70700 1 -- 172.21.15.39:0/1865775081 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1e4c108f40 msgr2=0x7f1e4c109350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:12.340 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.346+0000 7f1e50d70700 1 --2- 172.21.15.39:0/1865775081 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1e4c108f40 0x7f1e4c109350 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c0099c0 tx=0x7f1e3c009cd0 comp rx=0 tx=0).stop 2024-05-09T05:37:12.340 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.346+0000 7f1e50d70700 1 -- 172.21.15.39:0/1865775081 shutdown_connections 2024-05-09T05:37:12.340 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.346+0000 7f1e50d70700 1 --2- 172.21.15.39:0/1865775081 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e4c109890 0x7f1e4c1111f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:12.340 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.346+0000 7f1e50d70700 1 --2- 172.21.15.39:0/1865775081 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e4c104610 0x7f1e4c104a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:12.340 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.346+0000 7f1e50d70700 1 --2- 172.21.15.39:0/1865775081 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1e4c108f40 0x7f1e4c109350 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:12.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.346+0000 7f1e50d70700 1 -- 172.21.15.39:0/1865775081 >> 172.21.15.39:0/1865775081 conn(0x7f1e4c07af70 msgr2=0x7f1e4c07b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:37:12.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.346+0000 7f1e50d70700 1 -- 172.21.15.39:0/1865775081 shutdown_connections 2024-05-09T05:37:12.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.346+0000 7f1e50d70700 1 -- 172.21.15.39:0/1865775081 wait complete. 2024-05-09T05:37:12.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.347+0000 7f1e50d70700 1 Processor -- start 2024-05-09T05:37:12.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.347+0000 7f1e50d70700 1 -- start start 2024-05-09T05:37:12.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.348+0000 7f1e50d70700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e4c104610 0x7f1e4c19aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:12.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.348+0000 7f1e50d70700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e4c108f40 0x7f1e4c19b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:12.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.348+0000 7f1e50d70700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1e4c109890 0x7f1e4c19f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:12.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.348+0000 7f1e50d70700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f1e4c1144f0 con 0x7f1e4c109890 2024-05-09T05:37:12.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.348+0000 7f1e50d70700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f1e4c114370 con 0x7f1e4c108f40 2024-05-09T05:37:12.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.348+0000 7f1e50d70700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1e4c114670 con 0x7f1e4c104610 2024-05-09T05:37:12.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.348+0000 7f1e4ad9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1e4c109890 0x7f1e4c19f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:12.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.348+0000 7f1e4ad9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1e4c109890 0x7f1e4c19f6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45660/0 (socket says 172.21.15.39:45660) 2024-05-09T05:37:12.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.348+0000 7f1e4ad9d700 1 -- 172.21.15.39:0/3005618177 learned_addr learned my addr 172.21.15.39:0/3005618177 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:37:12.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.348+0000 7f1e4a59c700 1 --2- 172.21.15.39:0/3005618177 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e4c104610 0x7f1e4c19aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:12.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.348+0000 7f1e49d9b700 1 --2- 172.21.15.39:0/3005618177 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e4c108f40 0x7f1e4c19b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:12.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.348+0000 7f1e4ad9d700 1 -- 172.21.15.39:0/3005618177 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e4c104610 msgr2=0x7f1e4c19aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:12.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.348+0000 7f1e4ad9d700 1 --2- 172.21.15.39:0/3005618177 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e4c104610 0x7f1e4c19aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:12.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.348+0000 7f1e4ad9d700 1 -- 172.21.15.39:0/3005618177 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e4c108f40 msgr2=0x7f1e4c19b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:12.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.348+0000 7f1e4ad9d700 1 --2- 172.21.15.39:0/3005618177 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e4c108f40 0x7f1e4c19b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:12.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.348+0000 7f1e4ad9d700 1 -- 172.21.15.39:0/3005618177 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e4c19fd90 con 0x7f1e4c109890 2024-05-09T05:37:12.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.348+0000 7f1e4ad9d700 1 --2- 172.21.15.39:0/3005618177 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1e4c109890 0x7f1e4c19f6f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f1e44007ee0 tx=0x7f1e4400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:37:12.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.349+0000 7f1e437fe700 1 -- 172.21.15.39:0/3005618177 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e44004bb0 con 0x7f1e4c109890 2024-05-09T05:37:12.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.349+0000 7f1e437fe700 1 -- 172.21.15.39:0/3005618177 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1e44004d50 con 0x7f1e4c109890 2024-05-09T05:37:12.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.349+0000 7f1e50d70700 1 -- 172.21.15.39:0/3005618177 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e4c1a0080 con 0x7f1e4c109890 2024-05-09T05:37:12.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.349+0000 7f1e437fe700 1 -- 172.21.15.39:0/3005618177 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e44005920 con 0x7f1e4c109890 2024-05-09T05:37:12.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.349+0000 7f1e50d70700 1 -- 172.21.15.39:0/3005618177 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e4c1a79a0 con 0x7f1e4c109890 2024-05-09T05:37:12.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.351+0000 7f1e437fe700 1 -- 172.21.15.39:0/3005618177 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f1e4401a020 con 0x7f1e4c109890 2024-05-09T05:37:12.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.352+0000 7f1e437fe700 1 --2- 172.21.15.39:0/3005618177 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f1e380b2900 0x7f1e380b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:12.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.352+0000 7f1e4a59c700 1 --2- 172.21.15.39:0/3005618177 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f1e380b2900 0x7f1e380b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:12.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.352+0000 7f1e437fe700 1 -- 172.21.15.39:0/3005618177 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f1e440e1810 con 0x7f1e4c109890 2024-05-09T05:37:12.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.352+0000 7f1e5f786b80 1 Processor -- start 2024-05-09T05:37:12.348 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.353+0000 7f1e5f786b80 1 -- start start 2024-05-09T05:37:12.348 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.353+0000 7f1e4a59c700 1 --2- 172.21.15.39:0/3005618177 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f1e380b2900 0x7f1e380b4e10 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1e34009c60 tx=0x7f1e34009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:37:12.348 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.353+0000 7f1e5f786b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555f47fcdcb0 0x555f480d4a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:12.348 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.353+0000 7f1e5f786b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555f47f53450 0x555f480d4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:12.348 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.353+0000 7f1e5f786b80 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f480d9190 0x555f480d95a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:12.348 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.353+0000 7f1e5f786b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x555f47ff3050 con 0x555f47f53450 2024-05-09T05:37:12.348 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.353+0000 7f1e5f786b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x555f47f98950 con 0x555f47fcdcb0 2024-05-09T05:37:12.348 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.353+0000 7f1e5f786b80 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x555f47fef010 con 0x555f480d9190 2024-05-09T05:37:12.348 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.353+0000 7f1e49d9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555f47f53450 0x555f480d4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:12.348 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.353+0000 7f1e49d9b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555f47f53450 0x555f480d4fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45672/0 (socket says 172.21.15.39:45672) 2024-05-09T05:37:12.348 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.353+0000 7f1e49d9b700 1 -- 172.21.15.39:0/3288858696 learned_addr learned my addr 172.21.15.39:0/3288858696 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:37:12.348 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.353+0000 7f1e4a59c700 1 --2- 172.21.15.39:0/3288858696 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555f47fcdcb0 0x555f480d4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:12.348 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.353+0000 7f1e4ad9d700 1 --2- 172.21.15.39:0/3288858696 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f480d9190 0x555f480d95a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:12.348 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.353+0000 7f1e49d9b700 1 -- 172.21.15.39:0/3288858696 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f480d9190 msgr2=0x555f480d95a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:37:12.349 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.353+0000 7f1e49d9b700 1 --2- 172.21.15.39:0/3288858696 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f480d9190 0x555f480d95a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:12.349 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.353+0000 7f1e49d9b700 1 -- 172.21.15.39:0/3288858696 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555f47fcdcb0 msgr2=0x555f480d4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:37:12.349 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.353+0000 7f1e49d9b700 1 --2- 172.21.15.39:0/3288858696 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555f47fcdcb0 0x555f480d4a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:12.349 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.353+0000 7f1e49d9b700 1 -- 172.21.15.39:0/3288858696 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f47f894b0 con 0x555f47f53450 2024-05-09T05:37:12.349 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.354+0000 7f1e4a59c700 1 --2- 172.21.15.39:0/3288858696 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555f47fcdcb0 0x555f480d4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T05:37:12.349 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.354+0000 7f1e4ad9d700 1 --2- 172.21.15.39:0/3288858696 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f480d9190 0x555f480d95a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:37:12.349 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.354+0000 7f1e49d9b700 1 --2- 172.21.15.39:0/3288858696 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555f47f53450 0x555f480d4fe0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c0099c0 tx=0x7f1e3c005040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75da9a0fee0879c2 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:37:12.349 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.354+0000 7f1e40ff9700 1 -- 172.21.15.39:0/3288858696 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e3c027070 con 0x555f47f53450 2024-05-09T05:37:12.349 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.354+0000 7f1e40ff9700 1 -- 172.21.15.39:0/3288858696 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1e3c0037c0 con 0x555f47f53450 2024-05-09T05:37:12.349 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.354+0000 7f1e40ff9700 1 -- 172.21.15.39:0/3288858696 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e3c00b9f0 con 0x555f47f53450 2024-05-09T05:37:12.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.355+0000 7f1e5f786b80 1 -- 172.21.15.39:0/3288858696 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555f47f53450 msgr2=0x555f480d4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:12.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.355+0000 7f1e5f786b80 1 --2- 172.21.15.39:0/3288858696 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555f47f53450 0x555f480d4fe0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c0099c0 tx=0x7f1e3c005040 comp rx=0 tx=0).stop 2024-05-09T05:37:12.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.355+0000 7f1e5f786b80 1 -- 172.21.15.39:0/3288858696 shutdown_connections 2024-05-09T05:37:12.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.355+0000 7f1e5f786b80 1 --2- 172.21.15.39:0/3288858696 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f480d9190 0x555f480d95a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:12.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.355+0000 7f1e5f786b80 1 --2- 172.21.15.39:0/3288858696 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555f47fcdcb0 0x555f480d4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:12.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.355+0000 7f1e5f786b80 1 --2- 172.21.15.39:0/3288858696 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555f47f53450 0x555f480d4fe0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:12.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.355+0000 7f1e5f786b80 1 -- 172.21.15.39:0/3288858696 >> 172.21.15.39:0/3288858696 conn(0x555f47f56f20 msgr2=0x555f480cb1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:37:12.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.355+0000 7f1e5f786b80 1 -- 172.21.15.39:0/3288858696 shutdown_connections 2024-05-09T05:37:12.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.355+0000 7f1e5f786b80 1 -- 172.21.15.39:0/3288858696 wait complete. 2024-05-09T05:37:12.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.355+0000 7f1e5f786b80 1 -- start start 2024-05-09T05:37:12.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.356+0000 7f1e5f786b80 1 Processor -- start 2024-05-09T05:37:12.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.356+0000 7f1e5f786b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555f47f53450 0x555f480de370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:12.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.356+0000 7f1e5f786b80 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f47fcdcb0 0x555f480de8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:12.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.356+0000 7f1e5f786b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555f480d9190 0x555f480dedf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:12.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.356+0000 7f1e5f786b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x555f480d9e50 con 0x555f480d9190 2024-05-09T05:37:12.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.356+0000 7f1e5f786b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x555f47f8dad0 con 0x555f47f53450 2024-05-09T05:37:12.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.356+0000 7f1e5f786b80 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x555f480d9fd0 con 0x555f47fcdcb0 2024-05-09T05:37:12.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.356+0000 7f1e5f786b80 10 client.0 _ll_register_callbacks cb 0x555f47e64670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T05:37:12.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.356+0000 7f1e4ad9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555f480d9190 0x555f480dedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:12.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.356+0000 7f1e4ad9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555f480d9190 0x555f480dedf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45678/0 (socket says 172.21.15.39:45678) 2024-05-09T05:37:12.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.356+0000 7f1e4ad9d700 1 -- 172.21.15.39:0/814405050 learned_addr learned my addr 172.21.15.39:0/814405050 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:37:12.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.356+0000 7f1e4a59c700 1 --2- 172.21.15.39:0/814405050 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555f47f53450 0x555f480de370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:12.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.356+0000 7f1e49d9b700 1 --2- 172.21.15.39:0/814405050 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f47fcdcb0 0x555f480de8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:12.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.356+0000 7f1e4ad9d700 1 -- 172.21.15.39:0/814405050 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f47fcdcb0 msgr2=0x555f480de8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:37:12.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.356+0000 7f1e4ad9d700 1 --2- 172.21.15.39:0/814405050 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f47fcdcb0 0x555f480de8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:12.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.356+0000 7f1e4ad9d700 1 -- 172.21.15.39:0/814405050 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555f47f53450 msgr2=0x555f480de370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:37:12.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.356+0000 7f1e4ad9d700 1 --2- 172.21.15.39:0/814405050 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555f47f53450 0x555f480de370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:12.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.356+0000 7f1e4ad9d700 1 -- 172.21.15.39:0/814405050 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f47e6e440 con 0x555f480d9190 2024-05-09T05:37:12.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.356+0000 7f1e4a59c700 1 --2- 172.21.15.39:0/814405050 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555f47f53450 0x555f480de370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T05:37:12.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.357+0000 7f1e4ad9d700 1 --2- 172.21.15.39:0/814405050 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555f480d9190 0x555f480dedf0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f1e440a8b40 tx=0x7f1e44005250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5986b7e2d10bb30c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:37:12.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.357+0000 7f1e31ffb700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-05-09T05:37:12.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.357+0000 7f1e31ffb700 1 -- 172.21.15.39:0/814405050 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e440ab070 con 0x555f480d9190 2024-05-09T05:37:12.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.357+0000 7f1e31ffb700 1 -- 172.21.15.39:0/814405050 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f1e440c3450 con 0x555f480d9190 2024-05-09T05:37:12.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.357+0000 7f1e5f786b80 1 -- 172.21.15.39:0/814405050 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1e3c0037c0 con 0x555f480d9190 2024-05-09T05:37:12.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.357+0000 7f1e31ffb700 1 -- 172.21.15.39:0/814405050 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f1e440c8050 con 0x555f480d9190 2024-05-09T05:37:12.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.357+0000 7f1e5f786b80 10 client.15012 fetch_fsmap learned FSMap version 24 2024-05-09T05:37:12.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.357+0000 7f1e5f786b80 1 -- 172.21.15.39:0/814405050 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x555f480ebca0 con 0x555f480d9190 2024-05-09T05:37:12.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.357+0000 7f1e31ffb700 1 -- 172.21.15.39:0/814405050 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1e3c0037c0 con 0x555f480d9190 2024-05-09T05:37:12.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.357+0000 7f1e31ffb700 1 -- 172.21.15.39:0/814405050 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f1e440c0070 con 0x555f480d9190 2024-05-09T05:37:12.356 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.357+0000 7f1e5f786b80 10 client.15012 fetch_fsmap finished waiting for FSMap version 24 2024-05-09T05:37:12.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.358+0000 7f1e5f786b80 10 client.15012 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-09T05:37:12.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.358+0000 7f1e5f786b80 20 client.15012 populate_metadata read hostname 'smithi039' 2024-05-09T05:37:12.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.358+0000 7f1e5f786b80 1 --2- 172.21.15.39:0/814405050 >> [v2:172.21.15.60:6838/1418956667,v1:172.21.15.60:6839/1418956667] conn(0x555f480ee230 0x555f480ef6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:12.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.358+0000 7f1e5f786b80 4 client.15012 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T05:37:12.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.358+0000 7f1e5f786b80 1 -- 172.21.15.39:0/814405050 --> [v2:172.21.15.60:6838/1418956667,v1:172.21.15.60:6839/1418956667] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555f48000a30 con 0x555f480ee230 2024-05-09T05:37:12.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.358+0000 7f1e4a59c700 1 --2- 172.21.15.39:0/814405050 >> [v2:172.21.15.60:6838/1418956667,v1:172.21.15.60:6839/1418956667] conn(0x555f480ee230 0x555f480ef6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:12.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.358+0000 7f1e4a59c700 1 --2- 172.21.15.39:0/814405050 >> [v2:172.21.15.60:6838/1418956667,v1:172.21.15.60:6839/1418956667] conn(0x555f480ee230 0x555f480ef6a0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b32834195c4c292 server_cookie=1b2f9c6738cc89f5 in_seq=0 out_seq=0 2024-05-09T05:37:12.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.358+0000 7f1e31ffb700 10 client.15012 ms_handle_connect on v2:172.21.15.60:6838/1418956667 2024-05-09T05:37:12.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.359+0000 7f1e31ffb700 1 -- 172.21.15.39:0/814405050 <== mds.0 v2:172.21.15.60:6838/1418956667 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x555f48000a30 con 0x555f480ee230 2024-05-09T05:37:12.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.359+0000 7f1e31ffb700 10 client.15012 handle_command_reply: tid=0 2024-05-09T05:37:12.357 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.359+0000 7f1e5f786b80 1 client.15012 shutdown 2024-05-09T05:37:12.358 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.359+0000 7f1e5f786b80 1 -- 172.21.15.39:0/814405050 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555f480d9190 msgr2=0x555f480dedf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:12.358 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.359+0000 7f1e5f786b80 1 --2- 172.21.15.39:0/814405050 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555f480d9190 0x555f480dedf0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f1e440a8b40 tx=0x7f1e44005250 comp rx=0 tx=0).stop 2024-05-09T05:37:12.358 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.359+0000 7f1e5f786b80 1 -- 172.21.15.39:0/814405050 shutdown_connections 2024-05-09T05:37:12.358 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.359+0000 7f1e5f786b80 1 --2- 172.21.15.39:0/814405050 >> [v2:172.21.15.60:6838/1418956667,v1:172.21.15.60:6839/1418956667] conn(0x555f480ee230 0x555f480ef6a0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:12.358 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.359+0000 7f1e5f786b80 1 --2- 172.21.15.39:0/814405050 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555f480d9190 0x555f480dedf0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:12.358 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.359+0000 7f1e5f786b80 1 --2- 172.21.15.39:0/814405050 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555f47f53450 0x555f480de370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:12.358 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.359+0000 7f1e5f786b80 1 --2- 172.21.15.39:0/814405050 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f47fcdcb0 0x555f480de8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:12.358 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.359+0000 7f1e5f786b80 1 -- 172.21.15.39:0/814405050 >> 172.21.15.39:0/814405050 conn(0x555f47f56f20 msgr2=0x555f480c4fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:37:12.358 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.360+0000 7f1e31ffb700 0 client.15012 ms_handle_reset on v2:172.21.15.60:6838/1418956667 2024-05-09T05:37:12.358 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.360+0000 7f1e5f786b80 1 -- 172.21.15.39:0/814405050 shutdown_connections 2024-05-09T05:37:12.359 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.360+0000 7f1e5f786b80 1 -- 172.21.15.39:0/814405050 wait complete. 2024-05-09T05:37:12.359 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.360+0000 7f1e5f786b80 20 client.15012 trim_cache size 0 max 16384 2024-05-09T05:37:12.381 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.381+0000 7f1e5f786b80 1 Processor -- start 2024-05-09T05:37:12.381 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.381+0000 7f1e5f786b80 1 -- start start 2024-05-09T05:37:12.381 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.382+0000 7f1e5f786b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555f47f53450 0x555f480dec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:12.381 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.382+0000 7f1e5f786b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555f47fcdcb0 0x555f480dd370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:12.381 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.382+0000 7f1e5f786b80 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f480d9190 0x555f480f8b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:12.381 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.382+0000 7f1e5f786b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x555f480ed9e0 con 0x555f47f53450 2024-05-09T05:37:12.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.382+0000 7f1e5f786b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x555f480ee0b0 con 0x555f47fcdcb0 2024-05-09T05:37:12.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.382+0000 7f1e5f786b80 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x555f480ee780 con 0x555f480d9190 2024-05-09T05:37:12.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.382+0000 7f1e4a59c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555f47f53450 0x555f480dec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:12.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.382+0000 7f1e4a59c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555f47f53450 0x555f480dec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45690/0 (socket says 172.21.15.39:45690) 2024-05-09T05:37:12.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.382+0000 7f1e4a59c700 1 -- 172.21.15.39:0/3632042319 learned_addr learned my addr 172.21.15.39:0/3632042319 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:37:12.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.382+0000 7f1e4ad9d700 1 --2- 172.21.15.39:0/3632042319 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f480d9190 0x555f480f8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:12.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.382+0000 7f1e49d9b700 1 --2- 172.21.15.39:0/3632042319 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555f47fcdcb0 0x555f480dd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:12.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.382+0000 7f1e4a59c700 1 -- 172.21.15.39:0/3632042319 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f480d9190 msgr2=0x555f480f8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:37:12.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.382+0000 7f1e4a59c700 1 --2- 172.21.15.39:0/3632042319 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f480d9190 0x555f480f8b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:12.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.382+0000 7f1e4a59c700 1 -- 172.21.15.39:0/3632042319 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555f47fcdcb0 msgr2=0x555f480dd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:37:12.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.382+0000 7f1e4a59c700 1 --2- 172.21.15.39:0/3632042319 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555f47fcdcb0 0x555f480dd370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:12.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.382+0000 7f1e4a59c700 1 -- 172.21.15.39:0/3632042319 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f480cbdc0 con 0x555f47f53450 2024-05-09T05:37:12.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.382+0000 7f1e49d9b700 1 --2- 172.21.15.39:0/3632042319 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555f47fcdcb0 0x555f480dd370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:37:12.383 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.382+0000 7f1e4ad9d700 1 --2- 172.21.15.39:0/3632042319 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f480d9190 0x555f480f8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T05:37:12.383 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.382+0000 7f1e4a59c700 1 --2- 172.21.15.39:0/3632042319 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555f47f53450 0x555f480dec30 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x555f480d5af0 tx=0x7f1e34014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=405f86e8fda74155 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:37:12.383 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.382+0000 7f1e33fff700 1 -- 172.21.15.39:0/3632042319 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e3402f070 con 0x555f47f53450 2024-05-09T05:37:12.383 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.382+0000 7f1e33fff700 1 -- 172.21.15.39:0/3632042319 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1e34029580 con 0x555f47f53450 2024-05-09T05:37:12.383 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.382+0000 7f1e33fff700 1 -- 172.21.15.39:0/3632042319 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e3401dab0 con 0x555f47f53450 2024-05-09T05:37:12.383 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.383+0000 7f1e5f786b80 1 -- 172.21.15.39:0/3632042319 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555f47f53450 msgr2=0x555f480dec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:12.383 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.383+0000 7f1e5f786b80 1 --2- 172.21.15.39:0/3632042319 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555f47f53450 0x555f480dec30 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x555f480d5af0 tx=0x7f1e34014000 comp rx=0 tx=0).stop 2024-05-09T05:37:12.383 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.383+0000 7f1e5f786b80 1 -- 172.21.15.39:0/3632042319 shutdown_connections 2024-05-09T05:37:12.383 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.383+0000 7f1e5f786b80 1 --2- 172.21.15.39:0/3632042319 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f480d9190 0x555f480f8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:12.383 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.383+0000 7f1e5f786b80 1 --2- 172.21.15.39:0/3632042319 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555f47f53450 0x555f480dec30 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:12.383 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.383+0000 7f1e5f786b80 1 --2- 172.21.15.39:0/3632042319 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555f47fcdcb0 0x555f480dd370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:12.383 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.383+0000 7f1e5f786b80 1 -- 172.21.15.39:0/3632042319 >> 172.21.15.39:0/3632042319 conn(0x555f47f56f20 msgr2=0x555f480dcc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:37:12.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.383+0000 7f1e5f786b80 1 -- 172.21.15.39:0/3632042319 shutdown_connections 2024-05-09T05:37:12.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.383+0000 7f1e5f786b80 1 -- 172.21.15.39:0/3632042319 wait complete. 2024-05-09T05:37:12.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.384+0000 7f1e5f786b80 1 -- start start 2024-05-09T05:37:12.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.384+0000 7f1e5f786b80 1 Processor -- start 2024-05-09T05:37:12.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.384+0000 7f1e5f786b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555f47f53450 0x555f480f8c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:12.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.384+0000 7f1e5f786b80 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f47fcdcb0 0x555f480f91c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:12.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.384+0000 7f1e5f786b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555f480d9190 0x555f480f3130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:12.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.384+0000 7f1e5f786b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x555f480ef520 con 0x555f480d9190 2024-05-09T05:37:12.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.384+0000 7f1e5f786b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x555f480eee50 con 0x555f47f53450 2024-05-09T05:37:12.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.384+0000 7f1e5f786b80 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x555f480efbf0 con 0x555f47fcdcb0 2024-05-09T05:37:12.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.384+0000 7f1e5f786b80 10 client.0 _ll_register_callbacks cb 0x555f47e64670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T05:37:12.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.384+0000 7f1e4ad9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555f480d9190 0x555f480f3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:12.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.384+0000 7f1e4ad9d700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555f480d9190 0x555f480f3130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45702/0 (socket says 172.21.15.39:45702) 2024-05-09T05:37:12.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.384+0000 7f1e4ad9d700 1 -- 172.21.15.39:0/3546718213 learned_addr learned my addr 172.21.15.39:0/3546718213 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:37:12.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.384+0000 7f1e49d9b700 1 --2- 172.21.15.39:0/3546718213 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f47fcdcb0 0x555f480f91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:12.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.384+0000 7f1e4a59c700 1 --2- 172.21.15.39:0/3546718213 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555f47f53450 0x555f480f8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:12.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.385+0000 7f1e4ad9d700 1 -- 172.21.15.39:0/3546718213 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f47fcdcb0 msgr2=0x555f480f91c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:37:12.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.385+0000 7f1e4ad9d700 1 --2- 172.21.15.39:0/3546718213 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f47fcdcb0 0x555f480f91c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:12.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.385+0000 7f1e4ad9d700 1 -- 172.21.15.39:0/3546718213 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555f47f53450 msgr2=0x555f480f8c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:37:12.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.385+0000 7f1e4ad9d700 1 --2- 172.21.15.39:0/3546718213 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555f47f53450 0x555f480f8c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:12.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.385+0000 7f1e4ad9d700 1 -- 172.21.15.39:0/3546718213 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f480c7980 con 0x555f480d9190 2024-05-09T05:37:12.386 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.385+0000 7f1e4ad9d700 1 --2- 172.21.15.39:0/3546718213 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555f480d9190 0x555f480f3130 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f1e44005370 tx=0x7f1e44004f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dc6da715d45a6b1 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:37:12.386 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.385+0000 7f1e31ffb700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-05-09T05:37:12.386 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.385+0000 7f1e31ffb700 1 -- 172.21.15.39:0/3546718213 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e440ab070 con 0x555f480d9190 2024-05-09T05:37:12.386 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.385+0000 7f1e31ffb700 1 -- 172.21.15.39:0/3546718213 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f1e440a82b0 con 0x555f480d9190 2024-05-09T05:37:12.386 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.385+0000 7f1e5f786b80 1 -- 172.21.15.39:0/3546718213 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1e34029580 con 0x555f480d9190 2024-05-09T05:37:12.386 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.385+0000 7f1e31ffb700 1 -- 172.21.15.39:0/3546718213 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f1e4400dd30 con 0x555f480d9190 2024-05-09T05:37:12.386 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.385+0000 7f1e5f786b80 10 client.15018 fetch_fsmap learned FSMap version 24 2024-05-09T05:37:12.386 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.385+0000 7f1e5f786b80 1 -- 172.21.15.39:0/3546718213 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x555f48159f50 con 0x555f480d9190 2024-05-09T05:37:12.386 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.385+0000 7f1e31ffb700 1 -- 172.21.15.39:0/3546718213 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1e34029580 con 0x555f480d9190 2024-05-09T05:37:12.386 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.385+0000 7f1e31ffb700 1 -- 172.21.15.39:0/3546718213 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f1e440c0040 con 0x555f480d9190 2024-05-09T05:37:12.386 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.386+0000 7f1e5f786b80 10 client.15018 fetch_fsmap finished waiting for FSMap version 24 2024-05-09T05:37:12.386 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.386+0000 7f1e5f786b80 10 client.15018 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-09T05:37:12.387 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.386+0000 7f1e5f786b80 20 client.15018 populate_metadata read hostname 'smithi039' 2024-05-09T05:37:12.387 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.386+0000 7f1e5f786b80 1 --2- 172.21.15.39:0/3546718213 >> [v2:172.21.15.60:6838/1418956667,v1:172.21.15.60:6839/1418956667] conn(0x555f4815c390 0x555f4815d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:12.387 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.386+0000 7f1e5f786b80 4 client.15018 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-09T05:37:12.387 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.386+0000 7f1e5f786b80 1 -- 172.21.15.39:0/3546718213 --> [v2:172.21.15.60:6838/1418956667,v1:172.21.15.60:6839/1418956667] -- command(tid 0: {"prefix": "status"}) -- 0x555f47ffaad0 con 0x555f4815c390 2024-05-09T05:37:12.387 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.386+0000 7f1e4a59c700 1 --2- 172.21.15.39:0/3546718213 >> [v2:172.21.15.60:6838/1418956667,v1:172.21.15.60:6839/1418956667] conn(0x555f4815c390 0x555f4815d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:12.387 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.386+0000 7f1e31ffb700 10 client.15018 ms_handle_connect on v2:172.21.15.60:6838/1418956667 2024-05-09T05:37:12.387 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.386+0000 7f1e4a59c700 1 --2- 172.21.15.39:0/3546718213 >> [v2:172.21.15.60:6838/1418956667,v1:172.21.15.60:6839/1418956667] conn(0x555f4815c390 0x555f4815d800 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f92265159daf4c0c server_cookie=ab542c3898f86ec3 in_seq=0 out_seq=0 2024-05-09T05:37:12.387 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.386+0000 7f1e31ffb700 1 -- 172.21.15.39:0/3546718213 <== mds.0 v2:172.21.15.60:6838/1418956667 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x555f47ffaad0 con 0x555f4815c390 2024-05-09T05:37:12.387 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.387+0000 7f1e31ffb700 10 client.15018 handle_command_reply: tid=0 2024-05-09T05:37:12.387 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.387+0000 7f1e5f786b80 1 client.15018 shutdown 2024-05-09T05:37:12.387 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.387+0000 7f1e5f786b80 1 -- 172.21.15.39:0/3546718213 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555f480d9190 msgr2=0x555f480f3130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:12.387 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.387+0000 7f1e5f786b80 1 --2- 172.21.15.39:0/3546718213 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555f480d9190 0x555f480f3130 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f1e44005370 tx=0x7f1e44004f80 comp rx=0 tx=0).stop 2024-05-09T05:37:12.387 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.387+0000 7f1e5f786b80 1 -- 172.21.15.39:0/3546718213 shutdown_connections 2024-05-09T05:37:12.387 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.387+0000 7f1e5f786b80 1 --2- 172.21.15.39:0/3546718213 >> [v2:172.21.15.60:6838/1418956667,v1:172.21.15.60:6839/1418956667] conn(0x555f4815c390 0x555f4815d800 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:12.387 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.387+0000 7f1e5f786b80 1 --2- 172.21.15.39:0/3546718213 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555f480d9190 0x555f480f3130 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:12.387 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.387+0000 7f1e5f786b80 1 --2- 172.21.15.39:0/3546718213 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555f47f53450 0x555f480f8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:12.388 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.387+0000 7f1e5f786b80 1 --2- 172.21.15.39:0/3546718213 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f47fcdcb0 0x555f480f91c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:12.388 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.387+0000 7f1e5f786b80 1 -- 172.21.15.39:0/3546718213 >> 172.21.15.39:0/3546718213 conn(0x555f47f56f20 msgr2=0x555f480dec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:37:12.388 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.387+0000 7f1e31ffb700 0 client.15018 ms_handle_reset on v2:172.21.15.60:6838/1418956667 2024-05-09T05:37:12.388 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.387+0000 7f1e5f786b80 1 -- 172.21.15.39:0/3546718213 shutdown_connections 2024-05-09T05:37:12.388 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.387+0000 7f1e5f786b80 1 -- 172.21.15.39:0/3546718213 wait complete. 2024-05-09T05:37:12.388 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.387+0000 7f1e5f786b80 20 client.15018 trim_cache size 0 max 16384 2024-05-09T05:37:12.388 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-05-09T05:37:12.389 INFO:teuthology.orchestra.run.smithi039.stdout: "cluster_fsid": "86d4cc60-0dc4-11ef-bc97-c7b262605968", 2024-05-09T05:37:12.389 INFO:teuthology.orchestra.run.smithi039.stdout: "whoami": 0, 2024-05-09T05:37:12.389 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 24509, 2024-05-09T05:37:12.389 INFO:teuthology.orchestra.run.smithi039.stdout: "want_state": "up:active", 2024-05-09T05:37:12.389 INFO:teuthology.orchestra.run.smithi039.stdout: "state": "up:active", 2024-05-09T05:37:12.389 INFO:teuthology.orchestra.run.smithi039.stdout: "fs_name": "cephfs", 2024-05-09T05:37:12.389 INFO:teuthology.orchestra.run.smithi039.stdout: "rank_uptime": 136.06469800100001, 2024-05-09T05:37:12.389 INFO:teuthology.orchestra.run.smithi039.stdout: "mdsmap_epoch": 24, 2024-05-09T05:37:12.389 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_epoch": 83, 2024-05-09T05:37:12.389 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_epoch_barrier": 81, 2024-05-09T05:37:12.389 INFO:teuthology.orchestra.run.smithi039.stdout: "uptime": 152.74095214299999 2024-05-09T05:37:12.389 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-05-09T05:37:12.390 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.387+0000 7f1e50d70700 1 -- 172.21.15.39:0/3005618177 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f1e380b2900 msgr2=0x7f1e380b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:12.390 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.387+0000 7f1e50d70700 1 --2- 172.21.15.39:0/3005618177 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f1e380b2900 0x7f1e380b4e10 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1e34009c60 tx=0x7f1e34009260 comp rx=0 tx=0).stop 2024-05-09T05:37:12.390 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.387+0000 7f1e50d70700 1 -- 172.21.15.39:0/3005618177 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1e4c109890 msgr2=0x7f1e4c19f6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:12.390 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.387+0000 7f1e50d70700 1 --2- 172.21.15.39:0/3005618177 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1e4c109890 0x7f1e4c19f6f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f1e44007ee0 tx=0x7f1e4400d3b0 comp rx=0 tx=0).stop 2024-05-09T05:37:12.390 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.388+0000 7f1e50d70700 1 -- 172.21.15.39:0/3005618177 shutdown_connections 2024-05-09T05:37:12.390 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.388+0000 7f1e50d70700 1 --2- 172.21.15.39:0/3005618177 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f1e380b2900 0x7f1e380b4e10 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:12.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.388+0000 7f1e50d70700 1 --2- 172.21.15.39:0/3005618177 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1e4c109890 0x7f1e4c19f6f0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:12.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.388+0000 7f1e50d70700 1 --2- 172.21.15.39:0/3005618177 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e4c104610 0x7f1e4c19aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:12.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.388+0000 7f1e50d70700 1 --2- 172.21.15.39:0/3005618177 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e4c108f40 0x7f1e4c19b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:12.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.388+0000 7f1e50d70700 1 -- 172.21.15.39:0/3005618177 >> 172.21.15.39:0/3005618177 conn(0x7f1e4c07af70 msgr2=0x7f1e4c101960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:37:12.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.388+0000 7f1e50d70700 1 -- 172.21.15.39:0/3005618177 shutdown_connections 2024-05-09T05:37:12.391 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:12.388+0000 7f1e50d70700 1 -- 172.21.15.39:0/3005618177 wait complete. 2024-05-09T05:37:13.228 INFO:tasks.cephadm:Setup complete, yielding 2024-05-09T05:37:13.229 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-05-09T05:37:13.239 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi039.front.sepia.ceph.com 2024-05-09T05:37:13.240 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- bash -c 'ceph orch status' 2024-05-09T05:37:13.491 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T05:37:13.546 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:37:13 smithi060 ceph-mon[34555]: pgmap v365: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 85 B/s wr, 5 op/s 2024-05-09T05:37:13.609 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:37:13 smithi039 ceph-mon[30439]: pgmap v365: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 85 B/s wr, 5 op/s 2024-05-09T05:37:13.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:37:13 smithi100 ceph-mon[34353]: pgmap v365: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 85 B/s wr, 5 op/s 2024-05-09T05:37:15.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:15.103+0000 7f8218fd6700 1 -- 172.21.15.39:0/1743014952 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f821410a110 msgr2=0x7f821410c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:15.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:15.103+0000 7f8218fd6700 1 --2- 172.21.15.39:0/1743014952 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f821410a110 0x7f821410c530 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f820c00b0a0 tx=0x7f820c00b3b0 comp rx=0 tx=0).stop 2024-05-09T05:37:15.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:15.103+0000 7f8218fd6700 1 -- 172.21.15.39:0/1743014952 shutdown_connections 2024-05-09T05:37:15.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:15.103+0000 7f8218fd6700 1 --2- 172.21.15.39:0/1743014952 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f821410a110 0x7f821410c530 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:15.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:15.103+0000 7f8218fd6700 1 --2- 172.21.15.39:0/1743014952 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8214104e50 0x7f8214107270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:15.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:15.103+0000 7f8218fd6700 1 --2- 172.21.15.39:0/1743014952 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82141077b0 0x7f8214109bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:15.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:15.103+0000 7f8218fd6700 1 -- 172.21.15.39:0/1743014952 >> 172.21.15.39:0/1743014952 conn(0x7f82140fe890 msgr2=0x7f8214100d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:37:15.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:15.103+0000 7f8218fd6700 1 -- 172.21.15.39:0/1743014952 shutdown_connections 2024-05-09T05:37:15.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:15.103+0000 7f8218fd6700 1 -- 172.21.15.39:0/1743014952 wait complete. 2024-05-09T05:37:15.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:15.104+0000 7f8218fd6700 1 Processor -- start 2024-05-09T05:37:15.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:15.104+0000 7f8218fd6700 1 -- start start 2024-05-09T05:37:15.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:15.104+0000 7f8218fd6700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8214104e50 0x7f821419a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:15.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:15.104+0000 7f8218fd6700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82141077b0 0x7f821419ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:15.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:15.104+0000 7f8218fd6700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f821410a110 0x7f82141a1d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:15.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:15.104+0000 7f8218fd6700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f821410fda0 con 0x7f8214104e50 2024-05-09T05:37:15.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:15.104+0000 7f8218fd6700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f821410fc20 con 0x7f82141077b0 2024-05-09T05:37:15.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:15.104+0000 7f8218fd6700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f821410ff20 con 0x7f821410a110 2024-05-09T05:37:15.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:15.104+0000 7f821259c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8214104e50 0x7f821419a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:15.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:15.104+0000 7f821259c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8214104e50 0x7f821419a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:45720/0 (socket says 172.21.15.39:45720) 2024-05-09T05:37:15.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:15.104+0000 7f821259c700 1 -- 172.21.15.39:0/278967599 learned_addr learned my addr 172.21.15.39:0/278967599 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:37:15.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:15.105+0000 7f8211d9b700 1 --2- 172.21.15.39:0/278967599 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82141077b0 0x7f821419ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:15.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:15.105+0000 7f8212d9d700 1 --2- 172.21.15.39:0/278967599 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f821410a110 0x7f82141a1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:15.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:15.105+0000 7f821259c700 1 -- 172.21.15.39:0/278967599 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f821410a110 msgr2=0x7f82141a1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:15.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:15.105+0000 7f821259c700 1 --2- 172.21.15.39:0/278967599 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f821410a110 0x7f82141a1d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:15.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:15.105+0000 7f821259c700 1 -- 172.21.15.39:0/278967599 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82141077b0 msgr2=0x7f821419ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:15.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:15.105+0000 7f821259c700 1 --2- 172.21.15.39:0/278967599 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82141077b0 0x7f821419ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:15.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:15.105+0000 7f821259c700 1 -- 172.21.15.39:0/278967599 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82141a23b0 con 0x7f8214104e50 2024-05-09T05:37:15.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:15.105+0000 7f8212d9d700 1 --2- 172.21.15.39:0/278967599 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f821410a110 0x7f82141a1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:37:15.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:15.105+0000 7f821259c700 1 --2- 172.21.15.39:0/278967599 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8214104e50 0x7f821419a850 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f81fc00c8f0 tx=0x7f81fc00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:37:15.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:15.105+0000 7f820b7fe700 1 -- 172.21.15.39:0/278967599 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81fc007b00 con 0x7f8214104e50 2024-05-09T05:37:15.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:15.105+0000 7f8218fd6700 1 -- 172.21.15.39:0/278967599 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82141a26a0 con 0x7f8214104e50 2024-05-09T05:37:15.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:15.105+0000 7f820b7fe700 1 -- 172.21.15.39:0/278967599 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f81fc007ca0 con 0x7f8214104e50 2024-05-09T05:37:15.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:15.105+0000 7f820b7fe700 1 -- 172.21.15.39:0/278967599 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81fc018660 con 0x7f8214104e50 2024-05-09T05:37:15.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:15.106+0000 7f8218fd6700 1 -- 172.21.15.39:0/278967599 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82141a2c30 con 0x7f8214104e50 2024-05-09T05:37:15.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:15.106+0000 7f8218fd6700 1 -- 172.21.15.39:0/278967599 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82140512c0 con 0x7f8214104e50 2024-05-09T05:37:15.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:15.108+0000 7f820b7fe700 1 -- 172.21.15.39:0/278967599 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f81fc00f450 con 0x7f8214104e50 2024-05-09T05:37:15.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:15.109+0000 7f820b7fe700 1 --2- 172.21.15.39:0/278967599 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f82000b2880 0x7f82000b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:15.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:15.109+0000 7f8211d9b700 1 --2- 172.21.15.39:0/278967599 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f82000b2880 0x7f82000b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:15.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:15.109+0000 7f820b7fe700 1 -- 172.21.15.39:0/278967599 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f81fc0e22d0 con 0x7f8214104e50 2024-05-09T05:37:15.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:15.109+0000 7f8211d9b700 1 --2- 172.21.15.39:0/278967599 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f82000b2880 0x7f82000b4d90 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8204005950 tx=0x7f82040058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:37:15.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:15.113+0000 7f820b7fe700 1 -- 172.21.15.39:0/278967599 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f81fc014030 con 0x7f8214104e50 2024-05-09T05:37:15.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:15.348+0000 7f8218fd6700 1 -- 172.21.15.39:0/278967599 --> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f8214063c00 con 0x7f82000b2880 2024-05-09T05:37:15.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:15.350+0000 7f820b7fe700 1 -- 172.21.15.39:0/278967599 <== mgr.14152 v2:172.21.15.39:6800/3184189003 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f8214063c00 con 0x7f82000b2880 2024-05-09T05:37:15.343 INFO:teuthology.orchestra.run.smithi039.stdout:Backend: cephadm 2024-05-09T05:37:15.343 INFO:teuthology.orchestra.run.smithi039.stdout:Available: Yes 2024-05-09T05:37:15.343 INFO:teuthology.orchestra.run.smithi039.stdout:Paused: No 2024-05-09T05:37:15.345 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:15.352+0000 7f8218fd6700 1 -- 172.21.15.39:0/278967599 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f82000b2880 msgr2=0x7f82000b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:15.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:15.352+0000 7f8218fd6700 1 --2- 172.21.15.39:0/278967599 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f82000b2880 0x7f82000b4d90 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8204005950 tx=0x7f82040058e0 comp rx=0 tx=0).stop 2024-05-09T05:37:15.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:15.352+0000 7f8218fd6700 1 -- 172.21.15.39:0/278967599 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8214104e50 msgr2=0x7f821419a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:15.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:15.352+0000 7f8218fd6700 1 --2- 172.21.15.39:0/278967599 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8214104e50 0x7f821419a850 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f81fc00c8f0 tx=0x7f81fc00ccb0 comp rx=0 tx=0).stop 2024-05-09T05:37:15.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:15.352+0000 7f8218fd6700 1 -- 172.21.15.39:0/278967599 shutdown_connections 2024-05-09T05:37:15.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:15.352+0000 7f8218fd6700 1 --2- 172.21.15.39:0/278967599 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f82000b2880 0x7f82000b4d90 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:15.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:15.352+0000 7f8218fd6700 1 --2- 172.21.15.39:0/278967599 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f821410a110 0x7f82141a1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:15.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:15.352+0000 7f8218fd6700 1 --2- 172.21.15.39:0/278967599 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8214104e50 0x7f821419a850 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:15.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:15.352+0000 7f8218fd6700 1 --2- 172.21.15.39:0/278967599 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82141077b0 0x7f821419ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:15.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:15.352+0000 7f8218fd6700 1 -- 172.21.15.39:0/278967599 >> 172.21.15.39:0/278967599 conn(0x7f82140fe890 msgr2=0x7f8214105d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:37:15.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:15.352+0000 7f8218fd6700 1 -- 172.21.15.39:0/278967599 shutdown_connections 2024-05-09T05:37:15.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:15.352+0000 7f8218fd6700 1 -- 172.21.15.39:0/278967599 wait complete. 2024-05-09T05:37:15.357 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:37:15 smithi039 ceph-mon[30439]: pgmap v366: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s 2024-05-09T05:37:15.546 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:37:15 smithi060 ceph-mon[34555]: pgmap v366: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s 2024-05-09T05:37:15.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:37:15 smithi100 ceph-mon[34353]: pgmap v366: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s 2024-05-09T05:37:15.934 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- bash -c 'ceph orch ps' 2024-05-09T05:37:16.188 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T05:37:16.547 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:37:16 smithi060 ceph-mon[34555]: from='client.15024 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T05:37:16.584 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:37:16 smithi039 ceph-mon[30439]: from='client.15024 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T05:37:16.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:37:16 smithi100 ceph-mon[34353]: from='client.15024 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T05:37:17.456 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:37:17 smithi039 ceph-mon[30439]: pgmap v367: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-09T05:37:17.546 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:37:17 smithi060 ceph-mon[34555]: pgmap v367: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-09T05:37:17.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:37:17 smithi100 ceph-mon[34353]: pgmap v367: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-09T05:37:17.727 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:17.731+0000 7fdee5e06700 1 -- 172.21.15.39:0/106299642 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdee0104750 msgr2=0x7fdee0104b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:17.727 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:17.731+0000 7fdee5e06700 1 --2- 172.21.15.39:0/106299642 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdee0104750 0x7fdee0104b80 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fded0009990 tx=0x7fded0009ca0 comp rx=0 tx=0).stop 2024-05-09T05:37:17.727 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:17.731+0000 7fdee5e06700 1 -- 172.21.15.39:0/106299642 shutdown_connections 2024-05-09T05:37:17.727 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:17.731+0000 7fdee5e06700 1 --2- 172.21.15.39:0/106299642 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdee0103db0 0x7fdee010b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:17.727 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:17.731+0000 7fdee5e06700 1 --2- 172.21.15.39:0/106299642 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdee0104750 0x7fdee0104b80 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:17.727 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:17.731+0000 7fdee5e06700 1 --2- 172.21.15.39:0/106299642 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdee0103460 0x7fdee0103870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:17.727 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:17.731+0000 7fdee5e06700 1 -- 172.21.15.39:0/106299642 >> 172.21.15.39:0/106299642 conn(0x7fdee00fe020 msgr2=0x7fdee01004d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:37:17.728 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:17.731+0000 7fdee5e06700 1 -- 172.21.15.39:0/106299642 shutdown_connections 2024-05-09T05:37:17.728 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:17.731+0000 7fdee5e06700 1 -- 172.21.15.39:0/106299642 wait complete. 2024-05-09T05:37:17.728 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:17.732+0000 7fdee5e06700 1 Processor -- start 2024-05-09T05:37:17.728 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:17.732+0000 7fdee5e06700 1 -- start start 2024-05-09T05:37:17.728 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:17.732+0000 7fdee5e06700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdee0103460 0x7fdee019cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:17.728 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:17.732+0000 7fdee5e06700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdee0103db0 0x7fdee019d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:17.728 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:17.732+0000 7fdee5e06700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdee0104750 0x7fdee01a4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:17.728 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:17.732+0000 7fdee5e06700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fdee010ecc0 con 0x7fdee0103460 2024-05-09T05:37:17.728 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:17.732+0000 7fdee5e06700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fdee010eb40 con 0x7fdee0103db0 2024-05-09T05:37:17.728 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:17.732+0000 7fdee5e06700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fdee010ee40 con 0x7fdee0104750 2024-05-09T05:37:17.728 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:17.733+0000 7fdedf7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdee0103460 0x7fdee019cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:17.728 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:17.733+0000 7fdedf7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdee0103460 0x7fdee019cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:58842/0 (socket says 172.21.15.39:58842) 2024-05-09T05:37:17.728 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:17.733+0000 7fdedf7fe700 1 -- 172.21.15.39:0/3670038295 learned_addr learned my addr 172.21.15.39:0/3670038295 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:37:17.728 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:17.733+0000 7fdedeffd700 1 --2- 172.21.15.39:0/3670038295 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdee0103db0 0x7fdee019d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:17.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:17.733+0000 7fdedffff700 1 --2- 172.21.15.39:0/3670038295 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdee0104750 0x7fdee01a4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:17.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:17.733+0000 7fdedf7fe700 1 -- 172.21.15.39:0/3670038295 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdee0104750 msgr2=0x7fdee01a4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:17.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:17.733+0000 7fdedf7fe700 1 --2- 172.21.15.39:0/3670038295 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdee0104750 0x7fdee01a4090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:17.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:17.733+0000 7fdedf7fe700 1 -- 172.21.15.39:0/3670038295 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdee0103db0 msgr2=0x7fdee019d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:17.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:17.733+0000 7fdedf7fe700 1 --2- 172.21.15.39:0/3670038295 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdee0103db0 0x7fdee019d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:17.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:17.733+0000 7fdedf7fe700 1 -- 172.21.15.39:0/3670038295 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdee01a4710 con 0x7fdee0103460 2024-05-09T05:37:17.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:17.733+0000 7fdedffff700 1 --2- 172.21.15.39:0/3670038295 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdee0104750 0x7fdee01a4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:37:17.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:17.733+0000 7fdedeffd700 1 --2- 172.21.15.39:0/3670038295 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdee0103db0 0x7fdee019d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:37:17.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:17.733+0000 7fdedf7fe700 1 --2- 172.21.15.39:0/3670038295 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdee0103460 0x7fdee019cbb0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fded0003800 tx=0x7fded0009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:37:17.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:17.733+0000 7fdedcff9700 1 -- 172.21.15.39:0/3670038295 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fded0027070 con 0x7fdee0103460 2024-05-09T05:37:17.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:17.733+0000 7fdee5e06700 1 -- 172.21.15.39:0/3670038295 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdee01a49a0 con 0x7fdee0103460 2024-05-09T05:37:17.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:17.733+0000 7fdedcff9700 1 -- 172.21.15.39:0/3670038295 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fded0022470 con 0x7fdee0103460 2024-05-09T05:37:17.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:17.733+0000 7fdedcff9700 1 -- 172.21.15.39:0/3670038295 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fded000f6e0 con 0x7fdee0103460 2024-05-09T05:37:17.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:17.734+0000 7fdee5e06700 1 -- 172.21.15.39:0/3670038295 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdee01a4e50 con 0x7fdee0103460 2024-05-09T05:37:17.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:17.734+0000 7fdee5e06700 1 -- 172.21.15.39:0/3670038295 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdee00512c0 con 0x7fdee0103460 2024-05-09T05:37:17.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:17.736+0000 7fdedcff9700 1 -- 172.21.15.39:0/3670038295 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fded002a070 con 0x7fdee0103460 2024-05-09T05:37:17.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:17.737+0000 7fdedcff9700 1 --2- 172.21.15.39:0/3670038295 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fdec80b2880 0x7fdec80b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:17.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:17.737+0000 7fdedeffd700 1 --2- 172.21.15.39:0/3670038295 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fdec80b2880 0x7fdec80b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:17.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:17.737+0000 7fdedcff9700 1 -- 172.21.15.39:0/3670038295 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7fded00e3300 con 0x7fdee0103460 2024-05-09T05:37:17.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:17.738+0000 7fdedeffd700 1 --2- 172.21.15.39:0/3670038295 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fdec80b2880 0x7fdec80b4d90 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fded4005fd0 tx=0x7fded4005de0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:37:17.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:17.741+0000 7fdedcff9700 1 -- 172.21.15.39:0/3670038295 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fded0013070 con 0x7fdee0103460 2024-05-09T05:37:17.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:17.962+0000 7fdee5e06700 1 -- 172.21.15.39:0/3670038295 --> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fdee0100080 con 0x7fdec80b2880 2024-05-09T05:37:17.970 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:17.976+0000 7fdedcff9700 1 -- 172.21.15.39:0/3670038295 <== mgr.14152 v2:172.21.15.39:6800/3184189003 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4123 (secure 0 0 0) 0x7fdee0100080 con 0x7fdec80b2880 2024-05-09T05:37:17.970 INFO:teuthology.orchestra.run.smithi039.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-09T05:37:17.970 INFO:teuthology.orchestra.run.smithi039.stdout:mds.a smithi039 running (2m) 19s ago 2m 81.1M - 19.0.0-3594-gc9da4049 db794d706f49 fe69fbfa8301 2024-05-09T05:37:17.970 INFO:teuthology.orchestra.run.smithi039.stdout:mds.b smithi060 running (2m) 21s ago 2m 93.8M - 19.0.0-3594-gc9da4049 db794d706f49 8d92a93d8766 2024-05-09T05:37:17.970 INFO:teuthology.orchestra.run.smithi039.stdout:mds.c smithi100 running (2m) 22s ago 2m 87.3M - 19.0.0-3594-gc9da4049 db794d706f49 3d9f81982fde 2024-05-09T05:37:17.970 INFO:teuthology.orchestra.run.smithi039.stdout:mds.d smithi039 running (3m) 19s ago 3m 86.4M - 19.0.0-3594-gc9da4049 db794d706f49 2410ecfd9100 2024-05-09T05:37:17.970 INFO:teuthology.orchestra.run.smithi039.stdout:mds.e smithi060 running (3m) 21s ago 2m 86.9M - 19.0.0-3594-gc9da4049 db794d706f49 9ab439eb840f 2024-05-09T05:37:17.970 INFO:teuthology.orchestra.run.smithi039.stdout:mds.f smithi100 running (2m) 22s ago 2m 86.7M - 19.0.0-3594-gc9da4049 db794d706f49 78de515fbc7a 2024-05-09T05:37:17.971 INFO:teuthology.orchestra.run.smithi039.stdout:mds.g smithi039 running (2m) 19s ago 2m 84.1M - 19.0.0-3594-gc9da4049 db794d706f49 e4dec390d7b5 2024-05-09T05:37:17.971 INFO:teuthology.orchestra.run.smithi039.stdout:mds.h smithi060 running (2m) 21s ago 2m 90.4M - 19.0.0-3594-gc9da4049 db794d706f49 fa9e0675f81c 2024-05-09T05:37:17.971 INFO:teuthology.orchestra.run.smithi039.stdout:mds.i smithi100 running (2m) 22s ago 2m 86.4M - 19.0.0-3594-gc9da4049 db794d706f49 8f96def25582 2024-05-09T05:37:17.971 INFO:teuthology.orchestra.run.smithi039.stdout:mds.j smithi039 running (3m) 19s ago 3m 84.4M - 19.0.0-3594-gc9da4049 db794d706f49 52f6adc11bbf 2024-05-09T05:37:17.971 INFO:teuthology.orchestra.run.smithi039.stdout:mds.k smithi060 running (3m) 21s ago 3m 81.7M - 19.0.0-3594-gc9da4049 db794d706f49 af347e184d32 2024-05-09T05:37:17.971 INFO:teuthology.orchestra.run.smithi039.stdout:mds.l smithi100 running (3m) 22s ago 3m 82.0M - 19.0.0-3594-gc9da4049 db794d706f49 18ebd9304fb6 2024-05-09T05:37:17.971 INFO:teuthology.orchestra.run.smithi039.stdout:mgr.x smithi039 *:9283,8765 running (10m) 19s ago 10m 598M - 19.0.0-3594-gc9da4049 db794d706f49 07c07c8c5306 2024-05-09T05:37:17.971 INFO:teuthology.orchestra.run.smithi039.stdout:mgr.y smithi060 *:8443,8765 running (8m) 21s ago 8m 534M - 19.0.0-3594-gc9da4049 db794d706f49 e4c3c25c4dab 2024-05-09T05:37:17.971 INFO:teuthology.orchestra.run.smithi039.stdout:mgr.z smithi100 *:8443,8765 running (8m) 22s ago 8m 537M - 19.0.0-3594-gc9da4049 db794d706f49 0e88cf8e9140 2024-05-09T05:37:17.971 INFO:teuthology.orchestra.run.smithi039.stdout:mon.a smithi039 running (10m) 19s ago 10m 119M 2048M 19.0.0-3594-gc9da4049 db794d706f49 002b60ced19b 2024-05-09T05:37:17.971 INFO:teuthology.orchestra.run.smithi039.stdout:mon.b smithi060 running (8m) 21s ago 8m 107M 2048M 19.0.0-3594-gc9da4049 db794d706f49 2d6b6454a110 2024-05-09T05:37:17.971 INFO:teuthology.orchestra.run.smithi039.stdout:mon.c smithi100 running (9m) 22s ago 9m 108M 2048M 19.0.0-3594-gc9da4049 db794d706f49 636febe0454d 2024-05-09T05:37:17.971 INFO:teuthology.orchestra.run.smithi039.stdout:osd.0 smithi039 running (8m) 19s ago 8m 126M 4272M 19.0.0-3594-gc9da4049 db794d706f49 6891dc8e55ed 2024-05-09T05:37:17.971 INFO:teuthology.orchestra.run.smithi039.stdout:osd.1 smithi060 running (7m) 21s ago 7m 114M 4273M 19.0.0-3594-gc9da4049 db794d706f49 2aee270eb360 2024-05-09T05:37:17.972 INFO:teuthology.orchestra.run.smithi039.stdout:osd.2 smithi100 running (7m) 22s ago 7m 118M 4272M 19.0.0-3594-gc9da4049 db794d706f49 c6c20dac1167 2024-05-09T05:37:17.972 INFO:teuthology.orchestra.run.smithi039.stdout:osd.3 smithi039 running (7m) 19s ago 7m 116M 4272M 19.0.0-3594-gc9da4049 db794d706f49 ac281d2fb913 2024-05-09T05:37:17.972 INFO:teuthology.orchestra.run.smithi039.stdout:osd.4 smithi060 running (6m) 21s ago 6m 113M 4273M 19.0.0-3594-gc9da4049 db794d706f49 24b84316a5ef 2024-05-09T05:37:17.972 INFO:teuthology.orchestra.run.smithi039.stdout:osd.5 smithi100 running (6m) 22s ago 6m 121M 4272M 19.0.0-3594-gc9da4049 db794d706f49 701757da8133 2024-05-09T05:37:17.972 INFO:teuthology.orchestra.run.smithi039.stdout:osd.6 smithi039 running (5m) 19s ago 5m 113M 4272M 19.0.0-3594-gc9da4049 db794d706f49 e8a000e84d93 2024-05-09T05:37:17.972 INFO:teuthology.orchestra.run.smithi039.stdout:osd.7 smithi060 running (5m) 21s ago 5m 121M 4273M 19.0.0-3594-gc9da4049 db794d706f49 9d661cacb1b1 2024-05-09T05:37:17.972 INFO:teuthology.orchestra.run.smithi039.stdout:osd.8 smithi100 running (4m) 22s ago 4m 124M 4272M 19.0.0-3594-gc9da4049 db794d706f49 b198cf54b5ca 2024-05-09T05:37:17.972 INFO:teuthology.orchestra.run.smithi039.stdout:osd.9 smithi039 running (4m) 19s ago 4m 122M 4272M 19.0.0-3594-gc9da4049 db794d706f49 a226042332dd 2024-05-09T05:37:17.972 INFO:teuthology.orchestra.run.smithi039.stdout:osd.10 smithi060 running (4m) 21s ago 4m 121M 4273M 19.0.0-3594-gc9da4049 db794d706f49 9a1685294938 2024-05-09T05:37:17.972 INFO:teuthology.orchestra.run.smithi039.stdout:osd.11 smithi100 running (3m) 22s ago 3m 111M 4272M 19.0.0-3594-gc9da4049 db794d706f49 7d69d998368a 2024-05-09T05:37:17.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:17.979+0000 7fdee5e06700 1 -- 172.21.15.39:0/3670038295 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fdec80b2880 msgr2=0x7fdec80b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:17.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:17.979+0000 7fdee5e06700 1 --2- 172.21.15.39:0/3670038295 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fdec80b2880 0x7fdec80b4d90 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fded4005fd0 tx=0x7fded4005de0 comp rx=0 tx=0).stop 2024-05-09T05:37:17.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:17.979+0000 7fdee5e06700 1 -- 172.21.15.39:0/3670038295 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdee0103460 msgr2=0x7fdee019cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:17.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:17.979+0000 7fdee5e06700 1 --2- 172.21.15.39:0/3670038295 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdee0103460 0x7fdee019cbb0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fded0003800 tx=0x7fded0009f90 comp rx=0 tx=0).stop 2024-05-09T05:37:17.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:17.979+0000 7fdee5e06700 1 -- 172.21.15.39:0/3670038295 shutdown_connections 2024-05-09T05:37:17.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:17.979+0000 7fdee5e06700 1 --2- 172.21.15.39:0/3670038295 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fdec80b2880 0x7fdec80b4d90 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:17.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:17.979+0000 7fdee5e06700 1 --2- 172.21.15.39:0/3670038295 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdee0104750 0x7fdee01a4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:17.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:17.979+0000 7fdee5e06700 1 --2- 172.21.15.39:0/3670038295 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdee0103460 0x7fdee019cbb0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:17.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:17.979+0000 7fdee5e06700 1 --2- 172.21.15.39:0/3670038295 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdee0103db0 0x7fdee019d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:17.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:17.979+0000 7fdee5e06700 1 -- 172.21.15.39:0/3670038295 >> 172.21.15.39:0/3670038295 conn(0x7fdee00fe020 msgr2=0x7fdee00ff970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:37:17.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:17.979+0000 7fdee5e06700 1 -- 172.21.15.39:0/3670038295 shutdown_connections 2024-05-09T05:37:17.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:17.979+0000 7fdee5e06700 1 -- 172.21.15.39:0/3670038295 wait complete. 2024-05-09T05:37:18.667 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- bash -c 'ceph orch ls' 2024-05-09T05:37:18.917 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T05:37:19.546 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:37:19 smithi060 ceph-mon[34555]: from='client.15030 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T05:37:19.546 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:37:19 smithi060 ceph-mon[34555]: pgmap v368: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-09T05:37:19.602 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:37:19 smithi039 ceph-mon[30439]: from='client.15030 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T05:37:19.603 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:37:19 smithi039 ceph-mon[30439]: pgmap v368: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-09T05:37:19.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:37:19 smithi100 ceph-mon[34353]: from='client.15030 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T05:37:19.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:37:19 smithi100 ceph-mon[34353]: pgmap v368: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-09T05:37:20.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:20.446+0000 7fd27453c700 1 -- 172.21.15.39:0/3709239463 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd26c103250 msgr2=0x7fd26c103660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:20.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:20.446+0000 7fd27453c700 1 --2- 172.21.15.39:0/3709239463 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd26c103250 0x7fd26c103660 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fd268009990 tx=0x7fd268009ca0 comp rx=0 tx=0).stop 2024-05-09T05:37:20.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:20.446+0000 7fd27453c700 1 -- 172.21.15.39:0/3709239463 shutdown_connections 2024-05-09T05:37:20.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:20.446+0000 7fd27453c700 1 --2- 172.21.15.39:0/3709239463 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd26c104d20 0x7fd26c10b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:20.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:20.446+0000 7fd27453c700 1 --2- 172.21.15.39:0/3709239463 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd26c103250 0x7fd26c103660 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:20.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:20.446+0000 7fd27453c700 1 --2- 172.21.15.39:0/3709239463 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd26c104380 0x7fd26c104790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:20.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:20.446+0000 7fd27453c700 1 -- 172.21.15.39:0/3709239463 >> 172.21.15.39:0/3709239463 conn(0x7fd26c0fe890 msgr2=0x7fd26c100d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:37:20.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:20.446+0000 7fd27453c700 1 -- 172.21.15.39:0/3709239463 shutdown_connections 2024-05-09T05:37:20.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:20.446+0000 7fd27453c700 1 -- 172.21.15.39:0/3709239463 wait complete. 2024-05-09T05:37:20.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:20.447+0000 7fd27453c700 1 Processor -- start 2024-05-09T05:37:20.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:20.447+0000 7fd27453c700 1 -- start start 2024-05-09T05:37:20.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:20.447+0000 7fd27453c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd26c103250 0x7fd26c19a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:20.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:20.447+0000 7fd27453c700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd26c104380 0x7fd26c19aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:20.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:20.447+0000 7fd27453c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd26c104d20 0x7fd26c1a1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:20.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:20.447+0000 7fd27453c700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fd26c10ec90 con 0x7fd26c104380 2024-05-09T05:37:20.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:20.447+0000 7fd27453c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd26c10eb10 con 0x7fd26c103250 2024-05-09T05:37:20.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:20.447+0000 7fd27453c700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd26c10ee10 con 0x7fd26c104d20 2024-05-09T05:37:20.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:20.447+0000 7fd271ad7700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd26c104380 0x7fd26c19aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:20.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:20.447+0000 7fd271ad7700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd26c104380 0x7fd26c19aed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:58850/0 (socket says 172.21.15.39:58850) 2024-05-09T05:37:20.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:20.447+0000 7fd271ad7700 1 -- 172.21.15.39:0/3111621935 learned_addr learned my addr 172.21.15.39:0/3111621935 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:37:20.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:20.447+0000 7fd2722d8700 1 --2- 172.21.15.39:0/3111621935 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd26c103250 0x7fd26c19a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:20.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:20.447+0000 7fd272ad9700 1 --2- 172.21.15.39:0/3111621935 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd26c104d20 0x7fd26c1a1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:20.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:20.448+0000 7fd271ad7700 1 -- 172.21.15.39:0/3111621935 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd26c104d20 msgr2=0x7fd26c1a1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:20.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:20.448+0000 7fd271ad7700 1 --2- 172.21.15.39:0/3111621935 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd26c104d20 0x7fd26c1a1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:20.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:20.448+0000 7fd271ad7700 1 -- 172.21.15.39:0/3111621935 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd26c103250 msgr2=0x7fd26c19a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:20.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:20.448+0000 7fd271ad7700 1 --2- 172.21.15.39:0/3111621935 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd26c103250 0x7fd26c19a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:20.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:20.448+0000 7fd271ad7700 1 -- 172.21.15.39:0/3111621935 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd26c1a24f0 con 0x7fd26c104380 2024-05-09T05:37:20.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:20.448+0000 7fd2722d8700 1 --2- 172.21.15.39:0/3111621935 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd26c103250 0x7fd26c19a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T05:37:20.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:20.448+0000 7fd272ad9700 1 --2- 172.21.15.39:0/3111621935 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd26c104d20 0x7fd26c1a1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T05:37:20.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:20.448+0000 7fd271ad7700 1 --2- 172.21.15.39:0/3111621935 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd26c104380 0x7fd26c19aed0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fd25c00d980 tx=0x7fd25c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:37:20.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:20.448+0000 7fd2637fe700 1 -- 172.21.15.39:0/3111621935 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd25c016070 con 0x7fd26c104380 2024-05-09T05:37:20.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:20.448+0000 7fd2637fe700 1 -- 172.21.15.39:0/3111621935 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd25c004830 con 0x7fd26c104380 2024-05-09T05:37:20.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:20.448+0000 7fd2637fe700 1 -- 172.21.15.39:0/3111621935 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd25c005540 con 0x7fd26c104380 2024-05-09T05:37:20.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:20.448+0000 7fd27453c700 1 -- 172.21.15.39:0/3111621935 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd26c105600 con 0x7fd26c104380 2024-05-09T05:37:20.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:20.448+0000 7fd27453c700 1 -- 172.21.15.39:0/3111621935 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd26c105b90 con 0x7fd26c104380 2024-05-09T05:37:20.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:20.449+0000 7fd27453c700 1 -- 172.21.15.39:0/3111621935 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd26c0512c0 con 0x7fd26c104380 2024-05-09T05:37:20.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:20.451+0000 7fd2637fe700 1 -- 172.21.15.39:0/3111621935 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fd25c004220 con 0x7fd26c104380 2024-05-09T05:37:20.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:20.452+0000 7fd2637fe700 1 --2- 172.21.15.39:0/3111621935 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fd2580b2900 0x7fd2580b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:20.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:20.452+0000 7fd2722d8700 1 --2- 172.21.15.39:0/3111621935 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fd2580b2900 0x7fd2580b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:20.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:20.452+0000 7fd2637fe700 1 -- 172.21.15.39:0/3111621935 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7fd25c0e24d0 con 0x7fd26c104380 2024-05-09T05:37:20.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:20.452+0000 7fd2722d8700 1 --2- 172.21.15.39:0/3111621935 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fd2580b2900 0x7fd2580b4e10 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd2680038a0 tx=0x7fd26801e040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:37:20.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:20.455+0000 7fd2637fe700 1 -- 172.21.15.39:0/3111621935 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fd25c01f020 con 0x7fd26c104380 2024-05-09T05:37:20.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:20.679+0000 7fd27453c700 1 -- 172.21.15.39:0/3111621935 --> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7fd26c100940 con 0x7fd2580b2900 2024-05-09T05:37:20.678 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:20.685+0000 7fd2637fe700 1 -- 172.21.15.39:0/3111621935 <== mgr.14152 v2:172.21.15.39:6800/3184189003 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7fd26c100940 con 0x7fd2580b2900 2024-05-09T05:37:20.679 INFO:teuthology.orchestra.run.smithi039.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-05-09T05:37:20.679 INFO:teuthology.orchestra.run.smithi039.stdout:mds.all 12/12 24s ago 3m smithi039=a;smithi039=d;smithi039=g;smithi039=j;smithi060=b;smithi060=e;smithi060=h;smithi060=k;smithi100=c;smithi100=f;smithi100=i;smithi100=l;count:12 2024-05-09T05:37:20.679 INFO:teuthology.orchestra.run.smithi039.stdout:mgr 3/3 24s ago 8m smithi039=x;smithi060=y;smithi100=z;count:3 2024-05-09T05:37:20.679 INFO:teuthology.orchestra.run.smithi039.stdout:mon 3/3 24s ago 9m smithi039:172.21.15.39=a;smithi060:172.21.15.60=b;smithi100:172.21.15.100=c;count:3 2024-05-09T05:37:20.679 INFO:teuthology.orchestra.run.smithi039.stdout:osd 12 24s ago - 2024-05-09T05:37:20.681 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:20.687+0000 7fd27453c700 1 -- 172.21.15.39:0/3111621935 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fd2580b2900 msgr2=0x7fd2580b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:20.681 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:20.687+0000 7fd27453c700 1 --2- 172.21.15.39:0/3111621935 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fd2580b2900 0x7fd2580b4e10 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd2680038a0 tx=0x7fd26801e040 comp rx=0 tx=0).stop 2024-05-09T05:37:20.681 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:20.687+0000 7fd27453c700 1 -- 172.21.15.39:0/3111621935 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd26c104380 msgr2=0x7fd26c19aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:20.681 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:20.687+0000 7fd27453c700 1 --2- 172.21.15.39:0/3111621935 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd26c104380 0x7fd26c19aed0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fd25c00d980 tx=0x7fd25c00dc90 comp rx=0 tx=0).stop 2024-05-09T05:37:20.682 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:20.687+0000 7fd27453c700 1 -- 172.21.15.39:0/3111621935 shutdown_connections 2024-05-09T05:37:20.682 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:20.687+0000 7fd27453c700 1 --2- 172.21.15.39:0/3111621935 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fd2580b2900 0x7fd2580b4e10 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:20.682 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:20.687+0000 7fd27453c700 1 --2- 172.21.15.39:0/3111621935 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd26c104d20 0x7fd26c1a1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:20.682 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:20.687+0000 7fd27453c700 1 --2- 172.21.15.39:0/3111621935 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd26c103250 0x7fd26c19a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:20.682 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:20.687+0000 7fd27453c700 1 --2- 172.21.15.39:0/3111621935 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd26c104380 0x7fd26c19aed0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:20.682 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:20.687+0000 7fd27453c700 1 -- 172.21.15.39:0/3111621935 >> 172.21.15.39:0/3111621935 conn(0x7fd26c0fe890 msgr2=0x7fd26c100230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:37:20.682 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:20.687+0000 7fd27453c700 1 -- 172.21.15.39:0/3111621935 shutdown_connections 2024-05-09T05:37:20.682 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:20.687+0000 7fd27453c700 1 -- 172.21.15.39:0/3111621935 wait complete. 2024-05-09T05:37:21.325 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- bash -c 'ceph orch host ls' 2024-05-09T05:37:21.349 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:37:21 smithi039 ceph-mon[30439]: pgmap v369: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-09T05:37:21.581 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T05:37:21.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:37:21 smithi100 ceph-mon[34353]: pgmap v369: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-09T05:37:21.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:37:21 smithi060 ceph-mon[34555]: pgmap v369: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-09T05:37:22.574 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:37:22 smithi039 ceph-mon[30439]: from='client.15036 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T05:37:22.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:37:22 smithi100 ceph-mon[34353]: from='client.15036 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T05:37:22.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:37:22 smithi060 ceph-mon[34555]: from='client.15036 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T05:37:23.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:23.094+0000 7f69eef3e700 1 -- 172.21.15.39:0/1090060873 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f69e810c3e0 msgr2=0x7f69e810e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:23.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:23.094+0000 7f69eef3e700 1 --2- 172.21.15.39:0/1090060873 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f69e810c3e0 0x7f69e810e800 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f69e000b0a0 tx=0x7f69e000b3b0 comp rx=0 tx=0).stop 2024-05-09T05:37:23.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:23.094+0000 7f69eef3e700 1 -- 172.21.15.39:0/1090060873 shutdown_connections 2024-05-09T05:37:23.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:23.094+0000 7f69eef3e700 1 --2- 172.21.15.39:0/1090060873 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f69e810c3e0 0x7f69e810e800 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:23.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:23.094+0000 7f69eef3e700 1 --2- 172.21.15.39:0/1090060873 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69e8104830 0x7f69e8104c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:23.090 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:23.094+0000 7f69eef3e700 1 --2- 172.21.15.39:0/1090060873 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69e8109a80 0x7f69e810bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:23.090 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:23.094+0000 7f69eef3e700 1 -- 172.21.15.39:0/1090060873 >> 172.21.15.39:0/1090060873 conn(0x7f69e80fe020 msgr2=0x7f69e81004d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:37:23.090 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:23.094+0000 7f69eef3e700 1 -- 172.21.15.39:0/1090060873 shutdown_connections 2024-05-09T05:37:23.090 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:23.094+0000 7f69eef3e700 1 -- 172.21.15.39:0/1090060873 wait complete. 2024-05-09T05:37:23.090 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:23.095+0000 7f69eef3e700 1 Processor -- start 2024-05-09T05:37:23.090 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:23.095+0000 7f69eef3e700 1 -- start start 2024-05-09T05:37:23.090 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:23.095+0000 7f69eef3e700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69e8104830 0x7f69e819cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:23.090 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:23.095+0000 7f69eef3e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f69e8109a80 0x7f69e819d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:23.090 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:23.095+0000 7f69eef3e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69e810c3e0 0x7f69e81a4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:23.090 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:23.095+0000 7f69eef3e700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f69e8112010 con 0x7f69e8109a80 2024-05-09T05:37:23.090 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:23.095+0000 7f69eef3e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f69e8111e90 con 0x7f69e810c3e0 2024-05-09T05:37:23.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:23.095+0000 7f69eef3e700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f69e8112190 con 0x7f69e8104830 2024-05-09T05:37:23.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:23.095+0000 7f69e7fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f69e8109a80 0x7f69e819d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:23.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:23.095+0000 7f69e7fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f69e8109a80 0x7f69e819d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:58878/0 (socket says 172.21.15.39:58878) 2024-05-09T05:37:23.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:23.095+0000 7f69e7fff700 1 -- 172.21.15.39:0/762176943 learned_addr learned my addr 172.21.15.39:0/762176943 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:37:23.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:23.095+0000 7f69eccda700 1 --2- 172.21.15.39:0/762176943 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69e8104830 0x7f69e819cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:23.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:23.095+0000 7f69ed4db700 1 --2- 172.21.15.39:0/762176943 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69e810c3e0 0x7f69e81a4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:23.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:23.095+0000 7f69e7fff700 1 -- 172.21.15.39:0/762176943 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69e8104830 msgr2=0x7f69e819cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:23.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:23.095+0000 7f69e7fff700 1 --2- 172.21.15.39:0/762176943 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69e8104830 0x7f69e819cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:23.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:23.095+0000 7f69e7fff700 1 -- 172.21.15.39:0/762176943 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69e810c3e0 msgr2=0x7f69e81a4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:23.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:23.095+0000 7f69e7fff700 1 --2- 172.21.15.39:0/762176943 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69e810c3e0 0x7f69e81a4000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:23.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:23.095+0000 7f69e7fff700 1 -- 172.21.15.39:0/762176943 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69e81a4680 con 0x7f69e8109a80 2024-05-09T05:37:23.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:23.095+0000 7f69ed4db700 1 --2- 172.21.15.39:0/762176943 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69e810c3e0 0x7f69e81a4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T05:37:23.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:23.096+0000 7f69e7fff700 1 --2- 172.21.15.39:0/762176943 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f69e8109a80 0x7f69e819d060 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f69d400e9a0 tx=0x7f69d400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:37:23.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:23.096+0000 7f69e5ffb700 1 -- 172.21.15.39:0/762176943 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69d400cbd0 con 0x7f69e8109a80 2024-05-09T05:37:23.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:23.096+0000 7f69eef3e700 1 -- 172.21.15.39:0/762176943 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69e81a4970 con 0x7f69e8109a80 2024-05-09T05:37:23.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:23.096+0000 7f69e5ffb700 1 -- 172.21.15.39:0/762176943 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f69d400cd70 con 0x7f69e8109a80 2024-05-09T05:37:23.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:23.096+0000 7f69e5ffb700 1 -- 172.21.15.39:0/762176943 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69d4018680 con 0x7f69e8109a80 2024-05-09T05:37:23.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:23.096+0000 7f69eef3e700 1 -- 172.21.15.39:0/762176943 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69e81a4eb0 con 0x7f69e8109a80 2024-05-09T05:37:23.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:23.097+0000 7f69eef3e700 1 -- 172.21.15.39:0/762176943 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69e80512c0 con 0x7f69e8109a80 2024-05-09T05:37:23.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:23.099+0000 7f69e5ffb700 1 -- 172.21.15.39:0/762176943 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f69d4010430 con 0x7f69e8109a80 2024-05-09T05:37:23.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:23.100+0000 7f69e5ffb700 1 --2- 172.21.15.39:0/762176943 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f69d80b2880 0x7f69d80b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:23.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:23.100+0000 7f69eccda700 1 --2- 172.21.15.39:0/762176943 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f69d80b2880 0x7f69d80b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:23.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:23.100+0000 7f69e5ffb700 1 -- 172.21.15.39:0/762176943 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f69d40e2630 con 0x7f69e8109a80 2024-05-09T05:37:23.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:23.100+0000 7f69eccda700 1 --2- 172.21.15.39:0/762176943 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f69d80b2880 0x7f69d80b4d90 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f69e806c2a0 tx=0x7f69dc00b3c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:37:23.097 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:23.103+0000 7f69e5ffb700 1 -- 172.21.15.39:0/762176943 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f69d40aa360 con 0x7f69e8109a80 2024-05-09T05:37:23.318 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:23.325+0000 7f69eef3e700 1 -- 172.21.15.39:0/762176943 --> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f69e8063c00 con 0x7f69d80b2880 2024-05-09T05:37:23.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:23.326+0000 7f69e5ffb700 1 -- 172.21.15.39:0/762176943 <== mgr.14152 v2:172.21.15.39:6800/3184189003 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7f69e8063c00 con 0x7f69d80b2880 2024-05-09T05:37:23.320 INFO:teuthology.orchestra.run.smithi039.stdout:HOST ADDR LABELS STATUS 2024-05-09T05:37:23.320 INFO:teuthology.orchestra.run.smithi039.stdout:smithi039 172.21.15.39 2024-05-09T05:37:23.320 INFO:teuthology.orchestra.run.smithi039.stdout:smithi060 172.21.15.60 2024-05-09T05:37:23.320 INFO:teuthology.orchestra.run.smithi039.stdout:smithi100 172.21.15.100 2024-05-09T05:37:23.320 INFO:teuthology.orchestra.run.smithi039.stdout:3 hosts in cluster 2024-05-09T05:37:23.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:23.329+0000 7f69eef3e700 1 -- 172.21.15.39:0/762176943 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f69d80b2880 msgr2=0x7f69d80b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:23.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:23.329+0000 7f69eef3e700 1 --2- 172.21.15.39:0/762176943 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f69d80b2880 0x7f69d80b4d90 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f69e806c2a0 tx=0x7f69dc00b3c0 comp rx=0 tx=0).stop 2024-05-09T05:37:23.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:23.329+0000 7f69eef3e700 1 -- 172.21.15.39:0/762176943 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f69e8109a80 msgr2=0x7f69e819d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:23.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:23.329+0000 7f69eef3e700 1 --2- 172.21.15.39:0/762176943 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f69e8109a80 0x7f69e819d060 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f69d400e9a0 tx=0x7f69d400ecb0 comp rx=0 tx=0).stop 2024-05-09T05:37:23.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:23.329+0000 7f69eef3e700 1 -- 172.21.15.39:0/762176943 shutdown_connections 2024-05-09T05:37:23.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:23.329+0000 7f69eef3e700 1 --2- 172.21.15.39:0/762176943 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f69d80b2880 0x7f69d80b4d90 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:23.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:23.329+0000 7f69eef3e700 1 --2- 172.21.15.39:0/762176943 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69e810c3e0 0x7f69e81a4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:23.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:23.329+0000 7f69eef3e700 1 --2- 172.21.15.39:0/762176943 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69e8104830 0x7f69e819cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:23.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:23.329+0000 7f69eef3e700 1 --2- 172.21.15.39:0/762176943 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f69e8109a80 0x7f69e819d060 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:23.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:23.329+0000 7f69eef3e700 1 -- 172.21.15.39:0/762176943 >> 172.21.15.39:0/762176943 conn(0x7f69e80fe020 msgr2=0x7f69e810a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:37:23.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:23.329+0000 7f69eef3e700 1 -- 172.21.15.39:0/762176943 shutdown_connections 2024-05-09T05:37:23.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:23.329+0000 7f69eef3e700 1 -- 172.21.15.39:0/762176943 wait complete. 2024-05-09T05:37:23.609 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:37:23 smithi039 ceph-mon[30439]: pgmap v370: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-09T05:37:23.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:37:23 smithi100 ceph-mon[34353]: pgmap v370: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-09T05:37:23.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:37:23 smithi060 ceph-mon[34555]: pgmap v370: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-09T05:37:23.867 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- bash -c 'ceph orch device ls' 2024-05-09T05:37:24.157 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T05:37:24.585 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:37:24 smithi039 ceph-mon[30439]: from='client.15042 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T05:37:24.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:37:24 smithi100 ceph-mon[34353]: from='client.15042 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T05:37:24.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:37:24 smithi060 ceph-mon[34555]: from='client.15042 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T05:37:25.522 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:37:25 smithi039 ceph-mon[30439]: pgmap v371: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-05-09T05:37:25.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:37:25 smithi100 ceph-mon[34353]: pgmap v371: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-05-09T05:37:25.725 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:25.731+0000 7ff54c3b8700 1 -- 172.21.15.39:0/3368724833 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff544104360 msgr2=0x7ff544104770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:25.725 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:25.731+0000 7ff54c3b8700 1 --2- 172.21.15.39:0/3368724833 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff544104360 0x7ff544104770 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7ff540009990 tx=0x7ff540009ca0 comp rx=0 tx=0).stop 2024-05-09T05:37:25.725 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:25.732+0000 7ff54c3b8700 1 -- 172.21.15.39:0/3368724833 shutdown_connections 2024-05-09T05:37:25.725 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:25.732+0000 7ff54c3b8700 1 --2- 172.21.15.39:0/3368724833 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff544105e30 0x7ff54410c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:25.726 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:25.732+0000 7ff54c3b8700 1 --2- 172.21.15.39:0/3368724833 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff544104360 0x7ff544104770 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:25.726 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:25.732+0000 7ff54c3b8700 1 --2- 172.21.15.39:0/3368724833 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff544105490 0x7ff5441058a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:25.726 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:25.732+0000 7ff54c3b8700 1 -- 172.21.15.39:0/3368724833 >> 172.21.15.39:0/3368724833 conn(0x7ff5440ff9c0 msgr2=0x7ff544101e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:37:25.726 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:25.732+0000 7ff54c3b8700 1 -- 172.21.15.39:0/3368724833 shutdown_connections 2024-05-09T05:37:25.726 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:25.732+0000 7ff54c3b8700 1 -- 172.21.15.39:0/3368724833 wait complete. 2024-05-09T05:37:25.727 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:25.732+0000 7ff54c3b8700 1 Processor -- start 2024-05-09T05:37:25.727 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:25.732+0000 7ff54c3b8700 1 -- start start 2024-05-09T05:37:25.727 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:25.733+0000 7ff54c3b8700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff544104360 0x7ff54419a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:25.728 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:25.733+0000 7ff54c3b8700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff544105490 0x7ff54419af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:25.728 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:25.733+0000 7ff54c3b8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff544105e30 0x7ff5441a1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:25.728 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:25.733+0000 7ff54c3b8700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7ff54410fdf0 con 0x7ff544105490 2024-05-09T05:37:25.728 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:25.733+0000 7ff54c3b8700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff54410fc70 con 0x7ff544105e30 2024-05-09T05:37:25.728 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:25.733+0000 7ff54c3b8700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff54410ff70 con 0x7ff544104360 2024-05-09T05:37:25.728 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:25.733+0000 7ff549953700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff544105490 0x7ff54419af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:25.728 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:25.733+0000 7ff549953700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff544105490 0x7ff54419af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:58886/0 (socket says 172.21.15.39:58886) 2024-05-09T05:37:25.728 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:25.733+0000 7ff549953700 1 -- 172.21.15.39:0/2822145401 learned_addr learned my addr 172.21.15.39:0/2822145401 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:37:25.728 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:25.733+0000 7ff54a154700 1 --2- 172.21.15.39:0/2822145401 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff544104360 0x7ff54419a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:25.728 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:25.733+0000 7ff54a955700 1 --2- 172.21.15.39:0/2822145401 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff544105e30 0x7ff5441a1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:25.728 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:25.733+0000 7ff549953700 1 -- 172.21.15.39:0/2822145401 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff544104360 msgr2=0x7ff54419a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:25.728 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:25.733+0000 7ff549953700 1 --2- 172.21.15.39:0/2822145401 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff544104360 0x7ff54419a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:25.728 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:25.733+0000 7ff549953700 1 -- 172.21.15.39:0/2822145401 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff544105e30 msgr2=0x7ff5441a1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:25.728 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:25.733+0000 7ff549953700 1 --2- 172.21.15.39:0/2822145401 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff544105e30 0x7ff5441a1eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:25.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:25.733+0000 7ff549953700 1 -- 172.21.15.39:0/2822145401 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5441a24a0 con 0x7ff544105490 2024-05-09T05:37:25.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:25.733+0000 7ff54a955700 1 --2- 172.21.15.39:0/2822145401 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff544105e30 0x7ff5441a1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T05:37:25.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:25.733+0000 7ff549953700 1 --2- 172.21.15.39:0/2822145401 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff544105490 0x7ff54419af10 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ff53400c9b0 tx=0x7ff53400ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:37:25.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:25.733+0000 7ff53b7fe700 1 -- 172.21.15.39:0/2822145401 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff534007b00 con 0x7ff544105490 2024-05-09T05:37:25.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:25.733+0000 7ff53b7fe700 1 -- 172.21.15.39:0/2822145401 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff534007ca0 con 0x7ff544105490 2024-05-09T05:37:25.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:25.733+0000 7ff54c3b8700 1 -- 172.21.15.39:0/2822145401 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5441a2790 con 0x7ff544105490 2024-05-09T05:37:25.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:25.733+0000 7ff53b7fe700 1 -- 172.21.15.39:0/2822145401 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff534018660 con 0x7ff544105490 2024-05-09T05:37:25.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:25.734+0000 7ff54c3b8700 1 -- 172.21.15.39:0/2822145401 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5441a2d20 con 0x7ff544105490 2024-05-09T05:37:25.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:25.734+0000 7ff54c3b8700 1 -- 172.21.15.39:0/2822145401 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5440512c0 con 0x7ff544105490 2024-05-09T05:37:25.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:25.736+0000 7ff53b7fe700 1 -- 172.21.15.39:0/2822145401 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7ff53400f450 con 0x7ff544105490 2024-05-09T05:37:25.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:25.737+0000 7ff53b7fe700 1 --2- 172.21.15.39:0/2822145401 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7ff5300b2900 0x7ff5300b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:25.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:25.737+0000 7ff54a154700 1 --2- 172.21.15.39:0/2822145401 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7ff5300b2900 0x7ff5300b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:25.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:25.737+0000 7ff53b7fe700 1 -- 172.21.15.39:0/2822145401 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7ff5340e2420 con 0x7ff544105490 2024-05-09T05:37:25.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:25.737+0000 7ff54a154700 1 --2- 172.21.15.39:0/2822145401 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7ff5300b2900 0x7ff5300b4e10 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff5400038a0 tx=0x7ff54001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:37:25.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:25.741+0000 7ff53b7fe700 1 -- 172.21.15.39:0/2822145401 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7ff534014030 con 0x7ff544105490 2024-05-09T05:37:25.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:37:25 smithi060 ceph-mon[34555]: pgmap v371: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-05-09T05:37:25.958 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:25.964+0000 7ff54c3b8700 1 -- 172.21.15.39:0/2822145401 --> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7ff544063c00 con 0x7ff5300b2900 2024-05-09T05:37:25.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:25.966+0000 7ff53b7fe700 1 -- 172.21.15.39:0/2822145401 <== mgr.14152 v2:172.21.15.39:6800/3184189003 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7ff544063c00 con 0x7ff5300b2900 2024-05-09T05:37:25.959 INFO:teuthology.orchestra.run.smithi039.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-05-09T05:37:25.960 INFO:teuthology.orchestra.run.smithi039.stdout:smithi039 /dev/nvme0n1 ssd INTEL_SSDPEDKE040T7_BTLE736102QX4P0KGN 3726G No 4m ago Has a FileSystem, LVM detected 2024-05-09T05:37:25.960 INFO:teuthology.orchestra.run.smithi039.stdout:smithi060 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB7476008A480DGN 447G No 4m ago Has a FileSystem, LVM detected 2024-05-09T05:37:25.960 INFO:teuthology.orchestra.run.smithi039.stdout:smithi100 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400WR400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-05-09T05:37:25.962 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:25.968+0000 7ff54c3b8700 1 -- 172.21.15.39:0/2822145401 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7ff5300b2900 msgr2=0x7ff5300b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:25.962 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:25.968+0000 7ff54c3b8700 1 --2- 172.21.15.39:0/2822145401 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7ff5300b2900 0x7ff5300b4e10 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff5400038a0 tx=0x7ff54001a040 comp rx=0 tx=0).stop 2024-05-09T05:37:25.962 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:25.968+0000 7ff54c3b8700 1 -- 172.21.15.39:0/2822145401 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff544105490 msgr2=0x7ff54419af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:25.962 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:25.968+0000 7ff54c3b8700 1 --2- 172.21.15.39:0/2822145401 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff544105490 0x7ff54419af10 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ff53400c9b0 tx=0x7ff53400ccc0 comp rx=0 tx=0).stop 2024-05-09T05:37:25.963 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:25.968+0000 7ff54c3b8700 1 -- 172.21.15.39:0/2822145401 shutdown_connections 2024-05-09T05:37:25.963 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:25.969+0000 7ff54c3b8700 1 --2- 172.21.15.39:0/2822145401 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7ff5300b2900 0x7ff5300b4e10 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:25.963 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:25.969+0000 7ff54c3b8700 1 --2- 172.21.15.39:0/2822145401 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff544105e30 0x7ff5441a1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:25.963 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:25.969+0000 7ff54c3b8700 1 --2- 172.21.15.39:0/2822145401 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff544104360 0x7ff54419a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:25.963 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:25.969+0000 7ff54c3b8700 1 --2- 172.21.15.39:0/2822145401 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff544105490 0x7ff54419af10 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:25.963 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:25.969+0000 7ff54c3b8700 1 -- 172.21.15.39:0/2822145401 >> 172.21.15.39:0/2822145401 conn(0x7ff5440ff9c0 msgr2=0x7ff544108730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:37:25.963 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:25.969+0000 7ff54c3b8700 1 -- 172.21.15.39:0/2822145401 shutdown_connections 2024-05-09T05:37:25.963 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:25.969+0000 7ff54c3b8700 1 -- 172.21.15.39:0/2822145401 wait complete. 2024-05-09T05:37:26.607 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-05-09T05:37:26.617 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi039.front.sepia.ceph.com 2024-05-09T05:37:26.617 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- bash -c 'ceph fs dump' 2024-05-09T05:37:26.873 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T05:37:27.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:37:27 smithi039 ceph-mon[30439]: from='client.15048 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T05:37:27.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:37:27 smithi039 ceph-mon[30439]: pgmap v372: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-09T05:37:27.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:37:27 smithi100 ceph-mon[34353]: from='client.15048 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T05:37:27.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:37:27 smithi100 ceph-mon[34353]: pgmap v372: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-09T05:37:27.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:37:27 smithi060 ceph-mon[34555]: from='client.15048 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T05:37:27.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:37:27 smithi060 ceph-mon[34555]: pgmap v372: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-09T05:37:28.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:28.721+0000 7fe1b9773700 1 -- 172.21.15.39:0/1167917399 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe1b4103240 msgr2=0x7fe1b4103650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:28.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:28.721+0000 7fe1b9773700 1 --2- 172.21.15.39:0/1167917399 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe1b4103240 0x7fe1b4103650 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fe1a400b0a0 tx=0x7fe1a400b3b0 comp rx=0 tx=0).stop 2024-05-09T05:37:28.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:28.721+0000 7fe1b9773700 1 -- 172.21.15.39:0/1167917399 shutdown_connections 2024-05-09T05:37:28.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:28.721+0000 7fe1b9773700 1 --2- 172.21.15.39:0/1167917399 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe1b4104d10 0x7fe1b410b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:28.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:28.721+0000 7fe1b9773700 1 --2- 172.21.15.39:0/1167917399 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe1b4103240 0x7fe1b4103650 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:28.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:28.721+0000 7fe1b9773700 1 --2- 172.21.15.39:0/1167917399 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1b4104370 0x7fe1b4104780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:28.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:28.721+0000 7fe1b9773700 1 -- 172.21.15.39:0/1167917399 >> 172.21.15.39:0/1167917399 conn(0x7fe1b40fe880 msgr2=0x7fe1b4100d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:37:28.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:28.721+0000 7fe1b9773700 1 -- 172.21.15.39:0/1167917399 shutdown_connections 2024-05-09T05:37:28.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:28.721+0000 7fe1b9773700 1 -- 172.21.15.39:0/1167917399 wait complete. 2024-05-09T05:37:28.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:28.722+0000 7fe1b9773700 1 Processor -- start 2024-05-09T05:37:28.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:28.722+0000 7fe1b9773700 1 -- start start 2024-05-09T05:37:28.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:28.723+0000 7fe1b9773700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe1b4103240 0x7fe1b4107000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:28.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:28.723+0000 7fe1b9773700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1b4104370 0x7fe1b41056b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:28.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:28.723+0000 7fe1b9773700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe1b4104d10 0x7fe1b4105bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:28.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:28.723+0000 7fe1b9773700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fe1b410ed00 con 0x7fe1b4104d10 2024-05-09T05:37:28.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:28.723+0000 7fe1b9773700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe1b410eb80 con 0x7fe1b4104370 2024-05-09T05:37:28.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:28.723+0000 7fe1b9773700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe1b410ee80 con 0x7fe1b4103240 2024-05-09T05:37:28.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:28.723+0000 7fe1b2ffd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe1b4103240 0x7fe1b4107000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:28.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:28.723+0000 7fe1b37fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe1b4104d10 0x7fe1b4105bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:28.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:28.723+0000 7fe1b2ffd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe1b4103240 0x7fe1b4107000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.39:52366/0 (socket says 172.21.15.39:52366) 2024-05-09T05:37:28.719 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:28.723+0000 7fe1b2ffd700 1 -- 172.21.15.39:0/1572161718 learned_addr learned my addr 172.21.15.39:0/1572161718 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:37:28.719 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:28.723+0000 7fe1b27fc700 1 --2- 172.21.15.39:0/1572161718 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1b4104370 0x7fe1b41056b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:28.719 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:28.723+0000 7fe1b37fe700 1 -- 172.21.15.39:0/1572161718 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe1b4103240 msgr2=0x7fe1b4107000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:28.719 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:28.723+0000 7fe1b37fe700 1 --2- 172.21.15.39:0/1572161718 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe1b4103240 0x7fe1b4107000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:28.719 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:28.723+0000 7fe1b37fe700 1 -- 172.21.15.39:0/1572161718 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1b4104370 msgr2=0x7fe1b41056b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:28.719 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:28.723+0000 7fe1b37fe700 1 --2- 172.21.15.39:0/1572161718 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1b4104370 0x7fe1b41056b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:28.719 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:28.723+0000 7fe1b37fe700 1 -- 172.21.15.39:0/1572161718 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1b4106350 con 0x7fe1b4104d10 2024-05-09T05:37:28.719 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:28.723+0000 7fe1b2ffd700 1 --2- 172.21.15.39:0/1572161718 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe1b4103240 0x7fe1b4107000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T05:37:28.719 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:28.723+0000 7fe1b37fe700 1 --2- 172.21.15.39:0/1572161718 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe1b4104d10 0x7fe1b4105bf0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac00c7a0 tx=0x7fe1ac00cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:37:28.719 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:28.724+0000 7fe1abfff700 1 -- 172.21.15.39:0/1572161718 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1ac004a30 con 0x7fe1b4104d10 2024-05-09T05:37:28.719 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:28.724+0000 7fe1b9773700 1 -- 172.21.15.39:0/1572161718 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1b41a4af0 con 0x7fe1b4104d10 2024-05-09T05:37:28.719 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:28.724+0000 7fe1abfff700 1 -- 172.21.15.39:0/1572161718 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe1ac0054d0 con 0x7fe1b4104d10 2024-05-09T05:37:28.719 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:28.724+0000 7fe1abfff700 1 -- 172.21.15.39:0/1572161718 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1ac00ec20 con 0x7fe1b4104d10 2024-05-09T05:37:28.719 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:28.724+0000 7fe1b9773700 1 -- 172.21.15.39:0/1572161718 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1b41a4fd0 con 0x7fe1b4104d10 2024-05-09T05:37:28.720 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:28.725+0000 7fe1b9773700 1 -- 172.21.15.39:0/1572161718 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1b40512c0 con 0x7fe1b4104d10 2024-05-09T05:37:28.720 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:28.727+0000 7fe1abfff700 1 -- 172.21.15.39:0/1572161718 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fe1ac004fc0 con 0x7fe1b4104d10 2024-05-09T05:37:28.720 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:28.727+0000 7fe1abfff700 1 --2- 172.21.15.39:0/1572161718 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fe1a00b2880 0x7fe1a00b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:28.721 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:28.728+0000 7fe1b2ffd700 1 --2- 172.21.15.39:0/1572161718 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fe1a00b2880 0x7fe1a00b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:28.721 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:28.728+0000 7fe1abfff700 1 -- 172.21.15.39:0/1572161718 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7fe1ac0e1fb0 con 0x7fe1b4104d10 2024-05-09T05:37:28.721 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:28.728+0000 7fe1b2ffd700 1 --2- 172.21.15.39:0/1572161718 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fe1a00b2880 0x7fe1a00b4d90 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fe1a4009900 tx=0x7fe1a400b7b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:37:28.724 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:28.731+0000 7fe1abfff700 1 -- 172.21.15.39:0/1572161718 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fe1ac0a9ea0 con 0x7fe1b4104d10 2024-05-09T05:37:28.985 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:28.991+0000 7fe1b9773700 1 -- 172.21.15.39:0/1572161718 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fe1b41a5860 con 0x7fe1b4104d10 2024-05-09T05:37:28.985 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:28.992+0000 7fe1abfff700 1 -- 172.21.15.39:0/1572161718 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) ==== 76+0+3046 (secure 0 0 0) 0x7fe1ac0a97a0 con 0x7fe1b4104d10 2024-05-09T05:37:28.986 INFO:teuthology.orchestra.run.smithi039.stdout:e24 2024-05-09T05:37:28.986 INFO:teuthology.orchestra.run.smithi039.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-05-09T05:37:28.986 INFO:teuthology.orchestra.run.smithi039.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-05-09T05:37:28.986 INFO:teuthology.orchestra.run.smithi039.stdout:legacy client fscid: 1 2024-05-09T05:37:28.986 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-09T05:37:28.986 INFO:teuthology.orchestra.run.smithi039.stdout:Filesystem 'cephfs' (1) 2024-05-09T05:37:28.986 INFO:teuthology.orchestra.run.smithi039.stdout:fs_name cephfs 2024-05-09T05:37:28.987 INFO:teuthology.orchestra.run.smithi039.stdout:epoch 24 2024-05-09T05:37:28.987 INFO:teuthology.orchestra.run.smithi039.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-05-09T05:37:28.987 INFO:teuthology.orchestra.run.smithi039.stdout:created 2024-05-09T05:34:56.202280+0000 2024-05-09T05:37:28.987 INFO:teuthology.orchestra.run.smithi039.stdout:modified 2024-05-09T05:35:16.063547+0000 2024-05-09T05:37:28.987 INFO:teuthology.orchestra.run.smithi039.stdout:tableserver 0 2024-05-09T05:37:28.987 INFO:teuthology.orchestra.run.smithi039.stdout:root 0 2024-05-09T05:37:28.987 INFO:teuthology.orchestra.run.smithi039.stdout:session_timeout 300 2024-05-09T05:37:28.987 INFO:teuthology.orchestra.run.smithi039.stdout:session_autoclose 300 2024-05-09T05:37:28.988 INFO:teuthology.orchestra.run.smithi039.stdout:max_file_size 1099511627776 2024-05-09T05:37:28.988 INFO:teuthology.orchestra.run.smithi039.stdout:max_xattr_size 65536 2024-05-09T05:37:28.988 INFO:teuthology.orchestra.run.smithi039.stdout:required_client_features {} 2024-05-09T05:37:28.988 INFO:teuthology.orchestra.run.smithi039.stdout:last_failure 0 2024-05-09T05:37:28.988 INFO:teuthology.orchestra.run.smithi039.stdout:last_failure_osd_epoch 0 2024-05-09T05:37:28.988 INFO:teuthology.orchestra.run.smithi039.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-05-09T05:37:28.988 INFO:teuthology.orchestra.run.smithi039.stdout:max_mds 3 2024-05-09T05:37:28.988 INFO:teuthology.orchestra.run.smithi039.stdout:in 0,1,2 2024-05-09T05:37:28.988 INFO:teuthology.orchestra.run.smithi039.stdout:up {0=24509,1=24502,2=24487} 2024-05-09T05:37:28.988 INFO:teuthology.orchestra.run.smithi039.stdout:failed 2024-05-09T05:37:28.988 INFO:teuthology.orchestra.run.smithi039.stdout:damaged 2024-05-09T05:37:28.988 INFO:teuthology.orchestra.run.smithi039.stdout:stopped 2024-05-09T05:37:28.988 INFO:teuthology.orchestra.run.smithi039.stdout:data_pools [3] 2024-05-09T05:37:28.989 INFO:teuthology.orchestra.run.smithi039.stdout:metadata_pool 2 2024-05-09T05:37:28.989 INFO:teuthology.orchestra.run.smithi039.stdout:inline_data disabled 2024-05-09T05:37:28.989 INFO:teuthology.orchestra.run.smithi039.stdout:balancer 2024-05-09T05:37:28.989 INFO:teuthology.orchestra.run.smithi039.stdout:bal_rank_mask -1 2024-05-09T05:37:28.989 INFO:teuthology.orchestra.run.smithi039.stdout:standby_count_wanted 0 2024-05-09T05:37:28.989 INFO:teuthology.orchestra.run.smithi039.stdout:qdb_cluster leader: 24509 members: 24487,24502,24509 2024-05-09T05:37:28.989 INFO:teuthology.orchestra.run.smithi039.stdout:[mds.b{0:24509} state up:active seq 6 addr [v2:172.21.15.60:6838/1418956667,v1:172.21.15.60:6839/1418956667] compat {c=[1],r=[1],i=[1fff]}] 2024-05-09T05:37:28.989 INFO:teuthology.orchestra.run.smithi039.stdout:[mds.f{0:24481} state up:standby-replay seq 1 addr [v2:172.21.15.100:6834/2595255386,v1:172.21.15.100:6835/2595255386] compat {c=[1],r=[1],i=[1fff]}] 2024-05-09T05:37:28.989 INFO:teuthology.orchestra.run.smithi039.stdout:[mds.i{1:24502} state up:active seq 12 addr [v2:172.21.15.100:6838/1395178742,v1:172.21.15.100:6839/1395178742] compat {c=[1],r=[1],i=[1fff]}] 2024-05-09T05:37:28.989 INFO:teuthology.orchestra.run.smithi039.stdout:[mds.h{1:24479} state up:standby-replay seq 1 addr [v2:172.21.15.60:6836/3588840930,v1:172.21.15.60:6837/3588840930] compat {c=[1],r=[1],i=[1fff]}] 2024-05-09T05:37:28.989 INFO:teuthology.orchestra.run.smithi039.stdout:[mds.c{2:24487} state up:active seq 13 addr [v2:172.21.15.100:6836/3676209932,v1:172.21.15.100:6837/3676209932] compat {c=[1],r=[1],i=[1fff]}] 2024-05-09T05:37:28.989 INFO:teuthology.orchestra.run.smithi039.stdout:[mds.e{2:24461} state up:standby-replay seq 1 addr [v2:172.21.15.60:6834/924472374,v1:172.21.15.60:6835/924472374] compat {c=[1],r=[1],i=[1fff]}] 2024-05-09T05:37:28.989 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-09T05:37:28.990 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-09T05:37:28.990 INFO:teuthology.orchestra.run.smithi039.stdout:Standby daemons: 2024-05-09T05:37:28.990 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-09T05:37:28.990 INFO:teuthology.orchestra.run.smithi039.stdout:[mds.j{-1:14544} state up:standby seq 1 addr [v2:172.21.15.39:6834/1997969267,v1:172.21.15.39:6835/1997969267] compat {c=[1],r=[1],i=[1fff]}] 2024-05-09T05:37:28.990 INFO:teuthology.orchestra.run.smithi039.stdout:[mds.d{-1:14556} state up:standby seq 1 addr [v2:172.21.15.39:6836/283022063,v1:172.21.15.39:6837/283022063] compat {c=[1],r=[1],i=[1fff]}] 2024-05-09T05:37:28.990 INFO:teuthology.orchestra.run.smithi039.stdout:[mds.g{-1:14604} state up:standby seq 1 addr [v2:172.21.15.39:6838/669632573,v1:172.21.15.39:6839/669632573] compat {c=[1],r=[1],i=[1fff]}] 2024-05-09T05:37:28.990 INFO:teuthology.orchestra.run.smithi039.stdout:[mds.a{-1:14616} state up:standby seq 1 addr [v2:172.21.15.39:6840/2202260395,v1:172.21.15.39:6841/2202260395] compat {c=[1],r=[1],i=[1fff]}] 2024-05-09T05:37:28.990 INFO:teuthology.orchestra.run.smithi039.stdout:[mds.l{-1:24433} state up:standby seq 1 addr [v2:172.21.15.100:6832/1308189973,v1:172.21.15.100:6833/1308189973] compat {c=[1],r=[1],i=[1fff]}] 2024-05-09T05:37:28.990 INFO:teuthology.orchestra.run.smithi039.stdout:[mds.k{-1:24434} state up:standby seq 1 addr [v2:172.21.15.60:6832/2789974692,v1:172.21.15.60:6833/2789974692] compat {c=[1],r=[1],i=[1fff]}] 2024-05-09T05:37:28.991 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:28.994+0000 7fe1b9773700 1 -- 172.21.15.39:0/1572161718 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fe1a00b2880 msgr2=0x7fe1a00b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:28.991 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:28.994+0000 7fe1b9773700 1 --2- 172.21.15.39:0/1572161718 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fe1a00b2880 0x7fe1a00b4d90 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fe1a4009900 tx=0x7fe1a400b7b0 comp rx=0 tx=0).stop 2024-05-09T05:37:28.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:28.994+0000 7fe1b9773700 1 -- 172.21.15.39:0/1572161718 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe1b4104d10 msgr2=0x7fe1b4105bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:28.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:28.994+0000 7fe1b9773700 1 --2- 172.21.15.39:0/1572161718 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe1b4104d10 0x7fe1b4105bf0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac00c7a0 tx=0x7fe1ac00cab0 comp rx=0 tx=0).stop 2024-05-09T05:37:28.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:28.994+0000 7fe1b9773700 1 -- 172.21.15.39:0/1572161718 shutdown_connections 2024-05-09T05:37:28.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:28.994+0000 7fe1b9773700 1 --2- 172.21.15.39:0/1572161718 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fe1a00b2880 0x7fe1a00b4d90 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:28.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:28.994+0000 7fe1b9773700 1 --2- 172.21.15.39:0/1572161718 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe1b4104d10 0x7fe1b4105bf0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:28.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:28.994+0000 7fe1b9773700 1 --2- 172.21.15.39:0/1572161718 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe1b4103240 0x7fe1b4107000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:28.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:28.994+0000 7fe1b9773700 1 --2- 172.21.15.39:0/1572161718 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1b4104370 0x7fe1b41056b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:28.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:28.994+0000 7fe1b9773700 1 -- 172.21.15.39:0/1572161718 >> 172.21.15.39:0/1572161718 conn(0x7fe1b40fe880 msgr2=0x7fe1b4100260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:37:28.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:28.994+0000 7fe1b9773700 1 -- 172.21.15.39:0/1572161718 shutdown_connections 2024-05-09T05:37:28.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:28.994+0000 7fe1b9773700 1 -- 172.21.15.39:0/1572161718 wait complete. 2024-05-09T05:37:28.992 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 24 2024-05-09T05:37:29.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:37:29 smithi039 ceph-mon[30439]: pgmap v373: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-09T05:37:29.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:37:29 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/1572161718' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T05:37:29.662 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- bash -c 'ceph osd dump' 2024-05-09T05:37:29.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:37:29 smithi100 ceph-mon[34353]: pgmap v373: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-09T05:37:29.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:37:29 smithi100 ceph-mon[34353]: from='client.? 172.21.15.39:0/1572161718' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T05:37:29.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:37:29 smithi060 ceph-mon[34555]: pgmap v373: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-09T05:37:29.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:37:29 smithi060 ceph-mon[34555]: from='client.? 172.21.15.39:0/1572161718' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T05:37:29.920 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T05:37:31.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:31.556+0000 7fbaf805e700 1 -- 172.21.15.39:0/1270597370 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbaf0103ee0 msgr2=0x7fbaf01042f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:31.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:31.556+0000 7fbaf805e700 1 --2- 172.21.15.39:0/1270597370 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbaf0103ee0 0x7fbaf01042f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fbae800b0a0 tx=0x7fbae800b3b0 comp rx=0 tx=0).stop 2024-05-09T05:37:31.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:31.556+0000 7fbaf805e700 1 -- 172.21.15.39:0/1270597370 shutdown_connections 2024-05-09T05:37:31.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:31.556+0000 7fbaf805e700 1 --2- 172.21.15.39:0/1270597370 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbaf0103ee0 0x7fbaf01042f0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:31.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:31.556+0000 7fbaf805e700 1 --2- 172.21.15.39:0/1270597370 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbaf0102c40 0x7fbaf0103050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:31.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:31.556+0000 7fbaf805e700 1 --2- 172.21.15.39:0/1270597370 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbaf0103590 0x7fbaf01039a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:31.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:31.556+0000 7fbaf805e700 1 -- 172.21.15.39:0/1270597370 >> 172.21.15.39:0/1270597370 conn(0x7fbaf00fe890 msgr2=0x7fbaf0100d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:37:31.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:31.556+0000 7fbaf805e700 1 -- 172.21.15.39:0/1270597370 shutdown_connections 2024-05-09T05:37:31.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:31.556+0000 7fbaf805e700 1 -- 172.21.15.39:0/1270597370 wait complete. 2024-05-09T05:37:31.550 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:37:31 smithi039 ceph-mon[30439]: pgmap v374: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-09T05:37:31.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:31.557+0000 7fbaf805e700 1 Processor -- start 2024-05-09T05:37:31.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:31.557+0000 7fbaf805e700 1 -- start start 2024-05-09T05:37:31.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:31.557+0000 7fbaf805e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbaf0102c40 0x7fbaf019cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:31.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:31.557+0000 7fbaf805e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbaf0103590 0x7fbaf019d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:31.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:31.557+0000 7fbaf805e700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbaf0103ee0 0x7fbaf01a3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:31.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:31.557+0000 7fbaf805e700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fbaf0112000 con 0x7fbaf0102c40 2024-05-09T05:37:31.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:31.557+0000 7fbaf805e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fbaf0111e80 con 0x7fbaf0103590 2024-05-09T05:37:31.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:31.557+0000 7fbaf805e700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbaf0112180 con 0x7fbaf0103ee0 2024-05-09T05:37:31.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:31.557+0000 7fbaf5dfa700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbaf0102c40 0x7fbaf019cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:31.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:31.557+0000 7fbaf5dfa700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbaf0102c40 0x7fbaf019cae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:46486/0 (socket says 172.21.15.39:46486) 2024-05-09T05:37:31.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:31.557+0000 7fbaf5dfa700 1 -- 172.21.15.39:0/3495676463 learned_addr learned my addr 172.21.15.39:0/3495676463 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:37:31.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:31.558+0000 7fbaf65fb700 1 --2- 172.21.15.39:0/3495676463 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbaf0103ee0 0x7fbaf01a3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:31.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:31.558+0000 7fbaf55f9700 1 --2- 172.21.15.39:0/3495676463 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbaf0103590 0x7fbaf019d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:31.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:31.558+0000 7fbaf5dfa700 1 -- 172.21.15.39:0/3495676463 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbaf0103ee0 msgr2=0x7fbaf01a3fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:31.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:31.558+0000 7fbaf5dfa700 1 --2- 172.21.15.39:0/3495676463 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbaf0103ee0 0x7fbaf01a3fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:31.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:31.558+0000 7fbaf5dfa700 1 -- 172.21.15.39:0/3495676463 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbaf0103590 msgr2=0x7fbaf019d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:31.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:31.558+0000 7fbaf5dfa700 1 --2- 172.21.15.39:0/3495676463 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbaf0103590 0x7fbaf019d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:31.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:31.558+0000 7fbaf5dfa700 1 -- 172.21.15.39:0/3495676463 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaf01a4640 con 0x7fbaf0102c40 2024-05-09T05:37:31.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:31.558+0000 7fbaf5dfa700 1 --2- 172.21.15.39:0/3495676463 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbaf0102c40 0x7fbaf019cae0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fbaec00d980 tx=0x7fbaec00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:37:31.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:31.558+0000 7fbae6ffd700 1 -- 172.21.15.39:0/3495676463 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaec017070 con 0x7fbaf0102c40 2024-05-09T05:37:31.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:31.558+0000 7fbae6ffd700 1 -- 172.21.15.39:0/3495676463 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbaec009de0 con 0x7fbaf0102c40 2024-05-09T05:37:31.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:31.558+0000 7fbaf805e700 1 -- 172.21.15.39:0/3495676463 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbaf01a4930 con 0x7fbaf0102c40 2024-05-09T05:37:31.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:31.558+0000 7fbaf805e700 1 -- 172.21.15.39:0/3495676463 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbaf01a4e70 con 0x7fbaf0102c40 2024-05-09T05:37:31.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:31.558+0000 7fbae6ffd700 1 -- 172.21.15.39:0/3495676463 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaec00f3c0 con 0x7fbaf0102c40 2024-05-09T05:37:31.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:31.559+0000 7fbaf805e700 1 -- 172.21.15.39:0/3495676463 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbad4005360 con 0x7fbaf0102c40 2024-05-09T05:37:31.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:31.561+0000 7fbae6ffd700 1 -- 172.21.15.39:0/3495676463 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fbaec009930 con 0x7fbaf0102c40 2024-05-09T05:37:31.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:31.562+0000 7fbae6ffd700 1 --2- 172.21.15.39:0/3495676463 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fbadc0b2880 0x7fbadc0b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:31.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:31.562+0000 7fbaf55f9700 1 --2- 172.21.15.39:0/3495676463 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fbadc0b2880 0x7fbadc0b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:31.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:31.562+0000 7fbae6ffd700 1 -- 172.21.15.39:0/3495676463 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7fbaec0e2020 con 0x7fbaf0102c40 2024-05-09T05:37:31.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:31.562+0000 7fbaf55f9700 1 --2- 172.21.15.39:0/3495676463 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fbadc0b2880 0x7fbadc0b4d90 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fbae0005950 tx=0x7fbae00058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:37:31.558 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:31.565+0000 7fbae6ffd700 1 -- 172.21.15.39:0/3495676463 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fbaec0a9d50 con 0x7fbaf0102c40 2024-05-09T05:37:31.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:37:31 smithi100 ceph-mon[34353]: pgmap v374: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-09T05:37:31.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:31.782+0000 7fbaf805e700 1 -- 172.21.15.39:0/3495676463 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7fbad4005920 con 0x7fbaf0102c40 2024-05-09T05:37:31.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:31.783+0000 7fbae6ffd700 1 -- 172.21.15.39:0/3495676463 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v83) ==== 56+0+5265 (secure 0 0 0) 0x7fbaec0a9650 con 0x7fbaf0102c40 2024-05-09T05:37:31.776 INFO:teuthology.orchestra.run.smithi039.stdout:epoch 83 2024-05-09T05:37:31.776 INFO:teuthology.orchestra.run.smithi039.stdout:fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 2024-05-09T05:37:31.776 INFO:teuthology.orchestra.run.smithi039.stdout:created 2024-05-09T05:26:33.514203+0000 2024-05-09T05:37:31.776 INFO:teuthology.orchestra.run.smithi039.stdout:modified 2024-05-09T05:35:29.485823+0000 2024-05-09T05:37:31.776 INFO:teuthology.orchestra.run.smithi039.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-05-09T05:37:31.776 INFO:teuthology.orchestra.run.smithi039.stdout:crush_version 26 2024-05-09T05:37:31.776 INFO:teuthology.orchestra.run.smithi039.stdout:full_ratio 0.95 2024-05-09T05:37:31.776 INFO:teuthology.orchestra.run.smithi039.stdout:backfillfull_ratio 0.9 2024-05-09T05:37:31.776 INFO:teuthology.orchestra.run.smithi039.stdout:nearfull_ratio 0.85 2024-05-09T05:37:31.776 INFO:teuthology.orchestra.run.smithi039.stdout:require_min_compat_client luminous 2024-05-09T05:37:31.776 INFO:teuthology.orchestra.run.smithi039.stdout:min_compat_client luminous 2024-05-09T05:37:31.777 INFO:teuthology.orchestra.run.smithi039.stdout:require_osd_release squid 2024-05-09T05:37:31.777 INFO:teuthology.orchestra.run.smithi039.stdout:stretch_mode_enabled false 2024-05-09T05:37:31.777 INFO:teuthology.orchestra.run.smithi039.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 21 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-05-09T05:37:31.777 INFO:teuthology.orchestra.run.smithi039.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 81 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-05-09T05:37:31.777 INFO:teuthology.orchestra.run.smithi039.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 81 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-05-09T05:37:31.777 INFO:teuthology.orchestra.run.smithi039.stdout:max_osd 12 2024-05-09T05:37:31.777 INFO:teuthology.orchestra.run.smithi039.stdout:osd.0 up in weight 1 up_from 8 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.39:6802/1056276932,v1:172.21.15.39:6803/1056276932] [v2:172.21.15.39:6804/1056276932,v1:172.21.15.39:6805/1056276932] exists,up 3491bbda-3a9b-40d2-8627-87d15660f864 2024-05-09T05:37:31.777 INFO:teuthology.orchestra.run.smithi039.stdout:osd.1 up in weight 1 up_from 13 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.60:6800/4245630636,v1:172.21.15.60:6801/4245630636] [v2:172.21.15.60:6802/4245630636,v1:172.21.15.60:6803/4245630636] exists,up ec2bd2d0-2975-402c-9df8-3469dfd6070f 2024-05-09T05:37:31.777 INFO:teuthology.orchestra.run.smithi039.stdout:osd.2 up in weight 1 up_from 18 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.100:6800/4141597693,v1:172.21.15.100:6801/4141597693] [v2:172.21.15.100:6802/4141597693,v1:172.21.15.100:6803/4141597693] exists,up 9efaf6dd-086e-4095-b92e-cbbecf738523 2024-05-09T05:37:31.777 INFO:teuthology.orchestra.run.smithi039.stdout:osd.3 up in weight 1 up_from 25 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.39:6810/2254197543,v1:172.21.15.39:6811/2254197543] [v2:172.21.15.39:6812/2254197543,v1:172.21.15.39:6813/2254197543] exists,up 1ebe1a25-541d-4b54-bed8-4f0ec51b2432 2024-05-09T05:37:31.777 INFO:teuthology.orchestra.run.smithi039.stdout:osd.4 up in weight 1 up_from 31 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.60:6808/649037162,v1:172.21.15.60:6809/649037162] [v2:172.21.15.60:6810/649037162,v1:172.21.15.60:6811/649037162] exists,up d52450a3-8a97-4746-a857-35aec69aac44 2024-05-09T05:37:31.777 INFO:teuthology.orchestra.run.smithi039.stdout:osd.5 up in weight 1 up_from 37 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.100:6808/658409226,v1:172.21.15.100:6809/658409226] [v2:172.21.15.100:6810/658409226,v1:172.21.15.100:6811/658409226] exists,up b35bf704-898d-40f7-b575-90267764a5b2 2024-05-09T05:37:31.777 INFO:teuthology.orchestra.run.smithi039.stdout:osd.6 up in weight 1 up_from 43 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.39:6818/237628491,v1:172.21.15.39:6819/237628491] [v2:172.21.15.39:6820/237628491,v1:172.21.15.39:6821/237628491] exists,up 49eae2f5-1dad-4c2c-89f4-efa1dd1faefb 2024-05-09T05:37:31.777 INFO:teuthology.orchestra.run.smithi039.stdout:osd.7 up in weight 1 up_from 49 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.60:6816/2718201647,v1:172.21.15.60:6817/2718201647] [v2:172.21.15.60:6818/2718201647,v1:172.21.15.60:6819/2718201647] exists,up 60ccae54-535c-4a13-98d0-881c00b5e870 2024-05-09T05:37:31.778 INFO:teuthology.orchestra.run.smithi039.stdout:osd.8 up in weight 1 up_from 56 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.100:6816/1757558317,v1:172.21.15.100:6817/1757558317] [v2:172.21.15.100:6818/1757558317,v1:172.21.15.100:6819/1757558317] exists,up edd52a21-0066-429f-9e98-15d1a74c53b2 2024-05-09T05:37:31.778 INFO:teuthology.orchestra.run.smithi039.stdout:osd.9 up in weight 1 up_from 62 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.39:6826/2944584368,v1:172.21.15.39:6827/2944584368] [v2:172.21.15.39:6828/2944584368,v1:172.21.15.39:6829/2944584368] exists,up 03fb7543-3386-49a4-b165-1007f07d88d0 2024-05-09T05:37:31.778 INFO:teuthology.orchestra.run.smithi039.stdout:osd.10 up in weight 1 up_from 67 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.60:6824/1940670367,v1:172.21.15.60:6825/1940670367] [v2:172.21.15.60:6826/1940670367,v1:172.21.15.60:6827/1940670367] exists,up c1cadd6c-fcc4-4d76-b07e-0f392066a8d8 2024-05-09T05:37:31.778 INFO:teuthology.orchestra.run.smithi039.stdout:osd.11 up in weight 1 up_from 73 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.100:6824/3318561029,v1:172.21.15.100:6825/3318561029] [v2:172.21.15.100:6826/3318561029,v1:172.21.15.100:6827/3318561029] exists,up 56806877-9ce2-41e2-9506-ce67897fa09b 2024-05-09T05:37:31.778 INFO:teuthology.orchestra.run.smithi039.stdout:pg_upmap_items 2.5 [8,11] 2024-05-09T05:37:31.778 INFO:teuthology.orchestra.run.smithi039.stdout:pg_upmap_items 2.6 [8,11] 2024-05-09T05:37:31.778 INFO:teuthology.orchestra.run.smithi039.stdout:pg_upmap_items 2.14 [2,4] 2024-05-09T05:37:31.778 INFO:teuthology.orchestra.run.smithi039.stdout:pg_upmap_items 2.16 [2,4] 2024-05-09T05:37:31.778 INFO:teuthology.orchestra.run.smithi039.stdout:pg_upmap_items 3.3 [4,9] 2024-05-09T05:37:31.778 INFO:teuthology.orchestra.run.smithi039.stdout:pg_upmap_items 3.11 [5,9] 2024-05-09T05:37:31.778 INFO:teuthology.orchestra.run.smithi039.stdout:pg_upmap_items 3.1b [4,8] 2024-05-09T05:37:31.778 INFO:teuthology.orchestra.run.smithi039.stdout:pg_upmap_items 3.2c [4,9] 2024-05-09T05:37:31.778 INFO:teuthology.orchestra.run.smithi039.stdout:blocklist 172.21.15.39:6801/4091500272 expires 2024-05-10T05:27:28.034010+0000 2024-05-09T05:37:31.779 INFO:teuthology.orchestra.run.smithi039.stdout:blocklist 172.21.15.39:6800/4091500272 expires 2024-05-10T05:27:28.034010+0000 2024-05-09T05:37:31.779 INFO:teuthology.orchestra.run.smithi039.stdout:blocklist 172.21.15.39:0/782312916 expires 2024-05-10T05:27:28.034010+0000 2024-05-09T05:37:31.779 INFO:teuthology.orchestra.run.smithi039.stdout:blocklist 172.21.15.39:0/1899316433 expires 2024-05-10T05:27:28.034010+0000 2024-05-09T05:37:31.779 INFO:teuthology.orchestra.run.smithi039.stdout:blocklist 172.21.15.39:0/1613215795 expires 2024-05-10T05:27:00.650123+0000 2024-05-09T05:37:31.779 INFO:teuthology.orchestra.run.smithi039.stdout:blocklist 172.21.15.39:0/2870431271 expires 2024-05-10T05:27:00.650123+0000 2024-05-09T05:37:31.779 INFO:teuthology.orchestra.run.smithi039.stdout:blocklist 172.21.15.39:0/438945726 expires 2024-05-10T05:27:00.650123+0000 2024-05-09T05:37:31.779 INFO:teuthology.orchestra.run.smithi039.stdout:blocklist 172.21.15.39:6800/499609328 expires 2024-05-10T05:27:00.650123+0000 2024-05-09T05:37:31.779 INFO:teuthology.orchestra.run.smithi039.stdout:blocklist 172.21.15.39:6801/499609328 expires 2024-05-10T05:27:00.650123+0000 2024-05-09T05:37:31.779 INFO:teuthology.orchestra.run.smithi039.stdout:blocklist 172.21.15.39:0/1698165886 expires 2024-05-10T05:27:28.034010+0000 2024-05-09T05:37:31.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:31.785+0000 7fbaf805e700 1 -- 172.21.15.39:0/3495676463 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fbadc0b2880 msgr2=0x7fbadc0b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:31.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:31.785+0000 7fbaf805e700 1 --2- 172.21.15.39:0/3495676463 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fbadc0b2880 0x7fbadc0b4d90 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fbae0005950 tx=0x7fbae00058e0 comp rx=0 tx=0).stop 2024-05-09T05:37:31.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:31.785+0000 7fbaf805e700 1 -- 172.21.15.39:0/3495676463 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbaf0102c40 msgr2=0x7fbaf019cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:31.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:31.785+0000 7fbaf805e700 1 --2- 172.21.15.39:0/3495676463 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbaf0102c40 0x7fbaf019cae0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fbaec00d980 tx=0x7fbaec00dc90 comp rx=0 tx=0).stop 2024-05-09T05:37:31.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:31.786+0000 7fbaf805e700 1 -- 172.21.15.39:0/3495676463 shutdown_connections 2024-05-09T05:37:31.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:31.786+0000 7fbaf805e700 1 --2- 172.21.15.39:0/3495676463 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fbadc0b2880 0x7fbadc0b4d90 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:31.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:31.786+0000 7fbaf805e700 1 --2- 172.21.15.39:0/3495676463 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbaf0103ee0 0x7fbaf01a3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:31.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:31.786+0000 7fbaf805e700 1 --2- 172.21.15.39:0/3495676463 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbaf0102c40 0x7fbaf019cae0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:31.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:31.786+0000 7fbaf805e700 1 --2- 172.21.15.39:0/3495676463 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbaf0103590 0x7fbaf019d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:31.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:31.786+0000 7fbaf805e700 1 -- 172.21.15.39:0/3495676463 >> 172.21.15.39:0/3495676463 conn(0x7fbaf00fe890 msgr2=0x7fbaf010b270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:37:31.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:31.786+0000 7fbaf805e700 1 -- 172.21.15.39:0/3495676463 shutdown_connections 2024-05-09T05:37:31.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:31.786+0000 7fbaf805e700 1 -- 172.21.15.39:0/3495676463 wait complete. 2024-05-09T05:37:31.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:37:31 smithi060 ceph-mon[34555]: pgmap v374: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-09T05:37:32.395 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:37:32 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/3495676463' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-05-09T05:37:32.397 INFO:teuthology.run_tasks:Running task fs.ready... 2024-05-09T05:37:32.408 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-09T05:37:32.662 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T05:37:32.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:37:32 smithi100 ceph-mon[34353]: from='client.? 172.21.15.39:0/3495676463' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-05-09T05:37:32.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:37:32 smithi060 ceph-mon[34555]: from='client.? 172.21.15.39:0/3495676463' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-05-09T05:37:33.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:37:33 smithi100 ceph-mon[34353]: pgmap v375: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-09T05:37:33.786 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:37:33 smithi039 ceph-mon[30439]: pgmap v375: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-09T05:37:33.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:37:33 smithi060 ceph-mon[34555]: pgmap v375: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-09T05:37:34.400 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:34.406+0000 7f6bf9a90700 1 -- 172.21.15.39:0/3788458846 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6bf4108f30 msgr2=0x7f6bf4109340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:34.400 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:34.406+0000 7f6bf9a90700 1 --2- 172.21.15.39:0/3788458846 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6bf4108f30 0x7f6bf4109340 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f6be80099c0 tx=0x7f6be8009cd0 comp rx=0 tx=0).stop 2024-05-09T05:37:34.400 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:34.406+0000 7f6bf9a90700 1 -- 172.21.15.39:0/3788458846 shutdown_connections 2024-05-09T05:37:34.400 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:34.406+0000 7f6bf9a90700 1 --2- 172.21.15.39:0/3788458846 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bf4109880 0x7f6bf41111e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:34.400 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:34.406+0000 7f6bf9a90700 1 --2- 172.21.15.39:0/3788458846 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6bf4104650 0x7f6bf4104a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:34.400 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:34.406+0000 7f6bf9a90700 1 --2- 172.21.15.39:0/3788458846 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6bf4108f30 0x7f6bf4109340 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:34.400 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:34.406+0000 7f6bf9a90700 1 -- 172.21.15.39:0/3788458846 >> 172.21.15.39:0/3788458846 conn(0x7f6bf4079f00 msgr2=0x7f6bf407a340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:37:34.400 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:34.406+0000 7f6bf9a90700 1 -- 172.21.15.39:0/3788458846 shutdown_connections 2024-05-09T05:37:34.401 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:34.406+0000 7f6bf9a90700 1 -- 172.21.15.39:0/3788458846 wait complete. 2024-05-09T05:37:34.402 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:34.407+0000 7f6bf9a90700 1 Processor -- start 2024-05-09T05:37:34.402 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:34.407+0000 7f6bf9a90700 1 -- start start 2024-05-09T05:37:34.402 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:34.407+0000 7f6bf9a90700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6bf4104650 0x7f6bf419ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:34.402 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:34.407+0000 7f6bf9a90700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6bf4108f30 0x7f6bf419b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:34.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:34.407+0000 7f6bf9a90700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bf4109880 0x7f6bf419f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:34.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:34.407+0000 7f6bf9a90700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f6bf4114490 con 0x7f6bf4104650 2024-05-09T05:37:34.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:34.407+0000 7f6bf9a90700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6bf4114310 con 0x7f6bf4108f30 2024-05-09T05:37:34.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:34.407+0000 7f6bf9a90700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6bf4114610 con 0x7f6bf4109880 2024-05-09T05:37:34.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:34.407+0000 7f6bf37fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6bf4104650 0x7f6bf419ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:34.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:34.407+0000 7f6bf37fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6bf4104650 0x7f6bf419ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:46496/0 (socket says 172.21.15.39:46496) 2024-05-09T05:37:34.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:34.407+0000 7f6bf37fe700 1 -- 172.21.15.39:0/3527875880 learned_addr learned my addr 172.21.15.39:0/3527875880 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:37:34.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:34.407+0000 7f6bf2ffd700 1 --2- 172.21.15.39:0/3527875880 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6bf4108f30 0x7f6bf419b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:34.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:34.408+0000 7f6bf3fff700 1 --2- 172.21.15.39:0/3527875880 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bf4109880 0x7f6bf419f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:34.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:34.408+0000 7f6bf37fe700 1 -- 172.21.15.39:0/3527875880 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bf4109880 msgr2=0x7f6bf419f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:34.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:34.408+0000 7f6bf37fe700 1 --2- 172.21.15.39:0/3527875880 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bf4109880 0x7f6bf419f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:34.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:34.408+0000 7f6bf37fe700 1 -- 172.21.15.39:0/3527875880 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6bf4108f30 msgr2=0x7f6bf419b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:34.403 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:34.408+0000 7f6bf37fe700 1 --2- 172.21.15.39:0/3527875880 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6bf4108f30 0x7f6bf419b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:34.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:34.408+0000 7f6bf37fe700 1 -- 172.21.15.39:0/3527875880 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bf419fc60 con 0x7f6bf4104650 2024-05-09T05:37:34.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:34.408+0000 7f6bf37fe700 1 --2- 172.21.15.39:0/3527875880 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6bf4104650 0x7f6bf419ae40 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f6be400c9b0 tx=0x7f6be400ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:37:34.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:34.408+0000 7f6bf0ff9700 1 -- 172.21.15.39:0/3527875880 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6be4007b00 con 0x7f6bf4104650 2024-05-09T05:37:34.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:34.408+0000 7f6bf0ff9700 1 -- 172.21.15.39:0/3527875880 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6be400ce50 con 0x7f6bf4104650 2024-05-09T05:37:34.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:34.408+0000 7f6bf9a90700 1 -- 172.21.15.39:0/3527875880 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bf419ff50 con 0x7f6bf4104650 2024-05-09T05:37:34.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:34.408+0000 7f6bf0ff9700 1 -- 172.21.15.39:0/3527875880 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6be4018660 con 0x7f6bf4104650 2024-05-09T05:37:34.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:34.408+0000 7f6bf9a90700 1 -- 172.21.15.39:0/3527875880 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bf41a0460 con 0x7f6bf4104650 2024-05-09T05:37:34.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:34.409+0000 7f6bf9a90700 1 -- 172.21.15.39:0/3527875880 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bf40512c0 con 0x7f6bf4104650 2024-05-09T05:37:34.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:34.411+0000 7f6bf0ff9700 1 -- 172.21.15.39:0/3527875880 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f6be400f450 con 0x7f6bf4104650 2024-05-09T05:37:34.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:34.412+0000 7f6bf0ff9700 1 --2- 172.21.15.39:0/3527875880 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f6bdc0b2880 0x7f6bdc0b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:34.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:34.412+0000 7f6bf2ffd700 1 --2- 172.21.15.39:0/3527875880 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f6bdc0b2880 0x7f6bdc0b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:34.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:34.412+0000 7f6bf0ff9700 1 -- 172.21.15.39:0/3527875880 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f6be40e2130 con 0x7f6bf4104650 2024-05-09T05:37:34.406 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:34.412+0000 7f6bf2ffd700 1 --2- 172.21.15.39:0/3527875880 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f6bdc0b2880 0x7f6bdc0b4d90 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6be8006010 tx=0x7f6be8000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:37:34.410 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:34.417+0000 7f6bf0ff9700 1 -- 172.21.15.39:0/3527875880 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f6be4014030 con 0x7f6bf4104650 2024-05-09T05:37:34.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:34.680+0000 7f6bf9a90700 1 -- 172.21.15.39:0/3527875880 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6bf402e5f0 con 0x7f6bf4104650 2024-05-09T05:37:34.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:34.681+0000 7f6bf0ff9700 1 -- 172.21.15.39:0/3527875880 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11865 (secure 0 0 0) 0x7f6be40a9e60 con 0x7f6bf4104650 2024-05-09T05:37:34.674 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-09T05:37:34.674 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/1997969267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":1997969267},{"type":"v1","addr":"172.21.15.39:6835","nonce":1997969267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/283022063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":283022063},{"type":"v1","addr":"172.21.15.39:6837","nonce":283022063}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14604,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6839/669632573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":669632573},{"type":"v1","addr":"172.21.15.39:6839","nonce":669632573}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14616,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6841/2202260395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6840","nonce":2202260395},{"type":"v1","addr":"172.21.15.39:6841","nonce":2202260395}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24433,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/1308189973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":1308189973},{"type":"v1","addr":"172.21.15.100:6833","nonce":1308189973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24434,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/2789974692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2789974692},{"type":"v1","addr":"172.21.15.60:6833","nonce":2789974692}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-09T05:34:56.202280+0000","modified":"2024-05-09T05:35:16.063547+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24502,"mds_2":24487},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24461":{"gid":24461,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6835/924472374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":924472374},{"type":"v1","addr":"172.21.15.60:6835","nonce":924472374}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24479":{"gid":24479,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6837/3588840930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":3588840930},{"type":"v1","addr":"172.21.15.60:6837","nonce":3588840930}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.100:6835/2595255386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2595255386},{"type":"v1","addr":"172.21.15.100:6835","nonce":2595255386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":13,"addr":"172.21.15.100:6837/3676209932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":3676209932},{"type":"v1","addr":"172.21.15.100:6837","nonce":3676209932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":12,"addr":"172.21.15.100:6839/1395178742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1395178742},{"type":"v1","addr":"172.21.15.100:6839","nonce":1395178742}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.60:6839/1418956667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":1418956667},{"type":"v1","addr":"172.21.15.60:6839","nonce":1418956667}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24487,24502,24509]},"id":1}]} 2024-05-09T05:37:34.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:34.683+0000 7f6bf9a90700 1 -- 172.21.15.39:0/3527875880 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f6bdc0b2880 msgr2=0x7f6bdc0b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:34.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:34.683+0000 7f6bf9a90700 1 --2- 172.21.15.39:0/3527875880 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f6bdc0b2880 0x7f6bdc0b4d90 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6be8006010 tx=0x7f6be8000bc0 comp rx=0 tx=0).stop 2024-05-09T05:37:34.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:34.683+0000 7f6bf9a90700 1 -- 172.21.15.39:0/3527875880 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6bf4104650 msgr2=0x7f6bf419ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:34.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:34.683+0000 7f6bf9a90700 1 --2- 172.21.15.39:0/3527875880 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6bf4104650 0x7f6bf419ae40 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f6be400c9b0 tx=0x7f6be400ccc0 comp rx=0 tx=0).stop 2024-05-09T05:37:34.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:34.683+0000 7f6bf9a90700 1 -- 172.21.15.39:0/3527875880 shutdown_connections 2024-05-09T05:37:34.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:34.683+0000 7f6bf9a90700 1 --2- 172.21.15.39:0/3527875880 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f6bdc0b2880 0x7f6bdc0b4d90 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:34.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:34.683+0000 7f6bf9a90700 1 --2- 172.21.15.39:0/3527875880 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bf4109880 0x7f6bf419f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:34.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:34.683+0000 7f6bf9a90700 1 --2- 172.21.15.39:0/3527875880 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6bf4104650 0x7f6bf419ae40 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:34.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:34.683+0000 7f6bf9a90700 1 --2- 172.21.15.39:0/3527875880 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6bf4108f30 0x7f6bf419b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:34.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:34.683+0000 7f6bf9a90700 1 -- 172.21.15.39:0/3527875880 >> 172.21.15.39:0/3527875880 conn(0x7f6bf4079f00 msgr2=0x7f6bf4102050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:37:34.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:34.684+0000 7f6bf9a90700 1 -- 172.21.15.39:0/3527875880 shutdown_connections 2024-05-09T05:37:34.678 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:34.684+0000 7f6bf9a90700 1 -- 172.21.15.39:0/3527875880 wait complete. 2024-05-09T05:37:34.678 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 24 2024-05-09T05:37:35.278 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-09T05:37:35.531 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T05:37:35.609 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:37:35 smithi039 ceph-mon[30439]: pgmap v376: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-05-09T05:37:35.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:37:35 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/3527875880' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T05:37:35.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:37:35 smithi100 ceph-mon[34353]: pgmap v376: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-05-09T05:37:35.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:37:35 smithi100 ceph-mon[34353]: from='client.? 172.21.15.39:0/3527875880' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T05:37:35.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:37:35 smithi060 ceph-mon[34555]: pgmap v376: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-05-09T05:37:35.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:37:35 smithi060 ceph-mon[34555]: from='client.? 172.21.15.39:0/3527875880' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T05:37:37.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:37.075+0000 7f22926a9700 1 -- 172.21.15.39:0/634898776 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f228c107e30 msgr2=0x7f228c108240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:37.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:37.075+0000 7f22926a9700 1 --2- 172.21.15.39:0/634898776 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f228c107e30 0x7f228c108240 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f22740099c0 tx=0x7f2274009cd0 comp rx=0 tx=0).stop 2024-05-09T05:37:37.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:37.075+0000 7f22926a9700 1 -- 172.21.15.39:0/634898776 shutdown_connections 2024-05-09T05:37:37.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:37.075+0000 7f22926a9700 1 --2- 172.21.15.39:0/634898776 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f228c108780 0x7f228c1100e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:37.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:37.075+0000 7f22926a9700 1 --2- 172.21.15.39:0/634898776 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f228c103550 0x7f228c103960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:37.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:37.075+0000 7f22926a9700 1 --2- 172.21.15.39:0/634898776 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f228c107e30 0x7f228c108240 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:37.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:37.075+0000 7f22926a9700 1 -- 172.21.15.39:0/634898776 >> 172.21.15.39:0/634898776 conn(0x7f228c078e00 msgr2=0x7f228c079240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:37:37.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:37.075+0000 7f22926a9700 1 -- 172.21.15.39:0/634898776 shutdown_connections 2024-05-09T05:37:37.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:37.075+0000 7f22926a9700 1 -- 172.21.15.39:0/634898776 wait complete. 2024-05-09T05:37:37.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:37.076+0000 7f22926a9700 1 Processor -- start 2024-05-09T05:37:37.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:37.076+0000 7f22926a9700 1 -- start start 2024-05-09T05:37:37.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:37.076+0000 7f22926a9700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f228c103550 0x7f228c19aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:37.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:37.076+0000 7f22926a9700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f228c107e30 0x7f228c19b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:37.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:37.076+0000 7f22926a9700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f228c108780 0x7f228c19f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:37.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:37.076+0000 7f22926a9700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f228c113400 con 0x7f228c107e30 2024-05-09T05:37:37.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:37.076+0000 7f22926a9700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f228c113280 con 0x7f228c103550 2024-05-09T05:37:37.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:37.076+0000 7f22926a9700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f228c113580 con 0x7f228c108780 2024-05-09T05:37:37.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:37.076+0000 7f2283fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f228c107e30 0x7f228c19b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:37.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:37.076+0000 7f2283fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f228c107e30 0x7f228c19b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:59488/0 (socket says 172.21.15.39:59488) 2024-05-09T05:37:37.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:37.076+0000 7f2283fff700 1 -- 172.21.15.39:0/3531878326 learned_addr learned my addr 172.21.15.39:0/3531878326 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:37:37.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:37.076+0000 7f228bfff700 1 --2- 172.21.15.39:0/3531878326 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f228c103550 0x7f228c19aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:37.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:37.076+0000 7f2290c46700 1 --2- 172.21.15.39:0/3531878326 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f228c108780 0x7f228c19f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:37.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:37.076+0000 7f2283fff700 1 -- 172.21.15.39:0/3531878326 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f228c108780 msgr2=0x7f228c19f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:37.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:37.076+0000 7f2283fff700 1 --2- 172.21.15.39:0/3531878326 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f228c108780 0x7f228c19f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:37.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:37.076+0000 7f2283fff700 1 -- 172.21.15.39:0/3531878326 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f228c103550 msgr2=0x7f228c19aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:37.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:37.076+0000 7f2283fff700 1 --2- 172.21.15.39:0/3531878326 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f228c103550 0x7f228c19aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:37.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:37.076+0000 7f2283fff700 1 -- 172.21.15.39:0/3531878326 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f228c19fd70 con 0x7f228c107e30 2024-05-09T05:37:37.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:37.076+0000 7f2290c46700 1 --2- 172.21.15.39:0/3531878326 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f228c108780 0x7f228c19f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:37:37.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:37.077+0000 7f2283fff700 1 --2- 172.21.15.39:0/3531878326 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f228c107e30 0x7f228c19b440 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f22740098e0 tx=0x7f22740057c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:37:37.074 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:37.077+0000 7f2289ffb700 1 -- 172.21.15.39:0/3531878326 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2274027070 con 0x7f228c107e30 2024-05-09T05:37:37.074 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:37.077+0000 7f2289ffb700 1 -- 172.21.15.39:0/3531878326 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2274003f20 con 0x7f228c107e30 2024-05-09T05:37:37.074 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:37.077+0000 7f22926a9700 1 -- 172.21.15.39:0/3531878326 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f228c1a0000 con 0x7f228c107e30 2024-05-09T05:37:37.074 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:37.077+0000 7f2289ffb700 1 -- 172.21.15.39:0/3531878326 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2274022d70 con 0x7f228c107e30 2024-05-09T05:37:37.074 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:37.077+0000 7f22926a9700 1 -- 172.21.15.39:0/3531878326 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f228c1a7980 con 0x7f228c107e30 2024-05-09T05:37:37.074 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:37.078+0000 7f22926a9700 1 -- 172.21.15.39:0/3531878326 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f228c0512c0 con 0x7f228c107e30 2024-05-09T05:37:37.075 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:37.080+0000 7f2289ffb700 1 -- 172.21.15.39:0/3531878326 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f227402a070 con 0x7f228c107e30 2024-05-09T05:37:37.075 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:37.080+0000 7f2289ffb700 1 --2- 172.21.15.39:0/3531878326 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f22780b2900 0x7f22780b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:37.075 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:37.080+0000 7f228bfff700 1 --2- 172.21.15.39:0/3531878326 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f22780b2900 0x7f22780b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:37.075 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:37.081+0000 7f2289ffb700 1 -- 172.21.15.39:0/3531878326 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f22740e37a0 con 0x7f228c107e30 2024-05-09T05:37:37.075 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:37.081+0000 7f228bfff700 1 --2- 172.21.15.39:0/3531878326 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f22780b2900 0x7f22780b4e10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f227c007be0 tx=0x7f227c0073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:37:37.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:37.084+0000 7f2289ffb700 1 -- 172.21.15.39:0/3531878326 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f2274013070 con 0x7f228c107e30 2024-05-09T05:37:37.340 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:37.346+0000 7f22926a9700 1 -- 172.21.15.39:0/3531878326 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f228c02e5f0 con 0x7f228c107e30 2024-05-09T05:37:37.340 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:37.347+0000 7f2289ffb700 1 -- 172.21.15.39:0/3531878326 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11865 (secure 0 0 0) 0x7f22740ab560 con 0x7f228c107e30 2024-05-09T05:37:37.341 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-09T05:37:37.341 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/1997969267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":1997969267},{"type":"v1","addr":"172.21.15.39:6835","nonce":1997969267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/283022063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":283022063},{"type":"v1","addr":"172.21.15.39:6837","nonce":283022063}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14604,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6839/669632573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":669632573},{"type":"v1","addr":"172.21.15.39:6839","nonce":669632573}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14616,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6841/2202260395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6840","nonce":2202260395},{"type":"v1","addr":"172.21.15.39:6841","nonce":2202260395}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24433,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/1308189973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":1308189973},{"type":"v1","addr":"172.21.15.100:6833","nonce":1308189973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24434,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/2789974692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2789974692},{"type":"v1","addr":"172.21.15.60:6833","nonce":2789974692}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-09T05:34:56.202280+0000","modified":"2024-05-09T05:35:16.063547+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24502,"mds_2":24487},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24461":{"gid":24461,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6835/924472374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":924472374},{"type":"v1","addr":"172.21.15.60:6835","nonce":924472374}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24479":{"gid":24479,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6837/3588840930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":3588840930},{"type":"v1","addr":"172.21.15.60:6837","nonce":3588840930}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.100:6835/2595255386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2595255386},{"type":"v1","addr":"172.21.15.100:6835","nonce":2595255386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":13,"addr":"172.21.15.100:6837/3676209932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":3676209932},{"type":"v1","addr":"172.21.15.100:6837","nonce":3676209932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":12,"addr":"172.21.15.100:6839/1395178742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1395178742},{"type":"v1","addr":"172.21.15.100:6839","nonce":1395178742}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.60:6839/1418956667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":1418956667},{"type":"v1","addr":"172.21.15.60:6839","nonce":1418956667}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24487,24502,24509]},"id":1}]} 2024-05-09T05:37:37.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:37.350+0000 7f22926a9700 1 -- 172.21.15.39:0/3531878326 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f22780b2900 msgr2=0x7f22780b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:37.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:37.350+0000 7f22926a9700 1 --2- 172.21.15.39:0/3531878326 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f22780b2900 0x7f22780b4e10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f227c007be0 tx=0x7f227c0073d0 comp rx=0 tx=0).stop 2024-05-09T05:37:37.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:37.350+0000 7f22926a9700 1 -- 172.21.15.39:0/3531878326 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f228c107e30 msgr2=0x7f228c19b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:37.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:37.350+0000 7f22926a9700 1 --2- 172.21.15.39:0/3531878326 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f228c107e30 0x7f228c19b440 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f22740098e0 tx=0x7f22740057c0 comp rx=0 tx=0).stop 2024-05-09T05:37:37.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:37.350+0000 7f22926a9700 1 -- 172.21.15.39:0/3531878326 shutdown_connections 2024-05-09T05:37:37.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:37.350+0000 7f22926a9700 1 --2- 172.21.15.39:0/3531878326 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f22780b2900 0x7f22780b4e10 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:37.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:37.350+0000 7f22926a9700 1 --2- 172.21.15.39:0/3531878326 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f228c108780 0x7f228c19f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:37.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:37.350+0000 7f22926a9700 1 --2- 172.21.15.39:0/3531878326 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f228c103550 0x7f228c19aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:37.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:37.350+0000 7f22926a9700 1 --2- 172.21.15.39:0/3531878326 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f228c107e30 0x7f228c19b440 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:37.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:37.350+0000 7f22926a9700 1 -- 172.21.15.39:0/3531878326 >> 172.21.15.39:0/3531878326 conn(0x7f228c078e00 msgr2=0x7f228c075d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:37:37.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:37.350+0000 7f22926a9700 1 -- 172.21.15.39:0/3531878326 shutdown_connections 2024-05-09T05:37:37.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:37.350+0000 7f22926a9700 1 -- 172.21.15.39:0/3531878326 wait complete. 2024-05-09T05:37:37.344 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 24 2024-05-09T05:37:37.609 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:37:37 smithi039 ceph-mon[30439]: pgmap v377: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-09T05:37:37.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:37:37 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/3531878326' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T05:37:37.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:37:37 smithi100 ceph-mon[34353]: pgmap v377: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-09T05:37:37.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:37:37 smithi100 ceph-mon[34353]: from='client.? 172.21.15.39:0/3531878326' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T05:37:37.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:37:37 smithi060 ceph-mon[34555]: pgmap v377: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-09T05:37:37.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:37:37 smithi060 ceph-mon[34555]: from='client.? 172.21.15.39:0/3531878326' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T05:37:38.002 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-09T05:37:38.253 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T05:37:39.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:37:39 smithi100 ceph-mon[34353]: pgmap v378: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-09T05:37:39.689 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:37:39 smithi039 ceph-mon[30439]: pgmap v378: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-09T05:37:39.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:37:39 smithi060 ceph-mon[34555]: pgmap v378: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-09T05:37:39.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:39.923+0000 7f89cc1a5700 1 -- 172.21.15.39:0/1184021858 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f89c4109880 msgr2=0x7f89c41111e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:39.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:39.923+0000 7f89cc1a5700 1 --2- 172.21.15.39:0/1184021858 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f89c4109880 0x7f89c41111e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f89bc00b0d0 tx=0x7f89bc00b3e0 comp rx=0 tx=0).stop 2024-05-09T05:37:39.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:39.923+0000 7f89cc1a5700 1 -- 172.21.15.39:0/1184021858 shutdown_connections 2024-05-09T05:37:39.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:39.923+0000 7f89cc1a5700 1 --2- 172.21.15.39:0/1184021858 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f89c4109880 0x7f89c41111e0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:39.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:39.923+0000 7f89cc1a5700 1 --2- 172.21.15.39:0/1184021858 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f89c4104650 0x7f89c4104a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:39.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:39.923+0000 7f89cc1a5700 1 --2- 172.21.15.39:0/1184021858 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89c4108f30 0x7f89c4109340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:39.918 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:39.923+0000 7f89cc1a5700 1 -- 172.21.15.39:0/1184021858 >> 172.21.15.39:0/1184021858 conn(0x7f89c4079f00 msgr2=0x7f89c407a340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:37:39.918 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:39.923+0000 7f89cc1a5700 1 -- 172.21.15.39:0/1184021858 shutdown_connections 2024-05-09T05:37:39.918 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:39.923+0000 7f89cc1a5700 1 -- 172.21.15.39:0/1184021858 wait complete. 2024-05-09T05:37:39.919 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:39.924+0000 7f89cc1a5700 1 Processor -- start 2024-05-09T05:37:39.919 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:39.924+0000 7f89cc1a5700 1 -- start start 2024-05-09T05:37:39.920 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:39.925+0000 7f89cc1a5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89c4104650 0x7f89c419adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:39.920 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:39.925+0000 7f89cc1a5700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f89c4108f30 0x7f89c419b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:39.920 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:39.925+0000 7f89cc1a5700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f89c4109880 0x7f89c419f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:39.920 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:39.925+0000 7f89cc1a5700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f89c41144b0 con 0x7f89c4108f30 2024-05-09T05:37:39.920 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:39.925+0000 7f89cc1a5700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f89c4114330 con 0x7f89c4104650 2024-05-09T05:37:39.920 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:39.925+0000 7f89cc1a5700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f89c4114630 con 0x7f89c4109880 2024-05-09T05:37:39.920 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:39.925+0000 7f89c9740700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f89c4108f30 0x7f89c419b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:39.920 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:39.925+0000 7f89c9740700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f89c4108f30 0x7f89c419b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:59508/0 (socket says 172.21.15.39:59508) 2024-05-09T05:37:39.920 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:39.925+0000 7f89c9740700 1 -- 172.21.15.39:0/4283395238 learned_addr learned my addr 172.21.15.39:0/4283395238 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:37:39.920 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:39.925+0000 7f89ca742700 1 --2- 172.21.15.39:0/4283395238 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f89c4109880 0x7f89c419f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:39.920 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:39.925+0000 7f89c9f41700 1 --2- 172.21.15.39:0/4283395238 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89c4104650 0x7f89c419adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:39.920 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:39.925+0000 7f89c9740700 1 -- 172.21.15.39:0/4283395238 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f89c4109880 msgr2=0x7f89c419f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:39.921 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:39.925+0000 7f89c9740700 1 --2- 172.21.15.39:0/4283395238 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f89c4109880 0x7f89c419f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:39.921 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:39.925+0000 7f89c9740700 1 -- 172.21.15.39:0/4283395238 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89c4104650 msgr2=0x7f89c419adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:39.921 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:39.925+0000 7f89c9740700 1 --2- 172.21.15.39:0/4283395238 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89c4104650 0x7f89c419adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:39.921 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:39.925+0000 7f89c9740700 1 -- 172.21.15.39:0/4283395238 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89c419fc90 con 0x7f89c4108f30 2024-05-09T05:37:39.921 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:39.926+0000 7f89c9740700 1 --2- 172.21.15.39:0/4283395238 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f89c4108f30 0x7f89c419b360 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f89b400c8f0 tx=0x7f89b400cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:37:39.921 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:39.926+0000 7f89baffd700 1 -- 172.21.15.39:0/4283395238 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89b4007940 con 0x7f89c4108f30 2024-05-09T05:37:39.921 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:39.926+0000 7f89cc1a5700 1 -- 172.21.15.39:0/4283395238 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89c419ff80 con 0x7f89c4108f30 2024-05-09T05:37:39.921 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:39.926+0000 7f89baffd700 1 -- 172.21.15.39:0/4283395238 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f89b400f450 con 0x7f89c4108f30 2024-05-09T05:37:39.921 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:39.926+0000 7f89baffd700 1 -- 172.21.15.39:0/4283395238 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89b4018660 con 0x7f89c4108f30 2024-05-09T05:37:39.921 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:39.926+0000 7f89cc1a5700 1 -- 172.21.15.39:0/4283395238 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89c41a78a0 con 0x7f89c4108f30 2024-05-09T05:37:39.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:39.927+0000 7f89cc1a5700 1 -- 172.21.15.39:0/4283395238 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89c40512c0 con 0x7f89c4108f30 2024-05-09T05:37:39.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:39.928+0000 7f89baffd700 1 -- 172.21.15.39:0/4283395238 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f89b400f890 con 0x7f89c4108f30 2024-05-09T05:37:39.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:39.929+0000 7f89baffd700 1 --2- 172.21.15.39:0/4283395238 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f89b00b2880 0x7f89b00b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:39.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:39.929+0000 7f89c9f41700 1 --2- 172.21.15.39:0/4283395238 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f89b00b2880 0x7f89b00b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:39.923 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:39.929+0000 7f89baffd700 1 -- 172.21.15.39:0/4283395238 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f89b40e2100 con 0x7f89c4108f30 2024-05-09T05:37:39.923 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:39.930+0000 7f89c9f41700 1 --2- 172.21.15.39:0/4283395238 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f89b00b2880 0x7f89b00b4d90 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f89c0005fd0 tx=0x7f89c0005f60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:37:39.926 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:39.932+0000 7f89baffd700 1 -- 172.21.15.39:0/4283395238 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f89b4014030 con 0x7f89c4108f30 2024-05-09T05:37:40.145 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:40.151+0000 7f89cc1a5700 1 -- 172.21.15.39:0/4283395238 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f89c419c120 con 0x7f89c4108f30 2024-05-09T05:37:40.146 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:40.153+0000 7f89baffd700 1 -- 172.21.15.39:0/4283395238 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+22602 (secure 0 0 0) 0x7f89b40a9ec0 con 0x7f89c4108f30 2024-05-09T05:37:40.147 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-09T05:37:40.147 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":83,"fsid":"86d4cc60-0dc4-11ef-bc97-c7b262605968","created":"2024-05-09T05:26:33.514203+0000","modified":"2024-05-09T05:35:29.485823+0000","last_up_change":"2024-05-09T05:33:48.776015+0000","last_in_change":"2024-05-09T05:33:28.117875+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T05:29:56.122407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-09T05:34:49.964521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-09T05:34:52.915301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3491bbda-3a9b-40d2-8627-87d15660f864","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":1056276932},{"type":"v1","addr":"172.21.15.39:6803","nonce":1056276932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":1056276932},{"type":"v1","addr":"172.21.15.39:6805","nonce":1056276932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":1056276932},{"type":"v1","addr":"172.21.15.39:6809","nonce":1056276932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":1056276932},{"type":"v1","addr":"172.21.15.39:6807","nonce":1056276932}]},"public_addr":"172.21.15.39:6803/1056276932","cluster_addr":"172.21.15.39:6805/1056276932","heartbeat_back_addr":"172.21.15.39:6809/1056276932","heartbeat_front_addr":"172.21.15.39:6807/1056276932","state":["exists","up"]},{"osd":1,"uuid":"ec2bd2d0-2975-402c-9df8-3469dfd6070f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":4245630636},{"type":"v1","addr":"172.21.15.60:6801","nonce":4245630636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":4245630636},{"type":"v1","addr":"172.21.15.60:6803","nonce":4245630636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":4245630636},{"type":"v1","addr":"172.21.15.60:6807","nonce":4245630636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":4245630636},{"type":"v1","addr":"172.21.15.60:6805","nonce":4245630636}]},"public_addr":"172.21.15.60:6801/4245630636","cluster_addr":"172.21.15.60:6803/4245630636","heartbeat_back_addr":"172.21.15.60:6807/4245630636","heartbeat_front_addr":"172.21.15.60:6805/4245630636","state":["exists","up"]},{"osd":2,"uuid":"9efaf6dd-086e-4095-b92e-cbbecf738523","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":4141597693},{"type":"v1","addr":"172.21.15.100:6801","nonce":4141597693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":4141597693},{"type":"v1","addr":"172.21.15.100:6803","nonce":4141597693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":4141597693},{"type":"v1","addr":"172.21.15.100:6807","nonce":4141597693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":4141597693},{"type":"v1","addr":"172.21.15.100:6805","nonce":4141597693}]},"public_addr":"172.21.15.100:6801/4141597693","cluster_addr":"172.21.15.100:6803/4141597693","heartbeat_back_addr":"172.21.15.100:6807/4141597693","heartbeat_front_addr":"172.21.15.100:6805/4141597693","state":["exists","up"]},{"osd":3,"uuid":"1ebe1a25-541d-4b54-bed8-4f0ec51b2432","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":2254197543},{"type":"v1","addr":"172.21.15.39:6811","nonce":2254197543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":2254197543},{"type":"v1","addr":"172.21.15.39:6813","nonce":2254197543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2254197543},{"type":"v1","addr":"172.21.15.39:6817","nonce":2254197543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":2254197543},{"type":"v1","addr":"172.21.15.39:6815","nonce":2254197543}]},"public_addr":"172.21.15.39:6811/2254197543","cluster_addr":"172.21.15.39:6813/2254197543","heartbeat_back_addr":"172.21.15.39:6817/2254197543","heartbeat_front_addr":"172.21.15.39:6815/2254197543","state":["exists","up"]},{"osd":4,"uuid":"d52450a3-8a97-4746-a857-35aec69aac44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":649037162},{"type":"v1","addr":"172.21.15.60:6809","nonce":649037162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":649037162},{"type":"v1","addr":"172.21.15.60:6811","nonce":649037162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":649037162},{"type":"v1","addr":"172.21.15.60:6815","nonce":649037162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":649037162},{"type":"v1","addr":"172.21.15.60:6813","nonce":649037162}]},"public_addr":"172.21.15.60:6809/649037162","cluster_addr":"172.21.15.60:6811/649037162","heartbeat_back_addr":"172.21.15.60:6815/649037162","heartbeat_front_addr":"172.21.15.60:6813/649037162","state":["exists","up"]},{"osd":5,"uuid":"b35bf704-898d-40f7-b575-90267764a5b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":658409226},{"type":"v1","addr":"172.21.15.100:6809","nonce":658409226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":658409226},{"type":"v1","addr":"172.21.15.100:6811","nonce":658409226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":658409226},{"type":"v1","addr":"172.21.15.100:6815","nonce":658409226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":658409226},{"type":"v1","addr":"172.21.15.100:6813","nonce":658409226}]},"public_addr":"172.21.15.100:6809/658409226","cluster_addr":"172.21.15.100:6811/658409226","heartbeat_back_addr":"172.21.15.100:6815/658409226","heartbeat_front_addr":"172.21.15.100:6813/658409226","state":["exists","up"]},{"osd":6,"uuid":"49eae2f5-1dad-4c2c-89f4-efa1dd1faefb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":237628491},{"type":"v1","addr":"172.21.15.39:6819","nonce":237628491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":237628491},{"type":"v1","addr":"172.21.15.39:6821","nonce":237628491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":237628491},{"type":"v1","addr":"172.21.15.39:6825","nonce":237628491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":237628491},{"type":"v1","addr":"172.21.15.39:6823","nonce":237628491}]},"public_addr":"172.21.15.39:6819/237628491","cluster_addr":"172.21.15.39:6821/237628491","heartbeat_back_addr":"172.21.15.39:6825/237628491","heartbeat_front_addr":"172.21.15.39:6823/237628491","state":["exists","up"]},{"osd":7,"uuid":"60ccae54-535c-4a13-98d0-881c00b5e870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":2718201647},{"type":"v1","addr":"172.21.15.60:6817","nonce":2718201647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":2718201647},{"type":"v1","addr":"172.21.15.60:6819","nonce":2718201647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":2718201647},{"type":"v1","addr":"172.21.15.60:6823","nonce":2718201647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":2718201647},{"type":"v1","addr":"172.21.15.60:6821","nonce":2718201647}]},"public_addr":"172.21.15.60:6817/2718201647","cluster_addr":"172.21.15.60:6819/2718201647","heartbeat_back_addr":"172.21.15.60:6823/2718201647","heartbeat_front_addr":"172.21.15.60:6821/2718201647","state":["exists","up"]},{"osd":8,"uuid":"edd52a21-0066-429f-9e98-15d1a74c53b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":1757558317},{"type":"v1","addr":"172.21.15.100:6817","nonce":1757558317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":1757558317},{"type":"v1","addr":"172.21.15.100:6819","nonce":1757558317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":1757558317},{"type":"v1","addr":"172.21.15.100:6823","nonce":1757558317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":1757558317},{"type":"v1","addr":"172.21.15.100:6821","nonce":1757558317}]},"public_addr":"172.21.15.100:6817/1757558317","cluster_addr":"172.21.15.100:6819/1757558317","heartbeat_back_addr":"172.21.15.100:6823/1757558317","heartbeat_front_addr":"172.21.15.100:6821/1757558317","state":["exists","up"]},{"osd":9,"uuid":"03fb7543-3386-49a4-b165-1007f07d88d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":2944584368},{"type":"v1","addr":"172.21.15.39:6827","nonce":2944584368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":2944584368},{"type":"v1","addr":"172.21.15.39:6829","nonce":2944584368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":2944584368},{"type":"v1","addr":"172.21.15.39:6833","nonce":2944584368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":2944584368},{"type":"v1","addr":"172.21.15.39:6831","nonce":2944584368}]},"public_addr":"172.21.15.39:6827/2944584368","cluster_addr":"172.21.15.39:6829/2944584368","heartbeat_back_addr":"172.21.15.39:6833/2944584368","heartbeat_front_addr":"172.21.15.39:6831/2944584368","state":["exists","up"]},{"osd":10,"uuid":"c1cadd6c-fcc4-4d76-b07e-0f392066a8d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1940670367},{"type":"v1","addr":"172.21.15.60:6825","nonce":1940670367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":1940670367},{"type":"v1","addr":"172.21.15.60:6827","nonce":1940670367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":1940670367},{"type":"v1","addr":"172.21.15.60:6831","nonce":1940670367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":1940670367},{"type":"v1","addr":"172.21.15.60:6829","nonce":1940670367}]},"public_addr":"172.21.15.60:6825/1940670367","cluster_addr":"172.21.15.60:6827/1940670367","heartbeat_back_addr":"172.21.15.60:6831/1940670367","heartbeat_front_addr":"172.21.15.60:6829/1940670367","state":["exists","up"]},{"osd":11,"uuid":"56806877-9ce2-41e2-9506-ce67897fa09b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":3318561029},{"type":"v1","addr":"172.21.15.100:6825","nonce":3318561029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":3318561029},{"type":"v1","addr":"172.21.15.100:6827","nonce":3318561029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":3318561029},{"type":"v1","addr":"172.21.15.100:6831","nonce":3318561029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":3318561029},{"type":"v1","addr":"172.21.15.100:6829","nonce":3318561029}]},"public_addr":"172.21.15.100:6825/3318561029","cluster_addr":"172.21.15.100:6827/3318561029","heartbeat_back_addr":"172.21.15.100:6831/3318561029","heartbeat_front_addr":"172.21.15.100:6829/3318561029","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:29:03.565705+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:29:28.380764+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:29:53.300224+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:30:20.046517+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:30:45.557983+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:31:10.397933+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:31:37.644428+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:32:02.325329+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:32:27.699044+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:32:54.436305+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:33:20.691300+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:33:46.806146+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.39:6801/4091500272":"2024-05-10T05:27:28.034010+0000","172.21.15.39:6800/4091500272":"2024-05-10T05:27:28.034010+0000","172.21.15.39:0/782312916":"2024-05-10T05:27:28.034010+0000","172.21.15.39:0/1899316433":"2024-05-10T05:27:28.034010+0000","172.21.15.39:0/1613215795":"2024-05-10T05:27:00.650123+0000","172.21.15.39:0/2870431271":"2024-05-10T05:27:00.650123+0000","172.21.15.39:0/438945726":"2024-05-10T05:27:00.650123+0000","172.21.15.39:6800/499609328":"2024-05-10T05:27:00.650123+0000","172.21.15.39:6801/499609328":"2024-05-10T05:27:00.650123+0000","172.21.15.39:0/1698165886":"2024-05-10T05:27:28.034010+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T05:37:40.149 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:40.155+0000 7f89cc1a5700 1 -- 172.21.15.39:0/4283395238 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f89b00b2880 msgr2=0x7f89b00b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:40.149 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:40.155+0000 7f89cc1a5700 1 --2- 172.21.15.39:0/4283395238 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f89b00b2880 0x7f89b00b4d90 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f89c0005fd0 tx=0x7f89c0005f60 comp rx=0 tx=0).stop 2024-05-09T05:37:40.149 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:40.155+0000 7f89cc1a5700 1 -- 172.21.15.39:0/4283395238 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f89c4108f30 msgr2=0x7f89c419b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:40.149 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:40.155+0000 7f89cc1a5700 1 --2- 172.21.15.39:0/4283395238 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f89c4108f30 0x7f89c419b360 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f89b400c8f0 tx=0x7f89b400cc00 comp rx=0 tx=0).stop 2024-05-09T05:37:40.149 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:40.155+0000 7f89cc1a5700 1 -- 172.21.15.39:0/4283395238 shutdown_connections 2024-05-09T05:37:40.149 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:40.155+0000 7f89cc1a5700 1 --2- 172.21.15.39:0/4283395238 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f89b00b2880 0x7f89b00b4d90 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:40.149 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:40.155+0000 7f89cc1a5700 1 --2- 172.21.15.39:0/4283395238 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f89c4109880 0x7f89c419f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:40.149 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:40.155+0000 7f89cc1a5700 1 --2- 172.21.15.39:0/4283395238 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89c4104650 0x7f89c419adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:40.149 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:40.155+0000 7f89cc1a5700 1 --2- 172.21.15.39:0/4283395238 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f89c4108f30 0x7f89c419b360 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:40.149 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:40.155+0000 7f89cc1a5700 1 -- 172.21.15.39:0/4283395238 >> 172.21.15.39:0/4283395238 conn(0x7f89c4079f00 msgr2=0x7f89c4101f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:37:40.149 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:40.155+0000 7f89cc1a5700 1 -- 172.21.15.39:0/4283395238 shutdown_connections 2024-05-09T05:37:40.150 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:40.155+0000 7f89cc1a5700 1 -- 172.21.15.39:0/4283395238 wait complete. 2024-05-09T05:37:40.464 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:37:40 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/4283395238' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T05:37:40.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:37:40 smithi100 ceph-mon[34353]: from='client.? 172.21.15.39:0/4283395238' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T05:37:40.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:37:40 smithi060 ceph-mon[34555]: from='client.? 172.21.15.39:0/4283395238' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T05:37:40.880 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-05-09T05:34:56.202280+0000', 'modified': '2024-05-09T05:35:16.063547+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24509, 'mds_1': 24502, 'mds_2': 24487}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24461': {'gid': 24461, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.60:6835/924472374', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6834', 'nonce': 924472374}, {'type': 'v1', 'addr': '172.21.15.60:6835', 'nonce': 924472374}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24479': {'gid': 24479, 'name': 'h', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.60:6837/3588840930', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6836', 'nonce': 3588840930}, {'type': 'v1', 'addr': '172.21.15.60:6837', 'nonce': 3588840930}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24481': {'gid': 24481, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.100:6835/2595255386', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.100:6834', 'nonce': 2595255386}, {'type': 'v1', 'addr': '172.21.15.100:6835', 'nonce': 2595255386}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24487': {'gid': 24487, 'name': 'c', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 13, 'addr': '172.21.15.100:6837/3676209932', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.100:6836', 'nonce': 3676209932}, {'type': 'v1', 'addr': '172.21.15.100:6837', 'nonce': 3676209932}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24502': {'gid': 24502, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.100:6839/1395178742', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.100:6838', 'nonce': 1395178742}, {'type': 'v1', 'addr': '172.21.15.100:6839', 'nonce': 1395178742}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24509': {'gid': 24509, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.60:6839/1418956667', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6838', 'nonce': 1418956667}, {'type': 'v1', 'addr': '172.21.15.60:6839', 'nonce': 1418956667}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24509, 'qdb_cluster': [24487, 24502, 24509]} 2024-05-09T05:37:40.880 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-05-09T05:37:40.880 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph tell mds.c status 2024-05-09T05:37:41.137 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T05:37:41.552 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:37:41 smithi039 ceph-mon[30439]: pgmap v379: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-09T05:37:41.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:37:41 smithi100 ceph-mon[34353]: pgmap v379: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-09T05:37:41.697 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:37:41 smithi060 ceph-mon[34555]: pgmap v379: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-09T05:37:42.819 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.825+0000 7f3186dca700 1 -- 172.21.15.39:0/4184406066 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f31801034e0 msgr2=0x7f31801038f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:42.819 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.825+0000 7f3186dca700 1 --2- 172.21.15.39:0/4184406066 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f31801034e0 0x7f31801038f0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f31740099c0 tx=0x7f3174009cd0 comp rx=0 tx=0).stop 2024-05-09T05:37:42.819 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.825+0000 7f3186dca700 1 -- 172.21.15.39:0/4184406066 shutdown_connections 2024-05-09T05:37:42.819 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.825+0000 7f3186dca700 1 --2- 172.21.15.39:0/4184406066 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3180108760 0x7f31801100c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:42.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.825+0000 7f3186dca700 1 --2- 172.21.15.39:0/4184406066 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f31801034e0 0x7f31801038f0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:42.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.825+0000 7f3186dca700 1 --2- 172.21.15.39:0/4184406066 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3180107e10 0x7f3180108220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:42.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.825+0000 7f3186dca700 1 -- 172.21.15.39:0/4184406066 >> 172.21.15.39:0/4184406066 conn(0x7f31800fef30 msgr2=0x7f3180101350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:37:42.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.825+0000 7f3186dca700 1 -- 172.21.15.39:0/4184406066 shutdown_connections 2024-05-09T05:37:42.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.825+0000 7f3186dca700 1 -- 172.21.15.39:0/4184406066 wait complete. 2024-05-09T05:37:42.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.826+0000 7f3186dca700 1 Processor -- start 2024-05-09T05:37:42.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.826+0000 7f3186dca700 1 -- start start 2024-05-09T05:37:42.822 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.826+0000 7f3186dca700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31801034e0 0x7f31801a1450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:42.822 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.826+0000 7f3186dca700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3180107e10 0x7f31801a19f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:42.822 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.826+0000 7f3186dca700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3180108760 0x7f31801a5c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:42.822 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.826+0000 7f3186dca700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f3180113390 con 0x7f3180107e10 2024-05-09T05:37:42.822 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.826+0000 7f3186dca700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f3180113210 con 0x7f3180108760 2024-05-09T05:37:42.822 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.826+0000 7f3186dca700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3180113510 con 0x7f31801034e0 2024-05-09T05:37:42.822 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.826+0000 7f317ffff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3180107e10 0x7f31801a19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:42.822 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.826+0000 7f317ffff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3180107e10 0x7f31801a19f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:59528/0 (socket says 172.21.15.39:59528) 2024-05-09T05:37:42.822 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.826+0000 7f317ffff700 1 -- 172.21.15.39:0/2970233882 learned_addr learned my addr 172.21.15.39:0/2970233882 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:37:42.822 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.827+0000 7f3184b66700 1 --2- 172.21.15.39:0/2970233882 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31801034e0 0x7f31801a1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:42.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.827+0000 7f3185367700 1 --2- 172.21.15.39:0/2970233882 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3180108760 0x7f31801a5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:42.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.827+0000 7f317ffff700 1 -- 172.21.15.39:0/2970233882 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31801034e0 msgr2=0x7f31801a1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:42.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.827+0000 7f317ffff700 1 --2- 172.21.15.39:0/2970233882 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31801034e0 0x7f31801a1450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:42.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.827+0000 7f317ffff700 1 -- 172.21.15.39:0/2970233882 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3180108760 msgr2=0x7f31801a5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:42.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.827+0000 7f317ffff700 1 --2- 172.21.15.39:0/2970233882 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3180108760 0x7f31801a5c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:42.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.827+0000 7f317ffff700 1 -- 172.21.15.39:0/2970233882 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31801a6320 con 0x7f3180107e10 2024-05-09T05:37:42.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.827+0000 7f3185367700 1 --2- 172.21.15.39:0/2970233882 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3180108760 0x7f31801a5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:37:42.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.827+0000 7f317ffff700 1 --2- 172.21.15.39:0/2970233882 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3180107e10 0x7f31801a19f0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f316c00d980 tx=0x7f316c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:37:42.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.827+0000 7f317dffb700 1 -- 172.21.15.39:0/2970233882 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f316c017070 con 0x7f3180107e10 2024-05-09T05:37:42.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.827+0000 7f3186dca700 1 -- 172.21.15.39:0/2970233882 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31801a6610 con 0x7f3180107e10 2024-05-09T05:37:42.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.827+0000 7f317dffb700 1 -- 172.21.15.39:0/2970233882 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f316c009de0 con 0x7f3180107e10 2024-05-09T05:37:42.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.827+0000 7f317dffb700 1 -- 172.21.15.39:0/2970233882 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f316c00f3c0 con 0x7f3180107e10 2024-05-09T05:37:42.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.828+0000 7f3186dca700 1 -- 172.21.15.39:0/2970233882 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31801adf30 con 0x7f3180107e10 2024-05-09T05:37:42.824 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.830+0000 7f317dffb700 1 -- 172.21.15.39:0/2970233882 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f316c009930 con 0x7f3180107e10 2024-05-09T05:37:42.824 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.831+0000 7f317dffb700 1 --2- 172.21.15.39:0/2970233882 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f31700b2880 0x7f31700b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:42.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.831+0000 7f3184b66700 1 --2- 172.21.15.39:0/2970233882 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f31700b2880 0x7f31700b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:42.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.831+0000 7f317dffb700 1 -- 172.21.15.39:0/2970233882 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f316c0e1db0 con 0x7f3180107e10 2024-05-09T05:37:42.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.831+0000 7f3184b66700 1 --2- 172.21.15.39:0/2970233882 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f31700b2880 0x7f31700b4d90 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3174009990 tx=0x7f31740036e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:37:42.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.832+0000 7f31957e0b80 1 Processor -- start 2024-05-09T05:37:42.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.832+0000 7f31957e0b80 1 -- start start 2024-05-09T05:37:42.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.832+0000 7f31957e0b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55838c036cb0 0x55838c13f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:42.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.832+0000 7f31957e0b80 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55838bfbc450 0x55838c13f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:42.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.832+0000 7f31957e0b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55838c1393b0 0x55838c1397c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:42.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.832+0000 7f31957e0b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55838c05c050 con 0x55838c036cb0 2024-05-09T05:37:42.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.832+0000 7f31957e0b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55838c001950 con 0x55838c1393b0 2024-05-09T05:37:42.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.832+0000 7f31957e0b80 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55838c058010 con 0x55838bfbc450 2024-05-09T05:37:42.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.832+0000 7f3184b66700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55838c036cb0 0x55838c13f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:42.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.832+0000 7f3184b66700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55838c036cb0 0x55838c13f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:59530/0 (socket says 172.21.15.39:59530) 2024-05-09T05:37:42.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.832+0000 7f3184b66700 1 -- 172.21.15.39:0/3734937547 learned_addr learned my addr 172.21.15.39:0/3734937547 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:37:42.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.832+0000 7f317ffff700 1 --2- 172.21.15.39:0/3734937547 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55838bfbc450 0x55838c13f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:42.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.832+0000 7f3185367700 1 --2- 172.21.15.39:0/3734937547 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55838c1393b0 0x55838c1397c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:42.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.833+0000 7f3184b66700 1 -- 172.21.15.39:0/3734937547 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55838bfbc450 msgr2=0x55838c13f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:37:42.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.833+0000 7f3184b66700 1 --2- 172.21.15.39:0/3734937547 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55838bfbc450 0x55838c13f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:42.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.833+0000 7f3184b66700 1 -- 172.21.15.39:0/3734937547 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55838c1393b0 msgr2=0x55838c1397c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:37:42.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.833+0000 7f3184b66700 1 --2- 172.21.15.39:0/3734937547 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55838c1393b0 0x55838c1397c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:42.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.833+0000 7f3184b66700 1 -- 172.21.15.39:0/3734937547 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55838bff24b0 con 0x55838c036cb0 2024-05-09T05:37:42.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.833+0000 7f317ffff700 1 --2- 172.21.15.39:0/3734937547 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55838bfbc450 0x55838c13f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T05:37:42.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.833+0000 7f3184b66700 1 --2- 172.21.15.39:0/3734937547 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55838c036cb0 0x55838c13f1f0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f31740099c0 tx=0x7f317401e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf488d89eb69594a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:37:42.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.833+0000 7f316affd700 1 -- 172.21.15.39:0/3734937547 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3174005430 con 0x55838c036cb0 2024-05-09T05:37:42.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.833+0000 7f316affd700 1 -- 172.21.15.39:0/3734937547 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f31740055d0 con 0x55838c036cb0 2024-05-09T05:37:42.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.833+0000 7f316affd700 1 -- 172.21.15.39:0/3734937547 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f317400faa0 con 0x55838c036cb0 2024-05-09T05:37:42.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.834+0000 7f31957e0b80 1 -- 172.21.15.39:0/3734937547 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55838c036cb0 msgr2=0x55838c13f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:42.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.834+0000 7f31957e0b80 1 --2- 172.21.15.39:0/3734937547 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55838c036cb0 0x55838c13f1f0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f31740099c0 tx=0x7f317401e000 comp rx=0 tx=0).stop 2024-05-09T05:37:42.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.834+0000 7f31957e0b80 1 -- 172.21.15.39:0/3734937547 shutdown_connections 2024-05-09T05:37:42.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.834+0000 7f31957e0b80 1 --2- 172.21.15.39:0/3734937547 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55838c1393b0 0x55838c1397c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:42.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.834+0000 7f31957e0b80 1 --2- 172.21.15.39:0/3734937547 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55838c036cb0 0x55838c13f1f0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:42.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.834+0000 7f31957e0b80 1 --2- 172.21.15.39:0/3734937547 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55838bfbc450 0x55838c13f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:42.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.834+0000 7f31957e0b80 1 -- 172.21.15.39:0/3734937547 >> 172.21.15.39:0/3734937547 conn(0x55838bfbff20 msgr2=0x55838c1341d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:37:42.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.834+0000 7f31957e0b80 1 -- 172.21.15.39:0/3734937547 shutdown_connections 2024-05-09T05:37:42.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.834+0000 7f31957e0b80 1 -- 172.21.15.39:0/3734937547 wait complete. 2024-05-09T05:37:42.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.834+0000 7f31957e0b80 1 -- start start 2024-05-09T05:37:42.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.835+0000 7f31957e0b80 1 Processor -- start 2024-05-09T05:37:42.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.835+0000 7f31957e0b80 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55838bfbc450 0x55838c142ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:42.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.835+0000 7f31957e0b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55838c036cb0 0x55838c143530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:42.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.835+0000 7f31957e0b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55838c1393b0 0x55838c143a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:42.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.835+0000 7f31957e0b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55838c13a050 con 0x55838c1393b0 2024-05-09T05:37:42.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.835+0000 7f31957e0b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55838bff6ad0 con 0x55838c036cb0 2024-05-09T05:37:42.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.835+0000 7f31957e0b80 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55838c13a1d0 con 0x55838bfbc450 2024-05-09T05:37:42.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.835+0000 7f31957e0b80 10 client.0 _ll_register_callbacks cb 0x55838becd670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T05:37:42.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.835+0000 7f3185367700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55838c1393b0 0x55838c143a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:42.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.835+0000 7f3185367700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55838c1393b0 0x55838c143a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:59532/0 (socket says 172.21.15.39:59532) 2024-05-09T05:37:42.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.835+0000 7f3185367700 1 -- 172.21.15.39:0/49840608 learned_addr learned my addr 172.21.15.39:0/49840608 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:37:42.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.835+0000 7f3184b66700 1 --2- 172.21.15.39:0/49840608 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55838bfbc450 0x55838c142ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:42.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.835+0000 7f317ffff700 1 --2- 172.21.15.39:0/49840608 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55838c036cb0 0x55838c143530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:42.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.835+0000 7f3185367700 1 -- 172.21.15.39:0/49840608 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55838bfbc450 msgr2=0x55838c142ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:37:42.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.835+0000 7f3185367700 1 --2- 172.21.15.39:0/49840608 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55838bfbc450 0x55838c142ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:42.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.836+0000 7f3185367700 1 -- 172.21.15.39:0/49840608 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55838c036cb0 msgr2=0x55838c143530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:37:42.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.836+0000 7f3185367700 1 --2- 172.21.15.39:0/49840608 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55838c036cb0 0x55838c143530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:42.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.836+0000 7f3185367700 1 -- 172.21.15.39:0/49840608 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55838bed7440 con 0x55838c1393b0 2024-05-09T05:37:42.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.836+0000 7f3185367700 1 --2- 172.21.15.39:0/49840608 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55838c1393b0 0x55838c143a70 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f3178007b70 tx=0x7f3178007e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6c1e1266a4480df server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:37:42.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.836+0000 7f315ffff700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-05-09T05:37:42.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.836+0000 7f315ffff700 1 -- 172.21.15.39:0/49840608 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3178010860 con 0x55838c1393b0 2024-05-09T05:37:42.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.836+0000 7f315ffff700 1 -- 172.21.15.39:0/49840608 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f3178010a00 con 0x55838c1393b0 2024-05-09T05:37:42.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.836+0000 7f31957e0b80 1 -- 172.21.15.39:0/49840608 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f31740055d0 con 0x55838c1393b0 2024-05-09T05:37:42.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.836+0000 7f315ffff700 1 -- 172.21.15.39:0/49840608 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f3178010c00 con 0x55838c1393b0 2024-05-09T05:37:42.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.836+0000 7f31957e0b80 10 client.15090 fetch_fsmap learned FSMap version 24 2024-05-09T05:37:42.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.836+0000 7f31957e0b80 1 -- 172.21.15.39:0/49840608 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55838c1509c0 con 0x55838c1393b0 2024-05-09T05:37:42.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.836+0000 7f315ffff700 1 -- 172.21.15.39:0/49840608 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f31740055d0 con 0x55838c1393b0 2024-05-09T05:37:42.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.837+0000 7f315ffff700 1 -- 172.21.15.39:0/49840608 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f317801f400 con 0x55838c1393b0 2024-05-09T05:37:42.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.837+0000 7f31957e0b80 10 client.15090 fetch_fsmap finished waiting for FSMap version 24 2024-05-09T05:37:42.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.837+0000 7f31957e0b80 10 client.15090 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-09T05:37:42.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.837+0000 7f31957e0b80 20 client.15090 populate_metadata read hostname 'smithi039' 2024-05-09T05:37:42.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.837+0000 7f31957e0b80 1 --2- 172.21.15.39:0/49840608 >> [v2:172.21.15.100:6836/3676209932,v1:172.21.15.100:6837/3676209932] conn(0x55838c153010 0x55838c154480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:42.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.837+0000 7f31957e0b80 4 client.15090 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T05:37:42.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.837+0000 7f31957e0b80 1 -- 172.21.15.39:0/49840608 --> [v2:172.21.15.100:6836/3676209932,v1:172.21.15.100:6837/3676209932] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55838c069a30 con 0x55838c153010 2024-05-09T05:37:42.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.837+0000 7f3184b66700 1 --2- 172.21.15.39:0/49840608 >> [v2:172.21.15.100:6836/3676209932,v1:172.21.15.100:6837/3676209932] conn(0x55838c153010 0x55838c154480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:42.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.838+0000 7f315ffff700 10 client.15090 ms_handle_connect on v2:172.21.15.100:6836/3676209932 2024-05-09T05:37:42.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.838+0000 7f3184b66700 1 --2- 172.21.15.39:0/49840608 >> [v2:172.21.15.100:6836/3676209932,v1:172.21.15.100:6837/3676209932] conn(0x55838c153010 0x55838c154480 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2cd776bb380ab459 server_cookie=fe56400ca7b901c8 in_seq=0 out_seq=0 2024-05-09T05:37:42.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.838+0000 7f315ffff700 1 -- 172.21.15.39:0/49840608 <== mds.2 v2:172.21.15.100:6836/3676209932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55838c069a30 con 0x55838c153010 2024-05-09T05:37:42.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.838+0000 7f315ffff700 10 client.15090 handle_command_reply: tid=0 2024-05-09T05:37:42.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.838+0000 7f31957e0b80 1 client.15090 shutdown 2024-05-09T05:37:42.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.838+0000 7f31957e0b80 1 -- 172.21.15.39:0/49840608 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55838c1393b0 msgr2=0x55838c143a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:42.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.838+0000 7f31957e0b80 1 --2- 172.21.15.39:0/49840608 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55838c1393b0 0x55838c143a70 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f3178007b70 tx=0x7f3178007e80 comp rx=0 tx=0).stop 2024-05-09T05:37:42.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.838+0000 7f31957e0b80 1 -- 172.21.15.39:0/49840608 shutdown_connections 2024-05-09T05:37:42.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.838+0000 7f31957e0b80 1 --2- 172.21.15.39:0/49840608 >> [v2:172.21.15.100:6836/3676209932,v1:172.21.15.100:6837/3676209932] conn(0x55838c153010 0x55838c154480 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:42.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.839+0000 7f31957e0b80 1 --2- 172.21.15.39:0/49840608 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55838c1393b0 0x55838c143a70 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:42.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.839+0000 7f31957e0b80 1 --2- 172.21.15.39:0/49840608 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55838bfbc450 0x55838c142ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:42.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.839+0000 7f315ffff700 0 client.15090 ms_handle_reset on v2:172.21.15.100:6836/3676209932 2024-05-09T05:37:42.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.839+0000 7f31957e0b80 1 --2- 172.21.15.39:0/49840608 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55838c036cb0 0x55838c143530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:42.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.839+0000 7f31957e0b80 1 -- 172.21.15.39:0/49840608 >> 172.21.15.39:0/49840608 conn(0x55838bfbff20 msgr2=0x55838c12dfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:37:42.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.839+0000 7f31957e0b80 1 -- 172.21.15.39:0/49840608 shutdown_connections 2024-05-09T05:37:42.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.839+0000 7f31957e0b80 1 -- 172.21.15.39:0/49840608 wait complete. 2024-05-09T05:37:42.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.839+0000 7f31957e0b80 20 client.15090 trim_cache size 0 max 16384 2024-05-09T05:37:42.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.860+0000 7f31957e0b80 1 Processor -- start 2024-05-09T05:37:42.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.860+0000 7f31957e0b80 1 -- start start 2024-05-09T05:37:42.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.860+0000 7f31957e0b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55838bfbc450 0x55838c14f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:42.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.860+0000 7f31957e0b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55838c036cb0 0x55838c141ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:42.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.860+0000 7f31957e0b80 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55838c1393b0 0x55838c15d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:42.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.860+0000 7f31957e0b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55838c1527c0 con 0x55838c036cb0 2024-05-09T05:37:42.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.860+0000 7f31957e0b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55838c152e90 con 0x55838bfbc450 2024-05-09T05:37:42.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.860+0000 7f31957e0b80 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55838c153560 con 0x55838c1393b0 2024-05-09T05:37:42.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.860+0000 7f317ffff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55838c036cb0 0x55838c141ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:42.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.860+0000 7f317ffff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55838c036cb0 0x55838c141ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:59542/0 (socket says 172.21.15.39:59542) 2024-05-09T05:37:42.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.860+0000 7f317ffff700 1 -- 172.21.15.39:0/188467129 learned_addr learned my addr 172.21.15.39:0/188467129 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:37:42.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.860+0000 7f3184b66700 1 --2- 172.21.15.39:0/188467129 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55838bfbc450 0x55838c14f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:42.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.861+0000 7f317ffff700 1 -- 172.21.15.39:0/188467129 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55838c1393b0 msgr2=0x55838c15d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:37:42.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.861+0000 7f317ffff700 1 --2- 172.21.15.39:0/188467129 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55838c1393b0 0x55838c15d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:42.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.861+0000 7f317ffff700 1 -- 172.21.15.39:0/188467129 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55838bfbc450 msgr2=0x55838c14f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:37:42.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.861+0000 7f317ffff700 1 --2- 172.21.15.39:0/188467129 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55838bfbc450 0x55838c14f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:42.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.861+0000 7f317ffff700 1 -- 172.21.15.39:0/188467129 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55838c130980 con 0x55838c036cb0 2024-05-09T05:37:42.856 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.861+0000 7f317ffff700 1 --2- 172.21.15.39:0/188467129 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55838c036cb0 0x55838c141ff0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f316c00d950 tx=0x7f316c0a9a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44c545c553bb4715 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:37:42.856 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.861+0000 7f316a7fc700 1 -- 172.21.15.39:0/188467129 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f316c0c3070 con 0x55838c036cb0 2024-05-09T05:37:42.856 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.861+0000 7f316a7fc700 1 -- 172.21.15.39:0/188467129 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f316c0b21e0 con 0x55838c036cb0 2024-05-09T05:37:42.856 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.861+0000 7f316a7fc700 1 -- 172.21.15.39:0/188467129 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f316c020040 con 0x55838c036cb0 2024-05-09T05:37:42.860 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.862+0000 7f31957e0b80 1 -- 172.21.15.39:0/188467129 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55838c036cb0 msgr2=0x55838c141ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:42.860 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.862+0000 7f31957e0b80 1 --2- 172.21.15.39:0/188467129 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55838c036cb0 0x55838c141ff0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f316c00d950 tx=0x7f316c0a9a80 comp rx=0 tx=0).stop 2024-05-09T05:37:42.860 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.862+0000 7f31957e0b80 1 -- 172.21.15.39:0/188467129 shutdown_connections 2024-05-09T05:37:42.860 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.862+0000 7f31957e0b80 1 --2- 172.21.15.39:0/188467129 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55838c1393b0 0x55838c15d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:42.860 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.862+0000 7f31957e0b80 1 --2- 172.21.15.39:0/188467129 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55838bfbc450 0x55838c14f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:42.860 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.862+0000 7f31957e0b80 1 --2- 172.21.15.39:0/188467129 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55838c036cb0 0x55838c141ff0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:42.860 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.862+0000 7f31957e0b80 1 -- 172.21.15.39:0/188467129 >> 172.21.15.39:0/188467129 conn(0x55838bfbff20 msgr2=0x55838c1418e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:37:42.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.862+0000 7f31957e0b80 1 -- 172.21.15.39:0/188467129 shutdown_connections 2024-05-09T05:37:42.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.862+0000 7f31957e0b80 1 -- 172.21.15.39:0/188467129 wait complete. 2024-05-09T05:37:42.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.862+0000 7f31957e0b80 1 -- start start 2024-05-09T05:37:42.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.862+0000 7f31957e0b80 1 Processor -- start 2024-05-09T05:37:42.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.863+0000 7f31957e0b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55838bfbc450 0x55838c159b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:42.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.863+0000 7f31957e0b80 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55838c036cb0 0x55838c15a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:42.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.863+0000 7f31957e0b80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55838c1393b0 0x55838c1bd480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:42.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.863+0000 7f31957e0b80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55838c154300 con 0x55838c1393b0 2024-05-09T05:37:42.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.863+0000 7f31957e0b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55838c153c30 con 0x55838bfbc450 2024-05-09T05:37:42.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.863+0000 7f31957e0b80 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55838c1549d0 con 0x55838c036cb0 2024-05-09T05:37:42.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.863+0000 7f31957e0b80 10 client.0 _ll_register_callbacks cb 0x55838c142ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T05:37:42.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.863+0000 7f3185367700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55838c1393b0 0x55838c1bd480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:42.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.863+0000 7f317ffff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55838c036cb0 0x55838c15a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:42.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.863+0000 7f3185367700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55838c1393b0 0x55838c1bd480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:59546/0 (socket says 172.21.15.39:59546) 2024-05-09T05:37:42.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.863+0000 7f3185367700 1 -- 172.21.15.39:0/1950663989 learned_addr learned my addr 172.21.15.39:0/1950663989 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:37:42.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.863+0000 7f3184b66700 1 --2- 172.21.15.39:0/1950663989 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55838bfbc450 0x55838c159b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:42.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.863+0000 7f3185367700 1 -- 172.21.15.39:0/1950663989 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55838c036cb0 msgr2=0x55838c15a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:37:42.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.863+0000 7f3185367700 1 --2- 172.21.15.39:0/1950663989 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55838c036cb0 0x55838c15a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:42.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.863+0000 7f3185367700 1 -- 172.21.15.39:0/1950663989 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55838bfbc450 msgr2=0x55838c159b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:37:42.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.863+0000 7f3185367700 1 --2- 172.21.15.39:0/1950663989 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55838bfbc450 0x55838c159b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:42.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.863+0000 7f3185367700 1 -- 172.21.15.39:0/1950663989 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55838c1bd9c0 con 0x55838c1393b0 2024-05-09T05:37:42.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.863+0000 7f3185367700 1 --2- 172.21.15.39:0/1950663989 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55838c1393b0 0x55838c1bd480 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f3178009280 tx=0x7f31780104b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32b871918b6effe2 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:37:42.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.863+0000 7f315ffff700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-05-09T05:37:42.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.864+0000 7f315ffff700 1 -- 172.21.15.39:0/1950663989 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f317802f060 con 0x55838c1393b0 2024-05-09T05:37:42.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.864+0000 7f31957e0b80 1 -- 172.21.15.39:0/1950663989 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f316c0b21e0 con 0x55838c1393b0 2024-05-09T05:37:42.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.864+0000 7f315ffff700 1 -- 172.21.15.39:0/1950663989 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f3178012040 con 0x55838c1393b0 2024-05-09T05:37:42.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.864+0000 7f315ffff700 1 -- 172.21.15.39:0/1950663989 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f3178010ea0 con 0x55838c1393b0 2024-05-09T05:37:42.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.864+0000 7f31957e0b80 10 client.15096 fetch_fsmap learned FSMap version 24 2024-05-09T05:37:42.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.864+0000 7f31957e0b80 1 -- 172.21.15.39:0/1950663989 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55838c1beb10 con 0x55838c1393b0 2024-05-09T05:37:42.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.864+0000 7f315ffff700 1 -- 172.21.15.39:0/1950663989 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f316c0b21e0 con 0x55838c1393b0 2024-05-09T05:37:42.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.864+0000 7f315ffff700 1 -- 172.21.15.39:0/1950663989 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f3178022480 con 0x55838c1393b0 2024-05-09T05:37:42.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.864+0000 7f31957e0b80 10 client.15096 fetch_fsmap finished waiting for FSMap version 24 2024-05-09T05:37:42.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.864+0000 7f31957e0b80 10 client.15096 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-09T05:37:42.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.864+0000 7f31957e0b80 20 client.15096 populate_metadata read hostname 'smithi039' 2024-05-09T05:37:42.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.864+0000 7f31957e0b80 1 --2- 172.21.15.39:0/1950663989 >> [v2:172.21.15.100:6836/3676209932,v1:172.21.15.100:6837/3676209932] conn(0x55838c1c0fe0 0x55838c1c2450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:42.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.864+0000 7f31957e0b80 4 client.15096 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-09T05:37:42.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.864+0000 7f31957e0b80 1 -- 172.21.15.39:0/1950663989 --> [v2:172.21.15.100:6836/3676209932,v1:172.21.15.100:6837/3676209932] -- command(tid 0: {"prefix": "status"}) -- 0x55838c063ad0 con 0x55838c1c0fe0 2024-05-09T05:37:42.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.865+0000 7f3184b66700 1 --2- 172.21.15.39:0/1950663989 >> [v2:172.21.15.100:6836/3676209932,v1:172.21.15.100:6837/3676209932] conn(0x55838c1c0fe0 0x55838c1c2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:42.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.865+0000 7f315ffff700 10 client.15096 ms_handle_connect on v2:172.21.15.100:6836/3676209932 2024-05-09T05:37:42.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.865+0000 7f3184b66700 1 --2- 172.21.15.39:0/1950663989 >> [v2:172.21.15.100:6836/3676209932,v1:172.21.15.100:6837/3676209932] conn(0x55838c1c0fe0 0x55838c1c2450 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=65aa6394943776f4 server_cookie=478fe47e5185d66c in_seq=0 out_seq=0 2024-05-09T05:37:42.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.865+0000 7f315ffff700 1 -- 172.21.15.39:0/1950663989 <== mds.2 v2:172.21.15.100:6836/3676209932 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x55838c063ad0 con 0x55838c1c0fe0 2024-05-09T05:37:42.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.865+0000 7f315ffff700 10 client.15096 handle_command_reply: tid=0 2024-05-09T05:37:42.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.865+0000 7f31957e0b80 1 client.15096 shutdown 2024-05-09T05:37:42.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.865+0000 7f31957e0b80 1 -- 172.21.15.39:0/1950663989 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55838c1393b0 msgr2=0x55838c1bd480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:42.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.865+0000 7f31957e0b80 1 --2- 172.21.15.39:0/1950663989 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55838c1393b0 0x55838c1bd480 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f3178009280 tx=0x7f31780104b0 comp rx=0 tx=0).stop 2024-05-09T05:37:42.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.866+0000 7f31957e0b80 1 -- 172.21.15.39:0/1950663989 shutdown_connections 2024-05-09T05:37:42.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.866+0000 7f31957e0b80 1 --2- 172.21.15.39:0/1950663989 >> [v2:172.21.15.100:6836/3676209932,v1:172.21.15.100:6837/3676209932] conn(0x55838c1c0fe0 0x55838c1c2450 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:42.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.866+0000 7f31957e0b80 1 --2- 172.21.15.39:0/1950663989 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55838c1393b0 0x55838c1bd480 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:42.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.866+0000 7f31957e0b80 1 --2- 172.21.15.39:0/1950663989 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55838bfbc450 0x55838c159b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:42.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.866+0000 7f31957e0b80 1 --2- 172.21.15.39:0/1950663989 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55838c036cb0 0x55838c15a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:42.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.866+0000 7f31957e0b80 1 -- 172.21.15.39:0/1950663989 >> 172.21.15.39:0/1950663989 conn(0x55838bfbff20 msgr2=0x55838c1418e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:37:42.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.866+0000 7f315ffff700 0 client.15096 ms_handle_reset on v2:172.21.15.100:6836/3676209932 2024-05-09T05:37:42.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.866+0000 7f31957e0b80 1 -- 172.21.15.39:0/1950663989 shutdown_connections 2024-05-09T05:37:42.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.866+0000 7f31957e0b80 1 -- 172.21.15.39:0/1950663989 wait complete. 2024-05-09T05:37:42.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.866+0000 7f31957e0b80 20 client.15096 trim_cache size 0 max 16384 2024-05-09T05:37:42.865 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-05-09T05:37:42.865 INFO:teuthology.orchestra.run.smithi039.stdout: "cluster_fsid": "86d4cc60-0dc4-11ef-bc97-c7b262605968", 2024-05-09T05:37:42.865 INFO:teuthology.orchestra.run.smithi039.stdout: "whoami": 2, 2024-05-09T05:37:42.865 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 24487, 2024-05-09T05:37:42.865 INFO:teuthology.orchestra.run.smithi039.stdout: "want_state": "up:active", 2024-05-09T05:37:42.865 INFO:teuthology.orchestra.run.smithi039.stdout: "state": "up:active", 2024-05-09T05:37:42.865 INFO:teuthology.orchestra.run.smithi039.stdout: "fs_name": "cephfs", 2024-05-09T05:37:42.865 INFO:teuthology.orchestra.run.smithi039.stdout: "rank_uptime": 152.44971383199999, 2024-05-09T05:37:42.865 INFO:teuthology.orchestra.run.smithi039.stdout: "mdsmap_epoch": 24, 2024-05-09T05:37:42.865 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_epoch": 83, 2024-05-09T05:37:42.865 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_epoch_barrier": 81, 2024-05-09T05:37:42.865 INFO:teuthology.orchestra.run.smithi039.stdout: "uptime": 199.26913317 2024-05-09T05:37:42.866 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-05-09T05:37:42.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.867+0000 7f3186dca700 1 -- 172.21.15.39:0/2970233882 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f31700b2880 msgr2=0x7f31700b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:42.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.867+0000 7f3186dca700 1 --2- 172.21.15.39:0/2970233882 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f31700b2880 0x7f31700b4d90 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3174009990 tx=0x7f31740036e0 comp rx=0 tx=0).stop 2024-05-09T05:37:42.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.867+0000 7f3186dca700 1 -- 172.21.15.39:0/2970233882 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3180107e10 msgr2=0x7f31801a19f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:42.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.867+0000 7f3186dca700 1 --2- 172.21.15.39:0/2970233882 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3180107e10 0x7f31801a19f0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f316c00d980 tx=0x7f316c00dc90 comp rx=0 tx=0).stop 2024-05-09T05:37:42.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.867+0000 7f3186dca700 1 -- 172.21.15.39:0/2970233882 shutdown_connections 2024-05-09T05:37:42.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.867+0000 7f3186dca700 1 --2- 172.21.15.39:0/2970233882 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f31700b2880 0x7f31700b4d90 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:42.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.867+0000 7f3186dca700 1 --2- 172.21.15.39:0/2970233882 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3180108760 0x7f31801a5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:42.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.867+0000 7f3186dca700 1 --2- 172.21.15.39:0/2970233882 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31801034e0 0x7f31801a1450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:42.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.867+0000 7f3186dca700 1 --2- 172.21.15.39:0/2970233882 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3180107e10 0x7f31801a19f0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:42.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.867+0000 7f3186dca700 1 -- 172.21.15.39:0/2970233882 >> 172.21.15.39:0/2970233882 conn(0x7f31800fef30 msgr2=0x7f31801096c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:37:42.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.867+0000 7f3186dca700 1 -- 172.21.15.39:0/2970233882 shutdown_connections 2024-05-09T05:37:42.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:42.867+0000 7f3186dca700 1 -- 172.21.15.39:0/2970233882 wait complete. 2024-05-09T05:37:43.590 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:37:43 smithi039 ceph-mon[30439]: pgmap v380: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-09T05:37:43.623 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph tell mds.i status 2024-05-09T05:37:43.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:37:43 smithi100 ceph-mon[34353]: pgmap v380: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-09T05:37:43.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:37:43 smithi060 ceph-mon[34555]: pgmap v380: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-09T05:37:43.877 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T05:37:45.503 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:37:45 smithi039 ceph-mon[30439]: pgmap v381: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-05-09T05:37:45.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.630+0000 7f0f48187700 1 -- 172.21.15.39:0/2131947370 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0f40108740 msgr2=0x7f0f401100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:45.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.630+0000 7f0f48187700 1 --2- 172.21.15.39:0/2131947370 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0f40108740 0x7f0f401100a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f0f3800b0d0 tx=0x7f0f3800b3e0 comp rx=0 tx=0).stop 2024-05-09T05:37:45.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.630+0000 7f0f48187700 1 -- 172.21.15.39:0/2131947370 shutdown_connections 2024-05-09T05:37:45.625 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.630+0000 7f0f48187700 1 --2- 172.21.15.39:0/2131947370 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0f40108740 0x7f0f401100a0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:45.625 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.630+0000 7f0f48187700 1 --2- 172.21.15.39:0/2131947370 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f401034c0 0x7f0f401038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:45.625 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.630+0000 7f0f48187700 1 --2- 172.21.15.39:0/2131947370 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0f40107df0 0x7f0f40108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:45.625 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.630+0000 7f0f48187700 1 -- 172.21.15.39:0/2131947370 >> 172.21.15.39:0/2131947370 conn(0x7f0f400fedc0 msgr2=0x7f0f401011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:37:45.625 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.631+0000 7f0f48187700 1 -- 172.21.15.39:0/2131947370 shutdown_connections 2024-05-09T05:37:45.625 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.631+0000 7f0f48187700 1 -- 172.21.15.39:0/2131947370 wait complete. 2024-05-09T05:37:45.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.631+0000 7f0f48187700 1 Processor -- start 2024-05-09T05:37:45.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.631+0000 7f0f48187700 1 -- start start 2024-05-09T05:37:45.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.632+0000 7f0f48187700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0f401034c0 0x7f0f4019ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:45.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.632+0000 7f0f48187700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f40107df0 0x7f0f4019b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:45.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.632+0000 7f0f48187700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0f40108740 0x7f0f4019f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:45.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.632+0000 7f0f48187700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f0f401133c0 con 0x7f0f401034c0 2024-05-09T05:37:45.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.632+0000 7f0f48187700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f0f40113240 con 0x7f0f40108740 2024-05-09T05:37:45.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.632+0000 7f0f48187700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0f40113540 con 0x7f0f40107df0 2024-05-09T05:37:45.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.632+0000 7f0f45f23700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0f401034c0 0x7f0f4019ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:45.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.632+0000 7f0f45f23700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0f401034c0 0x7f0f4019ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:59556/0 (socket says 172.21.15.39:59556) 2024-05-09T05:37:45.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.632+0000 7f0f45f23700 1 -- 172.21.15.39:0/3984979105 learned_addr learned my addr 172.21.15.39:0/3984979105 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:37:45.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.632+0000 7f0f46724700 1 --2- 172.21.15.39:0/3984979105 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0f40108740 0x7f0f4019f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:45.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.632+0000 7f0f45722700 1 --2- 172.21.15.39:0/3984979105 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f40107df0 0x7f0f4019b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:45.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.632+0000 7f0f45f23700 1 -- 172.21.15.39:0/3984979105 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f40107df0 msgr2=0x7f0f4019b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:45.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.632+0000 7f0f45f23700 1 --2- 172.21.15.39:0/3984979105 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f40107df0 0x7f0f4019b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:45.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.632+0000 7f0f45f23700 1 -- 172.21.15.39:0/3984979105 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0f40108740 msgr2=0x7f0f4019f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:45.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.632+0000 7f0f45f23700 1 --2- 172.21.15.39:0/3984979105 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0f40108740 0x7f0f4019f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:45.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.632+0000 7f0f45f23700 1 -- 172.21.15.39:0/3984979105 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f4019fcd0 con 0x7f0f401034c0 2024-05-09T05:37:45.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.632+0000 7f0f45f23700 1 --2- 172.21.15.39:0/3984979105 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0f401034c0 0x7f0f4019ae00 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c00d950 tx=0x7f0f3c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:37:45.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.632+0000 7f0f36ffd700 1 -- 172.21.15.39:0/3984979105 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f3c016070 con 0x7f0f401034c0 2024-05-09T05:37:45.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.632+0000 7f0f36ffd700 1 -- 172.21.15.39:0/3984979105 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0f3c00fd40 con 0x7f0f401034c0 2024-05-09T05:37:45.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.632+0000 7f0f48187700 1 -- 172.21.15.39:0/3984979105 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f4019ffc0 con 0x7f0f401034c0 2024-05-09T05:37:45.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.633+0000 7f0f36ffd700 1 -- 172.21.15.39:0/3984979105 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f3c00e3b0 con 0x7f0f401034c0 2024-05-09T05:37:45.629 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.633+0000 7f0f48187700 1 -- 172.21.15.39:0/3984979105 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f401a78e0 con 0x7f0f401034c0 2024-05-09T05:37:45.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.635+0000 7f0f36ffd700 1 -- 172.21.15.39:0/3984979105 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f0f3c019070 con 0x7f0f401034c0 2024-05-09T05:37:45.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.636+0000 7f0f36ffd700 1 --2- 172.21.15.39:0/3984979105 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f0f2c0b2900 0x7f0f2c0b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:45.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.636+0000 7f0f45722700 1 --2- 172.21.15.39:0/3984979105 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f0f2c0b2900 0x7f0f2c0b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:45.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.636+0000 7f0f36ffd700 1 -- 172.21.15.39:0/3984979105 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f0f3c0e1c70 con 0x7f0f401034c0 2024-05-09T05:37:45.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.636+0000 7f0f56b9db80 1 Processor -- start 2024-05-09T05:37:45.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.636+0000 7f0f56b9db80 1 -- start start 2024-05-09T05:37:45.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.637+0000 7f0f45722700 1 --2- 172.21.15.39:0/3984979105 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f0f2c0b2900 0x7f0f2c0b4e10 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0f40109750 tx=0x7f0f3000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:37:45.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.637+0000 7f0f56b9db80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56352c677cb0 0x56352c7801f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:45.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.637+0000 7f0f56b9db80 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56352c5fd450 0x56352c780730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:45.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.637+0000 7f0f56b9db80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56352c77a3b0 0x56352c77a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:45.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.637+0000 7f0f56b9db80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x56352c69d050 con 0x56352c677cb0 2024-05-09T05:37:45.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.637+0000 7f0f56b9db80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x56352c642950 con 0x56352c77a3b0 2024-05-09T05:37:45.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.637+0000 7f0f56b9db80 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x56352c699010 con 0x56352c5fd450 2024-05-09T05:37:45.632 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.637+0000 7f0f45f23700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56352c677cb0 0x56352c7801f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:45.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.637+0000 7f0f45f23700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56352c677cb0 0x56352c7801f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:59568/0 (socket says 172.21.15.39:59568) 2024-05-09T05:37:45.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.637+0000 7f0f45f23700 1 -- 172.21.15.39:0/2409437259 learned_addr learned my addr 172.21.15.39:0/2409437259 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:37:45.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.637+0000 7f0f46724700 1 --2- 172.21.15.39:0/2409437259 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56352c77a3b0 0x56352c77a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:45.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.637+0000 7f0f45722700 1 --2- 172.21.15.39:0/2409437259 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56352c5fd450 0x56352c780730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:45.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.637+0000 7f0f45f23700 1 -- 172.21.15.39:0/2409437259 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56352c5fd450 msgr2=0x56352c780730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:37:45.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.637+0000 7f0f45f23700 1 --2- 172.21.15.39:0/2409437259 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56352c5fd450 0x56352c780730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:45.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.637+0000 7f0f45f23700 1 -- 172.21.15.39:0/2409437259 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56352c77a3b0 msgr2=0x56352c77a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:37:45.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.637+0000 7f0f45f23700 1 --2- 172.21.15.39:0/2409437259 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56352c77a3b0 0x56352c77a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:45.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.637+0000 7f0f45f23700 1 -- 172.21.15.39:0/2409437259 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56352c6334b0 con 0x56352c677cb0 2024-05-09T05:37:45.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.637+0000 7f0f45722700 1 --2- 172.21.15.39:0/2409437259 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56352c5fd450 0x56352c780730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T05:37:45.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.637+0000 7f0f45f23700 1 --2- 172.21.15.39:0/2409437259 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56352c677cb0 0x56352c7801f0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c0a5320 tx=0x7f0f3c010a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49f3d00aa3f0d4fd server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:37:45.633 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.638+0000 7f0f2bfff700 1 -- 172.21.15.39:0/2409437259 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f3c020040 con 0x56352c677cb0 2024-05-09T05:37:45.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.638+0000 7f0f2bfff700 1 -- 172.21.15.39:0/2409437259 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0f3c0ad650 con 0x56352c677cb0 2024-05-09T05:37:45.634 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.638+0000 7f0f2bfff700 1 -- 172.21.15.39:0/2409437259 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f3c0b1eb0 con 0x56352c677cb0 2024-05-09T05:37:45.638 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.638+0000 7f0f56b9db80 1 -- 172.21.15.39:0/2409437259 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56352c677cb0 msgr2=0x56352c7801f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:45.638 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.638+0000 7f0f56b9db80 1 --2- 172.21.15.39:0/2409437259 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56352c677cb0 0x56352c7801f0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c0a5320 tx=0x7f0f3c010a40 comp rx=0 tx=0).stop 2024-05-09T05:37:45.638 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.639+0000 7f0f56b9db80 1 -- 172.21.15.39:0/2409437259 shutdown_connections 2024-05-09T05:37:45.638 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.639+0000 7f0f56b9db80 1 --2- 172.21.15.39:0/2409437259 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56352c77a3b0 0x56352c77a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:45.638 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.639+0000 7f0f56b9db80 1 --2- 172.21.15.39:0/2409437259 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56352c677cb0 0x56352c7801f0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:45.638 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.639+0000 7f0f56b9db80 1 --2- 172.21.15.39:0/2409437259 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56352c5fd450 0x56352c780730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:45.638 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.639+0000 7f0f56b9db80 1 -- 172.21.15.39:0/2409437259 >> 172.21.15.39:0/2409437259 conn(0x56352c600f20 msgr2=0x56352c7751d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:37:45.638 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.639+0000 7f0f56b9db80 1 -- 172.21.15.39:0/2409437259 shutdown_connections 2024-05-09T05:37:45.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.639+0000 7f0f56b9db80 1 -- 172.21.15.39:0/2409437259 wait complete. 2024-05-09T05:37:45.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.639+0000 7f0f56b9db80 1 -- start start 2024-05-09T05:37:45.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.639+0000 7f0f56b9db80 1 Processor -- start 2024-05-09T05:37:45.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.640+0000 7f0f56b9db80 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56352c5fd450 0x56352c784030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:45.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.640+0000 7f0f56b9db80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56352c677cb0 0x56352c784570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:45.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.640+0000 7f0f56b9db80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56352c77a3b0 0x56352c784ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:45.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.640+0000 7f0f56b9db80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x56352c77b0b0 con 0x56352c77a3b0 2024-05-09T05:37:45.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.640+0000 7f0f56b9db80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x56352c637ad0 con 0x56352c677cb0 2024-05-09T05:37:45.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.640+0000 7f0f56b9db80 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x56352c790180 con 0x56352c5fd450 2024-05-09T05:37:45.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.640+0000 7f0f56b9db80 10 client.0 _ll_register_callbacks cb 0x56352c50e670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T05:37:45.639 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.640+0000 7f0f46724700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56352c77a3b0 0x56352c784ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:45.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.640+0000 7f0f46724700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56352c77a3b0 0x56352c784ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:59574/0 (socket says 172.21.15.39:59574) 2024-05-09T05:37:45.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.640+0000 7f0f46724700 1 -- 172.21.15.39:0/2375493737 learned_addr learned my addr 172.21.15.39:0/2375493737 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:37:45.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.640+0000 7f0f45722700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56352c677cb0 0x56352c784570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:45.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.640+0000 7f0f45f23700 1 --2- 172.21.15.39:0/2375493737 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56352c5fd450 0x56352c784030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:45.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.640+0000 7f0f46724700 1 -- 172.21.15.39:0/2375493737 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56352c5fd450 msgr2=0x56352c784030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:37:45.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.640+0000 7f0f46724700 1 --2- 172.21.15.39:0/2375493737 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56352c5fd450 0x56352c784030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:45.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.640+0000 7f0f46724700 1 -- 172.21.15.39:0/2375493737 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56352c677cb0 msgr2=0x56352c784570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:37:45.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.640+0000 7f0f46724700 1 --2- 172.21.15.39:0/2375493737 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56352c677cb0 0x56352c784570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:45.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.640+0000 7f0f46724700 1 -- 172.21.15.39:0/2375493737 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56352c518440 con 0x56352c77a3b0 2024-05-09T05:37:45.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.640+0000 7f0f45722700 1 --2- 172.21.15.39:0/2375493737 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56352c677cb0 0x56352c784570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T05:37:45.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.641+0000 7f0f46724700 1 --2- 172.21.15.39:0/2375493737 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56352c77a3b0 0x56352c784ab0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f0f380077f0 tx=0x7f0f38007820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fcd2d48af7de190 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:37:45.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.641+0000 7f0f297fa700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-05-09T05:37:45.641 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.641+0000 7f0f297fa700 1 -- 172.21.15.39:0/2375493737 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f38003c10 con 0x56352c77a3b0 2024-05-09T05:37:45.641 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.641+0000 7f0f297fa700 1 -- 172.21.15.39:0/2375493737 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f0f38003db0 con 0x56352c77a3b0 2024-05-09T05:37:45.641 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.641+0000 7f0f56b9db80 1 -- 172.21.15.39:0/2375493737 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0f3c0ad650 con 0x56352c77a3b0 2024-05-09T05:37:45.641 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.641+0000 7f0f297fa700 1 -- 172.21.15.39:0/2375493737 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f0f380079c0 con 0x56352c77a3b0 2024-05-09T05:37:45.641 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.641+0000 7f0f56b9db80 10 client.15108 fetch_fsmap learned FSMap version 24 2024-05-09T05:37:45.641 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.641+0000 7f0f56b9db80 1 -- 172.21.15.39:0/2375493737 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56352c791b20 con 0x56352c77a3b0 2024-05-09T05:37:45.641 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.641+0000 7f0f297fa700 1 -- 172.21.15.39:0/2375493737 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0f3c0ad650 con 0x56352c77a3b0 2024-05-09T05:37:45.641 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.641+0000 7f0f297fa700 1 -- 172.21.15.39:0/2375493737 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f0f38024020 con 0x56352c77a3b0 2024-05-09T05:37:45.641 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.641+0000 7f0f56b9db80 10 client.15108 fetch_fsmap finished waiting for FSMap version 24 2024-05-09T05:37:45.641 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.641+0000 7f0f56b9db80 10 client.15108 resolve_mds: resolved name 'i' to daemon mds.i 2024-05-09T05:37:45.641 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.641+0000 7f0f56b9db80 20 client.15108 populate_metadata read hostname 'smithi039' 2024-05-09T05:37:45.641 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.641+0000 7f0f56b9db80 1 --2- 172.21.15.39:0/2375493737 >> [v2:172.21.15.100:6838/1395178742,v1:172.21.15.100:6839/1395178742] conn(0x56352c794180 0x56352c7955f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:45.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.641+0000 7f0f56b9db80 4 client.15108 mds_command: new command op to 24502 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T05:37:45.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.641+0000 7f0f56b9db80 1 -- 172.21.15.39:0/2375493737 --> [v2:172.21.15.100:6838/1395178742,v1:172.21.15.100:6839/1395178742] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56352c6aaa30 con 0x56352c794180 2024-05-09T05:37:45.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.642+0000 7f0f45f23700 1 --2- 172.21.15.39:0/2375493737 >> [v2:172.21.15.100:6838/1395178742,v1:172.21.15.100:6839/1395178742] conn(0x56352c794180 0x56352c7955f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:45.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.642+0000 7f0f297fa700 10 client.15108 ms_handle_connect on v2:172.21.15.100:6838/1395178742 2024-05-09T05:37:45.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.642+0000 7f0f45f23700 1 --2- 172.21.15.39:0/2375493737 >> [v2:172.21.15.100:6838/1395178742,v1:172.21.15.100:6839/1395178742] conn(0x56352c794180 0x56352c7955f0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b4217a15b3295252 server_cookie=76372a48669713f6 in_seq=0 out_seq=0 2024-05-09T05:37:45.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.643+0000 7f0f297fa700 1 -- 172.21.15.39:0/2375493737 <== mds.1 v2:172.21.15.100:6838/1395178742 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x56352c6aaa30 con 0x56352c794180 2024-05-09T05:37:45.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.643+0000 7f0f297fa700 10 client.15108 handle_command_reply: tid=0 2024-05-09T05:37:45.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.643+0000 7f0f56b9db80 1 client.15108 shutdown 2024-05-09T05:37:45.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.643+0000 7f0f56b9db80 1 -- 172.21.15.39:0/2375493737 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56352c77a3b0 msgr2=0x56352c784ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:45.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.643+0000 7f0f56b9db80 1 --2- 172.21.15.39:0/2375493737 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56352c77a3b0 0x56352c784ab0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f0f380077f0 tx=0x7f0f38007820 comp rx=0 tx=0).stop 2024-05-09T05:37:45.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.643+0000 7f0f56b9db80 1 -- 172.21.15.39:0/2375493737 shutdown_connections 2024-05-09T05:37:45.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.643+0000 7f0f56b9db80 1 --2- 172.21.15.39:0/2375493737 >> [v2:172.21.15.100:6838/1395178742,v1:172.21.15.100:6839/1395178742] conn(0x56352c794180 0x56352c7955f0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:45.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.643+0000 7f0f56b9db80 1 --2- 172.21.15.39:0/2375493737 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56352c77a3b0 0x56352c784ab0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:45.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.643+0000 7f0f56b9db80 1 --2- 172.21.15.39:0/2375493737 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56352c5fd450 0x56352c784030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:45.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.643+0000 7f0f297fa700 0 client.15108 ms_handle_reset on v2:172.21.15.100:6838/1395178742 2024-05-09T05:37:45.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.643+0000 7f0f56b9db80 1 --2- 172.21.15.39:0/2375493737 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56352c677cb0 0x56352c784570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:45.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.643+0000 7f0f56b9db80 1 -- 172.21.15.39:0/2375493737 >> 172.21.15.39:0/2375493737 conn(0x56352c600f20 msgr2=0x56352c76efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:37:45.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.643+0000 7f0f56b9db80 1 -- 172.21.15.39:0/2375493737 shutdown_connections 2024-05-09T05:37:45.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.643+0000 7f0f56b9db80 1 -- 172.21.15.39:0/2375493737 wait complete. 2024-05-09T05:37:45.643 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.644+0000 7f0f56b9db80 20 client.15108 trim_cache size 0 max 16384 2024-05-09T05:37:45.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.665+0000 7f0f56b9db80 1 Processor -- start 2024-05-09T05:37:45.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.665+0000 7f0f56b9db80 1 -- start start 2024-05-09T05:37:45.661 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.665+0000 7f0f56b9db80 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56352c5fd450 0x56352c781c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:45.661 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.665+0000 7f0f56b9db80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56352c677cb0 0x56352c782f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:45.661 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.665+0000 7f0f56b9db80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56352c77a3b0 0x56352c7900f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:45.661 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.665+0000 7f0f56b9db80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x56352c793930 con 0x56352c677cb0 2024-05-09T05:37:45.661 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.665+0000 7f0f56b9db80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x56352c794000 con 0x56352c77a3b0 2024-05-09T05:37:45.661 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.665+0000 7f0f56b9db80 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x56352c7946d0 con 0x56352c5fd450 2024-05-09T05:37:45.661 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.665+0000 7f0f45722700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56352c677cb0 0x56352c782f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:45.661 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.665+0000 7f0f45722700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56352c677cb0 0x56352c782f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:59588/0 (socket says 172.21.15.39:59588) 2024-05-09T05:37:45.661 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.665+0000 7f0f45722700 1 -- 172.21.15.39:0/443476813 learned_addr learned my addr 172.21.15.39:0/443476813 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:37:45.661 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.665+0000 7f0f45f23700 1 --2- 172.21.15.39:0/443476813 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56352c5fd450 0x56352c781c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:45.661 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.665+0000 7f0f46724700 1 --2- 172.21.15.39:0/443476813 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56352c77a3b0 0x56352c7900f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:45.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.665+0000 7f0f45722700 1 -- 172.21.15.39:0/443476813 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56352c5fd450 msgr2=0x56352c781c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:37:45.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.665+0000 7f0f45722700 1 --2- 172.21.15.39:0/443476813 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56352c5fd450 0x56352c781c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:45.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.665+0000 7f0f45722700 1 -- 172.21.15.39:0/443476813 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56352c77a3b0 msgr2=0x56352c7900f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:37:45.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.665+0000 7f0f45722700 1 --2- 172.21.15.39:0/443476813 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56352c77a3b0 0x56352c7900f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:45.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.665+0000 7f0f45722700 1 -- 172.21.15.39:0/443476813 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56352c771980 con 0x56352c677cb0 2024-05-09T05:37:45.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.665+0000 7f0f45f23700 1 --2- 172.21.15.39:0/443476813 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56352c5fd450 0x56352c781c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T05:37:45.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.665+0000 7f0f46724700 1 --2- 172.21.15.39:0/443476813 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56352c77a3b0 0x56352c7900f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T05:37:45.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.666+0000 7f0f45722700 1 --2- 172.21.15.39:0/443476813 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56352c677cb0 0x56352c782f90 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f0f30005950 tx=0x7f0f30013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1c4d58d3c303901 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:37:45.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.666+0000 7f0f2b7fe700 1 -- 172.21.15.39:0/443476813 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f30011700 con 0x56352c677cb0 2024-05-09T05:37:45.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.666+0000 7f0f2b7fe700 1 -- 172.21.15.39:0/443476813 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0f30011d50 con 0x56352c677cb0 2024-05-09T05:37:45.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.666+0000 7f0f2b7fe700 1 -- 172.21.15.39:0/443476813 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f3001ee70 con 0x56352c677cb0 2024-05-09T05:37:45.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.667+0000 7f0f56b9db80 1 -- 172.21.15.39:0/443476813 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56352c677cb0 msgr2=0x56352c782f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:45.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.667+0000 7f0f56b9db80 1 --2- 172.21.15.39:0/443476813 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56352c677cb0 0x56352c782f90 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f0f30005950 tx=0x7f0f30013000 comp rx=0 tx=0).stop 2024-05-09T05:37:45.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.667+0000 7f0f56b9db80 1 -- 172.21.15.39:0/443476813 shutdown_connections 2024-05-09T05:37:45.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.667+0000 7f0f56b9db80 1 --2- 172.21.15.39:0/443476813 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56352c77a3b0 0x56352c7900f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:45.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.667+0000 7f0f56b9db80 1 --2- 172.21.15.39:0/443476813 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56352c5fd450 0x56352c781c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:45.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.667+0000 7f0f56b9db80 1 --2- 172.21.15.39:0/443476813 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56352c677cb0 0x56352c782f90 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:45.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.667+0000 7f0f56b9db80 1 -- 172.21.15.39:0/443476813 >> 172.21.15.39:0/443476813 conn(0x56352c600f20 msgr2=0x56352c76efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:37:45.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.667+0000 7f0f56b9db80 1 -- 172.21.15.39:0/443476813 shutdown_connections 2024-05-09T05:37:45.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.667+0000 7f0f56b9db80 1 -- 172.21.15.39:0/443476813 wait complete. 2024-05-09T05:37:45.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.667+0000 7f0f56b9db80 1 -- start start 2024-05-09T05:37:45.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.667+0000 7f0f56b9db80 1 Processor -- start 2024-05-09T05:37:45.667 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.668+0000 7f0f56b9db80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56352c5fd450 0x56352c783ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:45.667 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.668+0000 7f0f56b9db80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56352c677cb0 0x56352c784400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:45.667 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.668+0000 7f0f56b9db80 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56352c77a3b0 0x56352c784940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:45.667 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.668+0000 7f0f56b9db80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x56352c795470 con 0x56352c677cb0 2024-05-09T05:37:45.667 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.668+0000 7f0f56b9db80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x56352c794da0 con 0x56352c5fd450 2024-05-09T05:37:45.667 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.668+0000 7f0f56b9db80 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x56352c795b40 con 0x56352c77a3b0 2024-05-09T05:37:45.667 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.668+0000 7f0f56b9db80 10 client.0 _ll_register_callbacks cb 0x56352c50e670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T05:37:45.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.668+0000 7f0f45722700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56352c677cb0 0x56352c784400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:45.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.668+0000 7f0f45722700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56352c677cb0 0x56352c784400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:59590/0 (socket says 172.21.15.39:59590) 2024-05-09T05:37:45.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.668+0000 7f0f45722700 1 -- 172.21.15.39:0/799816554 learned_addr learned my addr 172.21.15.39:0/799816554 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:37:45.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.668+0000 7f0f45f23700 1 --2- 172.21.15.39:0/799816554 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56352c5fd450 0x56352c783ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:45.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.668+0000 7f0f46724700 1 --2- 172.21.15.39:0/799816554 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56352c77a3b0 0x56352c784940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:45.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.668+0000 7f0f45722700 1 -- 172.21.15.39:0/799816554 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56352c77a3b0 msgr2=0x56352c784940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:37:45.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.668+0000 7f0f45722700 1 --2- 172.21.15.39:0/799816554 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56352c77a3b0 0x56352c784940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:45.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.668+0000 7f0f45722700 1 -- 172.21.15.39:0/799816554 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56352c5fd450 msgr2=0x56352c783ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:37:45.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.668+0000 7f0f45722700 1 --2- 172.21.15.39:0/799816554 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56352c5fd450 0x56352c783ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:45.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.668+0000 7f0f45722700 1 -- 172.21.15.39:0/799816554 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56352c79cd60 con 0x56352c677cb0 2024-05-09T05:37:45.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.668+0000 7f0f45722700 1 --2- 172.21.15.39:0/799816554 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56352c677cb0 0x56352c784400 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f0f30029000 tx=0x7f0f3001ed20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e37e9d2d0d0b317f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:37:45.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.669+0000 7f0f297fa700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-05-09T05:37:45.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.669+0000 7f0f297fa700 1 -- 172.21.15.39:0/799816554 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f30036020 con 0x56352c677cb0 2024-05-09T05:37:45.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.669+0000 7f0f297fa700 1 -- 172.21.15.39:0/799816554 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f0f30011700 con 0x56352c677cb0 2024-05-09T05:37:45.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.669+0000 7f0f56b9db80 1 -- 172.21.15.39:0/799816554 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0f30011d50 con 0x56352c677cb0 2024-05-09T05:37:45.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.669+0000 7f0f297fa700 1 -- 172.21.15.39:0/799816554 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f0f3002e040 con 0x56352c677cb0 2024-05-09T05:37:45.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.669+0000 7f0f56b9db80 10 client.15114 fetch_fsmap learned FSMap version 24 2024-05-09T05:37:45.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.669+0000 7f0f56b9db80 1 -- 172.21.15.39:0/799816554 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56352c7ff770 con 0x56352c677cb0 2024-05-09T05:37:45.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.669+0000 7f0f297fa700 1 -- 172.21.15.39:0/799816554 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0f30011d50 con 0x56352c677cb0 2024-05-09T05:37:45.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.669+0000 7f0f297fa700 1 -- 172.21.15.39:0/799816554 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f0f30031030 con 0x56352c677cb0 2024-05-09T05:37:45.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.669+0000 7f0f56b9db80 10 client.15114 fetch_fsmap finished waiting for FSMap version 24 2024-05-09T05:37:45.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.669+0000 7f0f56b9db80 10 client.15114 resolve_mds: resolved name 'i' to daemon mds.i 2024-05-09T05:37:45.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.669+0000 7f0f56b9db80 20 client.15114 populate_metadata read hostname 'smithi039' 2024-05-09T05:37:45.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.669+0000 7f0f56b9db80 1 --2- 172.21.15.39:0/799816554 >> [v2:172.21.15.100:6838/1395178742,v1:172.21.15.100:6839/1395178742] conn(0x56352c801a10 0x56352c802e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:45.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.669+0000 7f0f56b9db80 4 client.15114 mds_command: new command op to 24502 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-09T05:37:45.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.669+0000 7f0f56b9db80 1 -- 172.21.15.39:0/799816554 --> [v2:172.21.15.100:6838/1395178742,v1:172.21.15.100:6839/1395178742] -- command(tid 0: {"prefix": "status"}) -- 0x56352c6a4ad0 con 0x56352c801a10 2024-05-09T05:37:45.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.670+0000 7f0f45f23700 1 --2- 172.21.15.39:0/799816554 >> [v2:172.21.15.100:6838/1395178742,v1:172.21.15.100:6839/1395178742] conn(0x56352c801a10 0x56352c802e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:45.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.670+0000 7f0f45f23700 1 --2- 172.21.15.39:0/799816554 >> [v2:172.21.15.100:6838/1395178742,v1:172.21.15.100:6839/1395178742] conn(0x56352c801a10 0x56352c802e80 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=582e8077492faa18 server_cookie=ba1d3fc7441a5244 in_seq=0 out_seq=0 2024-05-09T05:37:45.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.670+0000 7f0f297fa700 10 client.15114 ms_handle_connect on v2:172.21.15.100:6838/1395178742 2024-05-09T05:37:45.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.670+0000 7f0f297fa700 1 -- 172.21.15.39:0/799816554 <== mds.1 v2:172.21.15.100:6838/1395178742 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x56352c6a4ad0 con 0x56352c801a10 2024-05-09T05:37:45.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.670+0000 7f0f297fa700 10 client.15114 handle_command_reply: tid=0 2024-05-09T05:37:45.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.670+0000 7f0f56b9db80 1 client.15114 shutdown 2024-05-09T05:37:45.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.671+0000 7f0f56b9db80 1 -- 172.21.15.39:0/799816554 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56352c677cb0 msgr2=0x56352c784400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:45.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.671+0000 7f0f56b9db80 1 --2- 172.21.15.39:0/799816554 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56352c677cb0 0x56352c784400 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f0f30029000 tx=0x7f0f3001ed20 comp rx=0 tx=0).stop 2024-05-09T05:37:45.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.671+0000 7f0f56b9db80 1 -- 172.21.15.39:0/799816554 shutdown_connections 2024-05-09T05:37:45.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.671+0000 7f0f56b9db80 1 --2- 172.21.15.39:0/799816554 >> [v2:172.21.15.100:6838/1395178742,v1:172.21.15.100:6839/1395178742] conn(0x56352c801a10 0x56352c802e80 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:45.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.671+0000 7f0f56b9db80 1 --2- 172.21.15.39:0/799816554 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56352c77a3b0 0x56352c784940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:45.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.671+0000 7f0f297fa700 0 client.15114 ms_handle_reset on v2:172.21.15.100:6838/1395178742 2024-05-09T05:37:45.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.671+0000 7f0f56b9db80 1 --2- 172.21.15.39:0/799816554 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56352c5fd450 0x56352c783ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:45.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.671+0000 7f0f56b9db80 1 --2- 172.21.15.39:0/799816554 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56352c677cb0 0x56352c784400 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:45.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.671+0000 7f0f56b9db80 1 -- 172.21.15.39:0/799816554 >> 172.21.15.39:0/799816554 conn(0x56352c600f20 msgr2=0x56352c77dc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:37:45.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.671+0000 7f0f56b9db80 1 -- 172.21.15.39:0/799816554 shutdown_connections 2024-05-09T05:37:45.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.671+0000 7f0f56b9db80 1 -- 172.21.15.39:0/799816554 wait complete. 2024-05-09T05:37:45.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.671+0000 7f0f56b9db80 20 client.15114 trim_cache size 0 max 16384 2024-05-09T05:37:45.671 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-05-09T05:37:45.671 INFO:teuthology.orchestra.run.smithi039.stdout: "cluster_fsid": "86d4cc60-0dc4-11ef-bc97-c7b262605968", 2024-05-09T05:37:45.672 INFO:teuthology.orchestra.run.smithi039.stdout: "whoami": 1, 2024-05-09T05:37:45.672 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 24502, 2024-05-09T05:37:45.672 INFO:teuthology.orchestra.run.smithi039.stdout: "want_state": "up:active", 2024-05-09T05:37:45.672 INFO:teuthology.orchestra.run.smithi039.stdout: "state": "up:active", 2024-05-09T05:37:45.672 INFO:teuthology.orchestra.run.smithi039.stdout: "fs_name": "cephfs", 2024-05-09T05:37:45.672 INFO:teuthology.orchestra.run.smithi039.stdout: "rank_uptime": 156.26352072399999, 2024-05-09T05:37:45.672 INFO:teuthology.orchestra.run.smithi039.stdout: "mdsmap_epoch": 24, 2024-05-09T05:37:45.672 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_epoch": 83, 2024-05-09T05:37:45.672 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_epoch_barrier": 81, 2024-05-09T05:37:45.672 INFO:teuthology.orchestra.run.smithi039.stdout: "uptime": 196.39545348600001 2024-05-09T05:37:45.672 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-05-09T05:37:45.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.672+0000 7f0f48187700 1 -- 172.21.15.39:0/3984979105 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f0f2c0b2900 msgr2=0x7f0f2c0b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:45.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.672+0000 7f0f48187700 1 --2- 172.21.15.39:0/3984979105 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f0f2c0b2900 0x7f0f2c0b4e10 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0f40109750 tx=0x7f0f3000b410 comp rx=0 tx=0).stop 2024-05-09T05:37:45.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.672+0000 7f0f48187700 1 -- 172.21.15.39:0/3984979105 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0f401034c0 msgr2=0x7f0f4019ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:45.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.672+0000 7f0f48187700 1 --2- 172.21.15.39:0/3984979105 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0f401034c0 0x7f0f4019ae00 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c00d950 tx=0x7f0f3c00dc60 comp rx=0 tx=0).stop 2024-05-09T05:37:45.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.672+0000 7f0f48187700 1 -- 172.21.15.39:0/3984979105 shutdown_connections 2024-05-09T05:37:45.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.672+0000 7f0f48187700 1 --2- 172.21.15.39:0/3984979105 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f0f2c0b2900 0x7f0f2c0b4e10 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:45.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.672+0000 7f0f48187700 1 --2- 172.21.15.39:0/3984979105 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0f40108740 0x7f0f4019f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:45.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.672+0000 7f0f48187700 1 --2- 172.21.15.39:0/3984979105 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0f401034c0 0x7f0f4019ae00 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:45.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.672+0000 7f0f48187700 1 --2- 172.21.15.39:0/3984979105 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f40107df0 0x7f0f4019b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:45.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.672+0000 7f0f48187700 1 -- 172.21.15.39:0/3984979105 >> 172.21.15.39:0/3984979105 conn(0x7f0f400fedc0 msgr2=0x7f0f4006b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:37:45.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.672+0000 7f0f48187700 1 -- 172.21.15.39:0/3984979105 shutdown_connections 2024-05-09T05:37:45.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:45.672+0000 7f0f48187700 1 -- 172.21.15.39:0/3984979105 wait complete. 2024-05-09T05:37:45.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:37:45 smithi100 ceph-mon[34353]: pgmap v381: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-05-09T05:37:45.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:37:45 smithi060 ceph-mon[34555]: pgmap v381: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-05-09T05:37:46.403 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph tell mds.b status 2024-05-09T05:37:46.656 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T05:37:47.598 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:37:47 smithi039 ceph-mon[30439]: pgmap v382: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-09T05:37:47.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:37:47 smithi100 ceph-mon[34353]: pgmap v382: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-09T05:37:47.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:37:47 smithi060 ceph-mon[34555]: pgmap v382: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-09T05:37:48.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.105+0000 7f91ab749700 1 -- 172.21.15.39:0/1770391369 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f91a4107df0 msgr2=0x7f91a4108200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:48.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.105+0000 7f91ab749700 1 --2- 172.21.15.39:0/1770391369 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f91a4107df0 0x7f91a4108200 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f91980099c0 tx=0x7f9198009cd0 comp rx=0 tx=0).stop 2024-05-09T05:37:48.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.105+0000 7f91ab749700 1 -- 172.21.15.39:0/1770391369 shutdown_connections 2024-05-09T05:37:48.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.105+0000 7f91ab749700 1 --2- 172.21.15.39:0/1770391369 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91a4108740 0x7f91a41100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:48.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.105+0000 7f91ab749700 1 --2- 172.21.15.39:0/1770391369 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91a41034c0 0x7f91a41038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:48.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.105+0000 7f91ab749700 1 --2- 172.21.15.39:0/1770391369 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f91a4107df0 0x7f91a4108200 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:48.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.105+0000 7f91ab749700 1 -- 172.21.15.39:0/1770391369 >> 172.21.15.39:0/1770391369 conn(0x7f91a40fedc0 msgr2=0x7f91a41011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:37:48.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.106+0000 7f91ab749700 1 -- 172.21.15.39:0/1770391369 shutdown_connections 2024-05-09T05:37:48.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.106+0000 7f91ab749700 1 -- 172.21.15.39:0/1770391369 wait complete. 2024-05-09T05:37:48.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.106+0000 7f91ab749700 1 Processor -- start 2024-05-09T05:37:48.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.106+0000 7f91ab749700 1 -- start start 2024-05-09T05:37:48.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.107+0000 7f91ab749700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91a41034c0 0x7f91a419bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:48.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.107+0000 7f91ab749700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f91a4107df0 0x7f91a419c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:48.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.107+0000 7f91ab749700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91a4108740 0x7f91a419c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:48.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.107+0000 7f91ab749700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f91a4113350 con 0x7f91a4107df0 2024-05-09T05:37:48.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.107+0000 7f91ab749700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f91a41131d0 con 0x7f91a4108740 2024-05-09T05:37:48.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.107+0000 7f91ab749700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f91a41134d0 con 0x7f91a41034c0 2024-05-09T05:37:48.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.107+0000 7f91a8ce4700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f91a4107df0 0x7f91a419c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:48.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.107+0000 7f91a8ce4700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f91a4107df0 0x7f91a419c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54384/0 (socket says 172.21.15.39:54384) 2024-05-09T05:37:48.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.107+0000 7f91a8ce4700 1 -- 172.21.15.39:0/14010942 learned_addr learned my addr 172.21.15.39:0/14010942 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:37:48.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.107+0000 7f91a94e5700 1 --2- 172.21.15.39:0/14010942 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91a41034c0 0x7f91a419bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:48.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.107+0000 7f91a8ce4700 1 -- 172.21.15.39:0/14010942 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91a41034c0 msgr2=0x7f91a419bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:48.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.107+0000 7f91a8ce4700 1 --2- 172.21.15.39:0/14010942 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91a41034c0 0x7f91a419bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:48.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.107+0000 7f91a8ce4700 1 -- 172.21.15.39:0/14010942 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91a4108740 msgr2=0x7f91a419c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:48.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.107+0000 7f91a8ce4700 1 --2- 172.21.15.39:0/14010942 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91a4108740 0x7f91a419c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:48.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.107+0000 7f91a8ce4700 1 -- 172.21.15.39:0/14010942 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91a41a6fe0 con 0x7f91a4107df0 2024-05-09T05:37:48.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.107+0000 7f91a8ce4700 1 --2- 172.21.15.39:0/14010942 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f91a4107df0 0x7f91a419c1b0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f9198006010 tx=0x7f91980047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:37:48.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.107+0000 7f91a27fc700 1 -- 172.21.15.39:0/14010942 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9198027070 con 0x7f91a4107df0 2024-05-09T05:37:48.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.108+0000 7f91ab749700 1 -- 172.21.15.39:0/14010942 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91a41a7270 con 0x7f91a4107df0 2024-05-09T05:37:48.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.108+0000 7f91a27fc700 1 -- 172.21.15.39:0/14010942 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9198003f20 con 0x7f91a4107df0 2024-05-09T05:37:48.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.108+0000 7f91a27fc700 1 -- 172.21.15.39:0/14010942 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9198022cd0 con 0x7f91a4107df0 2024-05-09T05:37:48.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.108+0000 7f91ab749700 1 -- 172.21.15.39:0/14010942 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91a41a7720 con 0x7f91a4107df0 2024-05-09T05:37:48.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.111+0000 7f91a27fc700 1 -- 172.21.15.39:0/14010942 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f919802a070 con 0x7f91a4107df0 2024-05-09T05:37:48.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.112+0000 7f91a27fc700 1 --2- 172.21.15.39:0/14010942 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f918c0b2880 0x7f918c0b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:48.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.112+0000 7f91ba15fb80 1 Processor -- start 2024-05-09T05:37:48.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.112+0000 7f91a94e5700 1 --2- 172.21.15.39:0/14010942 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f918c0b2880 0x7f918c0b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:48.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.112+0000 7f91a27fc700 1 -- 172.21.15.39:0/14010942 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f91980e31f0 con 0x7f91a4107df0 2024-05-09T05:37:48.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.112+0000 7f91ba15fb80 1 -- start start 2024-05-09T05:37:48.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.112+0000 7f91ba15fb80 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5652091ca110 0x5652092634a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:48.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.112+0000 7f91ba15fb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5652090e0450 0x5652092639e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:48.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.112+0000 7f91ba15fb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56520925d650 0x56520925da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:48.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.112+0000 7f91ba15fb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x56520917ffa0 con 0x56520925d650 2024-05-09T05:37:48.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.112+0000 7f91ba15fb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x56520911e7a0 con 0x5652090e0450 2024-05-09T05:37:48.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.112+0000 7f91ba15fb80 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x56520917bf60 con 0x5652091ca110 2024-05-09T05:37:48.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.112+0000 7f91a94e5700 1 --2- 172.21.15.39:0/14010942 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f918c0b2880 0x7f918c0b4d90 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f9194009550 tx=0x7f91940091b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:37:48.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.112+0000 7f91a9ce6700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56520925d650 0x56520925da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:48.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.112+0000 7f91a9ce6700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56520925d650 0x56520925da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54398/0 (socket says 172.21.15.39:54398) 2024-05-09T05:37:48.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.112+0000 7f91a9ce6700 1 -- 172.21.15.39:0/144711797 learned_addr learned my addr 172.21.15.39:0/144711797 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:37:48.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.113+0000 7f91a94e5700 1 --2- 172.21.15.39:0/144711797 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5652091ca110 0x5652092634a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:48.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.113+0000 7f91a8ce4700 1 --2- 172.21.15.39:0/144711797 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5652090e0450 0x5652092639e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:48.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.113+0000 7f91a9ce6700 1 -- 172.21.15.39:0/144711797 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5652091ca110 msgr2=0x5652092634a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:37:48.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.113+0000 7f91a9ce6700 1 --2- 172.21.15.39:0/144711797 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5652091ca110 0x5652092634a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:48.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.113+0000 7f91a9ce6700 1 -- 172.21.15.39:0/144711797 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5652090e0450 msgr2=0x5652092639e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:37:48.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.113+0000 7f91a9ce6700 1 --2- 172.21.15.39:0/144711797 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5652090e0450 0x5652092639e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:48.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.113+0000 7f91a9ce6700 1 -- 172.21.15.39:0/144711797 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565209116320 con 0x56520925d650 2024-05-09T05:37:48.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.113+0000 7f91a8ce4700 1 --2- 172.21.15.39:0/144711797 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5652090e0450 0x5652092639e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:37:48.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.113+0000 7f91a9ce6700 1 --2- 172.21.15.39:0/144711797 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56520925d650 0x56520925da80 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f919c00a920 tx=0x7f919c00ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10012ee83b589921 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:37:48.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.113+0000 7f918b7fe700 1 -- 172.21.15.39:0/144711797 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f919c00cc10 con 0x56520925d650 2024-05-09T05:37:48.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.113+0000 7f918b7fe700 1 -- 172.21.15.39:0/144711797 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f919c00cdb0 con 0x56520925d650 2024-05-09T05:37:48.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.113+0000 7f918b7fe700 1 -- 172.21.15.39:0/144711797 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f919c018660 con 0x56520925d650 2024-05-09T05:37:48.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.114+0000 7f91ba15fb80 1 -- 172.21.15.39:0/144711797 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56520925d650 msgr2=0x56520925da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:48.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.114+0000 7f91ba15fb80 1 --2- 172.21.15.39:0/144711797 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56520925d650 0x56520925da80 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f919c00a920 tx=0x7f919c00ac30 comp rx=0 tx=0).stop 2024-05-09T05:37:48.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.114+0000 7f91ba15fb80 1 -- 172.21.15.39:0/144711797 shutdown_connections 2024-05-09T05:37:48.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.114+0000 7f91ba15fb80 1 --2- 172.21.15.39:0/144711797 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56520925d650 0x56520925da80 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:48.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.114+0000 7f91ba15fb80 1 --2- 172.21.15.39:0/144711797 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5652091ca110 0x5652092634a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:48.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.114+0000 7f91ba15fb80 1 --2- 172.21.15.39:0/144711797 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5652090e0450 0x5652092639e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:48.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.114+0000 7f91ba15fb80 1 -- 172.21.15.39:0/144711797 >> 172.21.15.39:0/144711797 conn(0x565209140650 msgr2=0x5652092583b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:37:48.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.114+0000 7f91ba15fb80 1 -- 172.21.15.39:0/144711797 shutdown_connections 2024-05-09T05:37:48.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.114+0000 7f91ba15fb80 1 -- 172.21.15.39:0/144711797 wait complete. 2024-05-09T05:37:48.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.115+0000 7f91ba15fb80 1 -- start start 2024-05-09T05:37:48.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.115+0000 7f91ba15fb80 1 Processor -- start 2024-05-09T05:37:48.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.115+0000 7f91ba15fb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5652090e0450 0x565209267090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:48.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.115+0000 7f91ba15fb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5652091ca110 0x5652092675d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:48.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.115+0000 7f91ba15fb80 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56520925d650 0x565209267b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:48.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.115+0000 7f91ba15fb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x565208ffbb50 con 0x5652091ca110 2024-05-09T05:37:48.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.115+0000 7f91ba15fb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x56520913a100 con 0x5652090e0450 2024-05-09T05:37:48.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.115+0000 7f91ba15fb80 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x56520926a180 con 0x56520925d650 2024-05-09T05:37:48.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.115+0000 7f91ba15fb80 10 client.0 _ll_register_callbacks cb 0x565208ff1670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T05:37:48.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.115+0000 7f91a8ce4700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5652091ca110 0x5652092675d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:48.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.115+0000 7f91a8ce4700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5652091ca110 0x5652092675d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54410/0 (socket says 172.21.15.39:54410) 2024-05-09T05:37:48.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.115+0000 7f91a8ce4700 1 -- 172.21.15.39:0/2969253815 learned_addr learned my addr 172.21.15.39:0/2969253815 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:37:48.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.116+0000 7f91a9ce6700 1 --2- 172.21.15.39:0/2969253815 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56520925d650 0x565209267b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:48.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.116+0000 7f91a94e5700 1 --2- 172.21.15.39:0/2969253815 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5652090e0450 0x565209267090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:48.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.116+0000 7f91a8ce4700 1 -- 172.21.15.39:0/2969253815 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56520925d650 msgr2=0x565209267b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:37:48.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.116+0000 7f91a8ce4700 1 --2- 172.21.15.39:0/2969253815 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56520925d650 0x565209267b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:48.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.116+0000 7f91a8ce4700 1 -- 172.21.15.39:0/2969253815 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5652090e0450 msgr2=0x565209267090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:37:48.115 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.116+0000 7f91a8ce4700 1 --2- 172.21.15.39:0/2969253815 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5652090e0450 0x565209267090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:48.115 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.116+0000 7f91a8ce4700 1 -- 172.21.15.39:0/2969253815 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565208ffb440 con 0x5652091ca110 2024-05-09T05:37:48.115 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.116+0000 7f91a9ce6700 1 --2- 172.21.15.39:0/2969253815 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56520925d650 0x565209267b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:37:48.115 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.116+0000 7f91a94e5700 1 --2- 172.21.15.39:0/2969253815 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5652090e0450 0x565209267090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:37:48.115 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.116+0000 7f91a8ce4700 1 --2- 172.21.15.39:0/2969253815 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5652091ca110 0x5652092675d0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f91980e1070 tx=0x7f9198009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b1d9a83fca0939f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:37:48.115 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.116+0000 7f9188ff9700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-05-09T05:37:48.115 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.116+0000 7f9188ff9700 1 -- 172.21.15.39:0/2969253815 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91980aa3c0 con 0x5652091ca110 2024-05-09T05:37:48.115 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.116+0000 7f9188ff9700 1 -- 172.21.15.39:0/2969253815 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f91980040d0 con 0x5652091ca110 2024-05-09T05:37:48.115 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.116+0000 7f91ba15fb80 1 -- 172.21.15.39:0/2969253815 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f919c00cdb0 con 0x5652091ca110 2024-05-09T05:37:48.115 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.116+0000 7f9188ff9700 1 -- 172.21.15.39:0/2969253815 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f91980aafb0 con 0x5652091ca110 2024-05-09T05:37:48.115 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.116+0000 7f91ba15fb80 10 client.15126 fetch_fsmap learned FSMap version 24 2024-05-09T05:37:48.115 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.116+0000 7f91ba15fb80 1 -- 172.21.15.39:0/2969253815 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x565209274aa0 con 0x5652091ca110 2024-05-09T05:37:48.115 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.116+0000 7f9188ff9700 1 -- 172.21.15.39:0/2969253815 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f919c00cdb0 con 0x5652091ca110 2024-05-09T05:37:48.115 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.117+0000 7f9188ff9700 1 -- 172.21.15.39:0/2969253815 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f91980b31f0 con 0x5652091ca110 2024-05-09T05:37:48.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.117+0000 7f91ba15fb80 10 client.15126 fetch_fsmap finished waiting for FSMap version 24 2024-05-09T05:37:48.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.117+0000 7f91ba15fb80 10 client.15126 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-09T05:37:48.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.117+0000 7f91ba15fb80 20 client.15126 populate_metadata read hostname 'smithi039' 2024-05-09T05:37:48.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.117+0000 7f91ba15fb80 1 --2- 172.21.15.39:0/2969253815 >> [v2:172.21.15.60:6838/1418956667,v1:172.21.15.60:6839/1418956667] conn(0x5652092770e0 0x565209278550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:48.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.117+0000 7f91ba15fb80 4 client.15126 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T05:37:48.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.117+0000 7f91ba15fb80 1 -- 172.21.15.39:0/2969253815 --> [v2:172.21.15.60:6838/1418956667,v1:172.21.15.60:6839/1418956667] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56520918d980 con 0x5652092770e0 2024-05-09T05:37:48.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.117+0000 7f91a94e5700 1 --2- 172.21.15.39:0/2969253815 >> [v2:172.21.15.60:6838/1418956667,v1:172.21.15.60:6839/1418956667] conn(0x5652092770e0 0x565209278550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:48.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.117+0000 7f91a94e5700 1 --2- 172.21.15.39:0/2969253815 >> [v2:172.21.15.60:6838/1418956667,v1:172.21.15.60:6839/1418956667] conn(0x5652092770e0 0x565209278550 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c433880795848269 server_cookie=5139799063d36f2f in_seq=0 out_seq=0 2024-05-09T05:37:48.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.117+0000 7f9188ff9700 10 client.15126 ms_handle_connect on v2:172.21.15.60:6838/1418956667 2024-05-09T05:37:48.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.118+0000 7f9188ff9700 1 -- 172.21.15.39:0/2969253815 <== mds.0 v2:172.21.15.60:6838/1418956667 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x56520918d980 con 0x5652092770e0 2024-05-09T05:37:48.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.118+0000 7f9188ff9700 10 client.15126 handle_command_reply: tid=0 2024-05-09T05:37:48.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.118+0000 7f91ba15fb80 1 client.15126 shutdown 2024-05-09T05:37:48.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.118+0000 7f91ba15fb80 1 -- 172.21.15.39:0/2969253815 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5652091ca110 msgr2=0x5652092675d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:48.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.118+0000 7f91ba15fb80 1 --2- 172.21.15.39:0/2969253815 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5652091ca110 0x5652092675d0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f91980e1070 tx=0x7f9198009cd0 comp rx=0 tx=0).stop 2024-05-09T05:37:48.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.118+0000 7f91ba15fb80 1 -- 172.21.15.39:0/2969253815 shutdown_connections 2024-05-09T05:37:48.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.118+0000 7f91ba15fb80 1 --2- 172.21.15.39:0/2969253815 >> [v2:172.21.15.60:6838/1418956667,v1:172.21.15.60:6839/1418956667] conn(0x5652092770e0 0x565209278550 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:48.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.118+0000 7f91ba15fb80 1 --2- 172.21.15.39:0/2969253815 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56520925d650 0x565209267b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:48.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.118+0000 7f91ba15fb80 1 --2- 172.21.15.39:0/2969253815 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5652090e0450 0x565209267090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:48.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.118+0000 7f91ba15fb80 1 --2- 172.21.15.39:0/2969253815 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x5652091ca110 0x5652092675d0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:48.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.119+0000 7f91ba15fb80 1 -- 172.21.15.39:0/2969253815 >> 172.21.15.39:0/2969253815 conn(0x565209140650 msgr2=0x565209258170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:37:48.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.119+0000 7f9188ff9700 0 client.15126 ms_handle_reset on v2:172.21.15.60:6838/1418956667 2024-05-09T05:37:48.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.119+0000 7f91ba15fb80 1 -- 172.21.15.39:0/2969253815 shutdown_connections 2024-05-09T05:37:48.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.119+0000 7f91ba15fb80 1 -- 172.21.15.39:0/2969253815 wait complete. 2024-05-09T05:37:48.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.119+0000 7f91ba15fb80 20 client.15126 trim_cache size 0 max 16384 2024-05-09T05:37:48.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.140+0000 7f91ba15fb80 1 Processor -- start 2024-05-09T05:37:48.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.140+0000 7f91ba15fb80 1 -- start start 2024-05-09T05:37:48.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.140+0000 7f91ba15fb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5652090e0450 0x5652092733e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:48.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.140+0000 7f91ba15fb80 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5652091ca110 0x5652092615d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:48.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.140+0000 7f91ba15fb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56520925d650 0x56520925fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:48.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.140+0000 7f91ba15fb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x565209276890 con 0x56520925d650 2024-05-09T05:37:48.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.140+0000 7f91ba15fb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x565209276f60 con 0x5652090e0450 2024-05-09T05:37:48.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.140+0000 7f91ba15fb80 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x565209277630 con 0x5652091ca110 2024-05-09T05:37:48.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.140+0000 7f91a9ce6700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56520925d650 0x56520925fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:48.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.140+0000 7f91a9ce6700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56520925d650 0x56520925fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54416/0 (socket says 172.21.15.39:54416) 2024-05-09T05:37:48.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.140+0000 7f91a9ce6700 1 -- 172.21.15.39:0/2733036586 learned_addr learned my addr 172.21.15.39:0/2733036586 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:37:48.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.141+0000 7f91a94e5700 1 --2- 172.21.15.39:0/2733036586 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5652090e0450 0x5652092733e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:48.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.141+0000 7f91a8ce4700 1 --2- 172.21.15.39:0/2733036586 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5652091ca110 0x5652092615d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:48.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.141+0000 7f91a9ce6700 1 -- 172.21.15.39:0/2733036586 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5652091ca110 msgr2=0x5652092615d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:37:48.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.141+0000 7f91a9ce6700 1 --2- 172.21.15.39:0/2733036586 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5652091ca110 0x5652092615d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:48.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.141+0000 7f91a9ce6700 1 -- 172.21.15.39:0/2733036586 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5652090e0450 msgr2=0x5652092733e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:37:48.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.141+0000 7f91a9ce6700 1 --2- 172.21.15.39:0/2733036586 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5652090e0450 0x5652092733e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:48.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.141+0000 7f91a9ce6700 1 -- 172.21.15.39:0/2733036586 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56520925dfe0 con 0x56520925d650 2024-05-09T05:37:48.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.141+0000 7f91a94e5700 1 --2- 172.21.15.39:0/2733036586 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5652090e0450 0x5652092733e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T05:37:48.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.141+0000 7f91a9ce6700 1 --2- 172.21.15.39:0/2733036586 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56520925d650 0x56520925fdb0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f919c00a8c0 tx=0x7f919c005f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7aaa6108a4ebbc9 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:37:48.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.141+0000 7f918affd700 1 -- 172.21.15.39:0/2733036586 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f919c028070 con 0x56520925d650 2024-05-09T05:37:48.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.141+0000 7f918affd700 1 -- 172.21.15.39:0/2733036586 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f919c004040 con 0x56520925d650 2024-05-09T05:37:48.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.141+0000 7f918affd700 1 -- 172.21.15.39:0/2733036586 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f919c003ae0 con 0x56520925d650 2024-05-09T05:37:48.140 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.142+0000 7f91ba15fb80 1 -- 172.21.15.39:0/2733036586 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56520925d650 msgr2=0x56520925fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:48.140 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.142+0000 7f91ba15fb80 1 --2- 172.21.15.39:0/2733036586 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56520925d650 0x56520925fdb0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f919c00a8c0 tx=0x7f919c005f60 comp rx=0 tx=0).stop 2024-05-09T05:37:48.140 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.142+0000 7f91ba15fb80 1 -- 172.21.15.39:0/2733036586 shutdown_connections 2024-05-09T05:37:48.141 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.142+0000 7f91ba15fb80 1 --2- 172.21.15.39:0/2733036586 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56520925d650 0x56520925fdb0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:48.141 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.142+0000 7f91ba15fb80 1 --2- 172.21.15.39:0/2733036586 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5652090e0450 0x5652092733e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:48.141 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.142+0000 7f91ba15fb80 1 --2- 172.21.15.39:0/2733036586 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5652091ca110 0x5652092615d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:48.141 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.142+0000 7f91ba15fb80 1 -- 172.21.15.39:0/2733036586 >> 172.21.15.39:0/2733036586 conn(0x565209140650 msgr2=0x565209265980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:37:48.141 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.142+0000 7f91ba15fb80 1 -- 172.21.15.39:0/2733036586 shutdown_connections 2024-05-09T05:37:48.141 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.142+0000 7f91ba15fb80 1 -- 172.21.15.39:0/2733036586 wait complete. 2024-05-09T05:37:48.141 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.142+0000 7f91ba15fb80 1 -- start start 2024-05-09T05:37:48.141 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.142+0000 7f91ba15fb80 1 Processor -- start 2024-05-09T05:37:48.141 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.143+0000 7f91ba15fb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5652090e0450 0x565209261530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:48.141 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.143+0000 7f91ba15fb80 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5652091ca110 0x565209263ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:48.141 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.143+0000 7f91ba15fb80 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56520925d650 0x5652092643e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:48.141 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.143+0000 7f91ba15fb80 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x5652092783d0 con 0x56520925d650 2024-05-09T05:37:48.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.143+0000 7f91ba15fb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x565209277d00 con 0x5652090e0450 2024-05-09T05:37:48.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.143+0000 7f91ba15fb80 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x565209278aa0 con 0x5652091ca110 2024-05-09T05:37:48.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.143+0000 7f91ba15fb80 10 client.0 _ll_register_callbacks cb 0x565208ff1670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T05:37:48.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.143+0000 7f91a9ce6700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56520925d650 0x5652092643e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:48.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.143+0000 7f91a9ce6700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56520925d650 0x5652092643e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54430/0 (socket says 172.21.15.39:54430) 2024-05-09T05:37:48.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.143+0000 7f91a9ce6700 1 -- 172.21.15.39:0/3868184571 learned_addr learned my addr 172.21.15.39:0/3868184571 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:37:48.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.143+0000 7f91a94e5700 1 --2- 172.21.15.39:0/3868184571 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5652090e0450 0x565209261530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:48.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.143+0000 7f91a8ce4700 1 --2- 172.21.15.39:0/3868184571 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5652091ca110 0x565209263ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:48.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.143+0000 7f91a9ce6700 1 -- 172.21.15.39:0/3868184571 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5652091ca110 msgr2=0x565209263ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:37:48.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.143+0000 7f91a9ce6700 1 --2- 172.21.15.39:0/3868184571 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5652091ca110 0x565209263ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:48.143 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.143+0000 7f91a9ce6700 1 -- 172.21.15.39:0/3868184571 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5652090e0450 msgr2=0x565209261530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T05:37:48.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.143+0000 7f91a9ce6700 1 --2- 172.21.15.39:0/3868184571 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5652090e0450 0x565209261530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:48.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.143+0000 7f91a9ce6700 1 -- 172.21.15.39:0/3868184571 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565209264b60 con 0x56520925d650 2024-05-09T05:37:48.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.144+0000 7f91a9ce6700 1 --2- 172.21.15.39:0/3868184571 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56520925d650 0x5652092643e0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f919c006010 tx=0x7f919c004490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0cff4af4655efe9 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:37:48.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.144+0000 7f9188ff9700 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-05-09T05:37:48.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.144+0000 7f9188ff9700 1 -- 172.21.15.39:0/3868184571 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f919c028070 con 0x56520925d650 2024-05-09T05:37:48.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.144+0000 7f91ba15fb80 1 -- 172.21.15.39:0/3868184571 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f919c004040 con 0x56520925d650 2024-05-09T05:37:48.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.144+0000 7f9188ff9700 1 -- 172.21.15.39:0/3868184571 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f919c003890 con 0x56520925d650 2024-05-09T05:37:48.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.144+0000 7f9188ff9700 1 -- 172.21.15.39:0/3868184571 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f919c003a90 con 0x56520925d650 2024-05-09T05:37:48.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.144+0000 7f91ba15fb80 10 client.15132 fetch_fsmap learned FSMap version 24 2024-05-09T05:37:48.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.144+0000 7f91ba15fb80 1 -- 172.21.15.39:0/3868184571 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5652092e74b0 con 0x56520925d650 2024-05-09T05:37:48.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.144+0000 7f9188ff9700 1 -- 172.21.15.39:0/3868184571 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f919c004040 con 0x56520925d650 2024-05-09T05:37:48.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.144+0000 7f9188ff9700 1 -- 172.21.15.39:0/3868184571 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f919c00f450 con 0x56520925d650 2024-05-09T05:37:48.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.144+0000 7f91ba15fb80 10 client.15132 fetch_fsmap finished waiting for FSMap version 24 2024-05-09T05:37:48.144 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.144+0000 7f91ba15fb80 10 client.15132 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-09T05:37:48.145 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.144+0000 7f91ba15fb80 20 client.15132 populate_metadata read hostname 'smithi039' 2024-05-09T05:37:48.145 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.144+0000 7f91ba15fb80 1 --2- 172.21.15.39:0/3868184571 >> [v2:172.21.15.60:6838/1418956667,v1:172.21.15.60:6839/1418956667] conn(0x5652092e9230 0x5652092ea6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:48.145 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.144+0000 7f91ba15fb80 4 client.15132 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-09T05:37:48.145 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.144+0000 7f91ba15fb80 1 -- 172.21.15.39:0/3868184571 --> [v2:172.21.15.60:6838/1418956667,v1:172.21.15.60:6839/1418956667] -- command(tid 0: {"prefix": "status"}) -- 0x565209187a20 con 0x5652092e9230 2024-05-09T05:37:48.145 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.145+0000 7f91a94e5700 1 --2- 172.21.15.39:0/3868184571 >> [v2:172.21.15.60:6838/1418956667,v1:172.21.15.60:6839/1418956667] conn(0x5652092e9230 0x5652092ea6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:48.145 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.145+0000 7f91a94e5700 1 --2- 172.21.15.39:0/3868184571 >> [v2:172.21.15.60:6838/1418956667,v1:172.21.15.60:6839/1418956667] conn(0x5652092e9230 0x5652092ea6a0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c0856ed76e4d651d server_cookie=4c7fa434ededeb63 in_seq=0 out_seq=0 2024-05-09T05:37:48.145 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.145+0000 7f9188ff9700 10 client.15132 ms_handle_connect on v2:172.21.15.60:6838/1418956667 2024-05-09T05:37:48.145 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.145+0000 7f9188ff9700 1 -- 172.21.15.39:0/3868184571 <== mds.0 v2:172.21.15.60:6838/1418956667 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x565209187a20 con 0x5652092e9230 2024-05-09T05:37:48.145 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.145+0000 7f9188ff9700 10 client.15132 handle_command_reply: tid=0 2024-05-09T05:37:48.145 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.146+0000 7f91ba15fb80 1 client.15132 shutdown 2024-05-09T05:37:48.145 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.146+0000 7f91ba15fb80 1 -- 172.21.15.39:0/3868184571 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56520925d650 msgr2=0x5652092643e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:48.145 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.146+0000 7f91ba15fb80 1 --2- 172.21.15.39:0/3868184571 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56520925d650 0x5652092643e0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f919c006010 tx=0x7f919c004490 comp rx=0 tx=0).stop 2024-05-09T05:37:48.145 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.146+0000 7f91ba15fb80 1 -- 172.21.15.39:0/3868184571 shutdown_connections 2024-05-09T05:37:48.146 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.146+0000 7f91ba15fb80 1 --2- 172.21.15.39:0/3868184571 >> [v2:172.21.15.60:6838/1418956667,v1:172.21.15.60:6839/1418956667] conn(0x5652092e9230 0x5652092ea6a0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:48.146 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.146+0000 7f91ba15fb80 1 --2- 172.21.15.39:0/3868184571 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x56520925d650 0x5652092643e0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:48.146 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.146+0000 7f91ba15fb80 1 --2- 172.21.15.39:0/3868184571 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5652090e0450 0x565209261530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:48.146 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.146+0000 7f91ba15fb80 1 --2- 172.21.15.39:0/3868184571 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5652091ca110 0x565209263ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:48.146 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.146+0000 7f91ba15fb80 1 -- 172.21.15.39:0/3868184571 >> 172.21.15.39:0/3868184571 conn(0x565209140650 msgr2=0x56520925cdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:37:48.146 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.146+0000 7f9188ff9700 0 client.15132 ms_handle_reset on v2:172.21.15.60:6838/1418956667 2024-05-09T05:37:48.146 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.146+0000 7f91ba15fb80 1 -- 172.21.15.39:0/3868184571 shutdown_connections 2024-05-09T05:37:48.146 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.146+0000 7f91ba15fb80 1 -- 172.21.15.39:0/3868184571 wait complete. 2024-05-09T05:37:48.146 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.146+0000 7f91ba15fb80 20 client.15132 trim_cache size 0 max 16384 2024-05-09T05:37:48.147 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-05-09T05:37:48.147 INFO:teuthology.orchestra.run.smithi039.stdout: "cluster_fsid": "86d4cc60-0dc4-11ef-bc97-c7b262605968", 2024-05-09T05:37:48.147 INFO:teuthology.orchestra.run.smithi039.stdout: "whoami": 0, 2024-05-09T05:37:48.147 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 24509, 2024-05-09T05:37:48.147 INFO:teuthology.orchestra.run.smithi039.stdout: "want_state": "up:active", 2024-05-09T05:37:48.147 INFO:teuthology.orchestra.run.smithi039.stdout: "state": "up:active", 2024-05-09T05:37:48.147 INFO:teuthology.orchestra.run.smithi039.stdout: "fs_name": "cephfs", 2024-05-09T05:37:48.147 INFO:teuthology.orchestra.run.smithi039.stdout: "rank_uptime": 171.823672743, 2024-05-09T05:37:48.147 INFO:teuthology.orchestra.run.smithi039.stdout: "mdsmap_epoch": 24, 2024-05-09T05:37:48.147 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_epoch": 83, 2024-05-09T05:37:48.147 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_epoch_barrier": 81, 2024-05-09T05:37:48.148 INFO:teuthology.orchestra.run.smithi039.stdout: "uptime": 188.499926819 2024-05-09T05:37:48.148 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-05-09T05:37:48.148 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.147+0000 7f91ab749700 1 -- 172.21.15.39:0/14010942 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f918c0b2880 msgr2=0x7f918c0b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:48.149 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.147+0000 7f91ab749700 1 --2- 172.21.15.39:0/14010942 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f918c0b2880 0x7f918c0b4d90 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f9194009550 tx=0x7f91940091b0 comp rx=0 tx=0).stop 2024-05-09T05:37:48.149 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.147+0000 7f91ab749700 1 -- 172.21.15.39:0/14010942 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f91a4107df0 msgr2=0x7f91a419c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:48.149 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.147+0000 7f91ab749700 1 --2- 172.21.15.39:0/14010942 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f91a4107df0 0x7f91a419c1b0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f9198006010 tx=0x7f91980047b0 comp rx=0 tx=0).stop 2024-05-09T05:37:48.149 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.147+0000 7f91ab749700 1 -- 172.21.15.39:0/14010942 shutdown_connections 2024-05-09T05:37:48.149 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.147+0000 7f91ab749700 1 --2- 172.21.15.39:0/14010942 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f918c0b2880 0x7f918c0b4d90 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:48.149 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.147+0000 7f91ab749700 1 --2- 172.21.15.39:0/14010942 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91a4108740 0x7f91a419c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:48.149 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.147+0000 7f91ab749700 1 --2- 172.21.15.39:0/14010942 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91a41034c0 0x7f91a419bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:48.149 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.147+0000 7f91ab749700 1 --2- 172.21.15.39:0/14010942 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f91a4107df0 0x7f91a419c1b0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:48.149 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.147+0000 7f91ab749700 1 -- 172.21.15.39:0/14010942 >> 172.21.15.39:0/14010942 conn(0x7f91a40fedc0 msgr2=0x7f91a41096a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:37:48.149 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.147+0000 7f91ab749700 1 -- 172.21.15.39:0/14010942 shutdown_connections 2024-05-09T05:37:48.149 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:48.147+0000 7f91ab749700 1 -- 172.21.15.39:0/14010942 wait complete. 2024-05-09T05:37:48.937 INFO:teuthology.run_tasks:Running task sequential... 2024-05-09T05:37:48.946 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-05-09T05:37:48.946 INFO:teuthology.task.sequential:In sequential, running task print... 2024-05-09T05:37:48.946 INFO:teuthology.task.print:Enabling mgr modules 2024-05-09T05:37:48.946 INFO:teuthology.run_tasks:Running task kclient... 2024-05-09T05:37:48.981 INFO:tasks.kclient:Mounting kernel clients... 2024-05-09T05:37:48.982 INFO:tasks.kclient:config is {'client.0': {}} 2024-05-09T05:37:48.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:37:48.982 DEBUG:teuthology.orchestra.run.smithi039:> ip netns list 2024-05-09T05:37:49.001 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:37:49.001 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link delete ceph-brx 2024-05-09T05:37:49.071 INFO:teuthology.orchestra.run.smithi039.stderr:Cannot find device "ceph-brx" 2024-05-09T05:37:49.072 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T05:37:49.073 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=secure', 'wsync'], 'syntax': 'v1', 'mount_subvol_num': 1} 2024-05-09T05:37:49.073 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-09T05:37:49.073 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-09T05:37:49.073 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph fs ls 2024-05-09T05:37:49.367 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T05:37:49.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:37:49 smithi100 ceph-mon[34353]: pgmap v383: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-09T05:37:49.754 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:37:49 smithi039 ceph-mon[30439]: pgmap v383: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-09T05:37:49.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:37:49 smithi060 ceph-mon[34555]: pgmap v383: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-09T05:37:51.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:51.057+0000 7fd277f65700 1 -- 172.21.15.39:0/3329873125 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd270108f20 msgr2=0x7fd270109330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:51.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:51.057+0000 7fd277f65700 1 --2- 172.21.15.39:0/3329873125 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd270108f20 0x7fd270109330 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fd2600099c0 tx=0x7fd260009cd0 comp rx=0 tx=0).stop 2024-05-09T05:37:51.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:51.057+0000 7fd277f65700 1 -- 172.21.15.39:0/3329873125 shutdown_connections 2024-05-09T05:37:51.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:51.058+0000 7fd277f65700 1 --2- 172.21.15.39:0/3329873125 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd270109870 0x7fd2701111d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:51.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:51.058+0000 7fd277f65700 1 --2- 172.21.15.39:0/3329873125 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2701045f0 0x7fd270104a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:51.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:51.058+0000 7fd277f65700 1 --2- 172.21.15.39:0/3329873125 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd270108f20 0x7fd270109330 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:51.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:51.058+0000 7fd277f65700 1 -- 172.21.15.39:0/3329873125 >> 172.21.15.39:0/3329873125 conn(0x7fd270100040 msgr2=0x7fd270102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:37:51.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:51.058+0000 7fd277f65700 1 -- 172.21.15.39:0/3329873125 shutdown_connections 2024-05-09T05:37:51.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:51.058+0000 7fd277f65700 1 -- 172.21.15.39:0/3329873125 wait complete. 2024-05-09T05:37:51.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:51.058+0000 7fd277f65700 1 Processor -- start 2024-05-09T05:37:51.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:51.058+0000 7fd277f65700 1 -- start start 2024-05-09T05:37:51.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:51.059+0000 7fd277f65700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2701045f0 0x7fd27019af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:51.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:51.059+0000 7fd277f65700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd270108f20 0x7fd27019b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:51.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:51.059+0000 7fd277f65700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd270109870 0x7fd27019f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:51.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:51.059+0000 7fd277f65700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fd2701144d0 con 0x7fd270109870 2024-05-09T05:37:51.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:51.059+0000 7fd277f65700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd270114350 con 0x7fd270108f20 2024-05-09T05:37:51.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:51.059+0000 7fd277f65700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd270114650 con 0x7fd2701045f0 2024-05-09T05:37:51.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:51.059+0000 7fd276502700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd270109870 0x7fd27019f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:51.055 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:51.059+0000 7fd276502700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd270109870 0x7fd27019f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54448/0 (socket says 172.21.15.39:54448) 2024-05-09T05:37:51.055 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:51.059+0000 7fd276502700 1 -- 172.21.15.39:0/743179642 learned_addr learned my addr 172.21.15.39:0/743179642 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:37:51.055 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:51.059+0000 7fd275500700 1 --2- 172.21.15.39:0/743179642 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd270108f20 0x7fd27019b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:51.055 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:51.059+0000 7fd275d01700 1 --2- 172.21.15.39:0/743179642 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2701045f0 0x7fd27019af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:51.055 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:51.059+0000 7fd276502700 1 -- 172.21.15.39:0/743179642 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2701045f0 msgr2=0x7fd27019af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:51.055 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:51.059+0000 7fd276502700 1 --2- 172.21.15.39:0/743179642 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2701045f0 0x7fd27019af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:51.055 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:51.059+0000 7fd276502700 1 -- 172.21.15.39:0/743179642 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd270108f20 msgr2=0x7fd27019b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:51.055 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:51.059+0000 7fd276502700 1 --2- 172.21.15.39:0/743179642 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd270108f20 0x7fd27019b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:51.055 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:51.059+0000 7fd276502700 1 -- 172.21.15.39:0/743179642 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd27019fdd0 con 0x7fd270109870 2024-05-09T05:37:51.055 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:51.059+0000 7fd276502700 1 --2- 172.21.15.39:0/743179642 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd270109870 0x7fd27019f730 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fd26800ada0 tx=0x7fd26800c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:37:51.055 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:51.060+0000 7fd266ffd700 1 -- 172.21.15.39:0/743179642 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd268017020 con 0x7fd270109870 2024-05-09T05:37:51.055 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:51.060+0000 7fd266ffd700 1 -- 172.21.15.39:0/743179642 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd26800ce30 con 0x7fd270109870 2024-05-09T05:37:51.055 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:51.060+0000 7fd277f65700 1 -- 172.21.15.39:0/743179642 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2701a00c0 con 0x7fd270109870 2024-05-09T05:37:51.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:51.060+0000 7fd266ffd700 1 -- 172.21.15.39:0/743179642 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2680054a0 con 0x7fd270109870 2024-05-09T05:37:51.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:51.060+0000 7fd277f65700 1 -- 172.21.15.39:0/743179642 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2701a79e0 con 0x7fd270109870 2024-05-09T05:37:51.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:51.061+0000 7fd277f65700 1 -- 172.21.15.39:0/743179642 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd270105aa0 con 0x7fd270109870 2024-05-09T05:37:51.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:51.062+0000 7fd266ffd700 1 -- 172.21.15.39:0/743179642 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fd26800c980 con 0x7fd270109870 2024-05-09T05:37:51.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:51.064+0000 7fd266ffd700 1 --2- 172.21.15.39:0/743179642 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fd25c0b2880 0x7fd25c0b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:51.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:51.064+0000 7fd275d01700 1 --2- 172.21.15.39:0/743179642 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fd25c0b2880 0x7fd25c0b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:51.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:51.064+0000 7fd266ffd700 1 -- 172.21.15.39:0/743179642 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7fd2680e1f90 con 0x7fd270109870 2024-05-09T05:37:51.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:51.064+0000 7fd275d01700 1 --2- 172.21.15.39:0/743179642 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fd25c0b2880 0x7fd25c0b4d90 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd26c005950 tx=0x7fd26c0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:37:51.061 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:51.067+0000 7fd266ffd700 1 -- 172.21.15.39:0/743179642 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fd268021020 con 0x7fd270109870 2024-05-09T05:37:51.321 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:51.328+0000 7fd277f65700 1 -- 172.21.15.39:0/743179642 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fd27019c260 con 0x7fd270109870 2024-05-09T05:37:51.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:51.328+0000 7fd266ffd700 1 -- 172.21.15.39:0/743179642 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v24) ==== 53+0+73 (secure 0 0 0) 0x7fd2680a9d50 con 0x7fd270109870 2024-05-09T05:37:51.322 INFO:teuthology.orchestra.run.smithi039.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-09T05:37:51.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:51.331+0000 7fd277f65700 1 -- 172.21.15.39:0/743179642 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fd25c0b2880 msgr2=0x7fd25c0b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:51.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:51.331+0000 7fd277f65700 1 --2- 172.21.15.39:0/743179642 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fd25c0b2880 0x7fd25c0b4d90 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd26c005950 tx=0x7fd26c0058e0 comp rx=0 tx=0).stop 2024-05-09T05:37:51.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:51.331+0000 7fd277f65700 1 -- 172.21.15.39:0/743179642 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd270109870 msgr2=0x7fd27019f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:51.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:51.331+0000 7fd277f65700 1 --2- 172.21.15.39:0/743179642 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd270109870 0x7fd27019f730 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fd26800ada0 tx=0x7fd26800c330 comp rx=0 tx=0).stop 2024-05-09T05:37:51.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:51.331+0000 7fd277f65700 1 -- 172.21.15.39:0/743179642 shutdown_connections 2024-05-09T05:37:51.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:51.331+0000 7fd277f65700 1 --2- 172.21.15.39:0/743179642 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fd25c0b2880 0x7fd25c0b4d90 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:51.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:51.331+0000 7fd277f65700 1 --2- 172.21.15.39:0/743179642 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd270109870 0x7fd27019f730 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:51.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:51.331+0000 7fd277f65700 1 --2- 172.21.15.39:0/743179642 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2701045f0 0x7fd27019af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:51.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:51.331+0000 7fd277f65700 1 --2- 172.21.15.39:0/743179642 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd270108f20 0x7fd27019b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:51.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:51.331+0000 7fd277f65700 1 -- 172.21.15.39:0/743179642 >> 172.21.15.39:0/743179642 conn(0x7fd270100040 msgr2=0x7fd27010a7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:37:51.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:51.331+0000 7fd277f65700 1 -- 172.21.15.39:0/743179642 shutdown_connections 2024-05-09T05:37:51.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:51.331+0000 7fd277f65700 1 -- 172.21.15.39:0/743179642 wait complete. 2024-05-09T05:37:51.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:37:51 smithi039 ceph-mon[30439]: pgmap v384: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-09T05:37:51.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:37:51 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/743179642' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-09T05:37:51.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:37:51 smithi100 ceph-mon[34353]: pgmap v384: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-09T05:37:51.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:37:51 smithi100 ceph-mon[34353]: from='client.? 172.21.15.39:0/743179642' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-09T05:37:51.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:37:51 smithi060 ceph-mon[34555]: pgmap v384: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-09T05:37:51.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:37:51 smithi060 ceph-mon[34555]: from='client.? 172.21.15.39:0/743179642' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-09T05:37:51.967 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-09T05:37:51.967 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-09T05:37:51.967 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi039.front.sepia.ceph.com 2024-05-09T05:37:51.967 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-09T05:37:51.967 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-09T05:37:51.967 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-09T05:37:51.967 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-09T05:37:51.968 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-09T05:37:51.968 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-09T05:37:51.968 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:37:51.968 DEBUG:teuthology.orchestra.run.smithi039:> ip addr 2024-05-09T05:37:51.985 INFO:teuthology.orchestra.run.smithi039.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-09T05:37:51.985 INFO:teuthology.orchestra.run.smithi039.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-09T05:37:51.985 INFO:teuthology.orchestra.run.smithi039.stdout: inet 127.0.0.1/8 scope host lo 2024-05-09T05:37:51.985 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2024-05-09T05:37:51.986 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 ::1/128 scope host 2024-05-09T05:37:51.986 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2024-05-09T05:37:51.986 INFO:teuthology.orchestra.run.smithi039.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-09T05:37:51.986 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:6b:fe:c6 brd ff:ff:ff:ff:ff:ff 2024-05-09T05:37:51.986 INFO:teuthology.orchestra.run.smithi039.stdout: altname enp7s0f0 2024-05-09T05:37:51.986 INFO:teuthology.orchestra.run.smithi039.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-09T05:37:51.986 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:6b:fe:c7 brd ff:ff:ff:ff:ff:ff 2024-05-09T05:37:51.986 INFO:teuthology.orchestra.run.smithi039.stdout: altname enp7s0f1 2024-05-09T05:37:51.986 INFO:teuthology.orchestra.run.smithi039.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-09T05:37:51.986 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:bd:13:70 brd ff:ff:ff:ff:ff:ff 2024-05-09T05:37:51.986 INFO:teuthology.orchestra.run.smithi039.stdout: altname enp1s0f0 2024-05-09T05:37:51.986 INFO:teuthology.orchestra.run.smithi039.stdout: inet 172.21.15.39/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-05-09T05:37:51.986 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft 42069sec preferred_lft 42069sec 2024-05-09T05:37:51.987 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 fe80::ec4:7aff:febd:1370/64 scope link noprefixroute 2024-05-09T05:37:51.987 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2024-05-09T05:37:51.987 INFO:teuthology.orchestra.run.smithi039.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-09T05:37:51.987 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:bd:13:71 brd ff:ff:ff:ff:ff:ff 2024-05-09T05:37:51.987 INFO:teuthology.orchestra.run.smithi039.stdout: altname enp1s0f1 2024-05-09T05:37:51.987 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-09T05:37:51.987 DEBUG:teuthology.orchestra.run.smithi039:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-09T05:37:51.987 DEBUG:teuthology.orchestra.run.smithi039:> set -e 2024-05-09T05:37:51.987 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link add name ceph-brx type bridge 2024-05-09T05:37:51.988 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip addr flush dev ceph-brx 2024-05-09T05:37:51.988 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link set ceph-brx up 2024-05-09T05:37:51.988 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-09T05:37:51.988 DEBUG:teuthology.orchestra.run.smithi039:> ') 2024-05-09T05:37:52.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T05:37:52.198 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T05:37:52.205 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:37:52.205 DEBUG:teuthology.orchestra.run.smithi039:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-09T05:37:52.231 INFO:teuthology.orchestra.run.smithi039.stdout:1 2024-05-09T05:37:52.233 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:37:52.233 DEBUG:teuthology.orchestra.run.smithi039:> route 2024-05-09T05:37:52.307 INFO:teuthology.orchestra.run.smithi039.stdout:Kernel IP routing table 2024-05-09T05:37:52.308 INFO:teuthology.orchestra.run.smithi039.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-09T05:37:52.308 INFO:teuthology.orchestra.run.smithi039.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-05-09T05:37:52.308 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-05-09T05:37:52.308 INFO:teuthology.orchestra.run.smithi039.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-09T05:37:52.309 DEBUG:teuthology.orchestra.run.smithi039:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-09T05:37:52.309 DEBUG:teuthology.orchestra.run.smithi039:> set -e 2024-05-09T05:37:52.309 DEBUG:teuthology.orchestra.run.smithi039:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-09T05:37:52.309 DEBUG:teuthology.orchestra.run.smithi039:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-09T05:37:52.309 DEBUG:teuthology.orchestra.run.smithi039:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-09T05:37:52.309 DEBUG:teuthology.orchestra.run.smithi039:> ') 2024-05-09T05:37:52.398 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T05:37:52.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T05:37:52.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:37:52.634 DEBUG:teuthology.orchestra.run.smithi039:> ip netns list 2024-05-09T05:37:52.652 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:37:52.652 DEBUG:teuthology.orchestra.run.smithi039:> ip netns list-id 2024-05-09T05:37:52.707 DEBUG:teuthology.orchestra.run.smithi039:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-09T05:37:52.707 DEBUG:teuthology.orchestra.run.smithi039:> set -e 2024-05-09T05:37:52.707 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-09T05:37:52.708 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-05-09T05:37:52.708 DEBUG:teuthology.orchestra.run.smithi039:> ') 2024-05-09T05:37:52.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T05:37:52.822 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T05:37:52.831 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-05-09T05:37:52.832 DEBUG:teuthology.orchestra.run.smithi039:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-09T05:37:52.832 DEBUG:teuthology.orchestra.run.smithi039:> set -e 2024-05-09T05:37:52.832 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-05-09T05:37:52.832 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-09T05:37:52.833 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-05-09T05:37:52.833 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-05-09T05:37:52.833 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-05-09T05:37:52.833 DEBUG:teuthology.orchestra.run.smithi039:> ') 2024-05-09T05:37:52.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T05:37:52.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T05:37:52.963 DEBUG:teuthology.orchestra.run.smithi039:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-09T05:37:52.963 DEBUG:teuthology.orchestra.run.smithi039:> set -e 2024-05-09T05:37:52.963 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link set brx.0 up 2024-05-09T05:37:52.963 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link set dev brx.0 master ceph-brx 2024-05-09T05:37:52.963 DEBUG:teuthology.orchestra.run.smithi039:> ') 2024-05-09T05:37:53.013 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T05:37:53.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T05:37:53.043 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-09T05:37:53.043 DEBUG:teuthology.orchestra.run.smithi039:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-09T05:37:53.059 INFO:teuthology.orchestra.run.smithi039.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-09T05:37:53.059 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-09T05:37:53.059 DEBUG:teuthology.orchestra.run.smithi039:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-09T05:37:53.116 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-05-09T05:37:53.116 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-05-09T05:37:53.116 INFO:tasks.cephfs.kernel_mount:mounting using device: :/volumes/qa/sv_1/1c243c8b-da02-405b-9f58-64c0c1726231 2024-05-09T05:37:53.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:37:53.116 DEBUG:teuthology.orchestra.run.smithi039:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/volumes/qa/sv_1/1c243c8b-da02-405b-9f58-64c0c1726231 /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync 2024-05-09T05:37:53.230 INFO:teuthology.orchestra.run.smithi039.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync 2024-05-09T05:37:53.230 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync". 2024-05-09T05:37:53.230 INFO:teuthology.orchestra.run.smithi039.stdout:invalid new device string format 2024-05-09T05:37:53.369 INFO:teuthology.orchestra.run.smithi039.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync 2024-05-09T05:37:53.369 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync". 2024-05-09T05:37:53.369 INFO:teuthology.orchestra.run.smithi039.stdout:invalid new device string format 2024-05-09T05:37:53.369 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: resolved to: "172.21.15.39:3300,172.21.15.60:3300,172.21.15.100:3300" 2024-05-09T05:37:53.369 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.39:3300,172.21.15.60:3300,172.21.15.100:3300:/volumes/qa/sv_1/1c243c8b-da02-405b-9f58-64c0c1726231 2024-05-09T05:37:53.369 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync,key=0,fsid=86d4cc60-0dc4-11ef-bc97-c7b262605968" will pass to kernel 2024-05-09T05:37:53.369 INFO:teuthology.orchestra.run.smithi039.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-05-09T05:37:53.370 INFO:teuthology.orchestra.run.smithi039.stdout: You just mounted a file system that supports labels which does not 2024-05-09T05:37:53.370 INFO:teuthology.orchestra.run.smithi039.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-09T05:37:53.370 INFO:teuthology.orchestra.run.smithi039.stdout: applications will generate AVC messages and not be allowed access to 2024-05-09T05:37:53.370 INFO:teuthology.orchestra.run.smithi039.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-09T05:37:53.371 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-09T05:37:53.372 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T05:37:53.372 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-09T05:37:53.399 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-09T05:37:53.490 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:53 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-09T05:37:53.492 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T05:37:53.498 INFO:teuthology.orchestra.run.smithi039.stdout:client24887 2024-05-09T05:37:53.498 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-05-09T05:37:53.499 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-09T05:37:53.516 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-09T05:37:53.607 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:53 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-09T05:37:53.609 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T05:37:53.609 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:37:53 smithi039 ceph-mon[30439]: pgmap v385: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-09T05:37:53.615 INFO:teuthology.orchestra.run.smithi039.stdout:client24887 2024-05-09T05:37:53.616 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-09T05:37:53.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:53 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-09T05:37:53.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T05:37:53.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:37:53 smithi100 ceph-mon[34353]: pgmap v385: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-09T05:37:53.677 INFO:teuthology.orchestra.run.smithi039.stdout:client24887 2024-05-09T05:37:53.678 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968.client24887/status') 2024-05-09T05:37:53.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-09T05:37:53.739 INFO:teuthology.orchestra.run.smithi039.stdout:instance: client.24887 (3)172.21.15.39:0/659707062 2024-05-09T05:37:53.739 INFO:teuthology.orchestra.run.smithi039.stdout:blocklisted: false 2024-05-09T05:37:53.740 INFO:teuthology.orchestra.run.smithi039.stderr:0+1 records in 2024-05-09T05:37:53.740 INFO:teuthology.orchestra.run.smithi039.stderr:0+1 records out 2024-05-09T05:37:53.740 INFO:teuthology.orchestra.run.smithi039.stderr:70 bytes copied, 2.4359e-05 s, 2.9 MB/s 2024-05-09T05:37:53.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-09T05:37:53.747 INFO:teuthology.run_tasks:Running task exec... 2024-05-09T05:37:53.757 INFO:teuthology.task.exec:Executing custom commands... 2024-05-09T05:37:53.757 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi039.front.sepia.ceph.com 2024-05-09T05:37:53.757 DEBUG:teuthology.orchestra.run.smithi039:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate false' 2024-05-09T05:37:53.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:37:53 smithi060 ceph-mon[34555]: pgmap v385: 97 pgs: 97 active+clean; 639 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-09T05:37:53.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:53.880+0000 7f2e2c70d640 1 -- 172.21.15.39:0/2626923622 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2e24104530 msgr2=0x7f2e24102f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:53.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:53.880+0000 7f2e2c70d640 1 --2- 172.21.15.39:0/2626923622 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2e24104530 0x7f2e24102f30 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f2e18009900 tx=0x7f2e1802a410 comp rx=0 tx=0).stop 2024-05-09T05:37:53.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:53.880+0000 7f2e2c70d640 1 -- 172.21.15.39:0/2626923622 shutdown_connections 2024-05-09T05:37:53.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:53.880+0000 7f2e2c70d640 1 --2- 172.21.15.39:0/2626923622 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e24108b80 0x7f2e2410afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:53.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:53.880+0000 7f2e2c70d640 1 --2- 172.21.15.39:0/2626923622 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2e24104530 0x7f2e24102f30 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:53.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:53.880+0000 7f2e2c70d640 1 --2- 172.21.15.39:0/2626923622 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2e24104050 0x7f2e24102930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:53.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:53.880+0000 7f2e2c70d640 1 -- 172.21.15.39:0/2626923622 >> 172.21.15.39:0/2626923622 conn(0x7f2e240fd4d0 msgr2=0x7f2e240ff980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:37:53.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:53.880+0000 7f2e2c70d640 1 -- 172.21.15.39:0/2626923622 shutdown_connections 2024-05-09T05:37:53.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:53.880+0000 7f2e2c70d640 1 -- 172.21.15.39:0/2626923622 wait complete. 2024-05-09T05:37:53.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:53.881+0000 7f2e2c70d640 1 Processor -- start 2024-05-09T05:37:53.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:53.881+0000 7f2e2c70d640 1 -- start start 2024-05-09T05:37:53.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:53.881+0000 7f2e2c70d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2e24104050 0x7f2e24198e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:53.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:53.881+0000 7f2e2c70d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e24108b80 0x7f2e241993c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:53.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:53.881+0000 7f2e2c70d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2e2419e340 0x7f2e241a0760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:53.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:53.881+0000 7f2e2c70d640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f2e2410e690 con 0x7f2e24104050 2024-05-09T05:37:53.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:53.881+0000 7f2e2c70d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f2e2410e510 con 0x7f2e24108b80 2024-05-09T05:37:53.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:53.881+0000 7f2e2c70d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2e2410e810 con 0x7f2e2419e340 2024-05-09T05:37:53.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:53.881+0000 7f2e2a4a9640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2e24104050 0x7f2e24198e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:53.879 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:53.881+0000 7f2e2a4a9640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2e24104050 0x7f2e24198e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54464/0 (socket says 172.21.15.39:54464) 2024-05-09T05:37:53.879 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:53.881+0000 7f2e2a4a9640 1 -- 172.21.15.39:0/3207946341 learned_addr learned my addr 172.21.15.39:0/3207946341 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:37:53.879 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:53.881+0000 7f2e2acaa640 1 --2- 172.21.15.39:0/3207946341 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2e2419e340 0x7f2e241a0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:53.879 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:53.881+0000 7f2e2a4a9640 1 -- 172.21.15.39:0/3207946341 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2e2419e340 msgr2=0x7f2e241a0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:53.879 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:53.881+0000 7f2e2a4a9640 1 --2- 172.21.15.39:0/3207946341 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2e2419e340 0x7f2e241a0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:53.879 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:53.881+0000 7f2e2a4a9640 1 -- 172.21.15.39:0/3207946341 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e24108b80 msgr2=0x7f2e241993c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:53.879 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:53.881+0000 7f2e29ca8640 1 --2- 172.21.15.39:0/3207946341 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e24108b80 0x7f2e241993c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:53.879 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:53.882+0000 7f2e2a4a9640 1 --2- 172.21.15.39:0/3207946341 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e24108b80 0x7f2e241993c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:53.879 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:53.882+0000 7f2e2a4a9640 1 -- 172.21.15.39:0/3207946341 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e241a0dd0 con 0x7f2e24104050 2024-05-09T05:37:53.879 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:53.882+0000 7f2e2acaa640 1 --2- 172.21.15.39:0/3207946341 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2e2419e340 0x7f2e241a0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:37:53.879 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:53.882+0000 7f2e29ca8640 1 --2- 172.21.15.39:0/3207946341 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e24108b80 0x7f2e241993c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:37:53.879 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:53.882+0000 7f2e2a4a9640 1 --2- 172.21.15.39:0/3207946341 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2e24104050 0x7f2e24198e80 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f2e1400ebc0 tx=0x7f2e1400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:37:53.879 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:53.882+0000 7f2e237fe640 1 -- 172.21.15.39:0/3207946341 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e14004d20 con 0x7f2e24104050 2024-05-09T05:37:53.879 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:53.882+0000 7f2e237fe640 1 -- 172.21.15.39:0/3207946341 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2e140054d0 con 0x7f2e24104050 2024-05-09T05:37:53.880 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:53.882+0000 7f2e2c70d640 1 -- 172.21.15.39:0/3207946341 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e241a10c0 con 0x7f2e24104050 2024-05-09T05:37:53.880 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:53.882+0000 7f2e237fe640 1 -- 172.21.15.39:0/3207946341 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e14010720 con 0x7f2e24104050 2024-05-09T05:37:53.880 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:53.882+0000 7f2e2c70d640 1 -- 172.21.15.39:0/3207946341 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e241a15c0 con 0x7f2e24104050 2024-05-09T05:37:53.880 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:53.883+0000 7f2e2c70d640 1 -- 172.21.15.39:0/3207946341 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e24107280 con 0x7f2e24104050 2024-05-09T05:37:53.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:53.885+0000 7f2e237fe640 1 -- 172.21.15.39:0/3207946341 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f2e14005020 con 0x7f2e24104050 2024-05-09T05:37:53.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:53.885+0000 7f2e237fe640 1 --2- 172.21.15.39:0/3207946341 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f2e0c0b27e0 0x7f2e0c0b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:53.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:53.885+0000 7f2e237fe640 1 -- 172.21.15.39:0/3207946341 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f2e140e2c40 con 0x7f2e24104050 2024-05-09T05:37:53.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:53.885+0000 7f2e29ca8640 1 --2- 172.21.15.39:0/3207946341 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f2e0c0b27e0 0x7f2e0c0b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:53.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:53.886+0000 7f2e29ca8640 1 --2- 172.21.15.39:0/3207946341 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f2e0c0b27e0 0x7f2e0c0b4cf0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2e18006010 tx=0x7f2e18000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:37:53.882 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:53.889+0000 7f2e237fe640 1 -- 172.21.15.39:0/3207946341 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f2e140aa970 con 0x7f2e24104050 2024-05-09T05:37:54.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:54.122+0000 7f2e2c70d640 1 -- 172.21.15.39:0/3207946341 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} v 0) -- 0x7f2e2402ddb0 con 0x7f2e24104050 2024-05-09T05:37:54.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:54.428+0000 7f2e237fe640 1 -- 172.21.15.39:0/3207946341 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]=0 v25) ==== 118+0+0 (secure 0 0 0) 0x7f2e140aa270 con 0x7f2e24104050 2024-05-09T05:37:54.425 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:54.431+0000 7f2e2c70d640 1 -- 172.21.15.39:0/3207946341 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f2e0c0b27e0 msgr2=0x7f2e0c0b4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:54.425 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:54.431+0000 7f2e2c70d640 1 --2- 172.21.15.39:0/3207946341 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f2e0c0b27e0 0x7f2e0c0b4cf0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2e18006010 tx=0x7f2e18000bc0 comp rx=0 tx=0).stop 2024-05-09T05:37:54.425 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:54.431+0000 7f2e2c70d640 1 -- 172.21.15.39:0/3207946341 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2e24104050 msgr2=0x7f2e24198e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:54.425 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:54.431+0000 7f2e2c70d640 1 --2- 172.21.15.39:0/3207946341 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2e24104050 0x7f2e24198e80 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f2e1400ebc0 tx=0x7f2e1400c6a0 comp rx=0 tx=0).stop 2024-05-09T05:37:54.425 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:54.431+0000 7f2e2c70d640 1 -- 172.21.15.39:0/3207946341 shutdown_connections 2024-05-09T05:37:54.425 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:54.431+0000 7f2e2c70d640 1 --2- 172.21.15.39:0/3207946341 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f2e0c0b27e0 0x7f2e0c0b4cf0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:54.425 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:54.431+0000 7f2e2c70d640 1 --2- 172.21.15.39:0/3207946341 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2e2419e340 0x7f2e241a0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:54.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:54.431+0000 7f2e2c70d640 1 --2- 172.21.15.39:0/3207946341 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2e24108b80 0x7f2e241993c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:54.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:54.431+0000 7f2e2c70d640 1 --2- 172.21.15.39:0/3207946341 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2e24104050 0x7f2e24198e80 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:54.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:54.431+0000 7f2e2c70d640 1 -- 172.21.15.39:0/3207946341 >> 172.21.15.39:0/3207946341 conn(0x7f2e240fd4d0 msgr2=0x7f2e240ff8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:37:54.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:54.431+0000 7f2e2c70d640 1 -- 172.21.15.39:0/3207946341 shutdown_connections 2024-05-09T05:37:54.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:54.431+0000 7f2e2c70d640 1 -- 172.21.15.39:0/3207946341 wait complete. 2024-05-09T05:37:54.437 DEBUG:teuthology.orchestra.run.smithi039:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs subvolumegroup pin cephfs qa random 0.10' 2024-05-09T05:37:54.558 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:54.562+0000 7f4e79cf9640 1 -- 172.21.15.39:0/3749698147 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e74104eb0 msgr2=0x7f4e741052c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:54.558 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:54.562+0000 7f4e79cf9640 1 --2- 172.21.15.39:0/3749698147 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e74104eb0 0x7f4e741052c0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c009900 tx=0x7f4e5c02a410 comp rx=0 tx=0).stop 2024-05-09T05:37:54.558 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:54.562+0000 7f4e79cf9640 1 -- 172.21.15.39:0/3749698147 shutdown_connections 2024-05-09T05:37:54.558 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:54.562+0000 7f4e79cf9640 1 --2- 172.21.15.39:0/3749698147 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e74109bb0 0x7f4e7410bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:54.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:54.562+0000 7f4e79cf9640 1 --2- 172.21.15.39:0/3749698147 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e74104eb0 0x7f4e741052c0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:54.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:54.562+0000 7f4e79cf9640 1 --2- 172.21.15.39:0/3749698147 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e74103c70 0x7f4e74104970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:54.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:54.562+0000 7f4e79cf9640 1 -- 172.21.15.39:0/3749698147 >> 172.21.15.39:0/3749698147 conn(0x7f4e740fee60 msgr2=0x7f4e74101310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:37:54.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:54.562+0000 7f4e79cf9640 1 -- 172.21.15.39:0/3749698147 shutdown_connections 2024-05-09T05:37:54.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:54.562+0000 7f4e79cf9640 1 -- 172.21.15.39:0/3749698147 wait complete. 2024-05-09T05:37:54.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:54.563+0000 7f4e79cf9640 1 Processor -- start 2024-05-09T05:37:54.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:54.563+0000 7f4e79cf9640 1 -- start start 2024-05-09T05:37:54.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:54.563+0000 7f4e79cf9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e74103c70 0x7f4e7419a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:54.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:54.563+0000 7f4e79cf9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e74104eb0 0x7f4e7419a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:54.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:54.563+0000 7f4e79cf9640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e74109bb0 0x7f4e741a1830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:54.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:54.563+0000 7f4e79cf9640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f4e7410f790 con 0x7f4e74109bb0 2024-05-09T05:37:54.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:54.563+0000 7f4e79cf9640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f4e7410f610 con 0x7f4e74104eb0 2024-05-09T05:37:54.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:54.563+0000 7f4e79cf9640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4e7410f910 con 0x7f4e74103c70 2024-05-09T05:37:54.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:54.563+0000 7f4e73fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e74109bb0 0x7f4e741a1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:54.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:54.563+0000 7f4e73fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e74109bb0 0x7f4e741a1830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:54486/0 (socket says 172.21.15.39:54486) 2024-05-09T05:37:54.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:54.563+0000 7f4e73fff640 1 -- 172.21.15.39:0/1021413619 learned_addr learned my addr 172.21.15.39:0/1021413619 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T05:37:54.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:54.563+0000 7f4e6affd640 1 --2- 172.21.15.39:0/1021413619 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e74104eb0 0x7f4e7419a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:54.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:54.563+0000 7f4e737fe640 1 --2- 172.21.15.39:0/1021413619 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e74103c70 0x7f4e7419a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:54.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:54.563+0000 7f4e73fff640 1 -- 172.21.15.39:0/1021413619 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e74103c70 msgr2=0x7f4e7419a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:54.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:54.563+0000 7f4e73fff640 1 --2- 172.21.15.39:0/1021413619 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e74103c70 0x7f4e7419a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:54.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:54.563+0000 7f4e73fff640 1 -- 172.21.15.39:0/1021413619 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e74104eb0 msgr2=0x7f4e7419a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:54.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:54.563+0000 7f4e73fff640 1 --2- 172.21.15.39:0/1021413619 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e74104eb0 0x7f4e7419a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:54.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:54.563+0000 7f4e73fff640 1 -- 172.21.15.39:0/1021413619 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e741a1ea0 con 0x7f4e74109bb0 2024-05-09T05:37:54.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:54.563+0000 7f4e6affd640 1 --2- 172.21.15.39:0/1021413619 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e74104eb0 0x7f4e7419a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T05:37:54.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:54.563+0000 7f4e737fe640 1 --2- 172.21.15.39:0/1021413619 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e74103c70 0x7f4e7419a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T05:37:54.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:54.564+0000 7f4e73fff640 1 --2- 172.21.15.39:0/1021413619 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e74109bb0 0x7f4e741a1830 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c00eb10 tx=0x7f4e6c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:37:54.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:54.564+0000 7f4e717fa640 1 -- 172.21.15.39:0/1021413619 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e6c004b20 con 0x7f4e74109bb0 2024-05-09T05:37:54.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:54.564+0000 7f4e717fa640 1 -- 172.21.15.39:0/1021413619 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4e6c004cc0 con 0x7f4e74109bb0 2024-05-09T05:37:54.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:54.564+0000 7f4e79cf9640 1 -- 172.21.15.39:0/1021413619 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e741a2190 con 0x7f4e74109bb0 2024-05-09T05:37:54.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:54.564+0000 7f4e717fa640 1 -- 172.21.15.39:0/1021413619 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e6c010670 con 0x7f4e74109bb0 2024-05-09T05:37:54.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:54.564+0000 7f4e79cf9640 1 -- 172.21.15.39:0/1021413619 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e741a2690 con 0x7f4e74109bb0 2024-05-09T05:37:54.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:54.565+0000 7f4e79cf9640 1 -- 172.21.15.39:0/1021413619 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e741089c0 con 0x7f4e74109bb0 2024-05-09T05:37:54.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:54.566+0000 7f4e717fa640 1 -- 172.21.15.39:0/1021413619 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f4e6c005000 con 0x7f4e74109bb0 2024-05-09T05:37:54.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:54.567+0000 7f4e717fa640 1 --2- 172.21.15.39:0/1021413619 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f4e600b27e0 0x7f4e600b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T05:37:54.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:54.567+0000 7f4e737fe640 1 --2- 172.21.15.39:0/1021413619 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f4e600b27e0 0x7f4e600b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T05:37:54.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:54.567+0000 7f4e717fa640 1 -- 172.21.15.39:0/1021413619 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f4e6c0e2b30 con 0x7f4e74109bb0 2024-05-09T05:37:54.562 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:54.568+0000 7f4e737fe640 1 --2- 172.21.15.39:0/1021413619 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f4e600b27e0 0x7f4e600b4cf0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f4e640058c0 tx=0x7f4e64005d50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T05:37:54.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:54.571+0000 7f4e717fa640 1 -- 172.21.15.39:0/1021413619 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f4e6c054df0 con 0x7f4e74109bb0 2024-05-09T05:37:54.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:37:54 smithi100 ceph-mon[34353]: from='client.? 172.21.15.39:0/3207946341' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-05-09T05:37:54.785 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:54.791+0000 7f4e79cf9640 1 -- 172.21.15.39:0/1021413619 --> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}) -- 0x7f4e74063110 con 0x7f4e600b27e0 2024-05-09T05:37:54.791 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:37:54 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/3207946341' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-05-09T05:37:54.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:37:54 smithi060 ceph-mon[34555]: from='client.? 172.21.15.39:0/3207946341' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-05-09T05:37:54.805 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:54.812+0000 7f4e717fa640 1 -- 172.21.15.39:0/1021413619 <== mgr.14152 v2:172.21.15.39:6800/3184189003 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3 (secure 0 0 0) 0x7f4e74063110 con 0x7f4e600b27e0 2024-05-09T05:37:54.806 INFO:teuthology.orchestra.run.smithi039.stdout:{} 2024-05-09T05:37:54.808 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:54.814+0000 7f4e79cf9640 1 -- 172.21.15.39:0/1021413619 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f4e600b27e0 msgr2=0x7f4e600b4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:54.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:54.814+0000 7f4e79cf9640 1 --2- 172.21.15.39:0/1021413619 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f4e600b27e0 0x7f4e600b4cf0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f4e640058c0 tx=0x7f4e64005d50 comp rx=0 tx=0).stop 2024-05-09T05:37:54.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:54.814+0000 7f4e79cf9640 1 -- 172.21.15.39:0/1021413619 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e74109bb0 msgr2=0x7f4e741a1830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T05:37:54.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:54.814+0000 7f4e79cf9640 1 --2- 172.21.15.39:0/1021413619 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e74109bb0 0x7f4e741a1830 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c00eb10 tx=0x7f4e6c00c2d0 comp rx=0 tx=0).stop 2024-05-09T05:37:54.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:54.814+0000 7f4e79cf9640 1 -- 172.21.15.39:0/1021413619 shutdown_connections 2024-05-09T05:37:54.809 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:54.814+0000 7f4e79cf9640 1 --2- 172.21.15.39:0/1021413619 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f4e600b27e0 0x7f4e600b4cf0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:54.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:54.814+0000 7f4e79cf9640 1 --2- 172.21.15.39:0/1021413619 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e74109bb0 0x7f4e741a1830 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:54.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:54.814+0000 7f4e79cf9640 1 --2- 172.21.15.39:0/1021413619 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e74104eb0 0x7f4e7419a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:54.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:54.814+0000 7f4e79cf9640 1 --2- 172.21.15.39:0/1021413619 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e74103c70 0x7f4e7419a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T05:37:54.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:54.814+0000 7f4e79cf9640 1 -- 172.21.15.39:0/1021413619 >> 172.21.15.39:0/1021413619 conn(0x7f4e740fee60 msgr2=0x7f4e74105b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T05:37:54.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:54.814+0000 7f4e79cf9640 1 -- 172.21.15.39:0/1021413619 shutdown_connections 2024-05-09T05:37:54.810 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T05:37:54.814+0000 7f4e79cf9640 1 -- 172.21.15.39:0/1021413619 wait complete. 2024-05-09T05:37:54.820 INFO:teuthology.run_tasks:Running task check-counter... 2024-05-09T05:37:54.834 INFO:teuthology.run_tasks:Running task workunit... 2024-05-09T05:37:54.846 INFO:tasks.workunit:Pulling workunits from ref c9da4049f638c0f84bdd9b4e33c42e86046ac554 2024-05-09T05:37:54.847 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-05-09T05:37:54.847 INFO:tasks.workunit:timeout=3h 2024-05-09T05:37:54.847 INFO:tasks.workunit:cleanup=True 2024-05-09T05:37:54.847 DEBUG:teuthology.orchestra.run.smithi039:> stat -- /home/ubuntu/cephtest/mnt.0 2024-05-09T05:37:54.864 INFO:teuthology.orchestra.run.smithi039.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-05-09T05:37:54.864 INFO:teuthology.orchestra.run.smithi039.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-05-09T05:37:54.864 INFO:teuthology.orchestra.run.smithi039.stdout:Device: 72h/114d Inode: 1099511628283 Links: 2 2024-05-09T05:37:54.864 INFO:teuthology.orchestra.run.smithi039.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T05:37:54.864 INFO:teuthology.orchestra.run.smithi039.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-05-09T05:37:54.864 INFO:teuthology.orchestra.run.smithi039.stdout:Access: 2024-05-09 05:35:28.021654729 +0000 2024-05-09T05:37:54.864 INFO:teuthology.orchestra.run.smithi039.stdout:Modify: 2024-05-09 05:35:28.021654729 +0000 2024-05-09T05:37:54.865 INFO:teuthology.orchestra.run.smithi039.stdout:Change: 2024-05-09 05:37:53.403602352 +0000 2024-05-09T05:37:54.865 INFO:teuthology.orchestra.run.smithi039.stdout: Birth: 2024-05-09 05:35:28.021654729 +0000 2024-05-09T05:37:54.865 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-05-09T05:37:54.865 DEBUG:teuthology.orchestra.run.smithi039:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-05-09T05:37:54.936 DEBUG:teuthology.orchestra.run.smithi039:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout c9da4049f638c0f84bdd9b4e33c42e86046ac554 2024-05-09T05:37:54.993 INFO:tasks.workunit.client.0.smithi039.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-05-09T05:37:55.110 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:37:54 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: 2024-05-09T05:37:54.797+0000 7fcaf228a700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-09T05:37:55.110 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:37:54 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: 2024-05-09T05:37:54.797+0000 7fcaf228a700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-09T05:37:55.110 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:37:54 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: 2024-05-09T05:37:54.797+0000 7fcaf228a700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-09T05:37:55.110 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:37:54 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: 2024-05-09T05:37:54.797+0000 7fcaf228a700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-09T05:37:55.110 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 05:37:54 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: 2024-05-09T05:37:54.797+0000 7fcaf228a700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-09T05:37:55.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:37:55 smithi060 ceph-mon[34555]: pgmap v386: 97 pgs: 97 active+clean; 640 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 170 B/s wr, 7 op/s 2024-05-09T05:37:55.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:37:55 smithi060 ceph-mon[34555]: from='client.? 172.21.15.39:0/3207946341' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-05-09T05:37:55.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:37:55 smithi060 ceph-mon[34555]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-09T05:37:55.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:37:55 smithi039 ceph-mon[30439]: pgmap v386: 97 pgs: 97 active+clean; 640 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 170 B/s wr, 7 op/s 2024-05-09T05:37:55.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:37:55 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/3207946341' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-05-09T05:37:55.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:37:55 smithi039 ceph-mon[30439]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-09T05:37:55.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:37:55 smithi100 ceph-mon[34353]: pgmap v386: 97 pgs: 97 active+clean; 640 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 170 B/s wr, 7 op/s 2024-05-09T05:37:55.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:37:55 smithi100 ceph-mon[34353]: from='client.? 172.21.15.39:0/3207946341' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-05-09T05:37:55.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:37:55 smithi100 ceph-mon[34353]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-09T05:37:56.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:37:56 smithi060 ceph-mon[34555]: from='client.15150 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T05:37:56.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:37:56 smithi039 ceph-mon[30439]: from='client.15150 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T05:37:56.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:37:56 smithi100 ceph-mon[34353]: from='client.15150 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T05:37:57.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:37:57 smithi060 ceph-mon[34555]: pgmap v387: 97 pgs: 97 active+clean; 640 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 255 B/s wr, 5 op/s 2024-05-09T05:37:57.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:37:57 smithi060 ceph-mon[34555]: mgrmap e19: x(active, since 10m), standbys: z, y 2024-05-09T05:37:57.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:37:57 smithi039 ceph-mon[30439]: pgmap v387: 97 pgs: 97 active+clean; 640 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 255 B/s wr, 5 op/s 2024-05-09T05:37:57.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:37:57 smithi039 ceph-mon[30439]: mgrmap e19: x(active, since 10m), standbys: z, y 2024-05-09T05:37:57.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:37:57 smithi100 ceph-mon[34353]: pgmap v387: 97 pgs: 97 active+clean; 640 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 255 B/s wr, 5 op/s 2024-05-09T05:37:57.925 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:37:57 smithi100 ceph-mon[34353]: mgrmap e19: x(active, since 10m), standbys: z, y 2024-05-09T05:37:59.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:37:59 smithi060 ceph-mon[34555]: pgmap v388: 97 pgs: 97 active+clean; 640 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 682 B/s wr, 6 op/s 2024-05-09T05:37:59.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:37:59 smithi039 ceph-mon[30439]: pgmap v388: 97 pgs: 97 active+clean; 640 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 682 B/s wr, 6 op/s 2024-05-09T05:37:59.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:37:59 smithi100 ceph-mon[34353]: pgmap v388: 97 pgs: 97 active+clean; 640 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 682 B/s wr, 6 op/s 2024-05-09T05:38:00.548 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:38:00 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:38:00.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:38:00 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:38:00.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:38:00 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:38:01.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:38:01 smithi060 ceph-mon[34555]: pgmap v389: 97 pgs: 97 active+clean; 653 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.8 KiB/s wr, 8 op/s 2024-05-09T05:38:01.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:38:01 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:38:01.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:38:01 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:38:01.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:38:01 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:38:01.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:38:01 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:38:01.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:38:01 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:38:01.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:38:01 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:38:01.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:38:01 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:38:01.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:38:01 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:38:01.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:38:01 smithi039 ceph-mon[30439]: pgmap v389: 97 pgs: 97 active+clean; 653 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.8 KiB/s wr, 8 op/s 2024-05-09T05:38:01.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:38:01 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:38:01.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:38:01 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:38:01.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:38:01 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:38:01.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:38:01 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:38:01.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:38:01 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:38:01.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:38:01 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:38:01.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:38:01 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:38:01.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:38:01 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:38:01.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:38:01 smithi100 ceph-mon[34353]: pgmap v389: 97 pgs: 97 active+clean; 653 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.8 KiB/s wr, 8 op/s 2024-05-09T05:38:01.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:38:01 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:38:01.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:38:01 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:38:01.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:38:01 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:38:01.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:38:01 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:38:01.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:38:01 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:38:01.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:38:01 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:38:01.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:38:01 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:38:01.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:38:01 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:38:02.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:38:02 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:38:02.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:38:02 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:38:02.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:38:02 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:38:03.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:38:03 smithi060 ceph-mon[34555]: pgmap v390: 97 pgs: 97 active+clean; 653 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.8 KiB/s wr, 6 op/s 2024-05-09T05:38:03.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:38:03 smithi039 ceph-mon[30439]: pgmap v390: 97 pgs: 97 active+clean; 653 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.8 KiB/s wr, 6 op/s 2024-05-09T05:38:03.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:38:03 smithi100 ceph-mon[34353]: pgmap v390: 97 pgs: 97 active+clean; 653 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.8 KiB/s wr, 6 op/s 2024-05-09T05:38:05.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:38:05 smithi060 ceph-mon[34555]: pgmap v391: 97 pgs: 97 active+clean; 653 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.8 KiB/s wr, 8 op/s 2024-05-09T05:38:05.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:38:05 smithi039 ceph-mon[30439]: pgmap v391: 97 pgs: 97 active+clean; 653 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.8 KiB/s wr, 8 op/s 2024-05-09T05:38:05.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:38:05 smithi100 ceph-mon[34353]: pgmap v391: 97 pgs: 97 active+clean; 653 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.8 KiB/s wr, 8 op/s 2024-05-09T05:38:07.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:38:07 smithi060 ceph-mon[34555]: pgmap v392: 97 pgs: 97 active+clean; 653 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-05-09T05:38:07.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:38:07 smithi039 ceph-mon[30439]: pgmap v392: 97 pgs: 97 active+clean; 653 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-05-09T05:38:07.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:38:07 smithi100 ceph-mon[34353]: pgmap v392: 97 pgs: 97 active+clean; 653 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-05-09T05:38:09.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:38:09 smithi060 ceph-mon[34555]: pgmap v393: 97 pgs: 97 active+clean; 653 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.6 KiB/s wr, 6 op/s 2024-05-09T05:38:09.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:38:09 smithi039 ceph-mon[30439]: pgmap v393: 97 pgs: 97 active+clean; 653 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.6 KiB/s wr, 6 op/s 2024-05-09T05:38:09.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:38:09 smithi100 ceph-mon[34353]: pgmap v393: 97 pgs: 97 active+clean; 653 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.6 KiB/s wr, 6 op/s 2024-05-09T05:38:11.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:38:11 smithi060 ceph-mon[34555]: pgmap v394: 97 pgs: 97 active+clean; 654 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.3 KiB/s wr, 7 op/s 2024-05-09T05:38:11.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:38:11 smithi039 ceph-mon[30439]: pgmap v394: 97 pgs: 97 active+clean; 654 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.3 KiB/s wr, 7 op/s 2024-05-09T05:38:11.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:38:11 smithi100 ceph-mon[34353]: pgmap v394: 97 pgs: 97 active+clean; 654 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.3 KiB/s wr, 7 op/s 2024-05-09T05:38:13.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:38:13 smithi060 ceph-mon[34555]: pgmap v395: 97 pgs: 97 active+clean; 654 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 170 B/s wr, 5 op/s 2024-05-09T05:38:13.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:38:13 smithi039 ceph-mon[30439]: pgmap v395: 97 pgs: 97 active+clean; 654 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 170 B/s wr, 5 op/s 2024-05-09T05:38:13.926 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:38:13 smithi100 ceph-mon[34353]: pgmap v395: 97 pgs: 97 active+clean; 654 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 170 B/s wr, 5 op/s 2024-05-09T05:38:15.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:38:15 smithi060 ceph-mon[34555]: pgmap v396: 97 pgs: 97 active+clean; 654 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 170 B/s wr, 7 op/s 2024-05-09T05:38:15.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:38:15 smithi039 ceph-mon[30439]: pgmap v396: 97 pgs: 97 active+clean; 654 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 170 B/s wr, 7 op/s 2024-05-09T05:38:15.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:38:15 smithi100 ceph-mon[34353]: pgmap v396: 97 pgs: 97 active+clean; 654 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 170 B/s wr, 7 op/s 2024-05-09T05:38:17.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:38:17 smithi060 ceph-mon[34555]: pgmap v397: 97 pgs: 97 active+clean; 654 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 170 B/s wr, 5 op/s 2024-05-09T05:38:17.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:38:17 smithi039 ceph-mon[30439]: pgmap v397: 97 pgs: 97 active+clean; 654 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 170 B/s wr, 5 op/s 2024-05-09T05:38:17.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:38:17 smithi100 ceph-mon[34353]: pgmap v397: 97 pgs: 97 active+clean; 654 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 170 B/s wr, 5 op/s 2024-05-09T05:38:19.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:38:19 smithi060 ceph-mon[34555]: pgmap v398: 97 pgs: 97 active+clean; 654 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-05-09T05:38:19.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:38:19 smithi039 ceph-mon[30439]: pgmap v398: 97 pgs: 97 active+clean; 654 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-05-09T05:38:19.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:38:19 smithi100 ceph-mon[34353]: pgmap v398: 97 pgs: 97 active+clean; 654 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-05-09T05:38:21.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:38:21 smithi039 ceph-mon[30439]: pgmap v399: 97 pgs: 97 active+clean; 654 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 170 B/s wr, 6 op/s 2024-05-09T05:38:21.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:38:21 smithi100 ceph-mon[34353]: pgmap v399: 97 pgs: 97 active+clean; 654 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 170 B/s wr, 6 op/s 2024-05-09T05:38:22.046 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:38:21 smithi060 ceph-mon[34555]: pgmap v399: 97 pgs: 97 active+clean; 654 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 170 B/s wr, 6 op/s 2024-05-09T05:38:23.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:38:23 smithi039 ceph-mon[30439]: pgmap v400: 97 pgs: 97 active+clean; 654 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-09T05:38:23.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:38:23 smithi100 ceph-mon[34353]: pgmap v400: 97 pgs: 97 active+clean; 654 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-09T05:38:24.046 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:38:23 smithi060 ceph-mon[34555]: pgmap v400: 97 pgs: 97 active+clean; 654 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-09T05:38:25.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:38:25 smithi039 ceph-mon[30439]: pgmap v401: 97 pgs: 97 active+clean; 654 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-05-09T05:38:25.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:38:25 smithi100 ceph-mon[34353]: pgmap v401: 97 pgs: 97 active+clean; 654 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-05-09T05:38:26.046 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:38:25 smithi060 ceph-mon[34555]: pgmap v401: 97 pgs: 97 active+clean; 654 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-05-09T05:38:27.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:38:27 smithi039 ceph-mon[30439]: pgmap v402: 97 pgs: 97 active+clean; 654 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-09T05:38:27.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:38:27 smithi100 ceph-mon[34353]: pgmap v402: 97 pgs: 97 active+clean; 654 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-09T05:38:28.046 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:38:27 smithi060 ceph-mon[34555]: pgmap v402: 97 pgs: 97 active+clean; 654 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-09T05:38:29.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:38:29 smithi039 ceph-mon[30439]: pgmap v403: 97 pgs: 97 active+clean; 654 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-09T05:38:29.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:38:29 smithi100 ceph-mon[34353]: pgmap v403: 97 pgs: 97 active+clean; 654 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-09T05:38:30.046 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:38:29 smithi060 ceph-mon[34555]: pgmap v403: 97 pgs: 97 active+clean; 654 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-09T05:38:31.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:38:31 smithi039 ceph-mon[30439]: pgmap v404: 97 pgs: 97 active+clean; 660 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 597 B/s wr, 6 op/s 2024-05-09T05:38:31.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:38:31 smithi100 ceph-mon[34353]: pgmap v404: 97 pgs: 97 active+clean; 660 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 597 B/s wr, 6 op/s 2024-05-09T05:38:32.046 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:38:31 smithi060 ceph-mon[34555]: pgmap v404: 97 pgs: 97 active+clean; 660 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 597 B/s wr, 6 op/s 2024-05-09T05:38:33.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:38:33 smithi039 ceph-mon[30439]: pgmap v405: 97 pgs: 97 active+clean; 660 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 682 B/s wr, 5 op/s 2024-05-09T05:38:33.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:38:33 smithi100 ceph-mon[34353]: pgmap v405: 97 pgs: 97 active+clean; 660 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 682 B/s wr, 5 op/s 2024-05-09T05:38:34.046 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:38:33 smithi060 ceph-mon[34555]: pgmap v405: 97 pgs: 97 active+clean; 660 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 682 B/s wr, 5 op/s 2024-05-09T05:38:35.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:38:35 smithi039 ceph-mon[30439]: pgmap v406: 97 pgs: 97 active+clean; 660 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 682 B/s wr, 7 op/s 2024-05-09T05:38:35.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:38:35 smithi100 ceph-mon[34353]: pgmap v406: 97 pgs: 97 active+clean; 660 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 682 B/s wr, 7 op/s 2024-05-09T05:38:36.046 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:38:35 smithi060 ceph-mon[34555]: pgmap v406: 97 pgs: 97 active+clean; 660 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 682 B/s wr, 7 op/s 2024-05-09T05:38:37.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:38:37 smithi039 ceph-mon[30439]: pgmap v407: 97 pgs: 97 active+clean; 660 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 682 B/s wr, 5 op/s 2024-05-09T05:38:37.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:38:37 smithi100 ceph-mon[34353]: pgmap v407: 97 pgs: 97 active+clean; 660 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 682 B/s wr, 5 op/s 2024-05-09T05:38:38.046 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:38:37 smithi060 ceph-mon[34555]: pgmap v407: 97 pgs: 97 active+clean; 660 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 682 B/s wr, 5 op/s 2024-05-09T05:38:39.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:38:39 smithi039 ceph-mon[30439]: pgmap v408: 97 pgs: 97 active+clean; 660 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 682 B/s wr, 5 op/s 2024-05-09T05:38:39.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:38:39 smithi100 ceph-mon[34353]: pgmap v408: 97 pgs: 97 active+clean; 660 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 682 B/s wr, 5 op/s 2024-05-09T05:38:40.046 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:38:39 smithi060 ceph-mon[34555]: pgmap v408: 97 pgs: 97 active+clean; 660 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 682 B/s wr, 5 op/s 2024-05-09T05:38:41.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:38:41 smithi039 ceph-mon[30439]: pgmap v409: 97 pgs: 97 active+clean; 660 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 682 B/s wr, 6 op/s 2024-05-09T05:38:41.908 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:38:41 smithi100 ceph-mon[34353]: pgmap v409: 97 pgs: 97 active+clean; 660 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 682 B/s wr, 6 op/s 2024-05-09T05:38:41.947 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:38:41 smithi060 ceph-mon[34555]: pgmap v409: 97 pgs: 97 active+clean; 660 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 682 B/s wr, 6 op/s 2024-05-09T05:38:43.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:38:43 smithi100 ceph-mon[34353]: pgmap v410: 97 pgs: 97 active+clean; 660 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 85 B/s wr, 5 op/s 2024-05-09T05:38:44.046 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:38:43 smithi060 ceph-mon[34555]: pgmap v410: 97 pgs: 97 active+clean; 660 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 85 B/s wr, 5 op/s 2024-05-09T05:38:44.109 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:38:43 smithi039 ceph-mon[30439]: pgmap v410: 97 pgs: 97 active+clean; 660 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 85 B/s wr, 5 op/s 2024-05-09T05:38:45.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:38:45 smithi100 ceph-mon[34353]: pgmap v411: 97 pgs: 97 active+clean; 660 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-05-09T05:38:46.046 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:38:45 smithi060 ceph-mon[34555]: pgmap v411: 97 pgs: 97 active+clean; 660 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-05-09T05:38:46.109 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:38:45 smithi039 ceph-mon[30439]: pgmap v411: 97 pgs: 97 active+clean; 660 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-05-09T05:38:47.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:38:47 smithi100 ceph-mon[34353]: pgmap v412: 97 pgs: 97 active+clean; 660 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-05-09T05:38:48.046 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:38:47 smithi060 ceph-mon[34555]: pgmap v412: 97 pgs: 97 active+clean; 660 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-05-09T05:38:48.109 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:38:47 smithi039 ceph-mon[30439]: pgmap v412: 97 pgs: 97 active+clean; 660 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-05-09T05:38:49.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:38:49 smithi100 ceph-mon[34353]: pgmap v413: 97 pgs: 97 active+clean; 660 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-09T05:38:50.046 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:38:49 smithi060 ceph-mon[34555]: pgmap v413: 97 pgs: 97 active+clean; 660 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-09T05:38:50.109 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:38:49 smithi039 ceph-mon[30439]: pgmap v413: 97 pgs: 97 active+clean; 660 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-09T05:38:50.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:38:50 smithi100 ceph-mon[34353]: pgmap v414: 97 pgs: 97 active+clean; 660 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-09T05:38:51.046 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:38:50 smithi060 ceph-mon[34555]: pgmap v414: 97 pgs: 97 active+clean; 660 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-09T05:38:51.109 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:38:50 smithi039 ceph-mon[30439]: pgmap v414: 97 pgs: 97 active+clean; 660 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-09T05:38:53.546 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:38:53 smithi060 ceph-mon[34555]: pgmap v415: 97 pgs: 97 active+clean; 660 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-09T05:38:53.609 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:38:53 smithi039 ceph-mon[30439]: pgmap v415: 97 pgs: 97 active+clean; 660 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-09T05:38:53.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:38:53 smithi100 ceph-mon[34353]: pgmap v415: 97 pgs: 97 active+clean; 660 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-09T05:38:55.546 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:38:55 smithi060 ceph-mon[34555]: pgmap v416: 97 pgs: 97 active+clean; 660 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-05-09T05:38:55.609 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:38:55 smithi039 ceph-mon[30439]: pgmap v416: 97 pgs: 97 active+clean; 660 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-05-09T05:38:55.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:38:55 smithi100 ceph-mon[34353]: pgmap v416: 97 pgs: 97 active+clean; 660 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-05-09T05:38:57.546 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:38:57 smithi060 ceph-mon[34555]: pgmap v417: 97 pgs: 97 active+clean; 660 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-09T05:38:57.609 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:38:57 smithi039 ceph-mon[30439]: pgmap v417: 97 pgs: 97 active+clean; 660 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-09T05:38:57.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:38:57 smithi100 ceph-mon[34353]: pgmap v417: 97 pgs: 97 active+clean; 660 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-09T05:38:59.546 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:38:59 smithi060 ceph-mon[34555]: pgmap v418: 97 pgs: 97 active+clean; 660 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-05-09T05:38:59.546 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:38:59 smithi060 ceph-mon[34555]: mgrmap e20: x(active, since 11m), standbys: z, y 2024-05-09T05:38:59.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:38:59 smithi039 ceph-mon[30439]: pgmap v418: 97 pgs: 97 active+clean; 660 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-05-09T05:38:59.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:38:59 smithi039 ceph-mon[30439]: mgrmap e20: x(active, since 11m), standbys: z, y 2024-05-09T05:38:59.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:38:59 smithi100 ceph-mon[34353]: pgmap v418: 97 pgs: 97 active+clean; 660 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-05-09T05:38:59.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:38:59 smithi100 ceph-mon[34353]: mgrmap e20: x(active, since 11m), standbys: z, y 2024-05-09T05:39:01.609 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:39:01 smithi039 ceph-mon[30439]: pgmap v419: 97 pgs: 97 active+clean; 660 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 255 B/s wr, 6 op/s 2024-05-09T05:39:01.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:39:01 smithi100 ceph-mon[34353]: pgmap v419: 97 pgs: 97 active+clean; 660 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 255 B/s wr, 6 op/s 2024-05-09T05:39:01.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:39:01 smithi060 ceph-mon[34555]: pgmap v419: 97 pgs: 97 active+clean; 660 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 255 B/s wr, 6 op/s 2024-05-09T05:39:02.609 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:39:02 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:39:02.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:39:02 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:39:02.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:39:02 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:39:03.609 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:39:03 smithi039 ceph-mon[30439]: pgmap v420: 97 pgs: 97 active+clean; 660 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-05-09T05:39:03.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:39:03 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:39:03.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:39:03 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:39:03.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:39:03 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:39:03.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:39:03 smithi100 ceph-mon[34353]: pgmap v420: 97 pgs: 97 active+clean; 660 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-05-09T05:39:03.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:39:03 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:39:03.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:39:03 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:39:03.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:39:03 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:39:03.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:39:03 smithi060 ceph-mon[34555]: pgmap v420: 97 pgs: 97 active+clean; 660 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 426 B/s wr, 6 op/s 2024-05-09T05:39:03.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:39:03 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:39:03.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:39:03 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:39:03.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:39:03 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:39:05.609 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:39:05 smithi039 ceph-mon[30439]: pgmap v421: 97 pgs: 97 active+clean; 660 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-05-09T05:39:05.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:39:05 smithi100 ceph-mon[34353]: pgmap v421: 97 pgs: 97 active+clean; 660 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-05-09T05:39:05.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:39:05 smithi060 ceph-mon[34555]: pgmap v421: 97 pgs: 97 active+clean; 660 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-05-09T05:39:07.609 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:39:07 smithi039 ceph-mon[30439]: pgmap v422: 97 pgs: 97 active+clean; 660 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-05-09T05:39:07.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:39:07 smithi100 ceph-mon[34353]: pgmap v422: 97 pgs: 97 active+clean; 660 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-05-09T05:39:07.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:39:07 smithi060 ceph-mon[34555]: pgmap v422: 97 pgs: 97 active+clean; 660 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-05-09T05:39:09.609 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:39:09 smithi039 ceph-mon[30439]: pgmap v423: 97 pgs: 97 active+clean; 660 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-05-09T05:39:09.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:39:09 smithi100 ceph-mon[34353]: pgmap v423: 97 pgs: 97 active+clean; 660 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-05-09T05:39:09.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:39:09 smithi060 ceph-mon[34555]: pgmap v423: 97 pgs: 97 active+clean; 660 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-05-09T05:39:11.598 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:39:11 smithi060 ceph-mon[34555]: pgmap v424: 97 pgs: 97 active+clean; 660 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 341 B/s wr, 7 op/s 2024-05-09T05:39:11.609 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:39:11 smithi039 ceph-mon[30439]: pgmap v424: 97 pgs: 97 active+clean; 660 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 341 B/s wr, 7 op/s 2024-05-09T05:39:11.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:39:11 smithi100 ceph-mon[34353]: pgmap v424: 97 pgs: 97 active+clean; 660 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 341 B/s wr, 7 op/s 2024-05-09T05:39:13.609 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:39:13 smithi039 ceph-mon[30439]: pgmap v425: 97 pgs: 97 active+clean; 660 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 170 B/s wr, 5 op/s 2024-05-09T05:39:13.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:39:13 smithi100 ceph-mon[34353]: pgmap v425: 97 pgs: 97 active+clean; 660 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 170 B/s wr, 5 op/s 2024-05-09T05:39:13.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:39:13 smithi060 ceph-mon[34555]: pgmap v425: 97 pgs: 97 active+clean; 660 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 170 B/s wr, 5 op/s 2024-05-09T05:39:15.609 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:39:15 smithi039 ceph-mon[30439]: pgmap v426: 97 pgs: 97 active+clean; 660 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s 2024-05-09T05:39:15.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:39:15 smithi100 ceph-mon[34353]: pgmap v426: 97 pgs: 97 active+clean; 660 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s 2024-05-09T05:39:15.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:39:15 smithi060 ceph-mon[34555]: pgmap v426: 97 pgs: 97 active+clean; 660 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s 2024-05-09T05:39:17.609 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:39:17 smithi039 ceph-mon[30439]: pgmap v427: 97 pgs: 97 active+clean; 660 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-09T05:39:17.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:39:17 smithi100 ceph-mon[34353]: pgmap v427: 97 pgs: 97 active+clean; 660 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-09T05:39:17.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:39:17 smithi060 ceph-mon[34555]: pgmap v427: 97 pgs: 97 active+clean; 660 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-09T05:39:19.609 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:39:19 smithi039 ceph-mon[30439]: pgmap v428: 97 pgs: 97 active+clean; 660 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-09T05:39:19.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:39:19 smithi100 ceph-mon[34353]: pgmap v428: 97 pgs: 97 active+clean; 660 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-09T05:39:19.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:39:19 smithi060 ceph-mon[34555]: pgmap v428: 97 pgs: 97 active+clean; 660 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-09T05:39:21.609 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:39:21 smithi039 ceph-mon[30439]: pgmap v429: 97 pgs: 97 active+clean; 660 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-09T05:39:21.668 INFO:tasks.workunit.client.0.smithi039.stderr:Updating files: 93% (11450/12271) Updating files: 94% (11535/12271) Updating files: 95% (11658/12271) Updating files: 96% (11781/12271) Updating files: 97% (11903/12271) Updating files: 98% (12026/12271) Updating files: 99% (12149/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-05-09T05:39:21.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:39:21 smithi100 ceph-mon[34353]: pgmap v429: 97 pgs: 97 active+clean; 660 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-09T05:39:21.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:39:21 smithi060 ceph-mon[34555]: pgmap v429: 97 pgs: 97 active+clean; 660 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-09T05:39:22.482 INFO:tasks.workunit.client.0.smithi039.stderr:Note: switching to 'c9da4049f638c0f84bdd9b4e33c42e86046ac554'. 2024-05-09T05:39:22.482 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-05-09T05:39:22.482 INFO:tasks.workunit.client.0.smithi039.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-05-09T05:39:22.482 INFO:tasks.workunit.client.0.smithi039.stderr:changes and commit them, and you can discard any commits you make in this 2024-05-09T05:39:22.482 INFO:tasks.workunit.client.0.smithi039.stderr:state without impacting any branches by switching back to a branch. 2024-05-09T05:39:22.483 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-05-09T05:39:22.483 INFO:tasks.workunit.client.0.smithi039.stderr:If you want to create a new branch to retain commits you create, you may 2024-05-09T05:39:22.483 INFO:tasks.workunit.client.0.smithi039.stderr:do so (now or later) by using -c with the switch command. Example: 2024-05-09T05:39:22.483 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-05-09T05:39:22.483 INFO:tasks.workunit.client.0.smithi039.stderr: git switch -c 2024-05-09T05:39:22.483 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-05-09T05:39:22.483 INFO:tasks.workunit.client.0.smithi039.stderr:Or undo this operation with: 2024-05-09T05:39:22.483 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-05-09T05:39:22.483 INFO:tasks.workunit.client.0.smithi039.stderr: git switch - 2024-05-09T05:39:22.483 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-05-09T05:39:22.483 INFO:tasks.workunit.client.0.smithi039.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-05-09T05:39:22.484 INFO:tasks.workunit.client.0.smithi039.stderr: 2024-05-09T05:39:22.484 INFO:tasks.workunit.client.0.smithi039.stderr:HEAD is now at c9da4049f63 Merge PR #57081 into wip-pdonnell-testing-20240508.183908-debug 2024-05-09T05:39:22.489 DEBUG:teuthology.orchestra.run.smithi039:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-05-09T05:39:22.569 INFO:tasks.workunit.client.0.smithi039.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-05-09T05:39:22.574 INFO:tasks.workunit.client.0.smithi039.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-05-09T05:39:22.574 INFO:tasks.workunit.client.0.smithi039.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-05-09T05:39:23.234 INFO:tasks.workunit.client.0.smithi039.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-05-09T05:39:23.303 INFO:tasks.workunit.client.0.smithi039.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-05-09T05:39:23.345 INFO:tasks.workunit.client.0.smithi039.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-05-09T05:39:23.349 INFO:tasks.workunit.client.0.smithi039.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-05-09T05:39:23.350 INFO:tasks.workunit.client.0.smithi039.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-05-09T05:39:23.388 INFO:tasks.workunit.client.0.smithi039.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-05-09T05:39:23.391 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-05-09T05:39:23.391 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-05-09T05:39:23.451 INFO:tasks.workunit:Running workunits matching suites/dbench.sh on client.0... 2024-05-09T05:39:23.452 INFO:tasks.workunit:Running workunit suites/dbench.sh... 2024-05-09T05:39:23.452 DEBUG:teuthology.orchestra.run.smithi039:workunit test suites/dbench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c9da4049f638c0f84bdd9b4e33c42e86046ac554 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/dbench.sh 2024-05-09T05:39:23.516 INFO:tasks.workunit.client.0.smithi039.stderr:+ dbench 1 2024-05-09T05:39:23.526 INFO:tasks.workunit.client.0.smithi039.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2024-05-09T05:39:23.526 INFO:tasks.workunit.client.0.smithi039.stdout: 2024-05-09T05:39:23.526 INFO:tasks.workunit.client.0.smithi039.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2024-05-09T05:39:23.530 INFO:tasks.workunit.client.0.smithi039.stdout:0 of 1 processes prepared for launch 0 sec 2024-05-09T05:39:23.609 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:39:23 smithi039 ceph-mon[30439]: pgmap v430: 97 pgs: 97 active+clean; 660 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-09T05:39:23.630 INFO:tasks.workunit.client.0.smithi039.stdout:1 of 1 processes prepared for launch 0 sec 2024-05-09T05:39:23.630 INFO:tasks.workunit.client.0.smithi039.stdout:releasing clients 2024-05-09T05:39:23.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:39:23 smithi100 ceph-mon[34353]: pgmap v430: 97 pgs: 97 active+clean; 660 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-09T05:39:23.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:39:23 smithi060 ceph-mon[34555]: pgmap v430: 97 pgs: 97 active+clean; 660 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-09T05:39:24.630 INFO:tasks.workunit.client.0.smithi039.stdout: 1 2984 33.52 MB/sec warmup 1 sec latency 8.674 ms 2024-05-09T05:39:25.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:39:25 smithi039 ceph-mon[30439]: pgmap v431: 97 pgs: 97 active+clean; 703 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 4.3 KiB/s wr, 7 op/s 2024-05-09T05:39:25.630 INFO:tasks.workunit.client.0.smithi039.stdout: 1 5007 22.57 MB/sec warmup 2 sec latency 14.135 ms 2024-05-09T05:39:25.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:39:25 smithi100 ceph-mon[34353]: pgmap v431: 97 pgs: 97 active+clean; 703 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 4.3 KiB/s wr, 7 op/s 2024-05-09T05:39:25.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:39:25 smithi060 ceph-mon[34555]: pgmap v431: 97 pgs: 97 active+clean; 703 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 4.3 KiB/s wr, 7 op/s 2024-05-09T05:39:26.630 INFO:tasks.workunit.client.0.smithi039.stdout: 1 6907 18.17 MB/sec warmup 3 sec latency 521.087 ms 2024-05-09T05:39:26.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:39:26 smithi100 ceph-mon[34353]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-09T05:39:26.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:39:26 smithi060 ceph-mon[34555]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-09T05:39:26.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:39:26 smithi039 ceph-mon[30439]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-09T05:39:27.631 INFO:tasks.workunit.client.0.smithi039.stdout: 1 6907 13.62 MB/sec warmup 4 sec latency 1521.174 ms 2024-05-09T05:39:27.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:39:27 smithi100 ceph-mon[34353]: pgmap v432: 97 pgs: 97 active+clean; 1.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 44 KiB/s wr, 7 op/s 2024-05-09T05:39:27.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:39:27 smithi060 ceph-mon[34555]: pgmap v432: 97 pgs: 97 active+clean; 1.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 44 KiB/s wr, 7 op/s 2024-05-09T05:39:27.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:39:27 smithi039 ceph-mon[30439]: pgmap v432: 97 pgs: 97 active+clean; 1.1 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 44 KiB/s wr, 7 op/s 2024-05-09T05:39:28.630 INFO:tasks.workunit.client.0.smithi039.stdout: 1 6920 10.91 MB/sec warmup 5 sec latency 2501.260 ms 2024-05-09T05:39:29.630 INFO:tasks.workunit.client.0.smithi039.stdout: 1 6933 9.10 MB/sec warmup 6 sec latency 979.603 ms 2024-05-09T05:39:29.662 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:39:29 smithi039 ceph-mon[30439]: pgmap v433: 97 pgs: 97 active+clean; 1.9 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 137 KiB/s wr, 14 op/s 2024-05-09T05:39:29.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:39:29 smithi100 ceph-mon[34353]: pgmap v433: 97 pgs: 97 active+clean; 1.9 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 137 KiB/s wr, 14 op/s 2024-05-09T05:39:29.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:39:29 smithi060 ceph-mon[34555]: pgmap v433: 97 pgs: 97 active+clean; 1.9 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 137 KiB/s wr, 14 op/s 2024-05-09T05:39:30.631 INFO:tasks.workunit.client.0.smithi039.stdout: 1 6933 7.80 MB/sec warmup 7 sec latency 1979.667 ms 2024-05-09T05:39:31.631 INFO:tasks.workunit.client.0.smithi039.stdout: 1 6933 6.82 MB/sec warmup 8 sec latency 2979.765 ms 2024-05-09T05:39:31.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:39:31 smithi100 ceph-mon[34353]: pgmap v434: 97 pgs: 97 active+clean; 3.8 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 328 KiB/s wr, 46 op/s 2024-05-09T05:39:31.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:39:31 smithi100 ceph-mon[34353]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-09T05:39:31.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:39:31 smithi060 ceph-mon[34555]: pgmap v434: 97 pgs: 97 active+clean; 3.8 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 328 KiB/s wr, 46 op/s 2024-05-09T05:39:31.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:39:31 smithi060 ceph-mon[34555]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-09T05:39:31.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:39:31 smithi039 ceph-mon[30439]: pgmap v434: 97 pgs: 97 active+clean; 3.8 MiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 328 KiB/s wr, 46 op/s 2024-05-09T05:39:31.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:39:31 smithi039 ceph-mon[30439]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-09T05:39:32.631 INFO:tasks.workunit.client.0.smithi039.stdout: 1 6933 6.06 MB/sec warmup 9 sec latency 3979.914 ms 2024-05-09T05:39:33.631 INFO:tasks.workunit.client.0.smithi039.stdout: 1 7066 5.75 MB/sec warmup 10 sec latency 4960.141 ms 2024-05-09T05:39:33.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:39:33 smithi100 ceph-mon[34353]: pgmap v435: 97 pgs: 97 active+clean; 3.9 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 344 KiB/s wr, 47 op/s 2024-05-09T05:39:33.798 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:39:33 smithi060 ceph-mon[34555]: pgmap v435: 97 pgs: 97 active+clean; 3.9 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 344 KiB/s wr, 47 op/s 2024-05-09T05:39:33.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:39:33 smithi039 ceph-mon[30439]: pgmap v435: 97 pgs: 97 active+clean; 3.9 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 344 KiB/s wr, 47 op/s 2024-05-09T05:39:34.631 INFO:tasks.workunit.client.0.smithi039.stdout: 1 7084 5.23 MB/sec warmup 11 sec latency 985.373 ms 2024-05-09T05:39:35.631 INFO:tasks.workunit.client.0.smithi039.stdout: 1 7084 4.79 MB/sec warmup 12 sec latency 1985.465 ms 2024-05-09T05:39:35.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:39:35 smithi100 ceph-mon[34353]: pgmap v436: 97 pgs: 97 active+clean; 4.0 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 348 KiB/s wr, 50 op/s 2024-05-09T05:39:35.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:39:35 smithi060 ceph-mon[34555]: pgmap v436: 97 pgs: 97 active+clean; 4.0 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 348 KiB/s wr, 50 op/s 2024-05-09T05:39:35.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:39:35 smithi039 ceph-mon[30439]: pgmap v436: 97 pgs: 97 active+clean; 4.0 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 348 KiB/s wr, 50 op/s 2024-05-09T05:39:36.632 INFO:tasks.workunit.client.0.smithi039.stdout: 1 7084 4.42 MB/sec warmup 13 sec latency 2985.589 ms 2024-05-09T05:39:37.631 INFO:tasks.workunit.client.0.smithi039.stdout: 1 7084 4.11 MB/sec warmup 14 sec latency 3985.687 ms 2024-05-09T05:39:37.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:39:37 smithi100 ceph-mon[34353]: pgmap v437: 97 pgs: 97 active+clean; 4.0 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 344 KiB/s wr, 47 op/s 2024-05-09T05:39:37.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:39:37 smithi060 ceph-mon[34555]: pgmap v437: 97 pgs: 97 active+clean; 4.0 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 344 KiB/s wr, 47 op/s 2024-05-09T05:39:37.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:39:37 smithi039 ceph-mon[30439]: pgmap v437: 97 pgs: 97 active+clean; 4.0 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 344 KiB/s wr, 47 op/s 2024-05-09T05:39:38.631 INFO:tasks.workunit.client.0.smithi039.stdout: 1 7109 3.84 MB/sec warmup 15 sec latency 4963.423 ms 2024-05-09T05:39:39.631 INFO:tasks.workunit.client.0.smithi039.stdout: 1 7241 3.62 MB/sec warmup 16 sec latency 791.730 ms 2024-05-09T05:39:39.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:39:39 smithi100 ceph-mon[34353]: pgmap v438: 97 pgs: 97 active+clean; 4.0 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 306 KiB/s wr, 47 op/s 2024-05-09T05:39:39.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:39:39 smithi060 ceph-mon[34555]: pgmap v438: 97 pgs: 97 active+clean; 4.0 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 306 KiB/s wr, 47 op/s 2024-05-09T05:39:39.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:39:39 smithi039 ceph-mon[30439]: pgmap v438: 97 pgs: 97 active+clean; 4.0 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 306 KiB/s wr, 47 op/s 2024-05-09T05:39:40.632 INFO:tasks.workunit.client.0.smithi039.stdout: 1 7241 3.40 MB/sec warmup 17 sec latency 1102.952 ms 2024-05-09T05:39:41.632 INFO:tasks.workunit.client.0.smithi039.stdout: 1 7241 3.21 MB/sec warmup 18 sec latency 2103.065 ms 2024-05-09T05:39:41.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:39:41 smithi100 ceph-mon[34353]: pgmap v439: 97 pgs: 97 active+clean; 7.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 537 KiB/s wr, 45 op/s 2024-05-09T05:39:41.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:39:41 smithi060 ceph-mon[34555]: pgmap v439: 97 pgs: 97 active+clean; 7.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 537 KiB/s wr, 45 op/s 2024-05-09T05:39:41.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:39:41 smithi039 ceph-mon[30439]: pgmap v439: 97 pgs: 97 active+clean; 7.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 537 KiB/s wr, 45 op/s 2024-05-09T05:39:42.632 INFO:tasks.workunit.client.0.smithi039.stdout: 1 7241 3.05 MB/sec warmup 19 sec latency 3103.172 ms 2024-05-09T05:39:43.632 INFO:tasks.workunit.client.0.smithi039.stdout: 1 7254 2.89 MB/sec warmup 20 sec latency 4082.710 ms 2024-05-09T05:39:43.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:39:43 smithi100 ceph-mon[34353]: pgmap v440: 97 pgs: 97 active+clean; 18 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 1.4 MiB/s wr, 24 op/s 2024-05-09T05:39:43.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:39:43 smithi060 ceph-mon[34555]: pgmap v440: 97 pgs: 97 active+clean; 18 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 1.4 MiB/s wr, 24 op/s 2024-05-09T05:39:43.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:39:43 smithi039 ceph-mon[30439]: pgmap v440: 97 pgs: 97 active+clean; 18 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 1.4 MiB/s wr, 24 op/s 2024-05-09T05:39:44.632 INFO:tasks.workunit.client.0.smithi039.stdout: 1 9532 3.16 MB/sec warmup 21 sec latency 17.194 ms 2024-05-09T05:39:45.632 INFO:tasks.workunit.client.0.smithi039.stdout: 1 10451 3.35 MB/sec warmup 22 sec latency 701.970 ms 2024-05-09T05:39:45.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:39:45 smithi100 ceph-mon[34353]: pgmap v441: 97 pgs: 97 active+clean; 25 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 2.1 MiB/s wr, 34 op/s 2024-05-09T05:39:45.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:39:45 smithi060 ceph-mon[34555]: pgmap v441: 97 pgs: 97 active+clean; 25 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 2.1 MiB/s wr, 34 op/s 2024-05-09T05:39:45.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:39:45 smithi039 ceph-mon[30439]: pgmap v441: 97 pgs: 97 active+clean; 25 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 2.1 MiB/s wr, 34 op/s 2024-05-09T05:39:46.632 INFO:tasks.workunit.client.0.smithi039.stdout: 1 10451 3.20 MB/sec warmup 23 sec latency 1702.074 ms 2024-05-09T05:39:47.632 INFO:tasks.workunit.client.0.smithi039.stdout: 1 10451 3.07 MB/sec warmup 24 sec latency 2702.176 ms 2024-05-09T05:39:47.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:39:47 smithi060 ceph-mon[34555]: pgmap v442: 97 pgs: 97 active+clean; 25 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 2.1 MiB/s wr, 33 op/s 2024-05-09T05:39:47.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:39:47 smithi039 ceph-mon[30439]: pgmap v442: 97 pgs: 97 active+clean; 25 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 2.1 MiB/s wr, 33 op/s 2024-05-09T05:39:47.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:39:47 smithi100 ceph-mon[34353]: pgmap v442: 97 pgs: 97 active+clean; 25 MiB data, 456 MiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 2.1 MiB/s wr, 33 op/s 2024-05-09T05:39:48.632 INFO:tasks.workunit.client.0.smithi039.stdout: 1 10464 2.95 MB/sec warmup 25 sec latency 3679.148 ms 2024-05-09T05:39:49.632 INFO:tasks.workunit.client.0.smithi039.stdout: 1 12142 3.21 MB/sec warmup 26 sec latency 18.644 ms 2024-05-09T05:39:49.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:39:49 smithi060 ceph-mon[34555]: pgmap v443: 97 pgs: 97 active+clean; 25 MiB data, 463 MiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 2.2 MiB/s wr, 38 op/s 2024-05-09T05:39:49.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:39:49 smithi039 ceph-mon[30439]: pgmap v443: 97 pgs: 97 active+clean; 25 MiB data, 463 MiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 2.2 MiB/s wr, 38 op/s 2024-05-09T05:39:49.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:39:49 smithi100 ceph-mon[34353]: pgmap v443: 97 pgs: 97 active+clean; 25 MiB data, 463 MiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 2.2 MiB/s wr, 38 op/s 2024-05-09T05:39:50.632 INFO:tasks.workunit.client.0.smithi039.stdout: 1 14661 3.61 MB/sec warmup 27 sec latency 11.903 ms 2024-05-09T05:39:51.632 INFO:tasks.workunit.client.0.smithi039.stdout: 1 17544 3.99 MB/sec warmup 28 sec latency 65.843 ms 2024-05-09T05:39:51.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:39:51 smithi060 ceph-mon[34555]: pgmap v444: 97 pgs: 97 active+clean; 26 MiB data, 463 MiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 2.3 MiB/s wr, 57 op/s 2024-05-09T05:39:51.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:39:51 smithi039 ceph-mon[30439]: pgmap v444: 97 pgs: 97 active+clean; 26 MiB data, 463 MiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 2.3 MiB/s wr, 57 op/s 2024-05-09T05:39:51.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:39:51 smithi100 ceph-mon[34353]: pgmap v444: 97 pgs: 97 active+clean; 26 MiB data, 463 MiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 2.3 MiB/s wr, 57 op/s 2024-05-09T05:39:52.632 INFO:tasks.workunit.client.0.smithi039.stdout: 1 17544 3.86 MB/sec warmup 29 sec latency 1065.883 ms 2024-05-09T05:39:53.632 INFO:tasks.workunit.client.0.smithi039.stdout: 1 17557 3.73 MB/sec warmup 30 sec latency 2042.977 ms 2024-05-09T05:39:53.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:39:53 smithi060 ceph-mon[34555]: pgmap v445: 97 pgs: 97 active+clean; 25 MiB data, 462 MiB used, 1.0 TiB / 1.0 TiB avail; 421 KiB/s rd, 2.0 MiB/s wr, 59 op/s 2024-05-09T05:39:53.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:39:53 smithi039 ceph-mon[30439]: pgmap v445: 97 pgs: 97 active+clean; 25 MiB data, 462 MiB used, 1.0 TiB / 1.0 TiB avail; 421 KiB/s rd, 2.0 MiB/s wr, 59 op/s 2024-05-09T05:39:53.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:39:53 smithi100 ceph-mon[34353]: pgmap v445: 97 pgs: 97 active+clean; 25 MiB data, 462 MiB used, 1.0 TiB / 1.0 TiB avail; 421 KiB/s rd, 2.0 MiB/s wr, 59 op/s 2024-05-09T05:39:54.632 INFO:tasks.workunit.client.0.smithi039.stdout: 1 19520 3.93 MB/sec warmup 31 sec latency 25.249 ms 2024-05-09T05:39:55.632 INFO:tasks.workunit.client.0.smithi039.stdout: 1 21930 4.24 MB/sec warmup 32 sec latency 15.221 ms 2024-05-09T05:39:55.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:39:55 smithi060 ceph-mon[34555]: pgmap v446: 97 pgs: 97 active+clean; 28 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 700 KiB/s rd, 1.2 MiB/s wr, 91 op/s 2024-05-09T05:39:55.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:39:55 smithi039 ceph-mon[30439]: pgmap v446: 97 pgs: 97 active+clean; 28 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 700 KiB/s rd, 1.2 MiB/s wr, 91 op/s 2024-05-09T05:39:55.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:39:55 smithi100 ceph-mon[34353]: pgmap v446: 97 pgs: 97 active+clean; 28 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 700 KiB/s rd, 1.2 MiB/s wr, 91 op/s 2024-05-09T05:39:56.632 INFO:tasks.workunit.client.0.smithi039.stdout: 1 25004 4.65 MB/sec warmup 33 sec latency 18.421 ms 2024-05-09T05:39:57.633 INFO:tasks.workunit.client.0.smithi039.stdout: 1 27286 4.76 MB/sec warmup 34 sec latency 19.642 ms 2024-05-09T05:39:57.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:39:57 smithi060 ceph-mon[34555]: pgmap v447: 97 pgs: 97 active+clean; 28 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 877 KiB/s rd, 551 KiB/s wr, 84 op/s 2024-05-09T05:39:57.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:39:57 smithi039 ceph-mon[30439]: pgmap v447: 97 pgs: 97 active+clean; 28 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 877 KiB/s rd, 551 KiB/s wr, 84 op/s 2024-05-09T05:39:57.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:39:57 smithi100 ceph-mon[34353]: pgmap v447: 97 pgs: 97 active+clean; 28 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 877 KiB/s rd, 551 KiB/s wr, 84 op/s 2024-05-09T05:39:58.633 INFO:tasks.workunit.client.0.smithi039.stdout: 1 29284 4.99 MB/sec warmup 35 sec latency 24.005 ms 2024-05-09T05:39:59.633 INFO:tasks.workunit.client.0.smithi039.stdout: 1 32242 5.35 MB/sec warmup 36 sec latency 22.154 ms 2024-05-09T05:39:59.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:39:59 smithi060 ceph-mon[34555]: pgmap v448: 97 pgs: 97 active+clean; 29 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 678 KiB/s wr, 98 op/s 2024-05-09T05:39:59.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:39:59 smithi039 ceph-mon[30439]: pgmap v448: 97 pgs: 97 active+clean; 29 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 678 KiB/s wr, 98 op/s 2024-05-09T05:39:59.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:39:59 smithi100 ceph-mon[34353]: pgmap v448: 97 pgs: 97 active+clean; 29 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 678 KiB/s wr, 98 op/s 2024-05-09T05:40:00.633 INFO:tasks.workunit.client.0.smithi039.stdout: 1 34865 5.54 MB/sec warmup 37 sec latency 55.248 ms 2024-05-09T05:40:00.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:40:00 smithi060 ceph-mon[34555]: overall HEALTH_OK 2024-05-09T05:40:00.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:40:00 smithi039 ceph-mon[30439]: overall HEALTH_OK 2024-05-09T05:40:00.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:40:00 smithi100 ceph-mon[34353]: overall HEALTH_OK 2024-05-09T05:40:01.633 INFO:tasks.workunit.client.0.smithi039.stdout: 1 35313 5.46 MB/sec warmup 38 sec latency 868.168 ms 2024-05-09T05:40:01.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:40:01 smithi060 ceph-mon[34555]: pgmap v449: 97 pgs: 97 active+clean; 32 MiB data, 477 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 936 KiB/s wr, 150 op/s 2024-05-09T05:40:01.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:40:01 smithi039 ceph-mon[30439]: pgmap v449: 97 pgs: 97 active+clean; 32 MiB data, 477 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 936 KiB/s wr, 150 op/s 2024-05-09T05:40:01.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:40:01 smithi100 ceph-mon[34353]: pgmap v449: 97 pgs: 97 active+clean; 32 MiB data, 477 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 936 KiB/s wr, 150 op/s 2024-05-09T05:40:02.633 INFO:tasks.workunit.client.0.smithi039.stdout: 1 35313 5.32 MB/sec warmup 39 sec latency 1868.211 ms 2024-05-09T05:40:03.633 INFO:tasks.workunit.client.0.smithi039.stdout: 1 35327 5.19 MB/sec warmup 40 sec latency 2845.244 ms 2024-05-09T05:40:03.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:40:03 smithi060 ceph-mon[34555]: pgmap v450: 97 pgs: 97 active+clean; 35 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.1 MiB/s wr, 169 op/s 2024-05-09T05:40:03.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:40:03 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:40:03.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:40:03 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:40:03.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:40:03 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:40:03.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:40:03 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:40:03.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:40:03 smithi039 ceph-mon[30439]: pgmap v450: 97 pgs: 97 active+clean; 35 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.1 MiB/s wr, 169 op/s 2024-05-09T05:40:03.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:40:03 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:40:03.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:40:03 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:40:03.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:40:03 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:40:03.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:40:03 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:40:03.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:40:03 smithi100 ceph-mon[34353]: pgmap v450: 97 pgs: 97 active+clean; 35 MiB data, 481 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.1 MiB/s wr, 169 op/s 2024-05-09T05:40:03.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:40:03 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:40:03.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:40:03 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:40:03.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:40:03 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:40:03.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:40:03 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:40:04.633 INFO:tasks.workunit.client.0.smithi039.stdout: 1 37486 5.31 MB/sec warmup 41 sec latency 17.972 ms 2024-05-09T05:40:05.633 INFO:tasks.workunit.client.0.smithi039.stdout: 1 38856 5.40 MB/sec warmup 42 sec latency 643.284 ms 2024-05-09T05:40:05.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:40:05 smithi060 ceph-mon[34555]: pgmap v451: 97 pgs: 97 active+clean; 36 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.1 MiB/s wr, 175 op/s 2024-05-09T05:40:05.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:40:05 smithi039 ceph-mon[30439]: pgmap v451: 97 pgs: 97 active+clean; 36 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.1 MiB/s wr, 175 op/s 2024-05-09T05:40:05.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:40:05 smithi100 ceph-mon[34353]: pgmap v451: 97 pgs: 97 active+clean; 36 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.1 MiB/s wr, 175 op/s 2024-05-09T05:40:06.633 INFO:tasks.workunit.client.0.smithi039.stdout: 1 38856 5.27 MB/sec warmup 43 sec latency 1643.391 ms 2024-05-09T05:40:07.633 INFO:tasks.workunit.client.0.smithi039.stdout: 1 38856 5.15 MB/sec warmup 44 sec latency 2643.483 ms 2024-05-09T05:40:07.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:40:07 smithi060 ceph-mon[34555]: pgmap v452: 97 pgs: 97 active+clean; 36 MiB data, 485 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 938 KiB/s wr, 134 op/s 2024-05-09T05:40:07.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:40:07 smithi039 ceph-mon[30439]: pgmap v452: 97 pgs: 97 active+clean; 36 MiB data, 485 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 938 KiB/s wr, 134 op/s 2024-05-09T05:40:07.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:40:07 smithi100 ceph-mon[34353]: pgmap v452: 97 pgs: 97 active+clean; 36 MiB data, 485 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 938 KiB/s wr, 134 op/s 2024-05-09T05:40:08.633 INFO:tasks.workunit.client.0.smithi039.stdout: 1 38868 5.04 MB/sec warmup 45 sec latency 3626.097 ms 2024-05-09T05:40:09.633 INFO:tasks.workunit.client.0.smithi039.stdout: 1 40748 5.14 MB/sec warmup 46 sec latency 16.150 ms 2024-05-09T05:40:09.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:40:09 smithi060 ceph-mon[34555]: pgmap v453: 97 pgs: 97 active+clean; 37 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.0 MiB/s wr, 152 op/s 2024-05-09T05:40:09.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:40:09 smithi039 ceph-mon[30439]: pgmap v453: 97 pgs: 97 active+clean; 37 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.0 MiB/s wr, 152 op/s 2024-05-09T05:40:09.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:40:09 smithi100 ceph-mon[34353]: pgmap v453: 97 pgs: 97 active+clean; 37 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.0 MiB/s wr, 152 op/s 2024-05-09T05:40:10.634 INFO:tasks.workunit.client.0.smithi039.stdout: 1 43200 5.33 MB/sec warmup 47 sec latency 15.911 ms 2024-05-09T05:40:11.634 INFO:tasks.workunit.client.0.smithi039.stdout: 1 46284 5.59 MB/sec warmup 48 sec latency 28.106 ms 2024-05-09T05:40:11.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:40:11 smithi060 ceph-mon[34555]: pgmap v454: 97 pgs: 97 active+clean; 37 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 894 KiB/s wr, 138 op/s 2024-05-09T05:40:11.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:40:11 smithi039 ceph-mon[30439]: pgmap v454: 97 pgs: 97 active+clean; 37 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 894 KiB/s wr, 138 op/s 2024-05-09T05:40:11.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:40:11 smithi100 ceph-mon[34353]: pgmap v454: 97 pgs: 97 active+clean; 37 MiB data, 493 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 894 KiB/s wr, 138 op/s 2024-05-09T05:40:12.633 INFO:tasks.workunit.client.0.smithi039.stdout: 1 48587 5.65 MB/sec warmup 49 sec latency 16.377 ms 2024-05-09T05:40:13.634 INFO:tasks.workunit.client.0.smithi039.stdout: 1 50410 5.78 MB/sec warmup 50 sec latency 22.445 ms 2024-05-09T05:40:13.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:40:13 smithi060 ceph-mon[34555]: pgmap v455: 97 pgs: 97 active+clean; 40 MiB data, 507 MiB used, 1.0 TiB / 1.0 TiB avail; 906 KiB/s rd, 819 KiB/s wr, 120 op/s 2024-05-09T05:40:13.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:40:13 smithi039 ceph-mon[30439]: pgmap v455: 97 pgs: 97 active+clean; 40 MiB data, 507 MiB used, 1.0 TiB / 1.0 TiB avail; 906 KiB/s rd, 819 KiB/s wr, 120 op/s 2024-05-09T05:40:13.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:40:13 smithi100 ceph-mon[34353]: pgmap v455: 97 pgs: 97 active+clean; 40 MiB data, 507 MiB used, 1.0 TiB / 1.0 TiB avail; 906 KiB/s rd, 819 KiB/s wr, 120 op/s 2024-05-09T05:40:14.634 INFO:tasks.workunit.client.0.smithi039.stdout: 1 53039 5.94 MB/sec warmup 51 sec latency 226.339 ms 2024-05-09T05:40:15.634 INFO:tasks.workunit.client.0.smithi039.stdout: 1 53039 5.83 MB/sec warmup 52 sec latency 1226.398 ms 2024-05-09T05:40:15.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:40:15 smithi060 ceph-mon[34555]: pgmap v456: 97 pgs: 97 active+clean; 41 MiB data, 514 MiB used, 1.0 TiB / 1.0 TiB avail; 557 KiB/s rd, 683 KiB/s wr, 96 op/s 2024-05-09T05:40:15.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:40:15 smithi039 ceph-mon[30439]: pgmap v456: 97 pgs: 97 active+clean; 41 MiB data, 514 MiB used, 1.0 TiB / 1.0 TiB avail; 557 KiB/s rd, 683 KiB/s wr, 96 op/s 2024-05-09T05:40:15.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:40:15 smithi100 ceph-mon[34353]: pgmap v456: 97 pgs: 97 active+clean; 41 MiB data, 514 MiB used, 1.0 TiB / 1.0 TiB avail; 557 KiB/s rd, 683 KiB/s wr, 96 op/s 2024-05-09T05:40:16.634 INFO:tasks.workunit.client.0.smithi039.stdout: 1 53039 5.72 MB/sec warmup 53 sec latency 2226.512 ms 2024-05-09T05:40:17.634 INFO:tasks.workunit.client.0.smithi039.stdout: 1 53039 5.61 MB/sec warmup 54 sec latency 3226.619 ms 2024-05-09T05:40:17.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:40:17 smithi060 ceph-mon[34555]: pgmap v457: 97 pgs: 97 active+clean; 42 MiB data, 518 MiB used, 1.0 TiB / 1.0 TiB avail; 723 KiB/s rd, 665 KiB/s wr, 93 op/s 2024-05-09T05:40:17.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:40:17 smithi039 ceph-mon[30439]: pgmap v457: 97 pgs: 97 active+clean; 42 MiB data, 518 MiB used, 1.0 TiB / 1.0 TiB avail; 723 KiB/s rd, 665 KiB/s wr, 93 op/s 2024-05-09T05:40:17.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:40:17 smithi100 ceph-mon[34353]: pgmap v457: 97 pgs: 97 active+clean; 42 MiB data, 518 MiB used, 1.0 TiB / 1.0 TiB avail; 723 KiB/s rd, 665 KiB/s wr, 93 op/s 2024-05-09T05:40:18.634 INFO:tasks.workunit.client.0.smithi039.stdout: 1 53046 5.51 MB/sec warmup 55 sec latency 4216.716 ms 2024-05-09T05:40:19.634 INFO:tasks.workunit.client.0.smithi039.stdout: 1 54931 5.59 MB/sec warmup 56 sec latency 17.921 ms 2024-05-09T05:40:19.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:40:19 smithi060 ceph-mon[34555]: pgmap v458: 97 pgs: 97 active+clean; 46 MiB data, 535 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 133 op/s 2024-05-09T05:40:19.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:40:19 smithi039 ceph-mon[30439]: pgmap v458: 97 pgs: 97 active+clean; 46 MiB data, 535 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 133 op/s 2024-05-09T05:40:19.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:40:19 smithi100 ceph-mon[34353]: pgmap v458: 97 pgs: 97 active+clean; 46 MiB data, 535 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 133 op/s 2024-05-09T05:40:20.634 INFO:tasks.workunit.client.0.smithi039.stdout: 1 57386 5.74 MB/sec warmup 57 sec latency 16.051 ms 2024-05-09T05:40:21.634 INFO:tasks.workunit.client.0.smithi039.stdout: 1 60128 5.89 MB/sec warmup 58 sec latency 136.386 ms 2024-05-09T05:40:21.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:40:21 smithi060 ceph-mon[34555]: pgmap v459: 97 pgs: 97 active+clean; 46 MiB data, 536 MiB used, 1.0 TiB / 1.0 TiB avail; 990 KiB/s rd, 1007 KiB/s wr, 113 op/s 2024-05-09T05:40:21.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:40:21 smithi039 ceph-mon[30439]: pgmap v459: 97 pgs: 97 active+clean; 46 MiB data, 536 MiB used, 1.0 TiB / 1.0 TiB avail; 990 KiB/s rd, 1007 KiB/s wr, 113 op/s 2024-05-09T05:40:21.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:40:21 smithi100 ceph-mon[34353]: pgmap v459: 97 pgs: 97 active+clean; 46 MiB data, 536 MiB used, 1.0 TiB / 1.0 TiB avail; 990 KiB/s rd, 1007 KiB/s wr, 113 op/s 2024-05-09T05:40:22.634 INFO:tasks.workunit.client.0.smithi039.stdout: 1 60128 5.79 MB/sec warmup 59 sec latency 1136.499 ms 2024-05-09T05:40:23.634 INFO:tasks.workunit.client.0.smithi039.stdout: 1 60137 5.69 MB/sec warmup 60 sec latency 2123.078 ms 2024-05-09T05:40:23.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:40:23 smithi060 ceph-mon[34555]: pgmap v460: 97 pgs: 97 active+clean; 48 MiB data, 572 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 153 op/s 2024-05-09T05:40:23.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:40:23 smithi039 ceph-mon[30439]: pgmap v460: 97 pgs: 97 active+clean; 48 MiB data, 572 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 153 op/s 2024-05-09T05:40:23.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:40:23 smithi100 ceph-mon[34353]: pgmap v460: 97 pgs: 97 active+clean; 48 MiB data, 572 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 153 op/s 2024-05-09T05:40:24.634 INFO:tasks.workunit.client.0.smithi039.stdout: 1 62221 5.76 MB/sec warmup 61 sec latency 26.070 ms 2024-05-09T05:40:25.635 INFO:tasks.workunit.client.0.smithi039.stdout: 1 63677 5.81 MB/sec warmup 62 sec latency 626.265 ms 2024-05-09T05:40:25.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:40:25 smithi060 ceph-mon[34555]: pgmap v461: 97 pgs: 97 active+clean; 47 MiB data, 568 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 136 op/s 2024-05-09T05:40:25.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:40:25 smithi039 ceph-mon[30439]: pgmap v461: 97 pgs: 97 active+clean; 47 MiB data, 568 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 136 op/s 2024-05-09T05:40:25.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:40:25 smithi100 ceph-mon[34353]: pgmap v461: 97 pgs: 97 active+clean; 47 MiB data, 568 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 136 op/s 2024-05-09T05:40:26.635 INFO:tasks.workunit.client.0.smithi039.stdout: 1 63677 5.72 MB/sec warmup 63 sec latency 1626.337 ms 2024-05-09T05:40:27.635 INFO:tasks.workunit.client.0.smithi039.stdout: 1 63677 5.63 MB/sec warmup 64 sec latency 2626.439 ms 2024-05-09T05:40:27.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:40:27 smithi060 ceph-mon[34555]: pgmap v462: 97 pgs: 97 active+clean; 47 MiB data, 571 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.3 MiB/s wr, 128 op/s 2024-05-09T05:40:27.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:40:27 smithi039 ceph-mon[30439]: pgmap v462: 97 pgs: 97 active+clean; 47 MiB data, 571 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.3 MiB/s wr, 128 op/s 2024-05-09T05:40:27.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:40:27 smithi100 ceph-mon[34353]: pgmap v462: 97 pgs: 97 active+clean; 47 MiB data, 571 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.3 MiB/s wr, 128 op/s 2024-05-09T05:40:28.635 INFO:tasks.workunit.client.0.smithi039.stdout: 1 63678 5.55 MB/sec warmup 65 sec latency 3625.603 ms 2024-05-09T05:40:29.635 INFO:tasks.workunit.client.0.smithi039.stdout: 1 65365 5.61 MB/sec warmup 66 sec latency 15.909 ms 2024-05-09T05:40:29.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:40:29 smithi060 ceph-mon[34555]: pgmap v463: 97 pgs: 97 active+clean; 50 MiB data, 570 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 135 op/s 2024-05-09T05:40:29.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:40:29 smithi039 ceph-mon[30439]: pgmap v463: 97 pgs: 97 active+clean; 50 MiB data, 570 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 135 op/s 2024-05-09T05:40:29.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:40:29 smithi100 ceph-mon[34353]: pgmap v463: 97 pgs: 97 active+clean; 50 MiB data, 570 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 135 op/s 2024-05-09T05:40:30.635 INFO:tasks.workunit.client.0.smithi039.stdout: 1 67220 5.67 MB/sec warmup 67 sec latency 497.468 ms 2024-05-09T05:40:31.635 INFO:tasks.workunit.client.0.smithi039.stdout: 1 67220 5.58 MB/sec warmup 68 sec latency 1497.588 ms 2024-05-09T05:40:31.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:40:31 smithi060 ceph-mon[34555]: pgmap v464: 97 pgs: 97 active+clean; 52 MiB data, 581 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 110 op/s 2024-05-09T05:40:31.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:40:31 smithi039 ceph-mon[30439]: pgmap v464: 97 pgs: 97 active+clean; 52 MiB data, 581 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 110 op/s 2024-05-09T05:40:31.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:40:31 smithi100 ceph-mon[34353]: pgmap v464: 97 pgs: 97 active+clean; 52 MiB data, 581 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 110 op/s 2024-05-09T05:40:32.635 INFO:tasks.workunit.client.0.smithi039.stdout: 1 67220 5.50 MB/sec warmup 69 sec latency 2497.687 ms 2024-05-09T05:40:33.635 INFO:tasks.workunit.client.0.smithi039.stdout: 1 67220 5.42 MB/sec warmup 70 sec latency 3497.726 ms 2024-05-09T05:40:33.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:40:33 smithi060 ceph-mon[34555]: pgmap v465: 97 pgs: 97 active+clean; 53 MiB data, 582 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.5 MiB/s wr, 124 op/s 2024-05-09T05:40:33.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:40:33 smithi039 ceph-mon[30439]: pgmap v465: 97 pgs: 97 active+clean; 53 MiB data, 582 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.5 MiB/s wr, 124 op/s 2024-05-09T05:40:33.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:40:33 smithi100 ceph-mon[34353]: pgmap v465: 97 pgs: 97 active+clean; 53 MiB data, 582 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.5 MiB/s wr, 124 op/s 2024-05-09T05:40:34.635 INFO:tasks.workunit.client.0.smithi039.stdout: 1 68978 5.48 MB/sec warmup 71 sec latency 3502.871 ms 2024-05-09T05:40:35.635 INFO:tasks.workunit.client.0.smithi039.stdout: 1 70768 5.54 MB/sec warmup 72 sec latency 516.480 ms 2024-05-09T05:40:35.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:40:35 smithi060 ceph-mon[34555]: pgmap v466: 97 pgs: 97 active+clean; 55 MiB data, 590 MiB used, 1.0 TiB / 1.0 TiB avail; 813 KiB/s rd, 1.8 MiB/s wr, 114 op/s 2024-05-09T05:40:35.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:40:35 smithi039 ceph-mon[30439]: pgmap v466: 97 pgs: 97 active+clean; 55 MiB data, 590 MiB used, 1.0 TiB / 1.0 TiB avail; 813 KiB/s rd, 1.8 MiB/s wr, 114 op/s 2024-05-09T05:40:35.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:40:35 smithi100 ceph-mon[34353]: pgmap v466: 97 pgs: 97 active+clean; 55 MiB data, 590 MiB used, 1.0 TiB / 1.0 TiB avail; 813 KiB/s rd, 1.8 MiB/s wr, 114 op/s 2024-05-09T05:40:36.635 INFO:tasks.workunit.client.0.smithi039.stdout: 1 70768 5.46 MB/sec warmup 73 sec latency 1516.528 ms 2024-05-09T05:40:37.636 INFO:tasks.workunit.client.0.smithi039.stdout: 1 70768 5.39 MB/sec warmup 74 sec latency 2516.574 ms 2024-05-09T05:40:37.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:40:37 smithi060 ceph-mon[34555]: pgmap v467: 97 pgs: 97 active+clean; 54 MiB data, 590 MiB used, 1.0 TiB / 1.0 TiB avail; 656 KiB/s rd, 1.8 MiB/s wr, 105 op/s 2024-05-09T05:40:37.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:40:37 smithi039 ceph-mon[30439]: pgmap v467: 97 pgs: 97 active+clean; 54 MiB data, 590 MiB used, 1.0 TiB / 1.0 TiB avail; 656 KiB/s rd, 1.8 MiB/s wr, 105 op/s 2024-05-09T05:40:37.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:40:37 smithi100 ceph-mon[34353]: pgmap v467: 97 pgs: 97 active+clean; 54 MiB data, 590 MiB used, 1.0 TiB / 1.0 TiB avail; 656 KiB/s rd, 1.8 MiB/s wr, 105 op/s 2024-05-09T05:40:38.635 INFO:tasks.workunit.client.0.smithi039.stdout: 1 70775 5.32 MB/sec warmup 75 sec latency 3505.754 ms 2024-05-09T05:40:39.635 INFO:tasks.workunit.client.0.smithi039.stdout: 1 72522 5.38 MB/sec warmup 76 sec latency 24.436 ms 2024-05-09T05:40:39.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:40:39 smithi060 ceph-mon[34555]: pgmap v468: 97 pgs: 97 active+clean; 50 MiB data, 578 MiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 2.0 MiB/s wr, 116 op/s 2024-05-09T05:40:39.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:40:39 smithi039 ceph-mon[30439]: pgmap v468: 97 pgs: 97 active+clean; 50 MiB data, 578 MiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 2.0 MiB/s wr, 116 op/s 2024-05-09T05:40:39.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:40:39 smithi100 ceph-mon[34353]: pgmap v468: 97 pgs: 97 active+clean; 50 MiB data, 578 MiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 2.0 MiB/s wr, 116 op/s 2024-05-09T05:40:40.635 INFO:tasks.workunit.client.0.smithi039.stdout: 1 74345 5.43 MB/sec warmup 77 sec latency 504.568 ms 2024-05-09T05:40:41.636 INFO:tasks.workunit.client.0.smithi039.stdout: 1 74345 5.36 MB/sec warmup 78 sec latency 1504.662 ms 2024-05-09T05:40:41.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:40:41 smithi060 ceph-mon[34555]: pgmap v469: 97 pgs: 97 active+clean; 51 MiB data, 578 MiB used, 1.0 TiB / 1.0 TiB avail; 583 KiB/s rd, 1.8 MiB/s wr, 122 op/s 2024-05-09T05:40:41.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:40:41 smithi039 ceph-mon[30439]: pgmap v469: 97 pgs: 97 active+clean; 51 MiB data, 578 MiB used, 1.0 TiB / 1.0 TiB avail; 583 KiB/s rd, 1.8 MiB/s wr, 122 op/s 2024-05-09T05:40:41.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:40:41 smithi100 ceph-mon[34353]: pgmap v469: 97 pgs: 97 active+clean; 51 MiB data, 578 MiB used, 1.0 TiB / 1.0 TiB avail; 583 KiB/s rd, 1.8 MiB/s wr, 122 op/s 2024-05-09T05:40:42.636 INFO:tasks.workunit.client.0.smithi039.stdout: 1 74345 5.29 MB/sec warmup 79 sec latency 2504.777 ms 2024-05-09T05:40:43.636 INFO:tasks.workunit.client.0.smithi039.stdout: 1 74345 5.22 MB/sec warmup 80 sec latency 3504.873 ms 2024-05-09T05:40:43.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:40:43 smithi060 ceph-mon[34555]: pgmap v470: 97 pgs: 97 active+clean; 50 MiB data, 582 MiB used, 1.0 TiB / 1.0 TiB avail; 651 KiB/s rd, 1.7 MiB/s wr, 114 op/s 2024-05-09T05:40:43.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:40:43 smithi039 ceph-mon[30439]: pgmap v470: 97 pgs: 97 active+clean; 50 MiB data, 582 MiB used, 1.0 TiB / 1.0 TiB avail; 651 KiB/s rd, 1.7 MiB/s wr, 114 op/s 2024-05-09T05:40:43.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:40:43 smithi100 ceph-mon[34353]: pgmap v470: 97 pgs: 97 active+clean; 50 MiB data, 582 MiB used, 1.0 TiB / 1.0 TiB avail; 651 KiB/s rd, 1.7 MiB/s wr, 114 op/s 2024-05-09T05:40:44.636 INFO:tasks.workunit.client.0.smithi039.stdout: 1 76211 5.28 MB/sec warmup 81 sec latency 3520.862 ms 2024-05-09T05:40:45.636 INFO:tasks.workunit.client.0.smithi039.stdout: 1 77893 5.33 MB/sec warmup 82 sec latency 582.440 ms 2024-05-09T05:40:45.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:40:45 smithi060 ceph-mon[34555]: pgmap v471: 97 pgs: 97 active+clean; 52 MiB data, 587 MiB used, 1.0 TiB / 1.0 TiB avail; 773 KiB/s rd, 1.7 MiB/s wr, 126 op/s 2024-05-09T05:40:45.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:40:45 smithi039 ceph-mon[30439]: pgmap v471: 97 pgs: 97 active+clean; 52 MiB data, 587 MiB used, 1.0 TiB / 1.0 TiB avail; 773 KiB/s rd, 1.7 MiB/s wr, 126 op/s 2024-05-09T05:40:45.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:40:45 smithi100 ceph-mon[34353]: pgmap v471: 97 pgs: 97 active+clean; 52 MiB data, 587 MiB used, 1.0 TiB / 1.0 TiB avail; 773 KiB/s rd, 1.7 MiB/s wr, 126 op/s 2024-05-09T05:40:46.636 INFO:tasks.workunit.client.0.smithi039.stdout: 1 77893 5.27 MB/sec warmup 83 sec latency 1582.532 ms 2024-05-09T05:40:47.636 INFO:tasks.workunit.client.0.smithi039.stdout: 1 77893 5.20 MB/sec warmup 84 sec latency 2582.637 ms 2024-05-09T05:40:47.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:40:47 smithi060 ceph-mon[34555]: pgmap v472: 97 pgs: 97 active+clean; 52 MiB data, 587 MiB used, 1.0 TiB / 1.0 TiB avail; 809 KiB/s rd, 1.3 MiB/s wr, 101 op/s 2024-05-09T05:40:47.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:40:47 smithi039 ceph-mon[30439]: pgmap v472: 97 pgs: 97 active+clean; 52 MiB data, 587 MiB used, 1.0 TiB / 1.0 TiB avail; 809 KiB/s rd, 1.3 MiB/s wr, 101 op/s 2024-05-09T05:40:47.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:40:47 smithi100 ceph-mon[34353]: pgmap v472: 97 pgs: 97 active+clean; 52 MiB data, 587 MiB used, 1.0 TiB / 1.0 TiB avail; 809 KiB/s rd, 1.3 MiB/s wr, 101 op/s 2024-05-09T05:40:48.636 INFO:tasks.workunit.client.0.smithi039.stdout: 1 77894 5.14 MB/sec warmup 85 sec latency 3580.390 ms 2024-05-09T05:40:49.636 INFO:tasks.workunit.client.0.smithi039.stdout: 1 79790 5.20 MB/sec warmup 86 sec latency 16.844 ms 2024-05-09T05:40:49.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:40:49 smithi060 ceph-mon[34555]: pgmap v473: 97 pgs: 97 active+clean; 54 MiB data, 589 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.4 MiB/s wr, 124 op/s 2024-05-09T05:40:49.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:40:49 smithi039 ceph-mon[30439]: pgmap v473: 97 pgs: 97 active+clean; 54 MiB data, 589 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.4 MiB/s wr, 124 op/s 2024-05-09T05:40:49.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:40:49 smithi100 ceph-mon[34353]: pgmap v473: 97 pgs: 97 active+clean; 54 MiB data, 589 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.4 MiB/s wr, 124 op/s 2024-05-09T05:40:50.636 INFO:tasks.workunit.client.0.smithi039.stdout: 1 81435 5.24 MB/sec warmup 87 sec latency 477.733 ms 2024-05-09T05:40:51.637 INFO:tasks.workunit.client.0.smithi039.stdout: 1 81435 5.18 MB/sec warmup 88 sec latency 1477.845 ms 2024-05-09T05:40:51.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:40:51 smithi060 ceph-mon[34555]: pgmap v474: 97 pgs: 97 active+clean; 54 MiB data, 593 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.3 MiB/s wr, 110 op/s 2024-05-09T05:40:51.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:40:51 smithi039 ceph-mon[30439]: pgmap v474: 97 pgs: 97 active+clean; 54 MiB data, 593 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.3 MiB/s wr, 110 op/s 2024-05-09T05:40:51.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:40:51 smithi100 ceph-mon[34353]: pgmap v474: 97 pgs: 97 active+clean; 54 MiB data, 593 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.3 MiB/s wr, 110 op/s 2024-05-09T05:40:52.636 INFO:tasks.workunit.client.0.smithi039.stdout: 1 81435 5.12 MB/sec warmup 89 sec latency 2477.957 ms 2024-05-09T05:40:53.637 INFO:tasks.workunit.client.0.smithi039.stdout: 1 81442 5.07 MB/sec warmup 90 sec latency 3473.286 ms 2024-05-09T05:40:53.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:40:53 smithi039 ceph-mon[30439]: pgmap v475: 97 pgs: 97 active+clean; 54 MiB data, 594 MiB used, 1.0 TiB / 1.0 TiB avail; 901 KiB/s rd, 1.4 MiB/s wr, 101 op/s 2024-05-09T05:40:53.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:40:53 smithi100 ceph-mon[34353]: pgmap v475: 97 pgs: 97 active+clean; 54 MiB data, 594 MiB used, 1.0 TiB / 1.0 TiB avail; 901 KiB/s rd, 1.4 MiB/s wr, 101 op/s 2024-05-09T05:40:54.045 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:40:53 smithi060 ceph-mon[34555]: pgmap v475: 97 pgs: 97 active+clean; 54 MiB data, 594 MiB used, 1.0 TiB / 1.0 TiB avail; 901 KiB/s rd, 1.4 MiB/s wr, 101 op/s 2024-05-09T05:40:54.637 INFO:tasks.workunit.client.0.smithi039.stdout: 1 83204 5.12 MB/sec warmup 91 sec latency 16.201 ms 2024-05-09T05:40:55.637 INFO:tasks.workunit.client.0.smithi039.stdout: 1 84984 5.17 MB/sec warmup 92 sec latency 447.660 ms 2024-05-09T05:40:55.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:40:55 smithi039 ceph-mon[30439]: pgmap v476: 97 pgs: 97 active+clean; 53 MiB data, 599 MiB used, 1.0 TiB / 1.0 TiB avail; 846 KiB/s rd, 1.6 MiB/s wr, 122 op/s 2024-05-09T05:40:55.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:40:55 smithi100 ceph-mon[34353]: pgmap v476: 97 pgs: 97 active+clean; 53 MiB data, 599 MiB used, 1.0 TiB / 1.0 TiB avail; 846 KiB/s rd, 1.6 MiB/s wr, 122 op/s 2024-05-09T05:40:56.046 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:40:55 smithi060 ceph-mon[34555]: pgmap v476: 97 pgs: 97 active+clean; 53 MiB data, 599 MiB used, 1.0 TiB / 1.0 TiB avail; 846 KiB/s rd, 1.6 MiB/s wr, 122 op/s 2024-05-09T05:40:56.637 INFO:tasks.workunit.client.0.smithi039.stdout: 1 84984 5.11 MB/sec warmup 93 sec latency 1447.715 ms 2024-05-09T05:40:57.637 INFO:tasks.workunit.client.0.smithi039.stdout: 1 84984 5.06 MB/sec warmup 94 sec latency 2447.812 ms 2024-05-09T05:40:57.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:40:57 smithi039 ceph-mon[30439]: pgmap v477: 97 pgs: 97 active+clean; 53 MiB data, 599 MiB used, 1.0 TiB / 1.0 TiB avail; 871 KiB/s rd, 1.6 MiB/s wr, 103 op/s 2024-05-09T05:40:57.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:40:57 smithi100 ceph-mon[34353]: pgmap v477: 97 pgs: 97 active+clean; 53 MiB data, 599 MiB used, 1.0 TiB / 1.0 TiB avail; 871 KiB/s rd, 1.6 MiB/s wr, 103 op/s 2024-05-09T05:40:58.046 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:40:57 smithi060 ceph-mon[34555]: pgmap v477: 97 pgs: 97 active+clean; 53 MiB data, 599 MiB used, 1.0 TiB / 1.0 TiB avail; 871 KiB/s rd, 1.6 MiB/s wr, 103 op/s 2024-05-09T05:40:58.637 INFO:tasks.workunit.client.0.smithi039.stdout: 1 84991 5.00 MB/sec warmup 95 sec latency 3436.517 ms 2024-05-09T05:40:59.637 INFO:tasks.workunit.client.0.smithi039.stdout: 1 86940 5.05 MB/sec warmup 96 sec latency 15.402 ms 2024-05-09T05:40:59.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:40:59 smithi039 ceph-mon[30439]: pgmap v478: 97 pgs: 97 active+clean; 52 MiB data, 615 MiB used, 1.0 TiB / 1.0 TiB avail; 963 KiB/s rd, 1.7 MiB/s wr, 129 op/s 2024-05-09T05:40:59.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:40:59 smithi100 ceph-mon[34353]: pgmap v478: 97 pgs: 97 active+clean; 52 MiB data, 615 MiB used, 1.0 TiB / 1.0 TiB avail; 963 KiB/s rd, 1.7 MiB/s wr, 129 op/s 2024-05-09T05:41:00.045 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:40:59 smithi060 ceph-mon[34555]: pgmap v478: 97 pgs: 97 active+clean; 52 MiB data, 615 MiB used, 1.0 TiB / 1.0 TiB avail; 963 KiB/s rd, 1.7 MiB/s wr, 129 op/s 2024-05-09T05:41:00.637 INFO:tasks.workunit.client.0.smithi039.stdout: 1 88527 5.10 MB/sec warmup 97 sec latency 546.162 ms 2024-05-09T05:41:01.637 INFO:tasks.workunit.client.0.smithi039.stdout: 1 88527 5.04 MB/sec warmup 98 sec latency 1546.290 ms 2024-05-09T05:41:01.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:41:01 smithi039 ceph-mon[30439]: pgmap v479: 97 pgs: 97 active+clean; 53 MiB data, 615 MiB used, 1.0 TiB / 1.0 TiB avail; 745 KiB/s rd, 1.3 MiB/s wr, 98 op/s 2024-05-09T05:41:01.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:41:01 smithi100 ceph-mon[34353]: pgmap v479: 97 pgs: 97 active+clean; 53 MiB data, 615 MiB used, 1.0 TiB / 1.0 TiB avail; 745 KiB/s rd, 1.3 MiB/s wr, 98 op/s 2024-05-09T05:41:02.046 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:41:01 smithi060 ceph-mon[34555]: pgmap v479: 97 pgs: 97 active+clean; 53 MiB data, 615 MiB used, 1.0 TiB / 1.0 TiB avail; 745 KiB/s rd, 1.3 MiB/s wr, 98 op/s 2024-05-09T05:41:02.637 INFO:tasks.workunit.client.0.smithi039.stdout: 1 88527 4.99 MB/sec warmup 99 sec latency 2546.412 ms 2024-05-09T05:41:03.637 INFO:tasks.workunit.client.0.smithi039.stdout: 1 88536 4.94 MB/sec warmup 100 sec latency 3535.702 ms 2024-05-09T05:41:03.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:41:03 smithi039 ceph-mon[30439]: pgmap v480: 97 pgs: 97 active+clean; 54 MiB data, 622 MiB used, 1.0 TiB / 1.0 TiB avail; 1003 KiB/s rd, 1.4 MiB/s wr, 120 op/s 2024-05-09T05:41:03.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:41:03 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:41:03.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:41:03 smithi100 ceph-mon[34353]: pgmap v480: 97 pgs: 97 active+clean; 54 MiB data, 622 MiB used, 1.0 TiB / 1.0 TiB avail; 1003 KiB/s rd, 1.4 MiB/s wr, 120 op/s 2024-05-09T05:41:03.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:41:03 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:41:04.045 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:41:03 smithi060 ceph-mon[34555]: pgmap v480: 97 pgs: 97 active+clean; 54 MiB data, 622 MiB used, 1.0 TiB / 1.0 TiB avail; 1003 KiB/s rd, 1.4 MiB/s wr, 120 op/s 2024-05-09T05:41:04.046 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:41:03 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:41:04.638 INFO:tasks.workunit.client.0.smithi039.stdout: 1 90552 4.99 MB/sec warmup 101 sec latency 16.651 ms 2024-05-09T05:41:04.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:41:04 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:41:04.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:41:04 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:41:04.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:41:04 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:41:04.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:41:04 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:41:04.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:41:04 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:41:04.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:41:04 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:41:05.046 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:41:04 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:41:05.046 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:41:04 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:41:05.046 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:41:04 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:41:05.637 INFO:tasks.workunit.client.0.smithi039.stdout: 1 92074 5.03 MB/sec warmup 102 sec latency 615.486 ms 2024-05-09T05:41:05.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:41:05 smithi039 ceph-mon[30439]: pgmap v481: 97 pgs: 97 active+clean; 53 MiB data, 622 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.3 MiB/s wr, 117 op/s 2024-05-09T05:41:05.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:41:05 smithi100 ceph-mon[34353]: pgmap v481: 97 pgs: 97 active+clean; 53 MiB data, 622 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.3 MiB/s wr, 117 op/s 2024-05-09T05:41:06.046 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:41:05 smithi060 ceph-mon[34555]: pgmap v481: 97 pgs: 97 active+clean; 53 MiB data, 622 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.3 MiB/s wr, 117 op/s 2024-05-09T05:41:06.638 INFO:tasks.workunit.client.0.smithi039.stdout: 1 92074 4.99 MB/sec warmup 103 sec latency 1615.616 ms 2024-05-09T05:41:07.638 INFO:tasks.workunit.client.0.smithi039.stdout: 1 92074 4.94 MB/sec warmup 104 sec latency 2615.678 ms 2024-05-09T05:41:07.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:41:07 smithi039 ceph-mon[30439]: pgmap v482: 97 pgs: 97 active+clean; 53 MiB data, 624 MiB used, 1.0 TiB / 1.0 TiB avail; 983 KiB/s rd, 1.1 MiB/s wr, 93 op/s 2024-05-09T05:41:07.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:41:07 smithi100 ceph-mon[34353]: pgmap v482: 97 pgs: 97 active+clean; 53 MiB data, 624 MiB used, 1.0 TiB / 1.0 TiB avail; 983 KiB/s rd, 1.1 MiB/s wr, 93 op/s 2024-05-09T05:41:08.046 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:41:07 smithi060 ceph-mon[34555]: pgmap v482: 97 pgs: 97 active+clean; 53 MiB data, 624 MiB used, 1.0 TiB / 1.0 TiB avail; 983 KiB/s rd, 1.1 MiB/s wr, 93 op/s 2024-05-09T05:41:08.638 INFO:tasks.workunit.client.0.smithi039.stdout: 1 92081 4.89 MB/sec warmup 105 sec latency 3605.090 ms 2024-05-09T05:41:09.638 INFO:tasks.workunit.client.0.smithi039.stdout: 1 93964 4.94 MB/sec warmup 106 sec latency 15.772 ms 2024-05-09T05:41:09.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:41:09 smithi039 ceph-mon[30439]: pgmap v483: 97 pgs: 97 active+clean; 55 MiB data, 628 MiB used, 1.0 TiB / 1.0 TiB avail; 912 KiB/s rd, 1.2 MiB/s wr, 112 op/s 2024-05-09T05:41:09.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:41:09 smithi100 ceph-mon[34353]: pgmap v483: 97 pgs: 97 active+clean; 55 MiB data, 628 MiB used, 1.0 TiB / 1.0 TiB avail; 912 KiB/s rd, 1.2 MiB/s wr, 112 op/s 2024-05-09T05:41:10.045 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:41:09 smithi060 ceph-mon[34555]: pgmap v483: 97 pgs: 97 active+clean; 55 MiB data, 628 MiB used, 1.0 TiB / 1.0 TiB avail; 912 KiB/s rd, 1.2 MiB/s wr, 112 op/s 2024-05-09T05:41:10.638 INFO:tasks.workunit.client.0.smithi039.stdout: 1 95619 4.98 MB/sec warmup 107 sec latency 587.127 ms 2024-05-09T05:41:11.638 INFO:tasks.workunit.client.0.smithi039.stdout: 1 95619 4.93 MB/sec warmup 108 sec latency 1587.235 ms 2024-05-09T05:41:11.848 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:41:11 smithi060 ceph-mon[34555]: pgmap v484: 97 pgs: 97 active+clean; 55 MiB data, 628 MiB used, 1.0 TiB / 1.0 TiB avail; 671 KiB/s rd, 928 KiB/s wr, 81 op/s 2024-05-09T05:41:11.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:41:11 smithi039 ceph-mon[30439]: pgmap v484: 97 pgs: 97 active+clean; 55 MiB data, 628 MiB used, 1.0 TiB / 1.0 TiB avail; 671 KiB/s rd, 928 KiB/s wr, 81 op/s 2024-05-09T05:41:11.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:41:11 smithi100 ceph-mon[34353]: pgmap v484: 97 pgs: 97 active+clean; 55 MiB data, 628 MiB used, 1.0 TiB / 1.0 TiB avail; 671 KiB/s rd, 928 KiB/s wr, 81 op/s 2024-05-09T05:41:12.638 INFO:tasks.workunit.client.0.smithi039.stdout: 1 95619 4.89 MB/sec warmup 109 sec latency 2587.315 ms 2024-05-09T05:41:13.638 INFO:tasks.workunit.client.0.smithi039.stdout: 1 95626 4.84 MB/sec warmup 110 sec latency 3578.034 ms 2024-05-09T05:41:13.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:41:13 smithi039 ceph-mon[30439]: pgmap v485: 97 pgs: 97 active+clean; 56 MiB data, 631 MiB used, 1.0 TiB / 1.0 TiB avail; 738 KiB/s rd, 1.1 MiB/s wr, 102 op/s 2024-05-09T05:41:13.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:41:13 smithi100 ceph-mon[34353]: pgmap v485: 97 pgs: 97 active+clean; 56 MiB data, 631 MiB used, 1.0 TiB / 1.0 TiB avail; 738 KiB/s rd, 1.1 MiB/s wr, 102 op/s 2024-05-09T05:41:14.045 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:41:13 smithi060 ceph-mon[34555]: pgmap v485: 97 pgs: 97 active+clean; 56 MiB data, 631 MiB used, 1.0 TiB / 1.0 TiB avail; 738 KiB/s rd, 1.1 MiB/s wr, 102 op/s 2024-05-09T05:41:14.638 INFO:tasks.workunit.client.0.smithi039.stdout: 1 97484 4.89 MB/sec warmup 111 sec latency 16.078 ms 2024-05-09T05:41:15.638 INFO:tasks.workunit.client.0.smithi039.stdout: 1 99166 4.93 MB/sec warmup 112 sec latency 574.069 ms 2024-05-09T05:41:15.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:41:15 smithi039 ceph-mon[30439]: pgmap v486: 97 pgs: 97 active+clean; 56 MiB data, 630 MiB used, 1.0 TiB / 1.0 TiB avail; 490 KiB/s rd, 923 KiB/s wr, 84 op/s 2024-05-09T05:41:15.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:41:15 smithi100 ceph-mon[34353]: pgmap v486: 97 pgs: 97 active+clean; 56 MiB data, 630 MiB used, 1.0 TiB / 1.0 TiB avail; 490 KiB/s rd, 923 KiB/s wr, 84 op/s 2024-05-09T05:41:16.046 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:41:15 smithi060 ceph-mon[34555]: pgmap v486: 97 pgs: 97 active+clean; 56 MiB data, 630 MiB used, 1.0 TiB / 1.0 TiB avail; 490 KiB/s rd, 923 KiB/s wr, 84 op/s 2024-05-09T05:41:16.638 INFO:tasks.workunit.client.0.smithi039.stdout: 1 99166 4.88 MB/sec warmup 113 sec latency 1574.158 ms 2024-05-09T05:41:17.638 INFO:tasks.workunit.client.0.smithi039.stdout: 1 99166 4.84 MB/sec warmup 114 sec latency 2574.240 ms 2024-05-09T05:41:17.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:41:17 smithi039 ceph-mon[30439]: pgmap v487: 97 pgs: 97 active+clean; 56 MiB data, 650 MiB used, 1.0 TiB / 1.0 TiB avail; 565 KiB/s rd, 1014 KiB/s wr, 82 op/s 2024-05-09T05:41:17.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:41:17 smithi100 ceph-mon[34353]: pgmap v487: 97 pgs: 97 active+clean; 56 MiB data, 650 MiB used, 1.0 TiB / 1.0 TiB avail; 565 KiB/s rd, 1014 KiB/s wr, 82 op/s 2024-05-09T05:41:18.046 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:41:17 smithi060 ceph-mon[34555]: pgmap v487: 97 pgs: 97 active+clean; 56 MiB data, 650 MiB used, 1.0 TiB / 1.0 TiB avail; 565 KiB/s rd, 1014 KiB/s wr, 82 op/s 2024-05-09T05:41:18.639 INFO:tasks.workunit.client.0.smithi039.stdout: 1 99173 4.80 MB/sec warmup 115 sec latency 3562.766 ms 2024-05-09T05:41:19.639 INFO:tasks.workunit.client.0.smithi039.stdout: 1 100893 4.84 MB/sec warmup 116 sec latency 16.190 ms 2024-05-09T05:41:19.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:41:19 smithi039 ceph-mon[30439]: pgmap v488: 97 pgs: 97 active+clean; 58 MiB data, 664 MiB used, 1.0 TiB / 1.0 TiB avail; 773 KiB/s rd, 1.2 MiB/s wr, 104 op/s 2024-05-09T05:41:19.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:41:19 smithi100 ceph-mon[34353]: pgmap v488: 97 pgs: 97 active+clean; 58 MiB data, 664 MiB used, 1.0 TiB / 1.0 TiB avail; 773 KiB/s rd, 1.2 MiB/s wr, 104 op/s 2024-05-09T05:41:20.045 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:41:19 smithi060 ceph-mon[34555]: pgmap v488: 97 pgs: 97 active+clean; 58 MiB data, 664 MiB used, 1.0 TiB / 1.0 TiB avail; 773 KiB/s rd, 1.2 MiB/s wr, 104 op/s 2024-05-09T05:41:20.639 INFO:tasks.workunit.client.0.smithi039.stdout: 1 103445 4.92 MB/sec warmup 117 sec latency 10.807 ms 2024-05-09T05:41:21.639 INFO:tasks.workunit.client.0.smithi039.stdout: 1 106450 5.03 MB/sec warmup 118 sec latency 21.456 ms 2024-05-09T05:41:21.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:41:21 smithi039 ceph-mon[30439]: pgmap v489: 97 pgs: 97 active+clean; 58 MiB data, 664 MiB used, 1.0 TiB / 1.0 TiB avail; 653 KiB/s rd, 919 KiB/s wr, 79 op/s 2024-05-09T05:41:21.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:41:21 smithi100 ceph-mon[34353]: pgmap v489: 97 pgs: 97 active+clean; 58 MiB data, 664 MiB used, 1.0 TiB / 1.0 TiB avail; 653 KiB/s rd, 919 KiB/s wr, 79 op/s 2024-05-09T05:41:22.045 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:41:21 smithi060 ceph-mon[34555]: pgmap v489: 97 pgs: 97 active+clean; 58 MiB data, 664 MiB used, 1.0 TiB / 1.0 TiB avail; 653 KiB/s rd, 919 KiB/s wr, 79 op/s 2024-05-09T05:41:22.639 INFO:tasks.workunit.client.0.smithi039.stdout: 1 108156 5.04 MB/sec warmup 119 sec latency 23.342 ms 2024-05-09T05:41:23.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:41:23 smithi039 ceph-mon[30439]: pgmap v490: 97 pgs: 97 active+clean; 60 MiB data, 657 MiB used, 1.0 TiB / 1.0 TiB avail; 814 KiB/s rd, 1.2 MiB/s wr, 117 op/s 2024-05-09T05:41:23.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:41:23 smithi100 ceph-mon[34353]: pgmap v490: 97 pgs: 97 active+clean; 60 MiB data, 657 MiB used, 1.0 TiB / 1.0 TiB avail; 814 KiB/s rd, 1.2 MiB/s wr, 117 op/s 2024-05-09T05:41:24.045 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:41:23 smithi060 ceph-mon[34555]: pgmap v490: 97 pgs: 97 active+clean; 60 MiB data, 657 MiB used, 1.0 TiB / 1.0 TiB avail; 814 KiB/s rd, 1.2 MiB/s wr, 117 op/s 2024-05-09T05:41:24.639 INFO:tasks.workunit.client.0.smithi039.stdout: 1 112296 11.43 MB/sec execute 1 sec latency 523.138 ms 2024-05-09T05:41:25.639 INFO:tasks.workunit.client.0.smithi039.stdout: 1 113347 9.52 MB/sec execute 2 sec latency 682.228 ms 2024-05-09T05:41:25.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:41:25 smithi039 ceph-mon[30439]: pgmap v491: 97 pgs: 97 active+clean; 60 MiB data, 661 MiB used, 1.0 TiB / 1.0 TiB avail; 799 KiB/s rd, 1.1 MiB/s wr, 111 op/s 2024-05-09T05:41:25.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:41:25 smithi100 ceph-mon[34353]: pgmap v491: 97 pgs: 97 active+clean; 60 MiB data, 661 MiB used, 1.0 TiB / 1.0 TiB avail; 799 KiB/s rd, 1.1 MiB/s wr, 111 op/s 2024-05-09T05:41:26.046 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:41:25 smithi060 ceph-mon[34555]: pgmap v491: 97 pgs: 97 active+clean; 60 MiB data, 661 MiB used, 1.0 TiB / 1.0 TiB avail; 799 KiB/s rd, 1.1 MiB/s wr, 111 op/s 2024-05-09T05:41:26.639 INFO:tasks.workunit.client.0.smithi039.stdout: 1 113347 6.35 MB/sec execute 3 sec latency 1682.325 ms 2024-05-09T05:41:27.639 INFO:tasks.workunit.client.0.smithi039.stdout: 1 113347 4.76 MB/sec execute 4 sec latency 2682.375 ms 2024-05-09T05:41:27.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:41:27 smithi039 ceph-mon[30439]: pgmap v492: 97 pgs: 97 active+clean; 60 MiB data, 668 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 115 op/s 2024-05-09T05:41:27.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:41:27 smithi100 ceph-mon[34353]: pgmap v492: 97 pgs: 97 active+clean; 60 MiB data, 668 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 115 op/s 2024-05-09T05:41:28.046 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:41:27 smithi060 ceph-mon[34555]: pgmap v492: 97 pgs: 97 active+clean; 60 MiB data, 668 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 115 op/s 2024-05-09T05:41:28.639 INFO:tasks.workunit.client.0.smithi039.stdout: 1 113354 3.82 MB/sec execute 5 sec latency 3676.284 ms 2024-05-09T05:41:29.639 INFO:tasks.workunit.client.0.smithi039.stdout: 1 115102 4.81 MB/sec execute 6 sec latency 15.068 ms 2024-05-09T05:41:29.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:41:29 smithi039 ceph-mon[30439]: pgmap v493: 97 pgs: 97 active+clean; 64 MiB data, 702 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 154 op/s 2024-05-09T05:41:29.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:41:29 smithi100 ceph-mon[34353]: pgmap v493: 97 pgs: 97 active+clean; 64 MiB data, 702 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 154 op/s 2024-05-09T05:41:30.045 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:41:29 smithi060 ceph-mon[34555]: pgmap v493: 97 pgs: 97 active+clean; 64 MiB data, 702 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 154 op/s 2024-05-09T05:41:30.639 INFO:tasks.workunit.client.0.smithi039.stdout: 1 117661 6.12 MB/sec execute 7 sec latency 16.916 ms 2024-05-09T05:41:31.639 INFO:tasks.workunit.client.0.smithi039.stdout: 1 120440 7.16 MB/sec execute 8 sec latency 104.468 ms 2024-05-09T05:41:31.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:41:31 smithi100 ceph-mon[34353]: pgmap v494: 97 pgs: 97 active+clean; 64 MiB data, 722 MiB used, 1.0 TiB / 1.0 TiB avail; 966 KiB/s rd, 1.3 MiB/s wr, 128 op/s 2024-05-09T05:41:31.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:41:31 smithi100 ceph-mon[34353]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-09T05:41:32.045 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:41:31 smithi060 ceph-mon[34555]: pgmap v494: 97 pgs: 97 active+clean; 64 MiB data, 722 MiB used, 1.0 TiB / 1.0 TiB avail; 966 KiB/s rd, 1.3 MiB/s wr, 128 op/s 2024-05-09T05:41:32.046 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:41:31 smithi060 ceph-mon[34555]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-09T05:41:32.109 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:41:31 smithi039 ceph-mon[30439]: pgmap v494: 97 pgs: 97 active+clean; 64 MiB data, 722 MiB used, 1.0 TiB / 1.0 TiB avail; 966 KiB/s rd, 1.3 MiB/s wr, 128 op/s 2024-05-09T05:41:32.110 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:41:31 smithi039 ceph-mon[30439]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-09T05:41:32.640 INFO:tasks.workunit.client.0.smithi039.stdout: 1 120440 6.36 MB/sec execute 9 sec latency 1104.520 ms 2024-05-09T05:41:33.639 INFO:tasks.workunit.client.0.smithi039.stdout: 1 120441 5.73 MB/sec execute 10 sec latency 2102.779 ms 2024-05-09T05:41:33.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:41:33 smithi100 ceph-mon[34353]: pgmap v495: 97 pgs: 97 active+clean; 65 MiB data, 726 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.5 MiB/s wr, 153 op/s 2024-05-09T05:41:34.045 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:41:33 smithi060 ceph-mon[34555]: pgmap v495: 97 pgs: 97 active+clean; 65 MiB data, 726 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.5 MiB/s wr, 153 op/s 2024-05-09T05:41:34.109 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:41:33 smithi039 ceph-mon[30439]: pgmap v495: 97 pgs: 97 active+clean; 65 MiB data, 726 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.5 MiB/s wr, 153 op/s 2024-05-09T05:41:34.639 INFO:tasks.workunit.client.0.smithi039.stdout: 1 122337 6.11 MB/sec execute 11 sec latency 16.507 ms 2024-05-09T05:41:35.639 INFO:tasks.workunit.client.0.smithi039.stdout: 1 124784 6.76 MB/sec execute 12 sec latency 15.869 ms 2024-05-09T05:41:35.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:41:35 smithi100 ceph-mon[34353]: pgmap v496: 97 pgs: 97 active+clean; 66 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.4 MiB/s wr, 127 op/s 2024-05-09T05:41:36.045 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:41:35 smithi060 ceph-mon[34555]: pgmap v496: 97 pgs: 97 active+clean; 66 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.4 MiB/s wr, 127 op/s 2024-05-09T05:41:36.109 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:41:35 smithi039 ceph-mon[30439]: pgmap v496: 97 pgs: 97 active+clean; 66 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.4 MiB/s wr, 127 op/s 2024-05-09T05:41:36.640 INFO:tasks.workunit.client.0.smithi039.stdout: 1 127534 7.35 MB/sec execute 13 sec latency 118.067 ms 2024-05-09T05:41:37.640 INFO:tasks.workunit.client.0.smithi039.stdout: 1 127534 6.82 MB/sec execute 14 sec latency 1118.113 ms 2024-05-09T05:41:37.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:41:37 smithi100 ceph-mon[34353]: pgmap v497: 97 pgs: 97 active+clean; 68 MiB data, 734 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 150 op/s 2024-05-09T05:41:38.046 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:41:37 smithi060 ceph-mon[34555]: pgmap v497: 97 pgs: 97 active+clean; 68 MiB data, 734 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 150 op/s 2024-05-09T05:41:38.109 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:41:37 smithi039 ceph-mon[30439]: pgmap v497: 97 pgs: 97 active+clean; 68 MiB data, 734 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 150 op/s 2024-05-09T05:41:38.640 INFO:tasks.workunit.client.0.smithi039.stdout: 1 127543 6.37 MB/sec execute 15 sec latency 2105.121 ms 2024-05-09T05:41:39.640 INFO:tasks.workunit.client.0.smithi039.stdout: 1 129588 6.60 MB/sec execute 16 sec latency 18.207 ms 2024-05-09T05:41:39.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:41:39 smithi100 ceph-mon[34353]: pgmap v498: 97 pgs: 97 active+clean; 68 MiB data, 765 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 155 op/s 2024-05-09T05:41:40.045 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:41:39 smithi060 ceph-mon[34555]: pgmap v498: 97 pgs: 97 active+clean; 68 MiB data, 765 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 155 op/s 2024-05-09T05:41:40.109 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:41:39 smithi039 ceph-mon[30439]: pgmap v498: 97 pgs: 97 active+clean; 68 MiB data, 765 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 155 op/s 2024-05-09T05:41:40.640 INFO:tasks.workunit.client.0.smithi039.stdout: 1 131885 7.02 MB/sec execute 17 sec latency 24.077 ms 2024-05-09T05:41:41.640 INFO:tasks.workunit.client.0.smithi039.stdout: 1 134625 7.43 MB/sec execute 18 sec latency 182.222 ms 2024-05-09T05:41:41.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:41:41 smithi100 ceph-mon[34353]: pgmap v499: 97 pgs: 97 active+clean; 67 MiB data, 767 MiB used, 1.0 TiB / 1.0 TiB avail; 964 KiB/s rd, 1.1 MiB/s wr, 114 op/s 2024-05-09T05:41:41.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:41:41 smithi100 ceph-mon[34353]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-09T05:41:42.046 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:41:41 smithi060 ceph-mon[34555]: pgmap v499: 97 pgs: 97 active+clean; 67 MiB data, 767 MiB used, 1.0 TiB / 1.0 TiB avail; 964 KiB/s rd, 1.1 MiB/s wr, 114 op/s 2024-05-09T05:41:42.046 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:41:41 smithi060 ceph-mon[34555]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-09T05:41:42.109 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:41:41 smithi039 ceph-mon[30439]: pgmap v499: 97 pgs: 97 active+clean; 67 MiB data, 767 MiB used, 1.0 TiB / 1.0 TiB avail; 964 KiB/s rd, 1.1 MiB/s wr, 114 op/s 2024-05-09T05:41:42.109 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:41:41 smithi039 ceph-mon[30439]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-09T05:41:42.640 INFO:tasks.workunit.client.0.smithi039.stdout: 1 134625 7.04 MB/sec execute 19 sec latency 1182.300 ms 2024-05-09T05:41:43.640 INFO:tasks.workunit.client.0.smithi039.stdout: 1 134625 6.69 MB/sec execute 20 sec latency 2182.374 ms 2024-05-09T05:41:43.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:41:43 smithi100 ceph-mon[34353]: pgmap v500: 97 pgs: 97 active+clean; 70 MiB data, 783 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 167 op/s 2024-05-09T05:41:44.045 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:41:43 smithi060 ceph-mon[34555]: pgmap v500: 97 pgs: 97 active+clean; 70 MiB data, 783 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 167 op/s 2024-05-09T05:41:44.109 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:41:43 smithi039 ceph-mon[30439]: pgmap v500: 97 pgs: 97 active+clean; 70 MiB data, 783 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 167 op/s 2024-05-09T05:41:44.640 INFO:tasks.workunit.client.0.smithi039.stdout: 1 136272 6.84 MB/sec execute 21 sec latency 2283.338 ms 2024-05-09T05:41:45.640 INFO:tasks.workunit.client.0.smithi039.stdout: 1 138792 7.16 MB/sec execute 22 sec latency 11.923 ms 2024-05-09T05:41:45.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:41:45 smithi100 ceph-mon[34353]: pgmap v501: 97 pgs: 97 active+clean; 71 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 152 op/s 2024-05-09T05:41:46.045 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:41:45 smithi060 ceph-mon[34555]: pgmap v501: 97 pgs: 97 active+clean; 71 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 152 op/s 2024-05-09T05:41:46.109 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:41:45 smithi039 ceph-mon[30439]: pgmap v501: 97 pgs: 97 active+clean; 71 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 152 op/s 2024-05-09T05:41:46.640 INFO:tasks.workunit.client.0.smithi039.stdout: 1 141542 7.42 MB/sec execute 23 sec latency 17.427 ms 2024-05-09T05:41:47.640 INFO:tasks.workunit.client.0.smithi039.stdout: 1 143551 7.58 MB/sec execute 24 sec latency 23.477 ms 2024-05-09T05:41:47.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:41:47 smithi100 ceph-mon[34353]: pgmap v502: 97 pgs: 97 active+clean; 71 MiB data, 775 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 144 op/s 2024-05-09T05:41:48.045 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:41:47 smithi060 ceph-mon[34555]: pgmap v502: 97 pgs: 97 active+clean; 71 MiB data, 775 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 144 op/s 2024-05-09T05:41:48.109 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:41:47 smithi039 ceph-mon[30439]: pgmap v502: 97 pgs: 97 active+clean; 71 MiB data, 775 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 144 op/s 2024-05-09T05:41:48.640 INFO:tasks.workunit.client.0.smithi039.stdout: 1 145983 7.83 MB/sec execute 25 sec latency 23.148 ms 2024-05-09T05:41:49.640 INFO:tasks.workunit.client.0.smithi039.stdout: 1 148834 8.09 MB/sec execute 26 sec latency 17.234 ms 2024-05-09T05:41:49.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:41:49 smithi100 ceph-mon[34353]: pgmap v503: 97 pgs: 97 active+clean; 73 MiB data, 801 MiB used, 1.0 TiB / 1.0 TiB avail; 949 KiB/s rd, 1.4 MiB/s wr, 153 op/s 2024-05-09T05:41:50.045 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:41:49 smithi060 ceph-mon[34555]: pgmap v503: 97 pgs: 97 active+clean; 73 MiB data, 801 MiB used, 1.0 TiB / 1.0 TiB avail; 949 KiB/s rd, 1.4 MiB/s wr, 153 op/s 2024-05-09T05:41:50.109 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:41:49 smithi039 ceph-mon[30439]: pgmap v503: 97 pgs: 97 active+clean; 73 MiB data, 801 MiB used, 1.0 TiB / 1.0 TiB avail; 949 KiB/s rd, 1.4 MiB/s wr, 153 op/s 2024-05-09T05:41:50.640 INFO:tasks.workunit.client.0.smithi039.stdout: 1 150704 8.16 MB/sec execute 27 sec latency 23.980 ms 2024-05-09T05:41:51.640 INFO:tasks.workunit.client.0.smithi039.stdout: 1 153082 8.36 MB/sec execute 28 sec latency 15.826 ms 2024-05-09T05:41:51.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:41:51 smithi100 ceph-mon[34353]: pgmap v504: 97 pgs: 97 active+clean; 73 MiB data, 807 MiB used, 1.0 TiB / 1.0 TiB avail; 867 KiB/s rd, 1.3 MiB/s wr, 140 op/s 2024-05-09T05:41:52.045 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:41:51 smithi060 ceph-mon[34555]: pgmap v504: 97 pgs: 97 active+clean; 73 MiB data, 807 MiB used, 1.0 TiB / 1.0 TiB avail; 867 KiB/s rd, 1.3 MiB/s wr, 140 op/s 2024-05-09T05:41:52.109 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:41:51 smithi039 ceph-mon[30439]: pgmap v504: 97 pgs: 97 active+clean; 73 MiB data, 807 MiB used, 1.0 TiB / 1.0 TiB avail; 867 KiB/s rd, 1.3 MiB/s wr, 140 op/s 2024-05-09T05:41:52.640 INFO:tasks.workunit.client.0.smithi039.stdout: 1 155911 8.57 MB/sec execute 29 sec latency 25.137 ms 2024-05-09T05:41:53.640 INFO:tasks.workunit.client.0.smithi039.stdout: 1 157518 8.61 MB/sec execute 30 sec latency 100.651 ms 2024-05-09T05:41:53.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:41:53 smithi100 ceph-mon[34353]: pgmap v505: 97 pgs: 97 active+clean; 76 MiB data, 808 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 196 op/s 2024-05-09T05:41:54.045 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:41:53 smithi060 ceph-mon[34555]: pgmap v505: 97 pgs: 97 active+clean; 76 MiB data, 808 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 196 op/s 2024-05-09T05:41:54.109 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:41:53 smithi039 ceph-mon[30439]: pgmap v505: 97 pgs: 97 active+clean; 76 MiB data, 808 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 196 op/s 2024-05-09T05:41:54.640 INFO:tasks.workunit.client.0.smithi039.stdout: 1 160095 8.78 MB/sec execute 31 sec latency 22.278 ms 2024-05-09T05:41:55.640 INFO:tasks.workunit.client.0.smithi039.stdout: 1 162909 8.96 MB/sec execute 32 sec latency 16.694 ms 2024-05-09T05:41:55.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:41:55 smithi100 ceph-mon[34353]: pgmap v506: 97 pgs: 97 active+clean; 79 MiB data, 801 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 162 op/s 2024-05-09T05:41:56.045 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:41:55 smithi060 ceph-mon[34555]: pgmap v506: 97 pgs: 97 active+clean; 79 MiB data, 801 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 162 op/s 2024-05-09T05:41:56.109 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:41:55 smithi039 ceph-mon[30439]: pgmap v506: 97 pgs: 97 active+clean; 79 MiB data, 801 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 162 op/s 2024-05-09T05:41:56.641 INFO:tasks.workunit.client.0.smithi039.stdout: 1 164887 8.99 MB/sec execute 33 sec latency 21.023 ms 2024-05-09T05:41:57.642 INFO:tasks.workunit.client.0.smithi039.stdout: 1 167325 9.13 MB/sec execute 34 sec latency 16.308 ms 2024-05-09T05:41:57.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:41:57 smithi100 ceph-mon[34353]: pgmap v507: 97 pgs: 97 active+clean; 82 MiB data, 812 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 218 op/s 2024-05-09T05:41:58.045 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:41:57 smithi060 ceph-mon[34555]: pgmap v507: 97 pgs: 97 active+clean; 82 MiB data, 812 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 218 op/s 2024-05-09T05:41:58.109 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:41:57 smithi039 ceph-mon[30439]: pgmap v507: 97 pgs: 97 active+clean; 82 MiB data, 812 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 218 op/s 2024-05-09T05:41:58.641 INFO:tasks.workunit.client.0.smithi039.stdout: 1 170093 9.29 MB/sec execute 35 sec latency 32.468 ms 2024-05-09T05:41:59.641 INFO:tasks.workunit.client.0.smithi039.stdout: 1 172081 9.31 MB/sec execute 36 sec latency 25.390 ms 2024-05-09T05:41:59.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:41:59 smithi039 ceph-mon[30439]: pgmap v508: 97 pgs: 97 active+clean; 82 MiB data, 813 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.4 MiB/s wr, 246 op/s 2024-05-09T05:41:59.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:41:59 smithi100 ceph-mon[34353]: pgmap v508: 97 pgs: 97 active+clean; 82 MiB data, 813 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.4 MiB/s wr, 246 op/s 2024-05-09T05:42:00.045 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:41:59 smithi060 ceph-mon[34555]: pgmap v508: 97 pgs: 97 active+clean; 82 MiB data, 813 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.4 MiB/s wr, 246 op/s 2024-05-09T05:42:00.641 INFO:tasks.workunit.client.0.smithi039.stdout: 1 174431 9.43 MB/sec execute 37 sec latency 16.092 ms 2024-05-09T05:42:01.045 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:42:00 smithi060 ceph-mon[34555]: pgmap v509: 97 pgs: 97 active+clean; 82 MiB data, 797 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.1 MiB/s wr, 200 op/s 2024-05-09T05:42:01.109 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:42:00 smithi039 ceph-mon[30439]: pgmap v509: 97 pgs: 97 active+clean; 82 MiB data, 797 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.1 MiB/s wr, 200 op/s 2024-05-09T05:42:01.173 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:42:00 smithi100 ceph-mon[34353]: pgmap v509: 97 pgs: 97 active+clean; 82 MiB data, 797 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.1 MiB/s wr, 200 op/s 2024-05-09T05:42:01.641 INFO:tasks.workunit.client.0.smithi039.stdout: 1 177453 9.64 MB/sec execute 38 sec latency 15.648 ms 2024-05-09T05:42:02.641 INFO:tasks.workunit.client.0.smithi039.stdout: 1 179701 9.61 MB/sec execute 39 sec latency 24.751 ms 2024-05-09T05:42:03.609 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:42:03 smithi039 ceph-mon[30439]: pgmap v510: 97 pgs: 97 active+clean; 87 MiB data, 827 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.6 MiB/s wr, 277 op/s 2024-05-09T05:42:03.641 INFO:tasks.workunit.client.0.smithi039.stdout: 1 181450 9.68 MB/sec execute 40 sec latency 46.409 ms 2024-05-09T05:42:03.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:42:03 smithi100 ceph-mon[34353]: pgmap v510: 97 pgs: 97 active+clean; 87 MiB data, 827 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.6 MiB/s wr, 277 op/s 2024-05-09T05:42:03.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:42:03 smithi060 ceph-mon[34555]: pgmap v510: 97 pgs: 97 active+clean; 87 MiB data, 827 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.6 MiB/s wr, 277 op/s 2024-05-09T05:42:04.641 INFO:tasks.workunit.client.0.smithi039.stdout: 1 184262 9.79 MB/sec execute 41 sec latency 22.254 ms 2024-05-09T05:42:05.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:42:05 smithi039 ceph-mon[30439]: pgmap v511: 97 pgs: 97 active+clean; 88 MiB data, 882 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.4 MiB/s wr, 236 op/s 2024-05-09T05:42:05.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:42:05 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:42:05.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:42:05 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:42:05.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:42:05 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:42:05.610 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:42:05 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:42:05.641 INFO:tasks.workunit.client.0.smithi039.stdout: 1 186096 9.79 MB/sec execute 42 sec latency 13.410 ms 2024-05-09T05:42:05.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:42:05 smithi100 ceph-mon[34353]: pgmap v511: 97 pgs: 97 active+clean; 88 MiB data, 882 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.4 MiB/s wr, 236 op/s 2024-05-09T05:42:05.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:42:05 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:42:05.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:42:05 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:42:05.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:42:05 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:42:05.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:42:05 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:42:05.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:42:05 smithi060 ceph-mon[34555]: pgmap v511: 97 pgs: 97 active+clean; 88 MiB data, 882 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.4 MiB/s wr, 236 op/s 2024-05-09T05:42:05.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:42:05 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:42:05.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:42:05 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:42:05.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:42:05 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:42:05.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:42:05 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:42:06.641 INFO:tasks.workunit.client.0.smithi039.stdout: 1 188560 9.89 MB/sec execute 43 sec latency 22.214 ms 2024-05-09T05:42:07.609 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:42:07 smithi039 ceph-mon[30439]: pgmap v512: 97 pgs: 97 active+clean; 90 MiB data, 898 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.8 MiB/s wr, 271 op/s 2024-05-09T05:42:07.641 INFO:tasks.workunit.client.0.smithi039.stdout: 1 191513 10.06 MB/sec execute 44 sec latency 15.801 ms 2024-05-09T05:42:07.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:42:07 smithi100 ceph-mon[34353]: pgmap v512: 97 pgs: 97 active+clean; 90 MiB data, 898 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.8 MiB/s wr, 271 op/s 2024-05-09T05:42:07.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:42:07 smithi060 ceph-mon[34555]: pgmap v512: 97 pgs: 97 active+clean; 90 MiB data, 898 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.8 MiB/s wr, 271 op/s 2024-05-09T05:42:08.641 INFO:tasks.workunit.client.0.smithi039.stdout: 1 193607 10.00 MB/sec execute 45 sec latency 35.526 ms 2024-05-09T05:42:09.609 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:42:09 smithi039 ceph-mon[30439]: pgmap v513: 97 pgs: 97 active+clean; 93 MiB data, 877 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.7 MiB/s wr, 263 op/s 2024-05-09T05:42:09.641 INFO:tasks.workunit.client.0.smithi039.stdout: 1 195688 10.08 MB/sec execute 46 sec latency 20.000 ms 2024-05-09T05:42:09.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:42:09 smithi100 ceph-mon[34353]: pgmap v513: 97 pgs: 97 active+clean; 93 MiB data, 877 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.7 MiB/s wr, 263 op/s 2024-05-09T05:42:09.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:42:09 smithi060 ceph-mon[34555]: pgmap v513: 97 pgs: 97 active+clean; 93 MiB data, 877 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.7 MiB/s wr, 263 op/s 2024-05-09T05:42:10.641 INFO:tasks.workunit.client.0.smithi039.stdout: 1 198717 10.24 MB/sec execute 47 sec latency 18.304 ms 2024-05-09T05:42:11.597 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:42:11 smithi060 ceph-mon[34555]: pgmap v514: 97 pgs: 97 active+clean; 93 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.3 MiB/s wr, 234 op/s 2024-05-09T05:42:11.609 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:42:11 smithi039 ceph-mon[30439]: pgmap v514: 97 pgs: 97 active+clean; 93 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.3 MiB/s wr, 234 op/s 2024-05-09T05:42:11.641 INFO:tasks.workunit.client.0.smithi039.stdout: 1 201088 10.20 MB/sec execute 48 sec latency 20.976 ms 2024-05-09T05:42:11.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:42:11 smithi100 ceph-mon[34353]: pgmap v514: 97 pgs: 97 active+clean; 93 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.3 MiB/s wr, 234 op/s 2024-05-09T05:42:12.641 INFO:tasks.workunit.client.0.smithi039.stdout: 1 203060 10.25 MB/sec execute 49 sec latency 16.523 ms 2024-05-09T05:42:13.609 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:42:13 smithi039 ceph-mon[30439]: pgmap v515: 97 pgs: 97 active+clean; 94 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.5 MiB/s wr, 251 op/s 2024-05-09T05:42:13.641 INFO:tasks.workunit.client.0.smithi039.stdout: 1 205890 10.39 MB/sec execute 50 sec latency 37.847 ms 2024-05-09T05:42:13.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:42:13 smithi100 ceph-mon[34353]: pgmap v515: 97 pgs: 97 active+clean; 94 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.5 MiB/s wr, 251 op/s 2024-05-09T05:42:13.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:42:13 smithi060 ceph-mon[34555]: pgmap v515: 97 pgs: 97 active+clean; 94 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.5 MiB/s wr, 251 op/s 2024-05-09T05:42:14.641 INFO:tasks.workunit.client.0.smithi039.stdout: 1 208164 10.35 MB/sec execute 51 sec latency 29.356 ms 2024-05-09T05:42:15.609 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:42:15 smithi039 ceph-mon[30439]: pgmap v516: 97 pgs: 97 active+clean; 96 MiB data, 892 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.4 MiB/s wr, 223 op/s 2024-05-09T05:42:15.641 INFO:tasks.workunit.client.0.smithi039.stdout: 1 210209 10.40 MB/sec execute 52 sec latency 16.530 ms 2024-05-09T05:42:15.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:42:15 smithi100 ceph-mon[34353]: pgmap v516: 97 pgs: 97 active+clean; 96 MiB data, 892 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.4 MiB/s wr, 223 op/s 2024-05-09T05:42:15.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:42:15 smithi060 ceph-mon[34555]: pgmap v516: 97 pgs: 97 active+clean; 96 MiB data, 892 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.4 MiB/s wr, 223 op/s 2024-05-09T05:42:16.641 INFO:tasks.workunit.client.0.smithi039.stdout: 1 213031 10.54 MB/sec execute 53 sec latency 13.174 ms 2024-05-09T05:42:17.609 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:42:17 smithi039 ceph-mon[30439]: pgmap v517: 97 pgs: 97 active+clean; 96 MiB data, 890 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.4 MiB/s wr, 220 op/s 2024-05-09T05:42:17.641 INFO:tasks.workunit.client.0.smithi039.stdout: 1 215433 10.50 MB/sec execute 54 sec latency 16.133 ms 2024-05-09T05:42:17.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:42:17 smithi100 ceph-mon[34353]: pgmap v517: 97 pgs: 97 active+clean; 96 MiB data, 890 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.4 MiB/s wr, 220 op/s 2024-05-09T05:42:17.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:42:17 smithi060 ceph-mon[34555]: pgmap v517: 97 pgs: 97 active+clean; 96 MiB data, 890 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.4 MiB/s wr, 220 op/s 2024-05-09T05:42:18.642 INFO:tasks.workunit.client.0.smithi039.stdout: 1 217213 10.52 MB/sec execute 55 sec latency 73.111 ms 2024-05-09T05:42:19.609 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:42:19 smithi039 ceph-mon[30439]: pgmap v518: 97 pgs: 97 active+clean; 101 MiB data, 943 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.6 MiB/s wr, 260 op/s 2024-05-09T05:42:19.641 INFO:tasks.workunit.client.0.smithi039.stdout: 1 220060 10.64 MB/sec execute 56 sec latency 48.196 ms 2024-05-09T05:42:19.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:42:19 smithi100 ceph-mon[34353]: pgmap v518: 97 pgs: 97 active+clean; 101 MiB data, 943 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.6 MiB/s wr, 260 op/s 2024-05-09T05:42:19.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:42:19 smithi060 ceph-mon[34555]: pgmap v518: 97 pgs: 97 active+clean; 101 MiB data, 943 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.6 MiB/s wr, 260 op/s 2024-05-09T05:42:20.641 INFO:tasks.workunit.client.0.smithi039.stdout: 1 222383 10.61 MB/sec execute 57 sec latency 15.784 ms 2024-05-09T05:42:21.609 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:42:21 smithi039 ceph-mon[30439]: pgmap v519: 97 pgs: 97 active+clean; 102 MiB data, 944 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.4 MiB/s wr, 207 op/s 2024-05-09T05:42:21.642 INFO:tasks.workunit.client.0.smithi039.stdout: 1 224281 10.64 MB/sec execute 58 sec latency 17.767 ms 2024-05-09T05:42:21.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:42:21 smithi100 ceph-mon[34353]: pgmap v519: 97 pgs: 97 active+clean; 102 MiB data, 944 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.4 MiB/s wr, 207 op/s 2024-05-09T05:42:21.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:42:21 smithi060 ceph-mon[34555]: pgmap v519: 97 pgs: 97 active+clean; 102 MiB data, 944 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.4 MiB/s wr, 207 op/s 2024-05-09T05:42:22.642 INFO:tasks.workunit.client.0.smithi039.stdout: 1 227216 10.75 MB/sec execute 59 sec latency 20.400 ms 2024-05-09T05:42:23.609 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:42:23 smithi039 ceph-mon[30439]: pgmap v520: 97 pgs: 97 active+clean; 102 MiB data, 946 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.7 MiB/s wr, 237 op/s 2024-05-09T05:42:23.642 INFO:tasks.workunit.client.0.smithi039.stdout: 1 229614 10.73 MB/sec execute 60 sec latency 27.387 ms 2024-05-09T05:42:23.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:42:23 smithi100 ceph-mon[34353]: pgmap v520: 97 pgs: 97 active+clean; 102 MiB data, 946 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.7 MiB/s wr, 237 op/s 2024-05-09T05:42:23.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:42:23 smithi060 ceph-mon[34555]: pgmap v520: 97 pgs: 97 active+clean; 102 MiB data, 946 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.7 MiB/s wr, 237 op/s 2024-05-09T05:42:24.642 INFO:tasks.workunit.client.0.smithi039.stdout: 1 231337 10.74 MB/sec execute 61 sec latency 67.040 ms 2024-05-09T05:42:25.609 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:42:25 smithi039 ceph-mon[30439]: pgmap v521: 97 pgs: 97 active+clean; 106 MiB data, 987 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.1 MiB/s wr, 292 op/s 2024-05-09T05:42:25.642 INFO:tasks.workunit.client.0.smithi039.stdout: 1 234281 10.85 MB/sec execute 62 sec latency 11.755 ms 2024-05-09T05:42:25.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:42:25 smithi100 ceph-mon[34353]: pgmap v521: 97 pgs: 97 active+clean; 106 MiB data, 987 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.1 MiB/s wr, 292 op/s 2024-05-09T05:42:25.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:42:25 smithi060 ceph-mon[34555]: pgmap v521: 97 pgs: 97 active+clean; 106 MiB data, 987 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.1 MiB/s wr, 292 op/s 2024-05-09T05:42:26.642 INFO:tasks.workunit.client.0.smithi039.stdout: 1 236616 10.82 MB/sec execute 63 sec latency 17.666 ms 2024-05-09T05:42:27.609 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:42:27 smithi039 ceph-mon[30439]: pgmap v522: 97 pgs: 97 active+clean; 108 MiB data, 990 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.0 MiB/s wr, 277 op/s 2024-05-09T05:42:27.642 INFO:tasks.workunit.client.0.smithi039.stdout: 1 238665 10.84 MB/sec execute 64 sec latency 17.387 ms 2024-05-09T05:42:27.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:42:27 smithi100 ceph-mon[34353]: pgmap v522: 97 pgs: 97 active+clean; 108 MiB data, 990 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.0 MiB/s wr, 277 op/s 2024-05-09T05:42:27.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:42:27 smithi060 ceph-mon[34555]: pgmap v522: 97 pgs: 97 active+clean; 108 MiB data, 990 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.0 MiB/s wr, 277 op/s 2024-05-09T05:42:28.642 INFO:tasks.workunit.client.0.smithi039.stdout: 1 241607 10.96 MB/sec execute 65 sec latency 12.752 ms 2024-05-09T05:42:29.609 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:42:29 smithi039 ceph-mon[30439]: pgmap v523: 97 pgs: 97 active+clean; 109 MiB data, 1002 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.3 MiB/s wr, 299 op/s 2024-05-09T05:42:29.642 INFO:tasks.workunit.client.0.smithi039.stdout: 1 243738 10.91 MB/sec execute 66 sec latency 66.540 ms 2024-05-09T05:42:29.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:42:29 smithi100 ceph-mon[34353]: pgmap v523: 97 pgs: 97 active+clean; 109 MiB data, 1002 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.3 MiB/s wr, 299 op/s 2024-05-09T05:42:29.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:42:29 smithi060 ceph-mon[34555]: pgmap v523: 97 pgs: 97 active+clean; 109 MiB data, 1002 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.3 MiB/s wr, 299 op/s 2024-05-09T05:42:30.642 INFO:tasks.workunit.client.0.smithi039.stdout: 1 245571 10.92 MB/sec execute 67 sec latency 27.833 ms 2024-05-09T05:42:31.609 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:42:31 smithi039 ceph-mon[30439]: pgmap v524: 97 pgs: 97 active+clean; 108 MiB data, 1008 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.6 MiB/s wr, 207 op/s 2024-05-09T05:42:31.642 INFO:tasks.workunit.client.0.smithi039.stdout: 1 248541 11.03 MB/sec execute 68 sec latency 14.819 ms 2024-05-09T05:42:31.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:42:31 smithi100 ceph-mon[34353]: pgmap v524: 97 pgs: 97 active+clean; 108 MiB data, 1008 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.6 MiB/s wr, 207 op/s 2024-05-09T05:42:31.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:42:31 smithi060 ceph-mon[34555]: pgmap v524: 97 pgs: 97 active+clean; 108 MiB data, 1008 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.6 MiB/s wr, 207 op/s 2024-05-09T05:42:32.642 INFO:tasks.workunit.client.0.smithi039.stdout: 1 250664 10.97 MB/sec execute 69 sec latency 17.182 ms 2024-05-09T05:42:33.609 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:42:33 smithi039 ceph-mon[30439]: pgmap v525: 97 pgs: 97 active+clean; 110 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.0 MiB/s wr, 265 op/s 2024-05-09T05:42:33.642 INFO:tasks.workunit.client.0.smithi039.stdout: 1 252624 11.00 MB/sec execute 70 sec latency 17.113 ms 2024-05-09T05:42:33.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:42:33 smithi100 ceph-mon[34353]: pgmap v525: 97 pgs: 97 active+clean; 110 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.0 MiB/s wr, 265 op/s 2024-05-09T05:42:33.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:42:33 smithi060 ceph-mon[34555]: pgmap v525: 97 pgs: 97 active+clean; 110 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.0 MiB/s wr, 265 op/s 2024-05-09T05:42:34.642 INFO:tasks.workunit.client.0.smithi039.stdout: 1 255396 11.08 MB/sec execute 71 sec latency 71.606 ms 2024-05-09T05:42:35.609 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:42:35 smithi039 ceph-mon[30439]: pgmap v526: 97 pgs: 97 active+clean; 113 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.4 MiB/s wr, 301 op/s 2024-05-09T05:42:35.642 INFO:tasks.workunit.client.0.smithi039.stdout: 1 257315 11.03 MB/sec execute 72 sec latency 16.794 ms 2024-05-09T05:42:35.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:42:35 smithi100 ceph-mon[34353]: pgmap v526: 97 pgs: 97 active+clean; 113 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.4 MiB/s wr, 301 op/s 2024-05-09T05:42:35.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:42:35 smithi060 ceph-mon[34555]: pgmap v526: 97 pgs: 97 active+clean; 113 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.4 MiB/s wr, 301 op/s 2024-05-09T05:42:36.642 INFO:tasks.workunit.client.0.smithi039.stdout: 1 259527 11.06 MB/sec execute 73 sec latency 13.206 ms 2024-05-09T05:42:37.609 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:42:37 smithi039 ceph-mon[30439]: pgmap v527: 97 pgs: 97 active+clean; 114 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.1 MiB/s wr, 251 op/s 2024-05-09T05:42:37.642 INFO:tasks.workunit.client.0.smithi039.stdout: 1 262518 11.15 MB/sec execute 74 sec latency 24.538 ms 2024-05-09T05:42:37.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:42:37 smithi100 ceph-mon[34353]: pgmap v527: 97 pgs: 97 active+clean; 114 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.1 MiB/s wr, 251 op/s 2024-05-09T05:42:37.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:42:37 smithi060 ceph-mon[34555]: pgmap v527: 97 pgs: 97 active+clean; 114 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.1 MiB/s wr, 251 op/s 2024-05-09T05:42:38.642 INFO:tasks.workunit.client.0.smithi039.stdout: 1 264890 11.12 MB/sec execute 75 sec latency 17.757 ms 2024-05-09T05:42:39.642 INFO:tasks.workunit.client.0.smithi039.stdout: 1 266652 11.13 MB/sec execute 76 sec latency 119.405 ms 2024-05-09T05:42:39.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:42:39 smithi100 ceph-mon[34353]: pgmap v528: 97 pgs: 97 active+clean; 116 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.5 MiB/s wr, 259 op/s 2024-05-09T05:42:39.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:42:39 smithi060 ceph-mon[34555]: pgmap v528: 97 pgs: 97 active+clean; 116 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.5 MiB/s wr, 259 op/s 2024-05-09T05:42:39.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:42:39 smithi039 ceph-mon[30439]: pgmap v528: 97 pgs: 97 active+clean; 116 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.5 MiB/s wr, 259 op/s 2024-05-09T05:42:40.642 INFO:tasks.workunit.client.0.smithi039.stdout: 1 269328 11.17 MB/sec execute 77 sec latency 22.655 ms 2024-05-09T05:42:41.642 INFO:tasks.workunit.client.0.smithi039.stdout: 1 271038 11.16 MB/sec execute 78 sec latency 20.914 ms 2024-05-09T05:42:41.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:42:41 smithi100 ceph-mon[34353]: pgmap v529: 97 pgs: 97 active+clean; 116 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.0 MiB/s wr, 230 op/s 2024-05-09T05:42:41.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:42:41 smithi060 ceph-mon[34555]: pgmap v529: 97 pgs: 97 active+clean; 116 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.0 MiB/s wr, 230 op/s 2024-05-09T05:42:41.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:42:41 smithi039 ceph-mon[30439]: pgmap v529: 97 pgs: 97 active+clean; 116 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.0 MiB/s wr, 230 op/s 2024-05-09T05:42:42.643 INFO:tasks.workunit.client.0.smithi039.stdout: 1 273709 11.19 MB/sec execute 79 sec latency 15.101 ms 2024-05-09T05:42:43.642 INFO:tasks.workunit.client.0.smithi039.stdout: 1 276659 11.27 MB/sec execute 80 sec latency 16.078 ms 2024-05-09T05:42:43.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:42:43 smithi100 ceph-mon[34353]: pgmap v530: 97 pgs: 97 active+clean; 120 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.9 MiB/s wr, 313 op/s 2024-05-09T05:42:43.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:42:43 smithi060 ceph-mon[34555]: pgmap v530: 97 pgs: 97 active+clean; 120 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.9 MiB/s wr, 313 op/s 2024-05-09T05:42:43.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:42:43 smithi039 ceph-mon[30439]: pgmap v530: 97 pgs: 97 active+clean; 120 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.9 MiB/s wr, 313 op/s 2024-05-09T05:42:44.642 INFO:tasks.workunit.client.0.smithi039.stdout: 1 278333 11.22 MB/sec execute 81 sec latency 33.002 ms 2024-05-09T05:42:45.642 INFO:tasks.workunit.client.0.smithi039.stdout: 1 280794 11.25 MB/sec execute 82 sec latency 43.214 ms 2024-05-09T05:42:45.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:42:45 smithi100 ceph-mon[34353]: pgmap v531: 97 pgs: 97 active+clean; 120 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.6 MiB/s wr, 267 op/s 2024-05-09T05:42:45.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:42:45 smithi060 ceph-mon[34555]: pgmap v531: 97 pgs: 97 active+clean; 120 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.6 MiB/s wr, 267 op/s 2024-05-09T05:42:45.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:42:45 smithi039 ceph-mon[30439]: pgmap v531: 97 pgs: 97 active+clean; 120 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.6 MiB/s wr, 267 op/s 2024-05-09T05:42:46.642 INFO:tasks.workunit.client.0.smithi039.stdout: 1 283774 11.32 MB/sec execute 83 sec latency 22.244 ms 2024-05-09T05:42:47.643 INFO:tasks.workunit.client.0.smithi039.stdout: 1 286155 11.29 MB/sec execute 84 sec latency 16.809 ms 2024-05-09T05:42:47.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:42:47 smithi100 ceph-mon[34353]: pgmap v532: 97 pgs: 97 active+clean; 120 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.2 MiB/s wr, 232 op/s 2024-05-09T05:42:47.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:42:47 smithi060 ceph-mon[34555]: pgmap v532: 97 pgs: 97 active+clean; 120 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.2 MiB/s wr, 232 op/s 2024-05-09T05:42:47.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:42:47 smithi039 ceph-mon[30439]: pgmap v532: 97 pgs: 97 active+clean; 120 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.2 MiB/s wr, 232 op/s 2024-05-09T05:42:48.643 INFO:tasks.workunit.client.0.smithi039.stdout: 1 288159 11.31 MB/sec execute 85 sec latency 17.248 ms 2024-05-09T05:42:49.643 INFO:tasks.workunit.client.0.smithi039.stdout: 1 290860 11.37 MB/sec execute 86 sec latency 90.119 ms 2024-05-09T05:42:49.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:42:49 smithi100 ceph-mon[34353]: pgmap v533: 97 pgs: 97 active+clean; 124 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.6 MiB/s wr, 285 op/s 2024-05-09T05:42:49.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:42:49 smithi060 ceph-mon[34555]: pgmap v533: 97 pgs: 97 active+clean; 124 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.6 MiB/s wr, 285 op/s 2024-05-09T05:42:49.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:42:49 smithi039 ceph-mon[30439]: pgmap v533: 97 pgs: 97 active+clean; 124 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.6 MiB/s wr, 285 op/s 2024-05-09T05:42:50.643 INFO:tasks.workunit.client.0.smithi039.stdout: 1 292966 11.33 MB/sec execute 87 sec latency 17.594 ms 2024-05-09T05:42:51.643 INFO:tasks.workunit.client.0.smithi039.stdout: 1 295029 11.35 MB/sec execute 88 sec latency 23.550 ms 2024-05-09T05:42:51.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:42:51 smithi100 ceph-mon[34353]: pgmap v534: 97 pgs: 97 active+clean; 124 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.1 MiB/s wr, 248 op/s 2024-05-09T05:42:51.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:42:51 smithi060 ceph-mon[34555]: pgmap v534: 97 pgs: 97 active+clean; 124 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.1 MiB/s wr, 248 op/s 2024-05-09T05:42:51.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:42:51 smithi039 ceph-mon[30439]: pgmap v534: 97 pgs: 97 active+clean; 124 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.1 MiB/s wr, 248 op/s 2024-05-09T05:42:52.643 INFO:tasks.workunit.client.0.smithi039.stdout: 1 298063 11.42 MB/sec execute 89 sec latency 18.280 ms 2024-05-09T05:42:53.645 INFO:tasks.workunit.client.0.smithi039.stdout: 1 300376 11.39 MB/sec execute 90 sec latency 16.959 ms 2024-05-09T05:42:53.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:42:53 smithi100 ceph-mon[34353]: pgmap v535: 97 pgs: 97 active+clean; 128 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.6 MiB/s wr, 326 op/s 2024-05-09T05:42:53.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:42:53 smithi060 ceph-mon[34555]: pgmap v535: 97 pgs: 97 active+clean; 128 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.6 MiB/s wr, 326 op/s 2024-05-09T05:42:53.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:42:53 smithi039 ceph-mon[30439]: pgmap v535: 97 pgs: 97 active+clean; 128 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.6 MiB/s wr, 326 op/s 2024-05-09T05:42:54.643 INFO:tasks.workunit.client.0.smithi039.stdout: 1 302206 11.40 MB/sec execute 91 sec latency 50.844 ms 2024-05-09T05:42:55.643 INFO:tasks.workunit.client.0.smithi039.stdout: 1 305138 11.47 MB/sec execute 92 sec latency 23.691 ms 2024-05-09T05:42:55.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:42:55 smithi100 ceph-mon[34353]: pgmap v536: 97 pgs: 97 active+clean; 128 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.1 MiB/s wr, 257 op/s 2024-05-09T05:42:55.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:42:55 smithi060 ceph-mon[34555]: pgmap v536: 97 pgs: 97 active+clean; 128 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.1 MiB/s wr, 257 op/s 2024-05-09T05:42:55.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:42:55 smithi039 ceph-mon[30439]: pgmap v536: 97 pgs: 97 active+clean; 128 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.1 MiB/s wr, 257 op/s 2024-05-09T05:42:56.643 INFO:tasks.workunit.client.0.smithi039.stdout: 1 307495 11.43 MB/sec execute 93 sec latency 16.395 ms 2024-05-09T05:42:57.643 INFO:tasks.workunit.client.0.smithi039.stdout: 1 309525 11.45 MB/sec execute 94 sec latency 32.611 ms 2024-05-09T05:42:57.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:42:57 smithi100 ceph-mon[34353]: pgmap v537: 97 pgs: 97 active+clean; 128 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.2 MiB/s wr, 263 op/s 2024-05-09T05:42:57.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:42:57 smithi060 ceph-mon[34555]: pgmap v537: 97 pgs: 97 active+clean; 128 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.2 MiB/s wr, 263 op/s 2024-05-09T05:42:57.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:42:57 smithi039 ceph-mon[30439]: pgmap v537: 97 pgs: 97 active+clean; 128 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.2 MiB/s wr, 263 op/s 2024-05-09T05:42:58.643 INFO:tasks.workunit.client.0.smithi039.stdout: 1 312384 11.52 MB/sec execute 95 sec latency 62.784 ms 2024-05-09T05:42:59.643 INFO:tasks.workunit.client.0.smithi039.stdout: 1 314339 11.46 MB/sec execute 96 sec latency 66.178 ms 2024-05-09T05:42:59.661 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:42:59 smithi039 ceph-mon[30439]: pgmap v538: 97 pgs: 97 active+clean; 132 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.7 MiB/s wr, 309 op/s 2024-05-09T05:42:59.672 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:42:59 smithi100 ceph-mon[34353]: pgmap v538: 97 pgs: 97 active+clean; 132 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.7 MiB/s wr, 309 op/s 2024-05-09T05:42:59.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:42:59 smithi060 ceph-mon[34555]: pgmap v538: 97 pgs: 97 active+clean; 132 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.7 MiB/s wr, 309 op/s 2024-05-09T05:43:00.643 INFO:tasks.workunit.client.0.smithi039.stdout: 1 316158 11.48 MB/sec execute 97 sec latency 30.856 ms 2024-05-09T05:43:01.643 INFO:tasks.workunit.client.0.smithi039.stdout: 1 319059 11.51 MB/sec execute 98 sec latency 18.590 ms 2024-05-09T05:43:01.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:43:01 smithi100 ceph-mon[34353]: pgmap v539: 97 pgs: 97 active+clean; 132 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.0 MiB/s wr, 237 op/s 2024-05-09T05:43:01.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:43:01 smithi060 ceph-mon[34555]: pgmap v539: 97 pgs: 97 active+clean; 132 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.0 MiB/s wr, 237 op/s 2024-05-09T05:43:01.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:43:01 smithi039 ceph-mon[30439]: pgmap v539: 97 pgs: 97 active+clean; 132 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.0 MiB/s wr, 237 op/s 2024-05-09T05:43:02.643 INFO:tasks.workunit.client.0.smithi039.stdout: 1 321314 11.50 MB/sec execute 99 sec latency 16.378 ms 2024-05-09T05:43:03.643 INFO:tasks.workunit.client.0.smithi039.stdout: 1 323400 11.52 MB/sec execute 100 sec latency 30.623 ms 2024-05-09T05:43:03.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:43:03 smithi100 ceph-mon[34353]: pgmap v540: 97 pgs: 97 active+clean; 136 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.5 MiB/s wr, 317 op/s 2024-05-09T05:43:03.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:43:03 smithi060 ceph-mon[34555]: pgmap v540: 97 pgs: 97 active+clean; 136 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.5 MiB/s wr, 317 op/s 2024-05-09T05:43:03.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:43:03 smithi039 ceph-mon[30439]: pgmap v540: 97 pgs: 97 active+clean; 136 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.5 MiB/s wr, 317 op/s 2024-05-09T05:43:04.643 INFO:tasks.workunit.client.0.smithi039.stdout: 1 326338 11.58 MB/sec execute 101 sec latency 22.313 ms 2024-05-09T05:43:05.643 INFO:tasks.workunit.client.0.smithi039.stdout: 1 327946 11.53 MB/sec execute 102 sec latency 82.071 ms 2024-05-09T05:43:05.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:43:05 smithi100 ceph-mon[34353]: pgmap v541: 97 pgs: 97 active+clean; 135 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.2 MiB/s wr, 249 op/s 2024-05-09T05:43:05.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:43:05 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:43:05.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:43:05 smithi060 ceph-mon[34555]: pgmap v541: 97 pgs: 97 active+clean; 135 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.2 MiB/s wr, 249 op/s 2024-05-09T05:43:05.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:43:05 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:43:05.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:43:05 smithi039 ceph-mon[30439]: pgmap v541: 97 pgs: 97 active+clean; 135 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.2 MiB/s wr, 249 op/s 2024-05-09T05:43:05.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:43:05 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:43:06.643 INFO:tasks.workunit.client.0.smithi039.stdout: 1 330348 11.55 MB/sec execute 103 sec latency 13.948 ms 2024-05-09T05:43:06.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:43:06 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:43:06.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:43:06 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:43:06.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:43:06 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:43:06.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:43:06 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:43:06.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:43:06 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:43:06.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:43:06 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:43:06.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:43:06 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:43:06.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:43:06 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:43:06.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:43:06 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:43:06.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:43:06 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:43:06.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:43:06 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:43:06.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:43:06 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:43:06.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:43:06 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:43:06.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:43:06 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:43:06.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:43:06 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:43:06.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:43:06 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:43:06.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:43:06 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:43:06.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:43:06 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:43:06.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:43:06 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:43:06.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:43:06 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:43:06.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:43:06 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:43:07.644 INFO:tasks.workunit.client.0.smithi039.stdout: 1 333179 11.58 MB/sec execute 104 sec latency 25.889 ms 2024-05-09T05:43:07.672 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:43:07 smithi100 ceph-mon[34353]: Adjusting osd_memory_target on smithi039 to 176.2M 2024-05-09T05:43:07.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:43:07 smithi100 ceph-mon[34353]: Unable to set osd_memory_target on smithi039 to 184773836: error parsing value: Value '184773836' is below minimum 939524096 2024-05-09T05:43:07.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:43:07 smithi100 ceph-mon[34353]: pgmap v542: 97 pgs: 97 active+clean; 139 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.5 MiB/s wr, 295 op/s 2024-05-09T05:43:07.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:43:07 smithi060 ceph-mon[34555]: Adjusting osd_memory_target on smithi039 to 176.2M 2024-05-09T05:43:07.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:43:07 smithi060 ceph-mon[34555]: Unable to set osd_memory_target on smithi039 to 184773836: error parsing value: Value '184773836' is below minimum 939524096 2024-05-09T05:43:07.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:43:07 smithi060 ceph-mon[34555]: pgmap v542: 97 pgs: 97 active+clean; 139 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.5 MiB/s wr, 295 op/s 2024-05-09T05:43:07.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:43:07 smithi039 ceph-mon[30439]: Adjusting osd_memory_target on smithi039 to 176.2M 2024-05-09T05:43:07.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:43:07 smithi039 ceph-mon[30439]: Unable to set osd_memory_target on smithi039 to 184773836: error parsing value: Value '184773836' is below minimum 939524096 2024-05-09T05:43:07.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:43:07 smithi039 ceph-mon[30439]: pgmap v542: 97 pgs: 97 active+clean; 139 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.5 MiB/s wr, 295 op/s 2024-05-09T05:43:08.644 INFO:tasks.workunit.client.0.smithi039.stdout: 1 335087 11.57 MB/sec execute 105 sec latency 16.448 ms 2024-05-09T05:43:09.644 INFO:tasks.workunit.client.0.smithi039.stdout: 1 337519 11.59 MB/sec execute 106 sec latency 15.189 ms 2024-05-09T05:43:09.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:43:09 smithi100 ceph-mon[34353]: pgmap v543: 97 pgs: 97 active+clean; 139 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.7 MiB/s wr, 293 op/s 2024-05-09T05:43:09.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:43:09 smithi060 ceph-mon[34555]: pgmap v543: 97 pgs: 97 active+clean; 139 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.7 MiB/s wr, 293 op/s 2024-05-09T05:43:09.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:43:09 smithi039 ceph-mon[30439]: pgmap v543: 97 pgs: 97 active+clean; 139 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.7 MiB/s wr, 293 op/s 2024-05-09T05:43:10.644 INFO:tasks.workunit.client.0.smithi039.stdout: 1 339999 11.60 MB/sec execute 107 sec latency 91.520 ms 2024-05-09T05:43:11.644 INFO:tasks.workunit.client.0.smithi039.stdout: 1 342112 11.60 MB/sec execute 108 sec latency 17.894 ms 2024-05-09T05:43:11.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:43:11 smithi100 ceph-mon[34353]: pgmap v544: 97 pgs: 97 active+clean; 141 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.2 MiB/s wr, 263 op/s 2024-05-09T05:43:11.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:43:11 smithi060 ceph-mon[34555]: pgmap v544: 97 pgs: 97 active+clean; 141 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.2 MiB/s wr, 263 op/s 2024-05-09T05:43:11.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:43:11 smithi039 ceph-mon[30439]: pgmap v544: 97 pgs: 97 active+clean; 141 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.2 MiB/s wr, 263 op/s 2024-05-09T05:43:12.644 INFO:tasks.workunit.client.0.smithi039.stdout: 1 344602 11.62 MB/sec execute 109 sec latency 12.604 ms 2024-05-09T05:43:13.644 INFO:tasks.workunit.client.0.smithi039.stdout: 1 347428 11.65 MB/sec execute 110 sec latency 16.736 ms 2024-05-09T05:43:13.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:43:13 smithi100 ceph-mon[34353]: pgmap v545: 97 pgs: 97 active+clean; 142 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.5 MiB/s wr, 295 op/s 2024-05-09T05:43:13.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:43:13 smithi060 ceph-mon[34555]: pgmap v545: 97 pgs: 97 active+clean; 142 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.5 MiB/s wr, 295 op/s 2024-05-09T05:43:13.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:43:13 smithi039 ceph-mon[30439]: pgmap v545: 97 pgs: 97 active+clean; 142 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.5 MiB/s wr, 295 op/s 2024-05-09T05:43:14.644 INFO:tasks.workunit.client.0.smithi039.stdout: 1 349219 11.63 MB/sec execute 111 sec latency 16.963 ms 2024-05-09T05:43:15.644 INFO:tasks.workunit.client.0.smithi039.stdout: 1 351530 11.65 MB/sec execute 112 sec latency 86.072 ms 2024-05-09T05:43:15.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:43:15 smithi100 ceph-mon[34353]: pgmap v546: 97 pgs: 97 active+clean; 143 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.3 MiB/s wr, 242 op/s 2024-05-09T05:43:15.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:43:15 smithi060 ceph-mon[34555]: pgmap v546: 97 pgs: 97 active+clean; 143 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.3 MiB/s wr, 242 op/s 2024-05-09T05:43:15.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:43:15 smithi039 ceph-mon[30439]: pgmap v546: 97 pgs: 97 active+clean; 143 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.3 MiB/s wr, 242 op/s 2024-05-09T05:43:16.644 INFO:tasks.workunit.client.0.smithi039.stdout: 1 354058 11.65 MB/sec execute 113 sec latency 19.283 ms 2024-05-09T05:43:17.644 INFO:tasks.workunit.client.0.smithi039.stdout: 1 355889 11.63 MB/sec execute 114 sec latency 18.452 ms 2024-05-09T05:43:17.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:43:17 smithi100 ceph-mon[34353]: pgmap v547: 97 pgs: 97 active+clean; 144 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.1 MiB/s wr, 248 op/s 2024-05-09T05:43:17.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:43:17 smithi060 ceph-mon[34555]: pgmap v547: 97 pgs: 97 active+clean; 144 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.1 MiB/s wr, 248 op/s 2024-05-09T05:43:17.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:43:17 smithi039 ceph-mon[30439]: pgmap v547: 97 pgs: 97 active+clean; 144 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.1 MiB/s wr, 248 op/s 2024-05-09T05:43:18.644 INFO:tasks.workunit.client.0.smithi039.stdout: 1 358631 11.68 MB/sec execute 115 sec latency 20.471 ms 2024-05-09T05:43:19.644 INFO:tasks.workunit.client.0.smithi039.stdout: 1 361228 11.69 MB/sec execute 116 sec latency 13.598 ms 2024-05-09T05:43:19.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:43:19 smithi100 ceph-mon[34353]: pgmap v548: 97 pgs: 97 active+clean; 148 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.2 MiB/s wr, 266 op/s 2024-05-09T05:43:19.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:43:19 smithi060 ceph-mon[34555]: pgmap v548: 97 pgs: 97 active+clean; 148 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.2 MiB/s wr, 266 op/s 2024-05-09T05:43:19.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:43:19 smithi039 ceph-mon[30439]: pgmap v548: 97 pgs: 97 active+clean; 148 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.2 MiB/s wr, 266 op/s 2024-05-09T05:43:20.644 INFO:tasks.workunit.client.0.smithi039.stdout: 1 362675 11.65 MB/sec execute 117 sec latency 71.843 ms 2024-05-09T05:43:21.644 INFO:tasks.workunit.client.0.smithi039.stdout: 1 365454 11.69 MB/sec execute 118 sec latency 16.554 ms 2024-05-09T05:43:21.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:43:21 smithi100 ceph-mon[34353]: pgmap v549: 97 pgs: 97 active+clean; 150 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.2 MiB/s wr, 291 op/s 2024-05-09T05:43:21.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:43:21 smithi060 ceph-mon[34555]: pgmap v549: 97 pgs: 97 active+clean; 150 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.2 MiB/s wr, 291 op/s 2024-05-09T05:43:21.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:43:21 smithi039 ceph-mon[30439]: pgmap v549: 97 pgs: 97 active+clean; 150 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.2 MiB/s wr, 291 op/s 2024-05-09T05:43:22.644 INFO:tasks.workunit.client.0.smithi039.stdout: 1 367675 11.67 MB/sec execute 119 sec latency 16.087 ms 2024-05-09T05:43:23.644 INFO:tasks.workunit.client.0.smithi039.stdout: 1 369684 11.67 MB/sec execute 120 sec latency 18.039 ms 2024-05-09T05:43:23.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:43:23 smithi100 ceph-mon[34353]: pgmap v550: 97 pgs: 97 active+clean; 151 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.1 MiB/s wr, 258 op/s 2024-05-09T05:43:23.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:43:23 smithi060 ceph-mon[34555]: pgmap v550: 97 pgs: 97 active+clean; 151 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.1 MiB/s wr, 258 op/s 2024-05-09T05:43:23.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:43:23 smithi039 ceph-mon[30439]: pgmap v550: 97 pgs: 97 active+clean; 151 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.1 MiB/s wr, 258 op/s 2024-05-09T05:43:24.644 INFO:tasks.workunit.client.0.smithi039.stdout: 1 372587 11.72 MB/sec execute 121 sec latency 22.768 ms 2024-05-09T05:43:25.644 INFO:tasks.workunit.client.0.smithi039.stdout: 1 374773 11.69 MB/sec execute 122 sec latency 86.420 ms 2024-05-09T05:43:25.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:43:25 smithi100 ceph-mon[34353]: pgmap v551: 97 pgs: 97 active+clean; 154 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.4 MiB/s wr, 279 op/s 2024-05-09T05:43:25.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:43:25 smithi060 ceph-mon[34555]: pgmap v551: 97 pgs: 97 active+clean; 154 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.4 MiB/s wr, 279 op/s 2024-05-09T05:43:25.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:43:25 smithi039 ceph-mon[30439]: pgmap v551: 97 pgs: 97 active+clean; 154 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.4 MiB/s wr, 279 op/s 2024-05-09T05:43:26.644 INFO:tasks.workunit.client.0.smithi039.stdout: 1 376697 11.70 MB/sec execute 123 sec latency 32.026 ms 2024-05-09T05:43:27.644 INFO:tasks.workunit.client.0.smithi039.stdout: 1 379704 11.75 MB/sec execute 124 sec latency 11.788 ms 2024-05-09T05:43:27.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:43:27 smithi100 ceph-mon[34353]: pgmap v552: 97 pgs: 97 active+clean; 155 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.5 MiB/s wr, 297 op/s 2024-05-09T05:43:27.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:43:27 smithi060 ceph-mon[34555]: pgmap v552: 97 pgs: 97 active+clean; 155 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.5 MiB/s wr, 297 op/s 2024-05-09T05:43:27.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:43:27 smithi039 ceph-mon[30439]: pgmap v552: 97 pgs: 97 active+clean; 155 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.5 MiB/s wr, 297 op/s 2024-05-09T05:43:28.644 INFO:tasks.workunit.client.0.smithi039.stdout: 1 382011 11.72 MB/sec execute 125 sec latency 31.184 ms 2024-05-09T05:43:29.645 INFO:tasks.workunit.client.0.smithi039.stdout: 1 383894 11.73 MB/sec execute 126 sec latency 133.481 ms 2024-05-09T05:43:29.672 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:43:29 smithi100 ceph-mon[34353]: pgmap v553: 97 pgs: 97 active+clean; 155 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.7 MiB/s wr, 305 op/s 2024-05-09T05:43:29.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:43:29 smithi060 ceph-mon[34555]: pgmap v553: 97 pgs: 97 active+clean; 155 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.7 MiB/s wr, 305 op/s 2024-05-09T05:43:29.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:43:29 smithi039 ceph-mon[30439]: pgmap v553: 97 pgs: 97 active+clean; 155 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.7 MiB/s wr, 305 op/s 2024-05-09T05:43:30.644 INFO:tasks.workunit.client.0.smithi039.stdout: 1 386681 11.77 MB/sec execute 127 sec latency 56.880 ms 2024-05-09T05:43:31.644 INFO:tasks.workunit.client.0.smithi039.stdout: 1 388344 11.73 MB/sec execute 128 sec latency 37.843 ms 2024-05-09T05:43:31.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:43:31 smithi100 ceph-mon[34353]: pgmap v554: 97 pgs: 97 active+clean; 158 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.4 MiB/s wr, 261 op/s 2024-05-09T05:43:31.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:43:31 smithi060 ceph-mon[34555]: pgmap v554: 97 pgs: 97 active+clean; 158 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.4 MiB/s wr, 261 op/s 2024-05-09T05:43:31.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:43:31 smithi039 ceph-mon[30439]: pgmap v554: 97 pgs: 97 active+clean; 158 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.4 MiB/s wr, 261 op/s 2024-05-09T05:43:32.645 INFO:tasks.workunit.client.0.smithi039.stdout: 1 390764 11.75 MB/sec execute 129 sec latency 17.415 ms 2024-05-09T05:43:33.644 INFO:tasks.workunit.client.0.smithi039.stdout: 1 393575 11.77 MB/sec execute 130 sec latency 23.697 ms 2024-05-09T05:43:33.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:43:33 smithi060 ceph-mon[34555]: pgmap v555: 97 pgs: 97 active+clean; 160 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.3 MiB/s wr, 269 op/s 2024-05-09T05:43:33.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:43:33 smithi039 ceph-mon[30439]: pgmap v555: 97 pgs: 97 active+clean; 160 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.3 MiB/s wr, 269 op/s 2024-05-09T05:43:33.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:43:33 smithi100 ceph-mon[34353]: pgmap v555: 97 pgs: 97 active+clean; 160 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.3 MiB/s wr, 269 op/s 2024-05-09T05:43:34.645 INFO:tasks.workunit.client.0.smithi039.stdout: 1 395405 11.75 MB/sec execute 131 sec latency 16.712 ms 2024-05-09T05:43:35.645 INFO:tasks.workunit.client.0.smithi039.stdout: 1 397712 11.77 MB/sec execute 132 sec latency 58.458 ms 2024-05-09T05:43:35.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:43:35 smithi060 ceph-mon[34555]: pgmap v556: 97 pgs: 97 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.4 MiB/s wr, 269 op/s 2024-05-09T05:43:35.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:43:35 smithi039 ceph-mon[30439]: pgmap v556: 97 pgs: 97 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.4 MiB/s wr, 269 op/s 2024-05-09T05:43:35.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:43:35 smithi100 ceph-mon[34353]: pgmap v556: 97 pgs: 97 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.4 MiB/s wr, 269 op/s 2024-05-09T05:43:36.645 INFO:tasks.workunit.client.0.smithi039.stdout: 1 400482 11.78 MB/sec execute 133 sec latency 21.683 ms 2024-05-09T05:43:37.645 INFO:tasks.workunit.client.0.smithi039.stdout: 1 402367 11.77 MB/sec execute 134 sec latency 23.136 ms 2024-05-09T05:43:37.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:43:37 smithi060 ceph-mon[34555]: pgmap v557: 97 pgs: 97 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.2 MiB/s wr, 276 op/s 2024-05-09T05:43:37.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:43:37 smithi039 ceph-mon[30439]: pgmap v557: 97 pgs: 97 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.2 MiB/s wr, 276 op/s 2024-05-09T05:43:37.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:43:37 smithi100 ceph-mon[34353]: pgmap v557: 97 pgs: 97 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.2 MiB/s wr, 276 op/s 2024-05-09T05:43:38.645 INFO:tasks.workunit.client.0.smithi039.stdout: 1 404887 11.79 MB/sec execute 135 sec latency 22.574 ms 2024-05-09T05:43:39.647 INFO:tasks.workunit.client.0.smithi039.stdout: 1 407607 11.80 MB/sec execute 136 sec latency 105.591 ms 2024-05-09T05:43:39.725 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:43:39 smithi100 ceph-mon[34353]: pgmap v558: 97 pgs: 97 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.2 MiB/s wr, 252 op/s 2024-05-09T05:43:39.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:43:39 smithi060 ceph-mon[34555]: pgmap v558: 97 pgs: 97 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.2 MiB/s wr, 252 op/s 2024-05-09T05:43:39.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:43:39 smithi039 ceph-mon[30439]: pgmap v558: 97 pgs: 97 active+clean; 161 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.2 MiB/s wr, 252 op/s 2024-05-09T05:43:40.645 INFO:tasks.workunit.client.0.smithi039.stdout: 1 409132 11.77 MB/sec execute 137 sec latency 66.566 ms 2024-05-09T05:43:41.645 INFO:tasks.workunit.client.0.smithi039.stdout: 1 411882 11.81 MB/sec execute 138 sec latency 16.519 ms 2024-05-09T05:43:41.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:43:41 smithi060 ceph-mon[34555]: pgmap v559: 97 pgs: 97 active+clean; 164 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.3 MiB/s wr, 287 op/s 2024-05-09T05:43:41.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:43:41 smithi039 ceph-mon[30439]: pgmap v559: 97 pgs: 97 active+clean; 164 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.3 MiB/s wr, 287 op/s 2024-05-09T05:43:41.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:43:41 smithi100 ceph-mon[34353]: pgmap v559: 97 pgs: 97 active+clean; 164 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.3 MiB/s wr, 287 op/s 2024-05-09T05:43:42.645 INFO:tasks.workunit.client.0.smithi039.stdout: 1 414765 11.83 MB/sec execute 139 sec latency 16.089 ms 2024-05-09T05:43:43.645 INFO:tasks.workunit.client.0.smithi039.stdout: 1 416680 11.82 MB/sec execute 140 sec latency 16.640 ms 2024-05-09T05:43:43.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:43:43 smithi060 ceph-mon[34555]: pgmap v560: 97 pgs: 97 active+clean; 165 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.2 MiB/s wr, 276 op/s 2024-05-09T05:43:43.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:43:43 smithi039 ceph-mon[30439]: pgmap v560: 97 pgs: 97 active+clean; 165 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.2 MiB/s wr, 276 op/s 2024-05-09T05:43:43.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:43:43 smithi100 ceph-mon[34353]: pgmap v560: 97 pgs: 97 active+clean; 165 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.2 MiB/s wr, 276 op/s 2024-05-09T05:43:44.645 INFO:tasks.workunit.client.0.smithi039.stdout: 1 418994 11.83 MB/sec execute 141 sec latency 15.456 ms 2024-05-09T05:43:45.645 INFO:tasks.workunit.client.0.smithi039.stdout: 1 421562 11.84 MB/sec execute 142 sec latency 39.998 ms 2024-05-09T05:43:45.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:43:45 smithi060 ceph-mon[34555]: pgmap v561: 97 pgs: 97 active+clean; 168 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.3 MiB/s wr, 275 op/s 2024-05-09T05:43:45.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:43:45 smithi039 ceph-mon[30439]: pgmap v561: 97 pgs: 97 active+clean; 168 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.3 MiB/s wr, 275 op/s 2024-05-09T05:43:45.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:43:45 smithi100 ceph-mon[34353]: pgmap v561: 97 pgs: 97 active+clean; 168 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.3 MiB/s wr, 275 op/s 2024-05-09T05:43:46.645 INFO:tasks.workunit.client.0.smithi039.stdout: 1 423201 11.81 MB/sec execute 143 sec latency 78.375 ms 2024-05-09T05:43:47.645 INFO:tasks.workunit.client.0.smithi039.stdout: 1 425977 11.85 MB/sec execute 144 sec latency 13.442 ms 2024-05-09T05:43:47.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:43:47 smithi060 ceph-mon[34555]: pgmap v562: 97 pgs: 97 active+clean; 167 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.1 MiB/s wr, 281 op/s 2024-05-09T05:43:47.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:43:47 smithi039 ceph-mon[30439]: pgmap v562: 97 pgs: 97 active+clean; 167 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.1 MiB/s wr, 281 op/s 2024-05-09T05:43:47.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:43:47 smithi100 ceph-mon[34353]: pgmap v562: 97 pgs: 97 active+clean; 167 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.1 MiB/s wr, 281 op/s 2024-05-09T05:43:48.645 INFO:tasks.workunit.client.0.smithi039.stdout: 1 428282 11.82 MB/sec execute 145 sec latency 24.829 ms 2024-05-09T05:43:49.646 INFO:tasks.workunit.client.0.smithi039.stdout: 1 430215 11.83 MB/sec execute 146 sec latency 17.148 ms 2024-05-09T05:43:49.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:43:49 smithi060 ceph-mon[34555]: pgmap v563: 97 pgs: 97 active+clean; 167 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.3 MiB/s wr, 246 op/s 2024-05-09T05:43:49.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:43:49 smithi039 ceph-mon[30439]: pgmap v563: 97 pgs: 97 active+clean; 167 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.3 MiB/s wr, 246 op/s 2024-05-09T05:43:49.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:43:49 smithi100 ceph-mon[34353]: pgmap v563: 97 pgs: 97 active+clean; 167 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.3 MiB/s wr, 246 op/s 2024-05-09T05:43:50.645 INFO:tasks.workunit.client.0.smithi039.stdout: 1 432987 11.87 MB/sec execute 147 sec latency 16.331 ms 2024-05-09T05:43:51.645 INFO:tasks.workunit.client.0.smithi039.stdout: 1 434458 11.82 MB/sec execute 148 sec latency 59.763 ms 2024-05-09T05:43:51.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:43:51 smithi060 ceph-mon[34555]: pgmap v564: 97 pgs: 97 active+clean; 170 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.3 MiB/s wr, 283 op/s 2024-05-09T05:43:51.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:43:51 smithi039 ceph-mon[30439]: pgmap v564: 97 pgs: 97 active+clean; 170 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.3 MiB/s wr, 283 op/s 2024-05-09T05:43:51.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:43:51 smithi100 ceph-mon[34353]: pgmap v564: 97 pgs: 97 active+clean; 170 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.3 MiB/s wr, 283 op/s 2024-05-09T05:43:52.645 INFO:tasks.workunit.client.0.smithi039.stdout: 1 436790 11.84 MB/sec execute 149 sec latency 12.164 ms 2024-05-09T05:43:53.645 INFO:tasks.workunit.client.0.smithi039.stdout: 1 439663 11.85 MB/sec execute 150 sec latency 14.831 ms 2024-05-09T05:43:53.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:43:53 smithi060 ceph-mon[34555]: pgmap v565: 97 pgs: 97 active+clean; 171 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.0 MiB/s wr, 238 op/s 2024-05-09T05:43:53.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:43:53 smithi039 ceph-mon[30439]: pgmap v565: 97 pgs: 97 active+clean; 171 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.0 MiB/s wr, 238 op/s 2024-05-09T05:43:53.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:43:53 smithi100 ceph-mon[34353]: pgmap v565: 97 pgs: 97 active+clean; 171 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.0 MiB/s wr, 238 op/s 2024-05-09T05:43:54.645 INFO:tasks.workunit.client.0.smithi039.stdout: 1 441663 11.84 MB/sec execute 151 sec latency 16.713 ms 2024-05-09T05:43:55.645 INFO:tasks.workunit.client.0.smithi039.stdout: 1 443990 11.86 MB/sec execute 152 sec latency 22.485 ms 2024-05-09T05:43:55.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:43:55 smithi060 ceph-mon[34555]: pgmap v566: 97 pgs: 97 active+clean; 173 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.2 MiB/s wr, 265 op/s 2024-05-09T05:43:55.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:43:55 smithi039 ceph-mon[30439]: pgmap v566: 97 pgs: 97 active+clean; 173 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.2 MiB/s wr, 265 op/s 2024-05-09T05:43:55.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:43:55 smithi100 ceph-mon[34353]: pgmap v566: 97 pgs: 97 active+clean; 173 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.2 MiB/s wr, 265 op/s 2024-05-09T05:43:56.646 INFO:tasks.workunit.client.0.smithi039.stdout: 1 446397 11.86 MB/sec execute 153 sec latency 127.946 ms 2024-05-09T05:43:57.645 INFO:tasks.workunit.client.0.smithi039.stdout: 1 448153 11.84 MB/sec execute 154 sec latency 13.076 ms 2024-05-09T05:43:57.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:43:57 smithi060 ceph-mon[34555]: pgmap v567: 97 pgs: 97 active+clean; 173 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.1 MiB/s wr, 228 op/s 2024-05-09T05:43:57.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:43:57 smithi039 ceph-mon[30439]: pgmap v567: 97 pgs: 97 active+clean; 173 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.1 MiB/s wr, 228 op/s 2024-05-09T05:43:57.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:43:57 smithi100 ceph-mon[34353]: pgmap v567: 97 pgs: 97 active+clean; 173 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.1 MiB/s wr, 228 op/s 2024-05-09T05:43:58.646 INFO:tasks.workunit.client.0.smithi039.stdout: 1 450910 11.87 MB/sec execute 155 sec latency 12.673 ms 2024-05-09T05:43:59.646 INFO:tasks.workunit.client.0.smithi039.stdout: 1 453832 11.89 MB/sec execute 156 sec latency 21.948 ms 2024-05-09T05:43:59.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:43:59 smithi060 ceph-mon[34555]: pgmap v568: 97 pgs: 97 active+clean; 176 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.5 MiB/s wr, 281 op/s 2024-05-09T05:43:59.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:43:59 smithi039 ceph-mon[30439]: pgmap v568: 97 pgs: 97 active+clean; 176 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.5 MiB/s wr, 281 op/s 2024-05-09T05:43:59.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:43:59 smithi100 ceph-mon[34353]: pgmap v568: 97 pgs: 97 active+clean; 176 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.5 MiB/s wr, 281 op/s 2024-05-09T05:44:00.646 INFO:tasks.workunit.client.0.smithi039.stdout: 1 455678 11.88 MB/sec execute 157 sec latency 37.847 ms 2024-05-09T05:44:01.646 INFO:tasks.workunit.client.0.smithi039.stdout: 1 457879 11.89 MB/sec execute 158 sec latency 39.725 ms 2024-05-09T05:44:01.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:44:01 smithi060 ceph-mon[34555]: pgmap v569: 97 pgs: 97 active+clean; 176 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.3 MiB/s wr, 266 op/s 2024-05-09T05:44:01.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:44:01 smithi039 ceph-mon[30439]: pgmap v569: 97 pgs: 97 active+clean; 176 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.3 MiB/s wr, 266 op/s 2024-05-09T05:44:01.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:44:01 smithi100 ceph-mon[34353]: pgmap v569: 97 pgs: 97 active+clean; 176 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.3 MiB/s wr, 266 op/s 2024-05-09T05:44:02.646 INFO:tasks.workunit.client.0.smithi039.stdout: 1 459372 11.96 MB/sec execute 159 sec latency 47.876 ms 2024-05-09T05:44:03.646 INFO:tasks.workunit.client.0.smithi039.stdout: 1 462222 11.99 MB/sec execute 160 sec latency 8.692 ms 2024-05-09T05:44:03.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:44:03 smithi060 ceph-mon[34555]: pgmap v570: 97 pgs: 97 active+clean; 178 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.0 MiB/s wr, 245 op/s 2024-05-09T05:44:03.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:44:03 smithi039 ceph-mon[30439]: pgmap v570: 97 pgs: 97 active+clean; 178 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.0 MiB/s wr, 245 op/s 2024-05-09T05:44:03.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:44:03 smithi100 ceph-mon[34353]: pgmap v570: 97 pgs: 97 active+clean; 178 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.0 MiB/s wr, 245 op/s 2024-05-09T05:44:04.646 INFO:tasks.workunit.client.0.smithi039.stdout: 1 464830 12.00 MB/sec execute 161 sec latency 15.474 ms 2024-05-09T05:44:05.646 INFO:tasks.workunit.client.0.smithi039.stdout: 1 466720 11.98 MB/sec execute 162 sec latency 16.722 ms 2024-05-09T05:44:05.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:44:05 smithi060 ceph-mon[34555]: pgmap v571: 97 pgs: 97 active+clean; 181 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.5 MiB/s wr, 291 op/s 2024-05-09T05:44:05.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:44:05 smithi060 ceph-mon[34555]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-09T05:44:05.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:44:05 smithi039 ceph-mon[30439]: pgmap v571: 97 pgs: 97 active+clean; 181 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.5 MiB/s wr, 291 op/s 2024-05-09T05:44:05.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:44:05 smithi039 ceph-mon[30439]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-09T05:44:05.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:44:05 smithi100 ceph-mon[34353]: pgmap v571: 97 pgs: 97 active+clean; 181 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.5 MiB/s wr, 291 op/s 2024-05-09T05:44:05.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:44:05 smithi100 ceph-mon[34353]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-09T05:44:06.646 INFO:tasks.workunit.client.0.smithi039.stdout: 1 469239 12.00 MB/sec execute 163 sec latency 73.856 ms 2024-05-09T05:44:06.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:44:06 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:44:06.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:44:06 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:44:06.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:44:06 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:44:07.646 INFO:tasks.workunit.client.0.smithi039.stdout: 1 471592 11.98 MB/sec execute 164 sec latency 16.481 ms 2024-05-09T05:44:07.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:44:07 smithi060 ceph-mon[34555]: pgmap v572: 97 pgs: 97 active+clean; 177 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.3 MiB/s wr, 254 op/s 2024-05-09T05:44:07.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:44:07 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:44:07.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:44:07 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:44:07.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:44:07 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:44:07.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:44:07 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:44:07.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:44:07 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:44:07.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:44:07 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:44:07.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:44:07 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:44:07.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:44:07 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:44:07.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:44:07 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:44:07.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:44:07 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:44:07.797 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:44:07 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:44:07.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:44:07 smithi039 ceph-mon[30439]: pgmap v572: 97 pgs: 97 active+clean; 177 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.3 MiB/s wr, 254 op/s 2024-05-09T05:44:07.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:44:07 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:44:07.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:44:07 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:44:07.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:44:07 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:44:07.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:44:07 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:44:07.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:44:07 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:44:07.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:44:07 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:44:07.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:44:07 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:44:07.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:44:07 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:44:07.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:44:07 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:44:07.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:44:07 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:44:07.860 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:44:07 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:44:07.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:44:07 smithi100 ceph-mon[34353]: pgmap v572: 97 pgs: 97 active+clean; 177 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.3 MiB/s wr, 254 op/s 2024-05-09T05:44:07.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:44:07 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:44:07.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:44:07 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:44:07.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:44:07 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:44:07.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:44:07 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:44:07.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:44:07 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:44:07.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:44:07 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:44:07.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:44:07 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:44:07.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:44:07 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:44:07.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:44:07 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:44:07.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:44:07 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:44:07.924 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:44:07 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:44:08.646 INFO:tasks.workunit.client.0.smithi039.stdout: 1 473519 11.98 MB/sec execute 165 sec latency 16.330 ms 2024-05-09T05:44:08.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:44:08 smithi060 ceph-mon[34555]: Adjusting osd_memory_target on smithi100 to 176.1M 2024-05-09T05:44:08.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:44:08 smithi060 ceph-mon[34555]: Adjusting osd_memory_target on smithi060 to 177.2M 2024-05-09T05:44:08.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:44:08 smithi060 ceph-mon[34555]: Unable to set osd_memory_target on smithi100 to 184727961: error parsing value: Value '184727961' is below minimum 939524096 2024-05-09T05:44:08.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:44:08 smithi060 ceph-mon[34555]: Unable to set osd_memory_target on smithi060 to 185897062: error parsing value: Value '185897062' is below minimum 939524096 2024-05-09T05:44:08.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:44:08 smithi039 ceph-mon[30439]: Adjusting osd_memory_target on smithi100 to 176.1M 2024-05-09T05:44:08.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:44:08 smithi039 ceph-mon[30439]: Adjusting osd_memory_target on smithi060 to 177.2M 2024-05-09T05:44:08.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:44:08 smithi039 ceph-mon[30439]: Unable to set osd_memory_target on smithi100 to 184727961: error parsing value: Value '184727961' is below minimum 939524096 2024-05-09T05:44:08.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:44:08 smithi039 ceph-mon[30439]: Unable to set osd_memory_target on smithi060 to 185897062: error parsing value: Value '185897062' is below minimum 939524096 2024-05-09T05:44:08.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:44:08 smithi100 ceph-mon[34353]: Adjusting osd_memory_target on smithi100 to 176.1M 2024-05-09T05:44:08.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:44:08 smithi100 ceph-mon[34353]: Adjusting osd_memory_target on smithi060 to 177.2M 2024-05-09T05:44:08.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:44:08 smithi100 ceph-mon[34353]: Unable to set osd_memory_target on smithi100 to 184727961: error parsing value: Value '184727961' is below minimum 939524096 2024-05-09T05:44:08.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:44:08 smithi100 ceph-mon[34353]: Unable to set osd_memory_target on smithi060 to 185897062: error parsing value: Value '185897062' is below minimum 939524096 2024-05-09T05:44:09.646 INFO:tasks.workunit.client.0.smithi039.stdout: 1 476348 12.02 MB/sec execute 166 sec latency 12.971 ms 2024-05-09T05:44:09.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:44:09 smithi060 ceph-mon[34555]: pgmap v573: 97 pgs: 97 active+clean; 175 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.7 MiB/s wr, 301 op/s 2024-05-09T05:44:09.824 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:44:09 smithi100 ceph-mon[34353]: pgmap v573: 97 pgs: 97 active+clean; 175 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.7 MiB/s wr, 301 op/s 2024-05-09T05:44:09.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:44:09 smithi039 ceph-mon[30439]: pgmap v573: 97 pgs: 97 active+clean; 175 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.7 MiB/s wr, 301 op/s 2024-05-09T05:44:10.646 INFO:tasks.workunit.client.0.smithi039.stdout: 1 478630 11.99 MB/sec execute 167 sec latency 19.694 ms 2024-05-09T05:44:11.646 INFO:tasks.workunit.client.0.smithi039.stdout: 1 480460 11.99 MB/sec execute 168 sec latency 67.031 ms 2024-05-09T05:44:11.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:44:11 smithi060 ceph-mon[34555]: pgmap v574: 97 pgs: 97 active+clean; 171 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.1 MiB/s wr, 234 op/s 2024-05-09T05:44:11.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:44:11 smithi039 ceph-mon[30439]: pgmap v574: 97 pgs: 97 active+clean; 171 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.1 MiB/s wr, 234 op/s 2024-05-09T05:44:11.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:44:11 smithi100 ceph-mon[34353]: pgmap v574: 97 pgs: 97 active+clean; 171 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.1 MiB/s wr, 234 op/s 2024-05-09T05:44:12.646 INFO:tasks.workunit.client.0.smithi039.stdout: 1 483460 12.03 MB/sec execute 169 sec latency 21.166 ms 2024-05-09T05:44:13.646 INFO:tasks.workunit.client.0.smithi039.stdout: 1 486137 12.04 MB/sec execute 170 sec latency 15.392 ms 2024-05-09T05:44:13.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:44:13 smithi060 ceph-mon[34555]: pgmap v575: 97 pgs: 97 active+clean; 176 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.6 MiB/s wr, 288 op/s 2024-05-09T05:44:13.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:44:13 smithi039 ceph-mon[30439]: pgmap v575: 97 pgs: 97 active+clean; 176 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.6 MiB/s wr, 288 op/s 2024-05-09T05:44:13.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:44:13 smithi100 ceph-mon[34353]: pgmap v575: 97 pgs: 97 active+clean; 176 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.6 MiB/s wr, 288 op/s 2024-05-09T05:44:14.646 INFO:tasks.workunit.client.0.smithi039.stdout: 1 488352 12.03 MB/sec execute 171 sec latency 15.259 ms 2024-05-09T05:44:15.646 INFO:tasks.workunit.client.0.smithi039.stdout: 1 490867 12.05 MB/sec execute 172 sec latency 32.052 ms 2024-05-09T05:44:15.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:44:15 smithi060 ceph-mon[34555]: pgmap v576: 97 pgs: 97 active+clean; 177 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.5 MiB/s wr, 285 op/s 2024-05-09T05:44:15.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:44:15 smithi039 ceph-mon[30439]: pgmap v576: 97 pgs: 97 active+clean; 177 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.5 MiB/s wr, 285 op/s 2024-05-09T05:44:15.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:44:15 smithi100 ceph-mon[34353]: pgmap v576: 97 pgs: 97 active+clean; 177 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.5 MiB/s wr, 285 op/s 2024-05-09T05:44:16.646 INFO:tasks.workunit.client.0.smithi039.stdout: 1 493569 12.06 MB/sec execute 173 sec latency 93.616 ms 2024-05-09T05:44:17.646 INFO:tasks.workunit.client.0.smithi039.stdout: 1 495255 12.05 MB/sec execute 174 sec latency 88.773 ms 2024-05-09T05:44:17.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:44:17 smithi060 ceph-mon[34555]: pgmap v577: 97 pgs: 97 active+clean; 175 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 796 KiB/s rd, 3.2 MiB/s wr, 235 op/s 2024-05-09T05:44:17.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:44:17 smithi039 ceph-mon[30439]: pgmap v577: 97 pgs: 97 active+clean; 175 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 796 KiB/s rd, 3.2 MiB/s wr, 235 op/s 2024-05-09T05:44:17.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:44:17 smithi100 ceph-mon[34353]: pgmap v577: 97 pgs: 97 active+clean; 175 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 796 KiB/s rd, 3.2 MiB/s wr, 235 op/s 2024-05-09T05:44:18.646 INFO:tasks.workunit.client.0.smithi039.stdout: 1 497870 12.06 MB/sec execute 175 sec latency 11.738 ms 2024-05-09T05:44:19.647 INFO:tasks.workunit.client.0.smithi039.stdout: 1 500953 12.09 MB/sec execute 176 sec latency 34.901 ms 2024-05-09T05:44:19.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:44:19 smithi060 ceph-mon[34555]: pgmap v578: 97 pgs: 97 active+clean; 178 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1007 KiB/s rd, 3.7 MiB/s wr, 307 op/s 2024-05-09T05:44:19.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:44:19 smithi039 ceph-mon[30439]: pgmap v578: 97 pgs: 97 active+clean; 178 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1007 KiB/s rd, 3.7 MiB/s wr, 307 op/s 2024-05-09T05:44:19.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:44:19 smithi100 ceph-mon[34353]: pgmap v578: 97 pgs: 97 active+clean; 178 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1007 KiB/s rd, 3.7 MiB/s wr, 307 op/s 2024-05-09T05:44:20.646 INFO:tasks.workunit.client.0.smithi039.stdout: 1 503319 12.07 MB/sec execute 177 sec latency 21.986 ms 2024-05-09T05:44:21.647 INFO:tasks.workunit.client.0.smithi039.stdout: 1 505079 12.07 MB/sec execute 178 sec latency 101.281 ms 2024-05-09T05:44:21.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:44:21 smithi060 ceph-mon[34555]: pgmap v579: 97 pgs: 97 active+clean; 178 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 793 KiB/s rd, 3.1 MiB/s wr, 253 op/s 2024-05-09T05:44:21.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:44:21 smithi039 ceph-mon[30439]: pgmap v579: 97 pgs: 97 active+clean; 178 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 793 KiB/s rd, 3.1 MiB/s wr, 253 op/s 2024-05-09T05:44:21.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:44:21 smithi100 ceph-mon[34353]: pgmap v579: 97 pgs: 97 active+clean; 178 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 793 KiB/s rd, 3.1 MiB/s wr, 253 op/s 2024-05-09T05:44:22.646 INFO:tasks.workunit.client.0.smithi039.stdout: 1 507858 12.08 MB/sec execute 179 sec latency 17.232 ms 2024-05-09T05:44:23.647 INFO:tasks.workunit.client.0.smithi039.stdout: 1 510362 12.08 MB/sec execute 180 sec latency 16.711 ms 2024-05-09T05:44:23.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:44:23 smithi060 ceph-mon[34555]: pgmap v580: 97 pgs: 97 active+clean; 177 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 838 KiB/s rd, 3.2 MiB/s wr, 268 op/s 2024-05-09T05:44:23.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:44:23 smithi039 ceph-mon[30439]: pgmap v580: 97 pgs: 97 active+clean; 177 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 838 KiB/s rd, 3.2 MiB/s wr, 268 op/s 2024-05-09T05:44:23.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:44:23 smithi100 ceph-mon[34353]: pgmap v580: 97 pgs: 97 active+clean; 177 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 838 KiB/s rd, 3.2 MiB/s wr, 268 op/s 2024-05-09T05:44:24.647 INFO:tasks.workunit.client.0.smithi039.stdout: 1 512322 12.08 MB/sec execute 181 sec latency 16.300 ms 2024-05-09T05:44:25.647 INFO:tasks.workunit.client.0.smithi039.stdout: 1 515360 12.12 MB/sec execute 182 sec latency 10.878 ms 2024-05-09T05:44:25.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:44:25 smithi060 ceph-mon[34555]: pgmap v581: 97 pgs: 97 active+clean; 179 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 777 KiB/s rd, 3.0 MiB/s wr, 258 op/s 2024-05-09T05:44:25.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:44:25 smithi039 ceph-mon[30439]: pgmap v581: 97 pgs: 97 active+clean; 179 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 777 KiB/s rd, 3.0 MiB/s wr, 258 op/s 2024-05-09T05:44:25.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:44:25 smithi100 ceph-mon[34353]: pgmap v581: 97 pgs: 97 active+clean; 179 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 777 KiB/s rd, 3.0 MiB/s wr, 258 op/s 2024-05-09T05:44:26.647 INFO:tasks.workunit.client.0.smithi039.stdout: 1 516888 12.08 MB/sec execute 183 sec latency 58.720 ms 2024-05-09T05:44:27.647 INFO:tasks.workunit.client.0.smithi039.stdout: 1 519040 12.09 MB/sec execute 184 sec latency 99.859 ms 2024-05-09T05:44:27.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:44:27 smithi060 ceph-mon[34555]: pgmap v582: 97 pgs: 97 active+clean; 181 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 799 KiB/s rd, 3.1 MiB/s wr, 265 op/s 2024-05-09T05:44:27.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:44:27 smithi039 ceph-mon[30439]: pgmap v582: 97 pgs: 97 active+clean; 181 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 799 KiB/s rd, 3.1 MiB/s wr, 265 op/s 2024-05-09T05:44:27.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:44:27 smithi100 ceph-mon[34353]: pgmap v582: 97 pgs: 97 active+clean; 181 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 799 KiB/s rd, 3.1 MiB/s wr, 265 op/s 2024-05-09T05:44:28.647 INFO:tasks.workunit.client.0.smithi039.stdout: 1 522010 12.10 MB/sec execute 185 sec latency 16.582 ms 2024-05-09T05:44:29.647 INFO:tasks.workunit.client.0.smithi039.stdout: 1 524193 12.09 MB/sec execute 186 sec latency 19.509 ms 2024-05-09T05:44:29.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:44:29 smithi060 ceph-mon[34555]: pgmap v583: 97 pgs: 97 active+clean; 181 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 825 KiB/s rd, 3.2 MiB/s wr, 276 op/s 2024-05-09T05:44:29.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:44:29 smithi039 ceph-mon[30439]: pgmap v583: 97 pgs: 97 active+clean; 181 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 825 KiB/s rd, 3.2 MiB/s wr, 276 op/s 2024-05-09T05:44:29.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:44:29 smithi100 ceph-mon[34353]: pgmap v583: 97 pgs: 97 active+clean; 181 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 825 KiB/s rd, 3.2 MiB/s wr, 276 op/s 2024-05-09T05:44:30.647 INFO:tasks.workunit.client.0.smithi039.stdout: 1 526431 12.10 MB/sec execute 187 sec latency 15.481 ms 2024-05-09T05:44:31.647 INFO:tasks.workunit.client.0.smithi039.stdout: 1 529395 12.13 MB/sec execute 188 sec latency 20.956 ms 2024-05-09T05:44:31.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:44:31 smithi060 ceph-mon[34555]: pgmap v584: 97 pgs: 97 active+clean; 182 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 675 KiB/s rd, 2.8 MiB/s wr, 230 op/s 2024-05-09T05:44:31.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:44:31 smithi039 ceph-mon[30439]: pgmap v584: 97 pgs: 97 active+clean; 182 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 675 KiB/s rd, 2.8 MiB/s wr, 230 op/s 2024-05-09T05:44:31.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:44:31 smithi100 ceph-mon[34353]: pgmap v584: 97 pgs: 97 active+clean; 182 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 675 KiB/s rd, 2.8 MiB/s wr, 230 op/s 2024-05-09T05:44:32.647 INFO:tasks.workunit.client.0.smithi039.stdout: 1 530966 12.10 MB/sec execute 189 sec latency 67.047 ms 2024-05-09T05:44:33.647 INFO:tasks.workunit.client.0.smithi039.stdout: 1 533445 12.11 MB/sec execute 190 sec latency 16.718 ms 2024-05-09T05:44:33.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:44:33 smithi060 ceph-mon[34555]: pgmap v585: 97 pgs: 97 active+clean; 183 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 870 KiB/s rd, 3.1 MiB/s wr, 282 op/s 2024-05-09T05:44:33.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:44:33 smithi039 ceph-mon[30439]: pgmap v585: 97 pgs: 97 active+clean; 183 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 870 KiB/s rd, 3.1 MiB/s wr, 282 op/s 2024-05-09T05:44:33.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:44:33 smithi100 ceph-mon[34353]: pgmap v585: 97 pgs: 97 active+clean; 183 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 870 KiB/s rd, 3.1 MiB/s wr, 282 op/s 2024-05-09T05:44:34.647 INFO:tasks.workunit.client.0.smithi039.stdout: 1 536504 12.14 MB/sec execute 191 sec latency 22.615 ms 2024-05-09T05:44:35.647 INFO:tasks.workunit.client.0.smithi039.stdout: 1 538832 12.12 MB/sec execute 192 sec latency 20.923 ms 2024-05-09T05:44:35.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:44:35 smithi060 ceph-mon[34555]: pgmap v586: 97 pgs: 97 active+clean; 183 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 825 KiB/s rd, 3.2 MiB/s wr, 275 op/s 2024-05-09T05:44:35.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:44:35 smithi039 ceph-mon[30439]: pgmap v586: 97 pgs: 97 active+clean; 183 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 825 KiB/s rd, 3.2 MiB/s wr, 275 op/s 2024-05-09T05:44:35.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:44:35 smithi100 ceph-mon[34353]: pgmap v586: 97 pgs: 97 active+clean; 183 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 825 KiB/s rd, 3.2 MiB/s wr, 275 op/s 2024-05-09T05:44:36.647 INFO:tasks.workunit.client.0.smithi039.stdout: 1 540893 12.13 MB/sec execute 193 sec latency 17.611 ms 2024-05-09T05:44:37.647 INFO:tasks.workunit.client.0.smithi039.stdout: 1 543530 12.15 MB/sec execute 194 sec latency 45.737 ms 2024-05-09T05:44:37.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:44:37 smithi060 ceph-mon[34555]: pgmap v587: 97 pgs: 97 active+clean; 184 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 580 KiB/s rd, 3.0 MiB/s wr, 232 op/s 2024-05-09T05:44:37.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:44:37 smithi039 ceph-mon[30439]: pgmap v587: 97 pgs: 97 active+clean; 184 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 580 KiB/s rd, 3.0 MiB/s wr, 232 op/s 2024-05-09T05:44:37.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:44:37 smithi100 ceph-mon[34353]: pgmap v587: 97 pgs: 97 active+clean; 184 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 580 KiB/s rd, 3.0 MiB/s wr, 232 op/s 2024-05-09T05:44:38.647 INFO:tasks.workunit.client.0.smithi039.stdout: 1 545922 12.13 MB/sec execute 195 sec latency 20.039 ms 2024-05-09T05:44:39.647 INFO:tasks.workunit.client.0.smithi039.stdout: 1 547829 12.13 MB/sec execute 196 sec latency 16.398 ms 2024-05-09T05:44:39.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:44:39 smithi060 ceph-mon[34555]: pgmap v588: 97 pgs: 97 active+clean; 194 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 839 KiB/s rd, 4.0 MiB/s wr, 281 op/s 2024-05-09T05:44:39.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:44:39 smithi039 ceph-mon[30439]: pgmap v588: 97 pgs: 97 active+clean; 194 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 839 KiB/s rd, 4.0 MiB/s wr, 281 op/s 2024-05-09T05:44:39.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:44:39 smithi100 ceph-mon[34353]: pgmap v588: 97 pgs: 97 active+clean; 194 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 839 KiB/s rd, 4.0 MiB/s wr, 281 op/s 2024-05-09T05:44:40.647 INFO:tasks.workunit.client.0.smithi039.stdout: 1 550734 12.16 MB/sec execute 197 sec latency 12.183 ms 2024-05-09T05:44:41.647 INFO:tasks.workunit.client.0.smithi039.stdout: 1 553063 12.14 MB/sec execute 198 sec latency 16.500 ms 2024-05-09T05:44:41.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:44:41 smithi060 ceph-mon[34555]: pgmap v589: 97 pgs: 97 active+clean; 200 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 852 KiB/s rd, 4.3 MiB/s wr, 265 op/s 2024-05-09T05:44:41.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:44:41 smithi039 ceph-mon[30439]: pgmap v589: 97 pgs: 97 active+clean; 200 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 852 KiB/s rd, 4.3 MiB/s wr, 265 op/s 2024-05-09T05:44:41.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:44:41 smithi100 ceph-mon[34353]: pgmap v589: 97 pgs: 97 active+clean; 200 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 852 KiB/s rd, 4.3 MiB/s wr, 265 op/s 2024-05-09T05:44:42.647 INFO:tasks.workunit.client.0.smithi039.stdout: 1 554722 12.14 MB/sec execute 199 sec latency 64.320 ms 2024-05-09T05:44:43.647 INFO:tasks.workunit.client.0.smithi039.stdout: 1 557712 12.17 MB/sec execute 200 sec latency 13.154 ms 2024-05-09T05:44:43.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:44:43 smithi060 ceph-mon[34555]: pgmap v590: 97 pgs: 97 active+clean; 210 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 938 KiB/s rd, 5.0 MiB/s wr, 264 op/s 2024-05-09T05:44:43.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:44:43 smithi039 ceph-mon[30439]: pgmap v590: 97 pgs: 97 active+clean; 210 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 938 KiB/s rd, 5.0 MiB/s wr, 264 op/s 2024-05-09T05:44:43.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:44:43 smithi100 ceph-mon[34353]: pgmap v590: 97 pgs: 97 active+clean; 210 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 938 KiB/s rd, 5.0 MiB/s wr, 264 op/s 2024-05-09T05:44:44.647 INFO:tasks.workunit.client.0.smithi039.stdout: 1 560040 12.15 MB/sec execute 201 sec latency 17.040 ms 2024-05-09T05:44:45.647 INFO:tasks.workunit.client.0.smithi039.stdout: 1 562044 12.15 MB/sec execute 202 sec latency 16.421 ms 2024-05-09T05:44:45.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:44:45 smithi060 ceph-mon[34555]: pgmap v591: 97 pgs: 97 active+clean; 211 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 998 KiB/s rd, 4.7 MiB/s wr, 243 op/s 2024-05-09T05:44:45.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:44:45 smithi039 ceph-mon[30439]: pgmap v591: 97 pgs: 97 active+clean; 211 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 998 KiB/s rd, 4.7 MiB/s wr, 243 op/s 2024-05-09T05:44:45.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:44:45 smithi100 ceph-mon[34353]: pgmap v591: 97 pgs: 97 active+clean; 211 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 998 KiB/s rd, 4.7 MiB/s wr, 243 op/s 2024-05-09T05:44:46.647 INFO:tasks.workunit.client.0.smithi039.stdout: 1 565031 12.18 MB/sec execute 203 sec latency 13.483 ms 2024-05-09T05:44:47.648 INFO:tasks.workunit.client.0.smithi039.stdout: 1 567099 12.16 MB/sec execute 204 sec latency 58.575 ms 2024-05-09T05:44:47.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:44:47 smithi060 ceph-mon[34555]: pgmap v592: 97 pgs: 97 active+clean; 211 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.7 MiB/s wr, 243 op/s 2024-05-09T05:44:47.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:44:47 smithi039 ceph-mon[30439]: pgmap v592: 97 pgs: 97 active+clean; 211 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.7 MiB/s wr, 243 op/s 2024-05-09T05:44:47.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:44:47 smithi100 ceph-mon[34353]: pgmap v592: 97 pgs: 97 active+clean; 211 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.7 MiB/s wr, 243 op/s 2024-05-09T05:44:48.648 INFO:tasks.workunit.client.0.smithi039.stdout: 1 568908 12.16 MB/sec execute 205 sec latency 15.418 ms 2024-05-09T05:44:49.647 INFO:tasks.workunit.client.0.smithi039.stdout: 1 571717 12.17 MB/sec execute 206 sec latency 14.536 ms 2024-05-09T05:44:49.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:44:49 smithi060 ceph-mon[34555]: pgmap v593: 97 pgs: 97 active+clean; 214 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.2 MiB/s wr, 313 op/s 2024-05-09T05:44:49.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:44:49 smithi039 ceph-mon[30439]: pgmap v593: 97 pgs: 97 active+clean; 214 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.2 MiB/s wr, 313 op/s 2024-05-09T05:44:49.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:44:49 smithi100 ceph-mon[34353]: pgmap v593: 97 pgs: 97 active+clean; 214 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.2 MiB/s wr, 313 op/s 2024-05-09T05:44:50.648 INFO:tasks.workunit.client.0.smithi039.stdout: 1 573731 12.16 MB/sec execute 207 sec latency 18.104 ms 2024-05-09T05:44:51.647 INFO:tasks.workunit.client.0.smithi039.stdout: 1 575992 12.17 MB/sec execute 208 sec latency 28.245 ms 2024-05-09T05:44:51.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:44:51 smithi060 ceph-mon[34555]: pgmap v594: 97 pgs: 97 active+clean; 217 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.1 MiB/s wr, 262 op/s 2024-05-09T05:44:51.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:44:51 smithi039 ceph-mon[30439]: pgmap v594: 97 pgs: 97 active+clean; 217 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.1 MiB/s wr, 262 op/s 2024-05-09T05:44:51.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:44:51 smithi100 ceph-mon[34353]: pgmap v594: 97 pgs: 97 active+clean; 217 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.1 MiB/s wr, 262 op/s 2024-05-09T05:44:52.647 INFO:tasks.workunit.client.0.smithi039.stdout: 1 578364 12.17 MB/sec execute 209 sec latency 105.336 ms 2024-05-09T05:44:53.648 INFO:tasks.workunit.client.0.smithi039.stdout: 1 580156 12.15 MB/sec execute 210 sec latency 26.903 ms 2024-05-09T05:44:53.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:44:53 smithi060 ceph-mon[34555]: pgmap v595: 97 pgs: 97 active+clean; 217 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.0 MiB/s wr, 276 op/s 2024-05-09T05:44:53.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:44:53 smithi039 ceph-mon[30439]: pgmap v595: 97 pgs: 97 active+clean; 217 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.0 MiB/s wr, 276 op/s 2024-05-09T05:44:53.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:44:53 smithi100 ceph-mon[34353]: pgmap v595: 97 pgs: 97 active+clean; 217 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.0 MiB/s wr, 276 op/s 2024-05-09T05:44:54.648 INFO:tasks.workunit.client.0.smithi039.stdout: 1 582892 12.18 MB/sec execute 211 sec latency 20.808 ms 2024-05-09T05:44:55.648 INFO:tasks.workunit.client.0.smithi039.stdout: 1 585539 12.18 MB/sec execute 212 sec latency 17.188 ms 2024-05-09T05:44:55.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:44:55 smithi060 ceph-mon[34555]: pgmap v596: 97 pgs: 97 active+clean; 220 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.1 MiB/s wr, 259 op/s 2024-05-09T05:44:55.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:44:55 smithi039 ceph-mon[30439]: pgmap v596: 97 pgs: 97 active+clean; 220 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.1 MiB/s wr, 259 op/s 2024-05-09T05:44:55.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:44:55 smithi100 ceph-mon[34353]: pgmap v596: 97 pgs: 97 active+clean; 220 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.1 MiB/s wr, 259 op/s 2024-05-09T05:44:56.648 INFO:tasks.workunit.client.0.smithi039.stdout: 1 587140 12.16 MB/sec execute 213 sec latency 25.869 ms 2024-05-09T05:44:57.648 INFO:tasks.workunit.client.0.smithi039.stdout: 1 589582 12.18 MB/sec execute 214 sec latency 106.910 ms 2024-05-09T05:44:57.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:44:57 smithi060 ceph-mon[34555]: pgmap v597: 97 pgs: 97 active+clean; 221 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.4 MiB/s wr, 264 op/s 2024-05-09T05:44:57.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:44:57 smithi039 ceph-mon[30439]: pgmap v597: 97 pgs: 97 active+clean; 221 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.4 MiB/s wr, 264 op/s 2024-05-09T05:44:57.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:44:57 smithi100 ceph-mon[34353]: pgmap v597: 97 pgs: 97 active+clean; 221 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.4 MiB/s wr, 264 op/s 2024-05-09T05:44:58.648 INFO:tasks.workunit.client.0.smithi039.stdout: 1 591288 12.15 MB/sec execute 215 sec latency 17.029 ms 2024-05-09T05:44:59.648 INFO:tasks.workunit.client.0.smithi039.stdout: 1 593721 12.16 MB/sec execute 216 sec latency 13.098 ms 2024-05-09T05:44:59.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:44:59 smithi060 ceph-mon[34555]: pgmap v598: 97 pgs: 97 active+clean; 226 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.8 MiB/s wr, 325 op/s 2024-05-09T05:44:59.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:44:59 smithi039 ceph-mon[30439]: pgmap v598: 97 pgs: 97 active+clean; 226 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.8 MiB/s wr, 325 op/s 2024-05-09T05:44:59.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:44:59 smithi100 ceph-mon[34353]: pgmap v598: 97 pgs: 97 active+clean; 226 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.8 MiB/s wr, 325 op/s 2024-05-09T05:45:00.648 INFO:tasks.workunit.client.0.smithi039.stdout: 1 596692 12.18 MB/sec execute 217 sec latency 17.052 ms 2024-05-09T05:45:01.648 INFO:tasks.workunit.client.0.smithi039.stdout: 1 598971 12.16 MB/sec execute 218 sec latency 17.144 ms 2024-05-09T05:45:01.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:45:01 smithi060 ceph-mon[34555]: pgmap v599: 97 pgs: 97 active+clean; 226 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.1 MiB/s wr, 249 op/s 2024-05-09T05:45:01.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:45:01 smithi039 ceph-mon[30439]: pgmap v599: 97 pgs: 97 active+clean; 226 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.1 MiB/s wr, 249 op/s 2024-05-09T05:45:01.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:45:01 smithi100 ceph-mon[34353]: pgmap v599: 97 pgs: 97 active+clean; 226 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.1 MiB/s wr, 249 op/s 2024-05-09T05:45:02.648 INFO:tasks.workunit.client.0.smithi039.stdout: 1 600795 12.17 MB/sec execute 219 sec latency 95.070 ms 2024-05-09T05:45:03.648 INFO:tasks.workunit.client.0.smithi039.stdout: 1 603602 12.18 MB/sec execute 220 sec latency 16.664 ms 2024-05-09T05:45:03.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:45:03 smithi060 ceph-mon[34555]: pgmap v600: 97 pgs: 97 active+clean; 229 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.4 MiB/s wr, 260 op/s 2024-05-09T05:45:03.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:45:03 smithi039 ceph-mon[30439]: pgmap v600: 97 pgs: 97 active+clean; 229 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.4 MiB/s wr, 260 op/s 2024-05-09T05:45:03.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:45:03 smithi100 ceph-mon[34353]: pgmap v600: 97 pgs: 97 active+clean; 229 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.4 MiB/s wr, 260 op/s 2024-05-09T05:45:04.648 INFO:tasks.workunit.client.0.smithi039.stdout: 1 605441 12.17 MB/sec execute 221 sec latency 21.747 ms 2024-05-09T05:45:05.648 INFO:tasks.workunit.client.0.smithi039.stdout: 1 607902 12.18 MB/sec execute 222 sec latency 11.106 ms 2024-05-09T05:45:05.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:45:05 smithi060 ceph-mon[34555]: pgmap v601: 97 pgs: 97 active+clean; 228 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.2 MiB/s wr, 250 op/s 2024-05-09T05:45:05.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:45:05 smithi039 ceph-mon[30439]: pgmap v601: 97 pgs: 97 active+clean; 228 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.2 MiB/s wr, 250 op/s 2024-05-09T05:45:05.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:45:05 smithi100 ceph-mon[34353]: pgmap v601: 97 pgs: 97 active+clean; 228 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.2 MiB/s wr, 250 op/s 2024-05-09T05:45:06.648 INFO:tasks.workunit.client.0.smithi039.stdout: 1 610606 12.19 MB/sec execute 223 sec latency 25.341 ms 2024-05-09T05:45:07.648 INFO:tasks.workunit.client.0.smithi039.stdout: 1 612030 12.16 MB/sec execute 224 sec latency 65.187 ms 2024-05-09T05:45:07.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:45:07 smithi039 ceph-mon[30439]: pgmap v602: 97 pgs: 97 active+clean; 230 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.5 MiB/s wr, 275 op/s 2024-05-09T05:45:07.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:45:07 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:45:07.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:45:07 smithi100 ceph-mon[34353]: pgmap v602: 97 pgs: 97 active+clean; 230 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.5 MiB/s wr, 275 op/s 2024-05-09T05:45:07.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:45:07 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:45:08.045 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:45:07 smithi060 ceph-mon[34555]: pgmap v602: 97 pgs: 97 active+clean; 230 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.5 MiB/s wr, 275 op/s 2024-05-09T05:45:08.045 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:45:07 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:45:08.648 INFO:tasks.workunit.client.0.smithi039.stdout: 1 614714 12.18 MB/sec execute 225 sec latency 31.986 ms 2024-05-09T05:45:08.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:45:08 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:45:08.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:45:08 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:45:08.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:45:08 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:45:08.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:45:08 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:45:08.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:45:08 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:45:08.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:45:08 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:45:09.045 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:45:08 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:45:09.046 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:45:08 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:45:09.046 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:45:08 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:45:09.648 INFO:tasks.workunit.client.0.smithi039.stdout: 1 617310 12.18 MB/sec execute 226 sec latency 13.841 ms 2024-05-09T05:45:09.823 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:45:09 smithi100 ceph-mon[34353]: pgmap v603: 97 pgs: 97 active+clean; 235 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.8 MiB/s wr, 285 op/s 2024-05-09T05:45:09.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:45:09 smithi039 ceph-mon[30439]: pgmap v603: 97 pgs: 97 active+clean; 235 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.8 MiB/s wr, 285 op/s 2024-05-09T05:45:10.045 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:45:09 smithi060 ceph-mon[34555]: pgmap v603: 97 pgs: 97 active+clean; 235 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.8 MiB/s wr, 285 op/s 2024-05-09T05:45:10.648 INFO:tasks.workunit.client.0.smithi039.stdout: 1 619104 12.17 MB/sec execute 227 sec latency 36.325 ms 2024-05-09T05:45:11.648 INFO:tasks.workunit.client.0.smithi039.stdout: 1 621687 12.18 MB/sec execute 228 sec latency 123.740 ms 2024-05-09T05:45:11.847 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:45:11 smithi060 ceph-mon[34555]: pgmap v604: 97 pgs: 97 active+clean; 235 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.1 MiB/s wr, 218 op/s 2024-05-09T05:45:11.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:45:11 smithi039 ceph-mon[30439]: pgmap v604: 97 pgs: 97 active+clean; 235 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.1 MiB/s wr, 218 op/s 2024-05-09T05:45:11.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:45:11 smithi100 ceph-mon[34353]: pgmap v604: 97 pgs: 97 active+clean; 235 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.1 MiB/s wr, 218 op/s 2024-05-09T05:45:12.649 INFO:tasks.workunit.client.0.smithi039.stdout: 1 623861 12.17 MB/sec execute 229 sec latency 19.208 ms 2024-05-09T05:45:13.648 INFO:tasks.workunit.client.0.smithi039.stdout: 1 625633 12.17 MB/sec execute 230 sec latency 51.950 ms 2024-05-09T05:45:13.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:45:13 smithi039 ceph-mon[30439]: pgmap v605: 97 pgs: 97 active+clean; 238 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.6 MiB/s wr, 284 op/s 2024-05-09T05:45:13.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:45:13 smithi100 ceph-mon[34353]: pgmap v605: 97 pgs: 97 active+clean; 238 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.6 MiB/s wr, 284 op/s 2024-05-09T05:45:14.045 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:45:13 smithi060 ceph-mon[34555]: pgmap v605: 97 pgs: 97 active+clean; 238 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.6 MiB/s wr, 284 op/s 2024-05-09T05:45:14.649 INFO:tasks.workunit.client.0.smithi039.stdout: 1 628444 12.18 MB/sec execute 231 sec latency 13.491 ms 2024-05-09T05:45:15.648 INFO:tasks.workunit.client.0.smithi039.stdout: 1 630393 12.17 MB/sec execute 232 sec latency 16.850 ms 2024-05-09T05:45:15.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:45:15 smithi039 ceph-mon[30439]: pgmap v606: 97 pgs: 97 active+clean; 234 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.2 MiB/s wr, 241 op/s 2024-05-09T05:45:15.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:45:15 smithi100 ceph-mon[34353]: pgmap v606: 97 pgs: 97 active+clean; 234 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.2 MiB/s wr, 241 op/s 2024-05-09T05:45:16.045 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:45:15 smithi060 ceph-mon[34555]: pgmap v606: 97 pgs: 97 active+clean; 234 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.2 MiB/s wr, 241 op/s 2024-05-09T05:45:16.649 INFO:tasks.workunit.client.0.smithi039.stdout: 1 632669 12.17 MB/sec execute 233 sec latency 12.483 ms 2024-05-09T05:45:17.648 INFO:tasks.workunit.client.0.smithi039.stdout: 1 635527 12.18 MB/sec execute 234 sec latency 24.851 ms 2024-05-09T05:45:17.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:45:17 smithi039 ceph-mon[30439]: pgmap v607: 97 pgs: 97 active+clean; 238 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.6 MiB/s wr, 298 op/s 2024-05-09T05:45:17.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:45:17 smithi100 ceph-mon[34353]: pgmap v607: 97 pgs: 97 active+clean; 238 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.6 MiB/s wr, 298 op/s 2024-05-09T05:45:18.045 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:45:17 smithi060 ceph-mon[34555]: pgmap v607: 97 pgs: 97 active+clean; 238 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.6 MiB/s wr, 298 op/s 2024-05-09T05:45:18.649 INFO:tasks.workunit.client.0.smithi039.stdout: 1 636876 12.16 MB/sec execute 235 sec latency 68.417 ms 2024-05-09T05:45:19.649 INFO:tasks.workunit.client.0.smithi039.stdout: 1 639630 12.18 MB/sec execute 236 sec latency 15.176 ms 2024-05-09T05:45:19.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:45:19 smithi039 ceph-mon[30439]: pgmap v608: 97 pgs: 97 active+clean; 240 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.5 MiB/s wr, 295 op/s 2024-05-09T05:45:19.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:45:19 smithi100 ceph-mon[34353]: pgmap v608: 97 pgs: 97 active+clean; 240 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.5 MiB/s wr, 295 op/s 2024-05-09T05:45:20.045 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:45:19 smithi060 ceph-mon[34555]: pgmap v608: 97 pgs: 97 active+clean; 240 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.5 MiB/s wr, 295 op/s 2024-05-09T05:45:20.649 INFO:tasks.workunit.client.0.smithi039.stdout: 1 642186 12.18 MB/sec execute 237 sec latency 17.662 ms 2024-05-09T05:45:21.649 INFO:tasks.workunit.client.0.smithi039.stdout: 1 643984 12.17 MB/sec execute 238 sec latency 25.121 ms 2024-05-09T05:45:21.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:45:21 smithi039 ceph-mon[30439]: pgmap v609: 97 pgs: 97 active+clean; 239 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.9 MiB/s wr, 252 op/s 2024-05-09T05:45:21.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:45:21 smithi100 ceph-mon[34353]: pgmap v609: 97 pgs: 97 active+clean; 239 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.9 MiB/s wr, 252 op/s 2024-05-09T05:45:22.045 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:45:21 smithi060 ceph-mon[34555]: pgmap v609: 97 pgs: 97 active+clean; 239 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.9 MiB/s wr, 252 op/s 2024-05-09T05:45:22.649 INFO:tasks.workunit.client.0.smithi039.stdout: 1 646712 12.19 MB/sec execute 239 sec latency 13.265 ms 2024-05-09T05:45:23.649 INFO:tasks.workunit.client.0.smithi039.stdout: 1 648759 12.17 MB/sec execute 240 sec latency 58.048 ms 2024-05-09T05:45:23.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:45:23 smithi039 ceph-mon[30439]: pgmap v610: 97 pgs: 97 active+clean; 240 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.0 MiB/s wr, 273 op/s 2024-05-09T05:45:23.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:45:23 smithi100 ceph-mon[34353]: pgmap v610: 97 pgs: 97 active+clean; 240 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.0 MiB/s wr, 273 op/s 2024-05-09T05:45:24.045 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:45:23 smithi060 ceph-mon[34555]: pgmap v610: 97 pgs: 97 active+clean; 240 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.0 MiB/s wr, 273 op/s 2024-05-09T05:45:24.649 INFO:tasks.workunit.client.0.smithi039.stdout: 1 650650 12.17 MB/sec execute 241 sec latency 17.051 ms 2024-05-09T05:45:25.649 INFO:tasks.workunit.client.0.smithi039.stdout: 1 653577 12.19 MB/sec execute 242 sec latency 11.362 ms 2024-05-09T05:45:25.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:45:25 smithi039 ceph-mon[30439]: pgmap v611: 97 pgs: 97 active+clean; 244 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.1 MiB/s wr, 272 op/s 2024-05-09T05:45:25.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:45:25 smithi100 ceph-mon[34353]: pgmap v611: 97 pgs: 97 active+clean; 244 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.1 MiB/s wr, 272 op/s 2024-05-09T05:45:26.045 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:45:25 smithi060 ceph-mon[34555]: pgmap v611: 97 pgs: 97 active+clean; 244 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.1 MiB/s wr, 272 op/s 2024-05-09T05:45:26.649 INFO:tasks.workunit.client.0.smithi039.stdout: 1 655434 12.17 MB/sec execute 243 sec latency 27.463 ms 2024-05-09T05:45:27.649 INFO:tasks.workunit.client.0.smithi039.stdout: 1 657644 12.17 MB/sec execute 244 sec latency 18.031 ms 2024-05-09T05:45:27.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:45:27 smithi039 ceph-mon[30439]: pgmap v612: 97 pgs: 97 active+clean; 243 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.1 MiB/s wr, 271 op/s 2024-05-09T05:45:27.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:45:27 smithi100 ceph-mon[34353]: pgmap v612: 97 pgs: 97 active+clean; 243 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.1 MiB/s wr, 271 op/s 2024-05-09T05:45:28.045 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:45:27 smithi060 ceph-mon[34555]: pgmap v612: 97 pgs: 97 active+clean; 243 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.1 MiB/s wr, 271 op/s 2024-05-09T05:45:28.649 INFO:tasks.workunit.client.0.smithi039.stdout: 1 660169 12.18 MB/sec execute 245 sec latency 49.901 ms 2024-05-09T05:45:29.649 INFO:tasks.workunit.client.0.smithi039.stdout: 1 661983 12.17 MB/sec execute 246 sec latency 17.513 ms 2024-05-09T05:45:29.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:45:29 smithi039 ceph-mon[30439]: pgmap v613: 97 pgs: 97 active+clean; 244 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.1 MiB/s wr, 229 op/s 2024-05-09T05:45:29.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:45:29 smithi100 ceph-mon[34353]: pgmap v613: 97 pgs: 97 active+clean; 244 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.1 MiB/s wr, 229 op/s 2024-05-09T05:45:30.045 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:45:29 smithi060 ceph-mon[34555]: pgmap v613: 97 pgs: 97 active+clean; 244 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.1 MiB/s wr, 229 op/s 2024-05-09T05:45:30.649 INFO:tasks.workunit.client.0.smithi039.stdout: 1 664476 12.18 MB/sec execute 247 sec latency 17.689 ms 2024-05-09T05:45:31.649 INFO:tasks.workunit.client.0.smithi039.stdout: 1 667051 12.18 MB/sec execute 248 sec latency 17.064 ms 2024-05-09T05:45:31.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:45:31 smithi039 ceph-mon[30439]: pgmap v614: 97 pgs: 97 active+clean; 249 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.3 MiB/s wr, 265 op/s 2024-05-09T05:45:31.926 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:45:31 smithi100 ceph-mon[34353]: pgmap v614: 97 pgs: 97 active+clean; 249 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.3 MiB/s wr, 265 op/s 2024-05-09T05:45:32.045 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:45:31 smithi060 ceph-mon[34555]: pgmap v614: 97 pgs: 97 active+clean; 249 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.3 MiB/s wr, 265 op/s 2024-05-09T05:45:32.649 INFO:tasks.workunit.client.0.smithi039.stdout: 1 668829 12.17 MB/sec execute 249 sec latency 37.100 ms 2024-05-09T05:45:33.649 INFO:tasks.workunit.client.0.smithi039.stdout: 1 671375 12.19 MB/sec execute 250 sec latency 69.448 ms 2024-05-09T05:45:33.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:45:33 smithi039 ceph-mon[30439]: pgmap v615: 97 pgs: 97 active+clean; 249 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.3 MiB/s wr, 273 op/s 2024-05-09T05:45:33.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:45:33 smithi100 ceph-mon[34353]: pgmap v615: 97 pgs: 97 active+clean; 249 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.3 MiB/s wr, 273 op/s 2024-05-09T05:45:34.045 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:45:33 smithi060 ceph-mon[34555]: pgmap v615: 97 pgs: 97 active+clean; 249 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.3 MiB/s wr, 273 op/s 2024-05-09T05:45:34.649 INFO:tasks.workunit.client.0.smithi039.stdout: 1 673719 12.17 MB/sec execute 251 sec latency 25.237 ms 2024-05-09T05:45:35.649 INFO:tasks.workunit.client.0.smithi039.stdout: 1 675556 12.17 MB/sec execute 252 sec latency 18.019 ms 2024-05-09T05:45:35.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:45:35 smithi039 ceph-mon[30439]: pgmap v616: 97 pgs: 97 active+clean; 248 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.3 MiB/s wr, 260 op/s 2024-05-09T05:45:35.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:45:35 smithi100 ceph-mon[34353]: pgmap v616: 97 pgs: 97 active+clean; 248 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.3 MiB/s wr, 260 op/s 2024-05-09T05:45:36.045 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:45:35 smithi060 ceph-mon[34555]: pgmap v616: 97 pgs: 97 active+clean; 248 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.3 MiB/s wr, 260 op/s 2024-05-09T05:45:36.650 INFO:tasks.workunit.client.0.smithi039.stdout: 1 678450 12.19 MB/sec execute 253 sec latency 16.307 ms 2024-05-09T05:45:37.649 INFO:tasks.workunit.client.0.smithi039.stdout: 1 680712 12.17 MB/sec execute 254 sec latency 16.501 ms 2024-05-09T05:45:37.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:45:37 smithi039 ceph-mon[30439]: pgmap v617: 97 pgs: 97 active+clean; 251 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.1 MiB/s wr, 244 op/s 2024-05-09T05:45:37.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:45:37 smithi100 ceph-mon[34353]: pgmap v617: 97 pgs: 97 active+clean; 251 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.1 MiB/s wr, 244 op/s 2024-05-09T05:45:38.045 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:45:37 smithi060 ceph-mon[34555]: pgmap v617: 97 pgs: 97 active+clean; 251 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.1 MiB/s wr, 244 op/s 2024-05-09T05:45:38.650 INFO:tasks.workunit.client.0.smithi039.stdout: 1 682303 12.17 MB/sec execute 255 sec latency 72.231 ms 2024-05-09T05:45:39.649 INFO:tasks.workunit.client.0.smithi039.stdout: 1 684867 12.18 MB/sec execute 256 sec latency 14.977 ms 2024-05-09T05:45:39.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:45:39 smithi039 ceph-mon[30439]: pgmap v618: 97 pgs: 97 active+clean; 252 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.4 MiB/s wr, 282 op/s 2024-05-09T05:45:39.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:45:39 smithi100 ceph-mon[34353]: pgmap v618: 97 pgs: 97 active+clean; 252 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.4 MiB/s wr, 282 op/s 2024-05-09T05:45:40.045 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:45:39 smithi060 ceph-mon[34555]: pgmap v618: 97 pgs: 97 active+clean; 252 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.4 MiB/s wr, 282 op/s 2024-05-09T05:45:40.650 INFO:tasks.workunit.client.0.smithi039.stdout: 1 686577 12.16 MB/sec execute 257 sec latency 41.939 ms 2024-05-09T05:45:41.650 INFO:tasks.workunit.client.0.smithi039.stdout: 1 689340 12.18 MB/sec execute 258 sec latency 14.249 ms 2024-05-09T05:45:41.847 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:45:41 smithi060 ceph-mon[34555]: pgmap v619: 97 pgs: 97 active+clean; 252 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.0 MiB/s wr, 262 op/s 2024-05-09T05:45:41.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:45:41 smithi039 ceph-mon[30439]: pgmap v619: 97 pgs: 97 active+clean; 252 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.0 MiB/s wr, 262 op/s 2024-05-09T05:45:41.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:45:41 smithi100 ceph-mon[34353]: pgmap v619: 97 pgs: 97 active+clean; 252 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.0 MiB/s wr, 262 op/s 2024-05-09T05:45:42.650 INFO:tasks.workunit.client.0.smithi039.stdout: 1 692156 12.19 MB/sec execute 259 sec latency 18.034 ms 2024-05-09T05:45:43.650 INFO:tasks.workunit.client.0.smithi039.stdout: 1 693550 12.17 MB/sec execute 260 sec latency 119.648 ms 2024-05-09T05:45:43.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:45:43 smithi039 ceph-mon[30439]: pgmap v620: 97 pgs: 97 active+clean; 255 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.9 MiB/s wr, 251 op/s 2024-05-09T05:45:43.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:45:43 smithi100 ceph-mon[34353]: pgmap v620: 97 pgs: 97 active+clean; 255 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.9 MiB/s wr, 251 op/s 2024-05-09T05:45:44.045 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:45:43 smithi060 ceph-mon[34555]: pgmap v620: 97 pgs: 97 active+clean; 255 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.9 MiB/s wr, 251 op/s 2024-05-09T05:45:44.650 INFO:tasks.workunit.client.0.smithi039.stdout: 1 696317 12.19 MB/sec execute 261 sec latency 27.828 ms 2024-05-09T05:45:45.650 INFO:tasks.workunit.client.0.smithi039.stdout: 1 698963 12.19 MB/sec execute 262 sec latency 17.267 ms 2024-05-09T05:45:45.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:45:45 smithi039 ceph-mon[30439]: pgmap v621: 97 pgs: 97 active+clean; 256 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.2 MiB/s wr, 271 op/s 2024-05-09T05:45:45.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:45:45 smithi100 ceph-mon[34353]: pgmap v621: 97 pgs: 97 active+clean; 256 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.2 MiB/s wr, 271 op/s 2024-05-09T05:45:46.045 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:45:45 smithi060 ceph-mon[34555]: pgmap v621: 97 pgs: 97 active+clean; 256 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.2 MiB/s wr, 271 op/s 2024-05-09T05:45:46.650 INFO:tasks.workunit.client.0.smithi039.stdout: 1 700628 12.17 MB/sec execute 263 sec latency 25.661 ms 2024-05-09T05:45:47.650 INFO:tasks.workunit.client.0.smithi039.stdout: 1 703390 12.19 MB/sec execute 264 sec latency 13.737 ms 2024-05-09T05:45:47.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:45:47 smithi039 ceph-mon[30439]: pgmap v622: 97 pgs: 97 active+clean; 256 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.2 MiB/s wr, 268 op/s 2024-05-09T05:45:47.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:45:47 smithi100 ceph-mon[34353]: pgmap v622: 97 pgs: 97 active+clean; 256 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.2 MiB/s wr, 268 op/s 2024-05-09T05:45:48.045 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:45:47 smithi060 ceph-mon[34555]: pgmap v622: 97 pgs: 97 active+clean; 256 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.2 MiB/s wr, 268 op/s 2024-05-09T05:45:48.650 INFO:tasks.workunit.client.0.smithi039.stdout: 1 705171 12.17 MB/sec execute 265 sec latency 89.555 ms 2024-05-09T05:45:49.650 INFO:tasks.workunit.client.0.smithi039.stdout: 1 707226 12.17 MB/sec execute 266 sec latency 14.661 ms 2024-05-09T05:45:49.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:45:49 smithi039 ceph-mon[30439]: pgmap v623: 97 pgs: 97 active+clean; 259 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.4 MiB/s wr, 278 op/s 2024-05-09T05:45:49.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:45:49 smithi100 ceph-mon[34353]: pgmap v623: 97 pgs: 97 active+clean; 259 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.4 MiB/s wr, 278 op/s 2024-05-09T05:45:50.045 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:45:49 smithi060 ceph-mon[34555]: pgmap v623: 97 pgs: 97 active+clean; 259 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.4 MiB/s wr, 278 op/s 2024-05-09T05:45:50.650 INFO:tasks.workunit.client.0.smithi039.stdout: 1 710029 12.18 MB/sec execute 267 sec latency 20.935 ms 2024-05-09T05:45:51.650 INFO:tasks.workunit.client.0.smithi039.stdout: 1 711719 12.17 MB/sec execute 268 sec latency 22.474 ms 2024-05-09T05:45:51.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:45:51 smithi039 ceph-mon[30439]: pgmap v624: 97 pgs: 97 active+clean; 262 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.3 MiB/s wr, 273 op/s 2024-05-09T05:45:51.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:45:51 smithi100 ceph-mon[34353]: pgmap v624: 97 pgs: 97 active+clean; 262 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.3 MiB/s wr, 273 op/s 2024-05-09T05:45:52.045 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:45:51 smithi060 ceph-mon[34555]: pgmap v624: 97 pgs: 97 active+clean; 262 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.3 MiB/s wr, 273 op/s 2024-05-09T05:45:52.650 INFO:tasks.workunit.client.0.smithi039.stdout: 1 714159 12.18 MB/sec execute 269 sec latency 8.863 ms 2024-05-09T05:45:53.650 INFO:tasks.workunit.client.0.smithi039.stdout: 1 716361 12.17 MB/sec execute 270 sec latency 59.303 ms 2024-05-09T05:45:53.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:45:53 smithi039 ceph-mon[30439]: pgmap v625: 97 pgs: 97 active+clean; 263 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.4 MiB/s wr, 289 op/s 2024-05-09T05:45:53.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:45:53 smithi100 ceph-mon[34353]: pgmap v625: 97 pgs: 97 active+clean; 263 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.4 MiB/s wr, 289 op/s 2024-05-09T05:45:54.045 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:45:53 smithi060 ceph-mon[34555]: pgmap v625: 97 pgs: 97 active+clean; 263 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.4 MiB/s wr, 289 op/s 2024-05-09T05:45:54.650 INFO:tasks.workunit.client.0.smithi039.stdout: 1 718058 12.16 MB/sec execute 271 sec latency 118.471 ms 2024-05-09T05:45:55.650 INFO:tasks.workunit.client.0.smithi039.stdout: 1 720967 12.18 MB/sec execute 272 sec latency 11.971 ms 2024-05-09T05:45:55.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:45:55 smithi100 ceph-mon[34353]: pgmap v626: 97 pgs: 97 active+clean; 262 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.0 MiB/s wr, 235 op/s 2024-05-09T05:45:55.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:45:55 smithi100 ceph-mon[34353]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-09T05:45:56.045 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:45:55 smithi060 ceph-mon[34555]: pgmap v626: 97 pgs: 97 active+clean; 262 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.0 MiB/s wr, 235 op/s 2024-05-09T05:45:56.045 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:45:55 smithi060 ceph-mon[34555]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-09T05:45:56.109 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:45:55 smithi039 ceph-mon[30439]: pgmap v626: 97 pgs: 97 active+clean; 262 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.0 MiB/s wr, 235 op/s 2024-05-09T05:45:56.109 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:45:55 smithi039 ceph-mon[30439]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-09T05:45:56.650 INFO:tasks.workunit.client.0.smithi039.stdout: 1 723058 12.16 MB/sec execute 273 sec latency 18.231 ms 2024-05-09T05:45:57.650 INFO:tasks.workunit.client.0.smithi039.stdout: 1 724883 12.17 MB/sec execute 274 sec latency 14.763 ms 2024-05-09T05:45:57.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:45:57 smithi100 ceph-mon[34353]: pgmap v627: 97 pgs: 97 active+clean; 266 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.1 MiB/s wr, 261 op/s 2024-05-09T05:45:58.045 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:45:57 smithi060 ceph-mon[34555]: pgmap v627: 97 pgs: 97 active+clean; 266 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.1 MiB/s wr, 261 op/s 2024-05-09T05:45:58.109 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:45:57 smithi039 ceph-mon[30439]: pgmap v627: 97 pgs: 97 active+clean; 266 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.1 MiB/s wr, 261 op/s 2024-05-09T05:45:58.650 INFO:tasks.workunit.client.0.smithi039.stdout: 1 727414 12.17 MB/sec execute 275 sec latency 25.793 ms 2024-05-09T05:45:59.650 INFO:tasks.workunit.client.0.smithi039.stdout: 1 728736 12.15 MB/sec execute 276 sec latency 57.499 ms 2024-05-09T05:45:59.911 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:45:59 smithi039 ceph-mon[30439]: pgmap v628: 97 pgs: 97 active+clean; 265 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.3 MiB/s wr, 278 op/s 2024-05-09T05:45:59.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:45:59 smithi100 ceph-mon[34353]: pgmap v628: 97 pgs: 97 active+clean; 265 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.3 MiB/s wr, 278 op/s 2024-05-09T05:46:00.045 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:45:59 smithi060 ceph-mon[34555]: pgmap v628: 97 pgs: 97 active+clean; 265 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.3 MiB/s wr, 278 op/s 2024-05-09T05:46:00.651 INFO:tasks.workunit.client.0.smithi039.stdout: 1 731631 12.17 MB/sec execute 277 sec latency 17.447 ms 2024-05-09T05:46:01.650 INFO:tasks.workunit.client.0.smithi039.stdout: 1 733831 12.15 MB/sec execute 278 sec latency 16.559 ms 2024-05-09T05:46:01.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:46:01 smithi100 ceph-mon[34353]: pgmap v629: 97 pgs: 97 active+clean; 269 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.1 MiB/s wr, 260 op/s 2024-05-09T05:46:02.045 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:46:01 smithi060 ceph-mon[34555]: pgmap v629: 97 pgs: 97 active+clean; 269 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.1 MiB/s wr, 260 op/s 2024-05-09T05:46:02.109 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:46:01 smithi039 ceph-mon[30439]: pgmap v629: 97 pgs: 97 active+clean; 269 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.1 MiB/s wr, 260 op/s 2024-05-09T05:46:02.650 INFO:tasks.workunit.client.0.smithi039.stdout: 1 735572 12.16 MB/sec execute 279 sec latency 75.435 ms 2024-05-09T05:46:03.651 INFO:tasks.workunit.client.0.smithi039.stdout: 1 738211 12.16 MB/sec execute 280 sec latency 16.121 ms 2024-05-09T05:46:03.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:46:03 smithi100 ceph-mon[34353]: pgmap v630: 97 pgs: 97 active+clean; 269 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.0 MiB/s wr, 231 op/s 2024-05-09T05:46:04.045 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:46:03 smithi060 ceph-mon[34555]: pgmap v630: 97 pgs: 97 active+clean; 269 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.0 MiB/s wr, 231 op/s 2024-05-09T05:46:04.109 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:46:03 smithi039 ceph-mon[30439]: pgmap v630: 97 pgs: 97 active+clean; 269 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.0 MiB/s wr, 231 op/s 2024-05-09T05:46:04.651 INFO:tasks.workunit.client.0.smithi039.stdout: 1 739565 12.14 MB/sec execute 281 sec latency 55.286 ms 2024-05-09T05:46:05.651 INFO:tasks.workunit.client.0.smithi039.stdout: 1 742339 12.16 MB/sec execute 282 sec latency 12.756 ms 2024-05-09T05:46:05.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:46:05 smithi100 ceph-mon[34353]: pgmap v631: 97 pgs: 97 active+clean; 270 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.1 MiB/s wr, 263 op/s 2024-05-09T05:46:06.045 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:46:05 smithi060 ceph-mon[34555]: pgmap v631: 97 pgs: 97 active+clean; 270 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.1 MiB/s wr, 263 op/s 2024-05-09T05:46:06.109 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:46:05 smithi039 ceph-mon[30439]: pgmap v631: 97 pgs: 97 active+clean; 270 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.1 MiB/s wr, 263 op/s 2024-05-09T05:46:06.651 INFO:tasks.workunit.client.0.smithi039.stdout: 1 744046 12.14 MB/sec execute 283 sec latency 27.381 ms 2024-05-09T05:46:07.651 INFO:tasks.workunit.client.0.smithi039.stdout: 1 746174 12.14 MB/sec execute 284 sec latency 39.173 ms 2024-05-09T05:46:07.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:46:07 smithi100 ceph-mon[34353]: pgmap v632: 97 pgs: 97 active+clean; 270 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.2 MiB/s wr, 263 op/s 2024-05-09T05:46:08.045 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:46:07 smithi060 ceph-mon[34555]: pgmap v632: 97 pgs: 97 active+clean; 270 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.2 MiB/s wr, 263 op/s 2024-05-09T05:46:08.109 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:46:07 smithi039 ceph-mon[30439]: pgmap v632: 97 pgs: 97 active+clean; 270 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.2 MiB/s wr, 263 op/s 2024-05-09T05:46:08.651 INFO:tasks.workunit.client.0.smithi039.stdout: 1 748884 12.15 MB/sec execute 285 sec latency 17.379 ms 2024-05-09T05:46:08.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:46:08 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:46:09.045 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:46:08 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:46:09.109 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:46:08 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:46:09.651 INFO:tasks.workunit.client.0.smithi039.stdout: 1 750020 12.13 MB/sec execute 286 sec latency 73.928 ms 2024-05-09T05:46:09.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:46:09 smithi100 ceph-mon[34353]: pgmap v633: 97 pgs: 97 active+clean; 274 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.4 MiB/s wr, 275 op/s 2024-05-09T05:46:09.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:46:09 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:46:09.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:46:09 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:46:09.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:46:09 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:46:10.045 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:46:09 smithi060 ceph-mon[34555]: pgmap v633: 97 pgs: 97 active+clean; 274 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.4 MiB/s wr, 275 op/s 2024-05-09T05:46:10.045 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:46:09 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:46:10.045 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:46:09 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:46:10.045 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:46:09 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:46:10.109 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:46:09 smithi039 ceph-mon[30439]: pgmap v633: 97 pgs: 97 active+clean; 274 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.4 MiB/s wr, 275 op/s 2024-05-09T05:46:10.109 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:46:09 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:46:10.109 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:46:09 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:46:10.109 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:46:09 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:46:10.651 INFO:tasks.workunit.client.0.smithi039.stdout: 1 752835 12.14 MB/sec execute 287 sec latency 78.013 ms 2024-05-09T05:46:11.651 INFO:tasks.workunit.client.0.smithi039.stdout: 1 754736 12.13 MB/sec execute 288 sec latency 17.413 ms 2024-05-09T05:46:11.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:46:11 smithi100 ceph-mon[34353]: pgmap v634: 97 pgs: 97 active+clean; 274 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.0 MiB/s wr, 254 op/s 2024-05-09T05:46:12.045 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:46:11 smithi060 ceph-mon[34555]: pgmap v634: 97 pgs: 97 active+clean; 274 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.0 MiB/s wr, 254 op/s 2024-05-09T05:46:12.109 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:46:11 smithi039 ceph-mon[30439]: pgmap v634: 97 pgs: 97 active+clean; 274 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.0 MiB/s wr, 254 op/s 2024-05-09T05:46:12.651 INFO:tasks.workunit.client.0.smithi039.stdout: 1 756795 12.13 MB/sec execute 289 sec latency 17.802 ms 2024-05-09T05:46:13.651 INFO:tasks.workunit.client.0.smithi039.stdout: 1 759675 12.14 MB/sec execute 290 sec latency 21.795 ms 2024-05-09T05:46:13.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:46:13 smithi100 ceph-mon[34353]: pgmap v635: 97 pgs: 97 active+clean; 274 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.0 MiB/s wr, 221 op/s 2024-05-09T05:46:14.045 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:46:13 smithi060 ceph-mon[34555]: pgmap v635: 97 pgs: 97 active+clean; 274 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.0 MiB/s wr, 221 op/s 2024-05-09T05:46:14.109 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:46:13 smithi039 ceph-mon[30439]: pgmap v635: 97 pgs: 97 active+clean; 274 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.0 MiB/s wr, 221 op/s 2024-05-09T05:46:14.651 INFO:tasks.workunit.client.0.smithi039.stdout: 1 761049 12.12 MB/sec execute 291 sec latency 77.317 ms 2024-05-09T05:46:15.651 INFO:tasks.workunit.client.0.smithi039.stdout: 1 763807 12.14 MB/sec execute 292 sec latency 12.597 ms 2024-05-09T05:46:15.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:46:15 smithi100 ceph-mon[34353]: pgmap v636: 97 pgs: 97 active+clean; 277 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.1 MiB/s wr, 265 op/s 2024-05-09T05:46:16.045 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:46:15 smithi060 ceph-mon[34555]: pgmap v636: 97 pgs: 97 active+clean; 277 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.1 MiB/s wr, 265 op/s 2024-05-09T05:46:16.109 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:46:15 smithi039 ceph-mon[30439]: pgmap v636: 97 pgs: 97 active+clean; 277 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.1 MiB/s wr, 265 op/s 2024-05-09T05:46:16.651 INFO:tasks.workunit.client.0.smithi039.stdout: 1 766390 12.14 MB/sec execute 293 sec latency 17.921 ms 2024-05-09T05:46:17.651 INFO:tasks.workunit.client.0.smithi039.stdout: 1 768254 12.13 MB/sec execute 294 sec latency 16.332 ms 2024-05-09T05:46:17.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:46:17 smithi100 ceph-mon[34353]: pgmap v637: 97 pgs: 97 active+clean; 280 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.0 MiB/s wr, 262 op/s 2024-05-09T05:46:18.045 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:46:17 smithi060 ceph-mon[34555]: pgmap v637: 97 pgs: 97 active+clean; 280 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.0 MiB/s wr, 262 op/s 2024-05-09T05:46:18.109 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:46:17 smithi039 ceph-mon[30439]: pgmap v637: 97 pgs: 97 active+clean; 280 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.0 MiB/s wr, 262 op/s 2024-05-09T05:46:18.651 INFO:tasks.workunit.client.0.smithi039.stdout: 1 770875 12.14 MB/sec execute 295 sec latency 17.399 ms 2024-05-09T05:46:19.651 INFO:tasks.workunit.client.0.smithi039.stdout: 1 772937 12.13 MB/sec execute 296 sec latency 102.435 ms 2024-05-09T05:46:19.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:46:19 smithi100 ceph-mon[34353]: pgmap v638: 97 pgs: 97 active+clean; 280 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.3 MiB/s wr, 278 op/s 2024-05-09T05:46:20.045 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:46:19 smithi060 ceph-mon[34555]: pgmap v638: 97 pgs: 97 active+clean; 280 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.3 MiB/s wr, 278 op/s 2024-05-09T05:46:20.109 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:46:19 smithi039 ceph-mon[30439]: pgmap v638: 97 pgs: 97 active+clean; 280 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.3 MiB/s wr, 278 op/s 2024-05-09T05:46:20.651 INFO:tasks.workunit.client.0.smithi039.stdout: 1 774737 12.13 MB/sec execute 297 sec latency 16.606 ms 2024-05-09T05:46:21.651 INFO:tasks.workunit.client.0.smithi039.stdout: 1 777559 12.14 MB/sec execute 298 sec latency 25.226 ms 2024-05-09T05:46:21.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:46:21 smithi100 ceph-mon[34353]: pgmap v639: 97 pgs: 97 active+clean; 280 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.9 MiB/s wr, 208 op/s 2024-05-09T05:46:22.045 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:46:21 smithi060 ceph-mon[34555]: pgmap v639: 97 pgs: 97 active+clean; 280 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.9 MiB/s wr, 208 op/s 2024-05-09T05:46:22.109 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:46:21 smithi039 ceph-mon[30439]: pgmap v639: 97 pgs: 97 active+clean; 280 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.9 MiB/s wr, 208 op/s 2024-05-09T05:46:22.651 INFO:tasks.workunit.client.0.smithi039.stdout: 1 779365 12.13 MB/sec execute 299 sec latency 16.932 ms 2024-05-09T05:46:23.652 INFO:tasks.workunit.client.0.smithi039.stdout: 1 781691 12.13 MB/sec execute 300 sec latency 12.456 ms 2024-05-09T05:46:23.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:46:23 smithi100 ceph-mon[34353]: pgmap v640: 97 pgs: 97 active+clean; 281 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.2 MiB/s wr, 238 op/s 2024-05-09T05:46:24.045 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:46:23 smithi060 ceph-mon[34555]: pgmap v640: 97 pgs: 97 active+clean; 281 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.2 MiB/s wr, 238 op/s 2024-05-09T05:46:24.109 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:46:23 smithi039 ceph-mon[30439]: pgmap v640: 97 pgs: 97 active+clean; 281 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.2 MiB/s wr, 238 op/s 2024-05-09T05:46:24.651 INFO:tasks.workunit.client.0.smithi039.stdout: 1 783912 12.13 MB/sec execute 301 sec latency 42.247 ms 2024-05-09T05:46:25.651 INFO:tasks.workunit.client.0.smithi039.stdout: 1 785741 12.12 MB/sec execute 302 sec latency 24.907 ms 2024-05-09T05:46:25.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:46:25 smithi100 ceph-mon[34353]: pgmap v641: 97 pgs: 97 active+clean; 284 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.4 MiB/s wr, 291 op/s 2024-05-09T05:46:26.045 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:46:25 smithi060 ceph-mon[34555]: pgmap v641: 97 pgs: 97 active+clean; 284 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.4 MiB/s wr, 291 op/s 2024-05-09T05:46:26.109 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:46:25 smithi039 ceph-mon[30439]: pgmap v641: 97 pgs: 97 active+clean; 284 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.4 MiB/s wr, 291 op/s 2024-05-09T05:46:26.651 INFO:tasks.workunit.client.0.smithi039.stdout: 1 788482 12.14 MB/sec execute 303 sec latency 12.656 ms 2024-05-09T05:46:27.652 INFO:tasks.workunit.client.0.smithi039.stdout: 1 790685 12.12 MB/sec execute 304 sec latency 22.786 ms 2024-05-09T05:46:27.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:46:27 smithi100 ceph-mon[34353]: pgmap v642: 97 pgs: 97 active+clean; 284 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.2 MiB/s wr, 246 op/s 2024-05-09T05:46:28.045 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:46:27 smithi060 ceph-mon[34555]: pgmap v642: 97 pgs: 97 active+clean; 284 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.2 MiB/s wr, 246 op/s 2024-05-09T05:46:28.109 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:46:27 smithi039 ceph-mon[30439]: pgmap v642: 97 pgs: 97 active+clean; 284 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.2 MiB/s wr, 246 op/s 2024-05-09T05:46:28.652 INFO:tasks.workunit.client.0.smithi039.stdout: 1 792496 12.12 MB/sec execute 305 sec latency 25.328 ms 2024-05-09T05:46:29.652 INFO:tasks.workunit.client.0.smithi039.stdout: 1 795120 12.13 MB/sec execute 306 sec latency 49.812 ms 2024-05-09T05:46:29.914 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:46:29 smithi039 ceph-mon[30439]: pgmap v643: 97 pgs: 97 active+clean; 286 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.3 MiB/s wr, 233 op/s 2024-05-09T05:46:29.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:46:29 smithi100 ceph-mon[34353]: pgmap v643: 97 pgs: 97 active+clean; 286 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.3 MiB/s wr, 233 op/s 2024-05-09T05:46:30.045 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:46:29 smithi060 ceph-mon[34555]: pgmap v643: 97 pgs: 97 active+clean; 286 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.3 MiB/s wr, 233 op/s 2024-05-09T05:46:30.652 INFO:tasks.workunit.client.0.smithi039.stdout: 1 796747 12.12 MB/sec execute 307 sec latency 25.775 ms 2024-05-09T05:46:31.652 INFO:tasks.workunit.client.0.smithi039.stdout: 1 799269 12.13 MB/sec execute 308 sec latency 12.997 ms 2024-05-09T05:46:31.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:46:31 smithi100 ceph-mon[34353]: pgmap v644: 97 pgs: 97 active+clean; 288 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.1 MiB/s wr, 259 op/s 2024-05-09T05:46:32.045 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:46:31 smithi060 ceph-mon[34555]: pgmap v644: 97 pgs: 97 active+clean; 288 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.1 MiB/s wr, 259 op/s 2024-05-09T05:46:32.109 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:46:31 smithi039 ceph-mon[30439]: pgmap v644: 97 pgs: 97 active+clean; 288 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.1 MiB/s wr, 259 op/s 2024-05-09T05:46:32.652 INFO:tasks.workunit.client.0.smithi039.stdout: 1 801779 12.13 MB/sec execute 309 sec latency 20.817 ms 2024-05-09T05:46:33.652 INFO:tasks.workunit.client.0.smithi039.stdout: 1 803355 12.11 MB/sec execute 310 sec latency 17.501 ms 2024-05-09T05:46:33.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:46:33 smithi100 ceph-mon[34353]: pgmap v645: 97 pgs: 97 active+clean; 289 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.2 MiB/s wr, 269 op/s 2024-05-09T05:46:34.045 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:46:33 smithi060 ceph-mon[34555]: pgmap v645: 97 pgs: 97 active+clean; 289 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.2 MiB/s wr, 269 op/s 2024-05-09T05:46:34.109 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:46:33 smithi039 ceph-mon[30439]: pgmap v645: 97 pgs: 97 active+clean; 289 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.2 MiB/s wr, 269 op/s 2024-05-09T05:46:34.652 INFO:tasks.workunit.client.0.smithi039.stdout: 1 806043 12.13 MB/sec execute 311 sec latency 71.879 ms 2024-05-09T05:46:35.652 INFO:tasks.workunit.client.0.smithi039.stdout: 1 807460 12.11 MB/sec execute 312 sec latency 110.713 ms 2024-05-09T05:46:35.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:46:35 smithi100 ceph-mon[34353]: pgmap v646: 97 pgs: 97 active+clean; 292 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.3 MiB/s wr, 303 op/s 2024-05-09T05:46:36.045 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:46:35 smithi060 ceph-mon[34555]: pgmap v646: 97 pgs: 97 active+clean; 292 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.3 MiB/s wr, 303 op/s 2024-05-09T05:46:36.109 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:46:35 smithi039 ceph-mon[30439]: pgmap v646: 97 pgs: 97 active+clean; 292 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.3 MiB/s wr, 303 op/s 2024-05-09T05:46:36.652 INFO:tasks.workunit.client.0.smithi039.stdout: 1 809886 12.12 MB/sec execute 313 sec latency 12.891 ms 2024-05-09T05:46:37.652 INFO:tasks.workunit.client.0.smithi039.stdout: 1 812280 12.11 MB/sec execute 314 sec latency 21.975 ms 2024-05-09T05:46:38.045 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:46:37 smithi060 ceph-mon[34555]: pgmap v647: 97 pgs: 97 active+clean; 297 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.1 MiB/s wr, 244 op/s 2024-05-09T05:46:38.109 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:46:37 smithi039 ceph-mon[30439]: pgmap v647: 97 pgs: 97 active+clean; 297 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.1 MiB/s wr, 244 op/s 2024-05-09T05:46:38.173 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:46:37 smithi100 ceph-mon[34353]: pgmap v647: 97 pgs: 97 active+clean; 297 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.1 MiB/s wr, 244 op/s 2024-05-09T05:46:38.652 INFO:tasks.workunit.client.0.smithi039.stdout: 1 814024 12.10 MB/sec execute 315 sec latency 24.775 ms 2024-05-09T05:46:39.652 INFO:tasks.workunit.client.0.smithi039.stdout: 1 816886 12.12 MB/sec execute 316 sec latency 9.197 ms 2024-05-09T05:46:39.974 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:46:39 smithi100 ceph-mon[34353]: pgmap v648: 97 pgs: 97 active+clean; 297 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.2 MiB/s wr, 257 op/s 2024-05-09T05:46:40.045 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:46:39 smithi060 ceph-mon[34555]: pgmap v648: 97 pgs: 97 active+clean; 297 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.2 MiB/s wr, 257 op/s 2024-05-09T05:46:40.109 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:46:39 smithi039 ceph-mon[30439]: pgmap v648: 97 pgs: 97 active+clean; 297 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.2 MiB/s wr, 257 op/s 2024-05-09T05:46:40.652 INFO:tasks.workunit.client.0.smithi039.stdout: 1 819035 12.11 MB/sec execute 317 sec latency 51.772 ms 2024-05-09T05:46:41.652 INFO:tasks.workunit.client.0.smithi039.stdout: 1 820916 12.11 MB/sec execute 318 sec latency 23.372 ms 2024-05-09T05:46:42.045 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:46:41 smithi060 ceph-mon[34555]: pgmap v649: 97 pgs: 97 active+clean; 297 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.9 MiB/s wr, 257 op/s 2024-05-09T05:46:42.109 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:46:41 smithi039 ceph-mon[30439]: pgmap v649: 97 pgs: 97 active+clean; 297 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.9 MiB/s wr, 257 op/s 2024-05-09T05:46:42.173 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:46:41 smithi100 ceph-mon[34353]: pgmap v649: 97 pgs: 97 active+clean; 297 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.9 MiB/s wr, 257 op/s 2024-05-09T05:46:42.652 INFO:tasks.workunit.client.0.smithi039.stdout: 1 823848 12.13 MB/sec execute 319 sec latency 24.023 ms 2024-05-09T05:46:43.045 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:46:42 smithi060 ceph-mon[34555]: pgmap v650: 97 pgs: 97 active+clean; 300 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.0 MiB/s wr, 247 op/s 2024-05-09T05:46:43.109 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:46:42 smithi039 ceph-mon[30439]: pgmap v650: 97 pgs: 97 active+clean; 300 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.0 MiB/s wr, 247 op/s 2024-05-09T05:46:43.172 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:46:42 smithi100 ceph-mon[34353]: pgmap v650: 97 pgs: 97 active+clean; 300 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.0 MiB/s wr, 247 op/s 2024-05-09T05:46:43.652 INFO:tasks.workunit.client.0.smithi039.stdout: 1 826113 12.11 MB/sec execute 320 sec latency 40.052 ms 2024-05-09T05:46:44.654 INFO:tasks.workunit.client.0.smithi039.stdout: 1 827949 12.11 MB/sec execute 321 sec latency 103.495 ms 2024-05-09T05:46:45.652 INFO:tasks.workunit.client.0.smithi039.stdout: 1 830762 12.13 MB/sec execute 322 sec latency 57.134 ms 2024-05-09T05:46:45.672 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:46:45 smithi100 ceph-mon[34353]: pgmap v651: 97 pgs: 97 active+clean; 300 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.9 MiB/s wr, 250 op/s 2024-05-09T05:46:45.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:46:45 smithi060 ceph-mon[34555]: pgmap v651: 97 pgs: 97 active+clean; 300 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.9 MiB/s wr, 250 op/s 2024-05-09T05:46:45.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:46:45 smithi039 ceph-mon[30439]: pgmap v651: 97 pgs: 97 active+clean; 300 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.9 MiB/s wr, 250 op/s 2024-05-09T05:46:46.653 INFO:tasks.workunit.client.0.smithi039.stdout: 1 832344 12.11 MB/sec execute 323 sec latency 16.225 ms 2024-05-09T05:46:47.653 INFO:tasks.workunit.client.0.smithi039.stdout: 1 834796 12.12 MB/sec execute 324 sec latency 12.382 ms 2024-05-09T05:46:47.672 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:46:47 smithi100 ceph-mon[34353]: pgmap v652: 97 pgs: 97 active+clean; 300 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.7 MiB/s wr, 224 op/s 2024-05-09T05:46:47.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:46:47 smithi060 ceph-mon[34555]: pgmap v652: 97 pgs: 97 active+clean; 300 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.7 MiB/s wr, 224 op/s 2024-05-09T05:46:47.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:46:47 smithi039 ceph-mon[30439]: pgmap v652: 97 pgs: 97 active+clean; 300 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.7 MiB/s wr, 224 op/s 2024-05-09T05:46:48.653 INFO:tasks.workunit.client.0.smithi039.stdout: 1 837379 12.12 MB/sec execute 325 sec latency 54.827 ms 2024-05-09T05:46:49.653 INFO:tasks.workunit.client.0.smithi039.stdout: 1 839400 12.12 MB/sec execute 326 sec latency 17.362 ms 2024-05-09T05:46:49.673 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:46:49 smithi100 ceph-mon[34353]: pgmap v653: 97 pgs: 97 active+clean; 303 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.3 MiB/s wr, 291 op/s 2024-05-09T05:46:49.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:46:49 smithi060 ceph-mon[34555]: pgmap v653: 97 pgs: 97 active+clean; 303 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.3 MiB/s wr, 291 op/s 2024-05-09T05:46:49.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:46:49 smithi039 ceph-mon[30439]: pgmap v653: 97 pgs: 97 active+clean; 303 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.3 MiB/s wr, 291 op/s 2024-05-09T05:46:50.653 INFO:tasks.workunit.client.0.smithi039.stdout: 1 841735 12.12 MB/sec execute 327 sec latency 60.662 ms 2024-05-09T05:46:51.653 INFO:tasks.workunit.client.0.smithi039.stdout: 1 844080 12.11 MB/sec execute 328 sec latency 18.837 ms 2024-05-09T05:46:51.672 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:46:51 smithi100 ceph-mon[34353]: pgmap v654: 97 pgs: 97 active+clean; 304 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.0 MiB/s wr, 270 op/s 2024-05-09T05:46:51.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:46:51 smithi060 ceph-mon[34555]: pgmap v654: 97 pgs: 97 active+clean; 304 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.0 MiB/s wr, 270 op/s 2024-05-09T05:46:51.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:46:51 smithi039 ceph-mon[30439]: pgmap v654: 97 pgs: 97 active+clean; 304 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.0 MiB/s wr, 270 op/s 2024-05-09T05:46:52.653 INFO:tasks.workunit.client.0.smithi039.stdout: 1 845957 12.11 MB/sec execute 329 sec latency 18.519 ms 2024-05-09T05:46:53.653 INFO:tasks.workunit.client.0.smithi039.stdout: 1 848803 12.13 MB/sec execute 330 sec latency 19.103 ms 2024-05-09T05:46:53.672 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:46:53 smithi100 ceph-mon[34353]: pgmap v655: 97 pgs: 97 active+clean; 306 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.1 MiB/s wr, 269 op/s 2024-05-09T05:46:53.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:46:53 smithi060 ceph-mon[34555]: pgmap v655: 97 pgs: 97 active+clean; 306 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.1 MiB/s wr, 269 op/s 2024-05-09T05:46:53.858 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:46:53 smithi039 ceph-mon[30439]: pgmap v655: 97 pgs: 97 active+clean; 306 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.1 MiB/s wr, 269 op/s 2024-05-09T05:46:54.653 INFO:tasks.workunit.client.0.smithi039.stdout: 1 850655 12.11 MB/sec execute 331 sec latency 38.281 ms 2024-05-09T05:46:55.653 INFO:tasks.workunit.client.0.smithi039.stdout: 1 852585 12.12 MB/sec execute 332 sec latency 40.780 ms 2024-05-09T05:46:55.672 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:46:55 smithi100 ceph-mon[34353]: pgmap v656: 97 pgs: 97 active+clean; 307 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.1 MiB/s wr, 255 op/s 2024-05-09T05:46:55.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:46:55 smithi060 ceph-mon[34555]: pgmap v656: 97 pgs: 97 active+clean; 307 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.1 MiB/s wr, 255 op/s 2024-05-09T05:46:55.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:46:55 smithi039 ceph-mon[30439]: pgmap v656: 97 pgs: 97 active+clean; 307 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.1 MiB/s wr, 255 op/s 2024-05-09T05:46:56.653 INFO:tasks.workunit.client.0.smithi039.stdout: 1 855306 12.12 MB/sec execute 333 sec latency 15.502 ms 2024-05-09T05:46:57.653 INFO:tasks.workunit.client.0.smithi039.stdout: 1 857106 12.12 MB/sec execute 334 sec latency 17.010 ms 2024-05-09T05:46:57.672 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:46:57 smithi100 ceph-mon[34353]: pgmap v657: 97 pgs: 97 active+clean; 307 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.1 MiB/s wr, 254 op/s 2024-05-09T05:46:57.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:46:57 smithi060 ceph-mon[34555]: pgmap v657: 97 pgs: 97 active+clean; 307 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.1 MiB/s wr, 254 op/s 2024-05-09T05:46:57.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:46:57 smithi039 ceph-mon[30439]: pgmap v657: 97 pgs: 97 active+clean; 307 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.1 MiB/s wr, 254 op/s 2024-05-09T05:46:58.653 INFO:tasks.workunit.client.0.smithi039.stdout: 1 859569 12.12 MB/sec execute 335 sec latency 22.897 ms 2024-05-09T05:46:59.653 INFO:tasks.workunit.client.0.smithi039.stdout: 1 861962 12.12 MB/sec execute 336 sec latency 22.576 ms 2024-05-09T05:46:59.672 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:46:59 smithi100 ceph-mon[34353]: pgmap v658: 97 pgs: 97 active+clean; 311 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.7 MiB/s wr, 296 op/s 2024-05-09T05:46:59.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:46:59 smithi060 ceph-mon[34555]: pgmap v658: 97 pgs: 97 active+clean; 311 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.7 MiB/s wr, 296 op/s 2024-05-09T05:46:59.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:46:59 smithi039 ceph-mon[30439]: pgmap v658: 97 pgs: 97 active+clean; 311 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.7 MiB/s wr, 296 op/s 2024-05-09T05:47:00.653 INFO:tasks.workunit.client.0.smithi039.stdout: 1 863346 12.11 MB/sec execute 337 sec latency 75.283 ms 2024-05-09T05:47:01.653 INFO:tasks.workunit.client.0.smithi039.stdout: 1 866005 12.11 MB/sec execute 338 sec latency 45.209 ms 2024-05-09T05:47:01.672 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:47:01 smithi100 ceph-mon[34353]: pgmap v659: 97 pgs: 97 active+clean; 311 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.9 MiB/s wr, 229 op/s 2024-05-09T05:47:01.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:47:01 smithi060 ceph-mon[34555]: pgmap v659: 97 pgs: 97 active+clean; 311 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.9 MiB/s wr, 229 op/s 2024-05-09T05:47:01.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:47:01 smithi039 ceph-mon[30439]: pgmap v659: 97 pgs: 97 active+clean; 311 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.9 MiB/s wr, 229 op/s 2024-05-09T05:47:02.653 INFO:tasks.workunit.client.0.smithi039.stdout: 1 867678 12.11 MB/sec execute 339 sec latency 18.288 ms 2024-05-09T05:47:03.653 INFO:tasks.workunit.client.0.smithi039.stdout: 1 870277 12.11 MB/sec execute 340 sec latency 12.889 ms 2024-05-09T05:47:03.672 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:47:03 smithi100 ceph-mon[34353]: pgmap v660: 97 pgs: 97 active+clean; 312 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.0 MiB/s wr, 243 op/s 2024-05-09T05:47:03.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:47:03 smithi060 ceph-mon[34555]: pgmap v660: 97 pgs: 97 active+clean; 312 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.0 MiB/s wr, 243 op/s 2024-05-09T05:47:03.858 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:47:03 smithi039 ceph-mon[30439]: pgmap v660: 97 pgs: 97 active+clean; 312 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.0 MiB/s wr, 243 op/s 2024-05-09T05:47:04.653 INFO:tasks.workunit.client.0.smithi039.stdout: 1 873198 12.12 MB/sec execute 341 sec latency 19.066 ms 2024-05-09T05:47:05.653 INFO:tasks.workunit.client.0.smithi039.stdout: 1 874659 12.10 MB/sec execute 342 sec latency 135.302 ms 2024-05-09T05:47:05.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:47:05 smithi060 ceph-mon[34555]: pgmap v661: 97 pgs: 97 active+clean; 314 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.2 MiB/s wr, 251 op/s 2024-05-09T05:47:05.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:47:05 smithi039 ceph-mon[30439]: pgmap v661: 97 pgs: 97 active+clean; 314 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.2 MiB/s wr, 251 op/s 2024-05-09T05:47:05.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:47:05 smithi100 ceph-mon[34353]: pgmap v661: 97 pgs: 97 active+clean; 314 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.2 MiB/s wr, 251 op/s 2024-05-09T05:47:06.653 INFO:tasks.workunit.client.0.smithi039.stdout: 1 877179 12.12 MB/sec execute 343 sec latency 22.870 ms 2024-05-09T05:47:07.653 INFO:tasks.workunit.client.0.smithi039.stdout: 1 879395 12.10 MB/sec execute 344 sec latency 17.271 ms 2024-05-09T05:47:07.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:47:07 smithi060 ceph-mon[34555]: pgmap v662: 97 pgs: 97 active+clean; 316 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.1 MiB/s wr, 273 op/s 2024-05-09T05:47:07.858 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:47:07 smithi039 ceph-mon[30439]: pgmap v662: 97 pgs: 97 active+clean; 316 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.1 MiB/s wr, 273 op/s 2024-05-09T05:47:07.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:47:07 smithi100 ceph-mon[34353]: pgmap v662: 97 pgs: 97 active+clean; 316 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.1 MiB/s wr, 273 op/s 2024-05-09T05:47:08.654 INFO:tasks.workunit.client.0.smithi039.stdout: 1 881261 12.10 MB/sec execute 345 sec latency 16.544 ms 2024-05-09T05:47:09.653 INFO:tasks.workunit.client.0.smithi039.stdout: 1 883963 12.12 MB/sec execute 346 sec latency 44.812 ms 2024-05-09T05:47:09.724 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:47:09 smithi100 ceph-mon[34353]: pgmap v663: 97 pgs: 97 active+clean; 308 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.2 MiB/s wr, 272 op/s 2024-05-09T05:47:09.724 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:47:09 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:47:09.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:47:09 smithi060 ceph-mon[34555]: pgmap v663: 97 pgs: 97 active+clean; 308 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.2 MiB/s wr, 272 op/s 2024-05-09T05:47:09.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:47:09 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:47:09.858 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:47:09 smithi039 ceph-mon[30439]: pgmap v663: 97 pgs: 97 active+clean; 308 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.2 MiB/s wr, 272 op/s 2024-05-09T05:47:09.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:47:09 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:47:10.654 INFO:tasks.workunit.client.0.smithi039.stdout: 1 885229 12.09 MB/sec execute 347 sec latency 71.187 ms 2024-05-09T05:47:11.653 INFO:tasks.workunit.client.0.smithi039.stdout: 1 887722 12.10 MB/sec execute 348 sec latency 34.413 ms 2024-05-09T05:47:11.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:47:11 smithi060 ceph-mon[34555]: pgmap v664: 97 pgs: 97 active+clean; 300 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.6 MiB/s wr, 191 op/s 2024-05-09T05:47:11.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:47:11 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:47:11.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:47:11 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:47:11.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:47:11 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:47:11.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:47:11 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:47:11.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:47:11 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:47:11.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:47:11 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:47:11.858 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:47:11 smithi039 ceph-mon[30439]: pgmap v664: 97 pgs: 97 active+clean; 300 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.6 MiB/s wr, 191 op/s 2024-05-09T05:47:11.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:47:11 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:47:11.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:47:11 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:47:11.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:47:11 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:47:11.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:47:11 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:47:11.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:47:11 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:47:11.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:47:11 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:47:11.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:47:11 smithi100 ceph-mon[34353]: pgmap v664: 97 pgs: 97 active+clean; 300 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.6 MiB/s wr, 191 op/s 2024-05-09T05:47:11.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:47:11 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:47:11.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:47:11 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:47:11.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:47:11 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:47:11.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:47:11 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:47:11.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:47:11 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:47:11.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:47:11 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:47:12.653 INFO:tasks.workunit.client.0.smithi039.stdout: 1 889759 12.09 MB/sec execute 349 sec latency 26.389 ms 2024-05-09T05:47:12.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:47:12 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:47:12.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:47:12 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:47:12.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:47:12 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:47:12.858 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:47:12 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:47:12.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:47:12 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:47:12.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:47:12 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:47:12.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:47:12 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:47:12.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:47:12 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:47:12.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:47:12 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:47:13.654 INFO:tasks.workunit.client.0.smithi039.stdout: 1 891681 12.09 MB/sec execute 350 sec latency 18.583 ms 2024-05-09T05:47:13.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:47:13 smithi060 ceph-mon[34555]: pgmap v665: 97 pgs: 97 active+clean; 296 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.9 MiB/s wr, 237 op/s 2024-05-09T05:47:13.858 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:47:13 smithi039 ceph-mon[30439]: pgmap v665: 97 pgs: 97 active+clean; 296 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.9 MiB/s wr, 237 op/s 2024-05-09T05:47:13.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:47:13 smithi100 ceph-mon[34353]: pgmap v665: 97 pgs: 97 active+clean; 296 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.9 MiB/s wr, 237 op/s 2024-05-09T05:47:14.654 INFO:tasks.workunit.client.0.smithi039.stdout: 1 894484 12.10 MB/sec execute 351 sec latency 22.974 ms 2024-05-09T05:47:15.653 INFO:tasks.workunit.client.0.smithi039.stdout: 1 895908 12.08 MB/sec execute 352 sec latency 71.412 ms 2024-05-09T05:47:15.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:47:15 smithi060 ceph-mon[34555]: pgmap v666: 97 pgs: 97 active+clean; 298 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.1 MiB/s wr, 274 op/s 2024-05-09T05:47:15.858 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:47:15 smithi039 ceph-mon[30439]: pgmap v666: 97 pgs: 97 active+clean; 298 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.1 MiB/s wr, 274 op/s 2024-05-09T05:47:15.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:47:15 smithi100 ceph-mon[34353]: pgmap v666: 97 pgs: 97 active+clean; 298 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.1 MiB/s wr, 274 op/s 2024-05-09T05:47:16.654 INFO:tasks.workunit.client.0.smithi039.stdout: 1 898471 12.10 MB/sec execute 353 sec latency 27.020 ms 2024-05-09T05:47:17.654 INFO:tasks.workunit.client.0.smithi039.stdout: 1 900781 12.09 MB/sec execute 354 sec latency 22.237 ms 2024-05-09T05:47:17.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:47:17 smithi060 ceph-mon[34555]: pgmap v667: 97 pgs: 97 active+clean; 297 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.8 MiB/s wr, 247 op/s 2024-05-09T05:47:17.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:47:17 smithi039 ceph-mon[30439]: pgmap v667: 97 pgs: 97 active+clean; 297 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.8 MiB/s wr, 247 op/s 2024-05-09T05:47:17.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:47:17 smithi100 ceph-mon[34353]: pgmap v667: 97 pgs: 97 active+clean; 297 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.8 MiB/s wr, 247 op/s 2024-05-09T05:47:18.654 INFO:tasks.workunit.client.0.smithi039.stdout: 1 902662 12.09 MB/sec execute 355 sec latency 17.713 ms 2024-05-09T05:47:19.654 INFO:tasks.workunit.client.0.smithi039.stdout: 1 905535 12.10 MB/sec execute 356 sec latency 16.293 ms 2024-05-09T05:47:19.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:47:19 smithi060 ceph-mon[34555]: pgmap v668: 97 pgs: 97 active+clean; 299 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.4 MiB/s wr, 236 op/s 2024-05-09T05:47:19.858 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:47:19 smithi039 ceph-mon[30439]: pgmap v668: 97 pgs: 97 active+clean; 299 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.4 MiB/s wr, 236 op/s 2024-05-09T05:47:19.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:47:19 smithi100 ceph-mon[34353]: pgmap v668: 97 pgs: 97 active+clean; 299 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.4 MiB/s wr, 236 op/s 2024-05-09T05:47:20.654 INFO:tasks.workunit.client.0.smithi039.stdout: 1 907886 12.09 MB/sec execute 357 sec latency 28.092 ms 2024-05-09T05:47:21.654 INFO:tasks.workunit.client.0.smithi039.stdout: 1 909629 12.09 MB/sec execute 358 sec latency 115.117 ms 2024-05-09T05:47:21.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:47:21 smithi060 ceph-mon[34555]: pgmap v669: 97 pgs: 97 active+clean; 302 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.3 MiB/s wr, 278 op/s 2024-05-09T05:47:21.858 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:47:21 smithi039 ceph-mon[30439]: pgmap v669: 97 pgs: 97 active+clean; 302 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.3 MiB/s wr, 278 op/s 2024-05-09T05:47:21.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:47:21 smithi100 ceph-mon[34353]: pgmap v669: 97 pgs: 97 active+clean; 302 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.3 MiB/s wr, 278 op/s 2024-05-09T05:47:22.654 INFO:tasks.workunit.client.0.smithi039.stdout: 1 912455 12.11 MB/sec execute 359 sec latency 19.282 ms 2024-05-09T05:47:23.654 INFO:tasks.workunit.client.0.smithi039.stdout: 1 914583 12.09 MB/sec execute 360 sec latency 16.939 ms 2024-05-09T05:47:23.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:47:23 smithi060 ceph-mon[34555]: pgmap v670: 97 pgs: 97 active+clean; 305 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.4 MiB/s wr, 294 op/s 2024-05-09T05:47:23.858 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:47:23 smithi039 ceph-mon[30439]: pgmap v670: 97 pgs: 97 active+clean; 305 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.4 MiB/s wr, 294 op/s 2024-05-09T05:47:23.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:47:23 smithi100 ceph-mon[34353]: pgmap v670: 97 pgs: 97 active+clean; 305 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.4 MiB/s wr, 294 op/s 2024-05-09T05:47:24.654 INFO:tasks.workunit.client.0.smithi039.stdout: 1 916651 12.10 MB/sec execute 361 sec latency 17.770 ms 2024-05-09T05:47:25.654 INFO:tasks.workunit.client.0.smithi039.stdout: 1 919070 12.14 MB/sec execute 362 sec latency 56.289 ms 2024-05-09T05:47:25.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:47:25 smithi060 ceph-mon[34555]: pgmap v671: 97 pgs: 97 active+clean; 306 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.3 MiB/s wr, 254 op/s 2024-05-09T05:47:25.858 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:47:25 smithi039 ceph-mon[30439]: pgmap v671: 97 pgs: 97 active+clean; 306 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.3 MiB/s wr, 254 op/s 2024-05-09T05:47:25.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:47:25 smithi100 ceph-mon[34353]: pgmap v671: 97 pgs: 97 active+clean; 306 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.3 MiB/s wr, 254 op/s 2024-05-09T05:47:26.654 INFO:tasks.workunit.client.0.smithi039.stdout: 1 920811 12.14 MB/sec execute 363 sec latency 50.705 ms 2024-05-09T05:47:27.654 INFO:tasks.workunit.client.0.smithi039.stdout: 1 923734 12.15 MB/sec execute 364 sec latency 35.572 ms 2024-05-09T05:47:27.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:47:27 smithi060 ceph-mon[34555]: pgmap v672: 97 pgs: 97 active+clean; 306 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.1 MiB/s wr, 228 op/s 2024-05-09T05:47:27.858 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:47:27 smithi039 ceph-mon[30439]: pgmap v672: 97 pgs: 97 active+clean; 306 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.1 MiB/s wr, 228 op/s 2024-05-09T05:47:27.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:47:27 smithi100 ceph-mon[34353]: pgmap v672: 97 pgs: 97 active+clean; 306 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.1 MiB/s wr, 228 op/s 2024-05-09T05:47:28.654 INFO:tasks.workunit.client.0.smithi039.stdout: 1 925651 12.14 MB/sec execute 365 sec latency 17.421 ms 2024-05-09T05:47:29.654 INFO:tasks.workunit.client.0.smithi039.stdout: 1 927956 12.14 MB/sec execute 366 sec latency 14.502 ms 2024-05-09T05:47:29.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:47:29 smithi060 ceph-mon[34555]: pgmap v673: 97 pgs: 97 active+clean; 303 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.7 MiB/s wr, 295 op/s 2024-05-09T05:47:29.858 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:47:29 smithi039 ceph-mon[30439]: pgmap v673: 97 pgs: 97 active+clean; 303 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.7 MiB/s wr, 295 op/s 2024-05-09T05:47:29.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:47:29 smithi100 ceph-mon[34353]: pgmap v673: 97 pgs: 97 active+clean; 303 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.7 MiB/s wr, 295 op/s 2024-05-09T05:47:30.654 INFO:tasks.workunit.client.0.smithi039.stdout: 1 930702 12.15 MB/sec execute 367 sec latency 19.884 ms 2024-05-09T05:47:30.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:47:30 smithi060 ceph-mon[34555]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-09T05:47:30.858 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:47:30 smithi039 ceph-mon[30439]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-09T05:47:30.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:47:30 smithi100 ceph-mon[34353]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-09T05:47:31.654 INFO:tasks.workunit.client.0.smithi039.stdout: 1 930892 12.13 MB/sec execute 368 sec latency 912.405 ms 2024-05-09T05:47:31.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:47:31 smithi060 ceph-mon[34555]: pgmap v674: 97 pgs: 97 active+clean; 299 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.8 MiB/s wr, 259 op/s 2024-05-09T05:47:31.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:47:31 smithi060 ceph-mon[34555]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-09T05:47:31.858 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:47:31 smithi039 ceph-mon[30439]: pgmap v674: 97 pgs: 97 active+clean; 299 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.8 MiB/s wr, 259 op/s 2024-05-09T05:47:31.858 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:47:31 smithi039 ceph-mon[30439]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-09T05:47:31.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:47:31 smithi100 ceph-mon[34353]: pgmap v674: 97 pgs: 97 active+clean; 299 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.8 MiB/s wr, 259 op/s 2024-05-09T05:47:31.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:47:31 smithi100 ceph-mon[34353]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-09T05:47:32.654 INFO:tasks.workunit.client.0.smithi039.stdout: 1 930892 12.09 MB/sec execute 369 sec latency 1912.484 ms 2024-05-09T05:47:33.654 INFO:tasks.workunit.client.0.smithi039.stdout: 1 930947 12.06 MB/sec execute 370 sec latency 2905.308 ms 2024-05-09T05:47:33.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:47:33 smithi060 ceph-mon[34555]: pgmap v675: 97 pgs: 97 active+clean; 295 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.8 MiB/s wr, 228 op/s 2024-05-09T05:47:33.858 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:47:33 smithi039 ceph-mon[30439]: pgmap v675: 97 pgs: 97 active+clean; 295 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.8 MiB/s wr, 228 op/s 2024-05-09T05:47:33.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:47:33 smithi100 ceph-mon[34353]: pgmap v675: 97 pgs: 97 active+clean; 295 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.8 MiB/s wr, 228 op/s 2024-05-09T05:47:34.654 INFO:tasks.workunit.client.0.smithi039.stdout: 1 930973 12.03 MB/sec execute 371 sec latency 961.820 ms 2024-05-09T05:47:35.654 INFO:tasks.workunit.client.0.smithi039.stdout: 1 931002 12.00 MB/sec execute 372 sec latency 1000.905 ms 2024-05-09T05:47:35.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:47:35 smithi060 ceph-mon[34555]: pgmap v676: 97 pgs: 97 active+clean; 300 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.9 MiB/s wr, 234 op/s 2024-05-09T05:47:35.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:47:35 smithi060 ceph-mon[34555]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-09T05:47:35.858 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:47:35 smithi039 ceph-mon[30439]: pgmap v676: 97 pgs: 97 active+clean; 300 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.9 MiB/s wr, 234 op/s 2024-05-09T05:47:35.858 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:47:35 smithi039 ceph-mon[30439]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-09T05:47:35.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:47:35 smithi100 ceph-mon[34353]: pgmap v676: 97 pgs: 97 active+clean; 300 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.9 MiB/s wr, 234 op/s 2024-05-09T05:47:35.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:47:35 smithi100 ceph-mon[34353]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-09T05:47:36.654 INFO:tasks.workunit.client.0.smithi039.stdout: 1 931002 11.96 MB/sec execute 373 sec latency 1938.450 ms 2024-05-09T05:47:36.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:47:36 smithi060 ceph-mon[34555]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-09T05:47:36.858 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:47:36 smithi039 ceph-mon[30439]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-09T05:47:36.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:47:36 smithi100 ceph-mon[34353]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-09T05:47:37.654 INFO:tasks.workunit.client.0.smithi039.stdout: 1 931002 11.93 MB/sec execute 374 sec latency 2938.560 ms 2024-05-09T05:47:37.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:47:37 smithi060 ceph-mon[34555]: pgmap v677: 97 pgs: 97 active+clean; 300 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.7 MiB/s wr, 229 op/s 2024-05-09T05:47:37.858 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:47:37 smithi039 ceph-mon[30439]: pgmap v677: 97 pgs: 97 active+clean; 300 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.7 MiB/s wr, 229 op/s 2024-05-09T05:47:37.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:47:37 smithi100 ceph-mon[34353]: pgmap v677: 97 pgs: 97 active+clean; 300 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.7 MiB/s wr, 229 op/s 2024-05-09T05:47:38.654 INFO:tasks.workunit.client.0.smithi039.stdout: 1 931017 11.90 MB/sec execute 375 sec latency 3927.679 ms 2024-05-09T05:47:39.654 INFO:tasks.workunit.client.0.smithi039.stdout: 1 933251 11.89 MB/sec execute 376 sec latency 17.686 ms 2024-05-09T05:47:39.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:47:39 smithi060 ceph-mon[34555]: pgmap v678: 97 pgs: 97 active+clean; 299 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 770 KiB/s rd, 2.8 MiB/s wr, 210 op/s 2024-05-09T05:47:39.858 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:47:39 smithi039 ceph-mon[30439]: pgmap v678: 97 pgs: 97 active+clean; 299 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 770 KiB/s rd, 2.8 MiB/s wr, 210 op/s 2024-05-09T05:47:39.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:47:39 smithi100 ceph-mon[34353]: pgmap v678: 97 pgs: 97 active+clean; 299 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 770 KiB/s rd, 2.8 MiB/s wr, 210 op/s 2024-05-09T05:47:40.655 INFO:tasks.workunit.client.0.smithi039.stdout: 1 934232 11.88 MB/sec execute 377 sec latency 645.470 ms 2024-05-09T05:47:41.655 INFO:tasks.workunit.client.0.smithi039.stdout: 1 934232 11.85 MB/sec execute 378 sec latency 1645.530 ms 2024-05-09T05:47:41.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:47:41 smithi060 ceph-mon[34555]: pgmap v679: 97 pgs: 97 active+clean; 299 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 2.0 MiB/s wr, 126 op/s 2024-05-09T05:47:41.858 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:47:41 smithi039 ceph-mon[30439]: pgmap v679: 97 pgs: 97 active+clean; 299 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 2.0 MiB/s wr, 126 op/s 2024-05-09T05:47:41.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:47:41 smithi100 ceph-mon[34353]: pgmap v679: 97 pgs: 97 active+clean; 299 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 2.0 MiB/s wr, 126 op/s 2024-05-09T05:47:42.655 INFO:tasks.workunit.client.0.smithi039.stdout: 1 934232 11.82 MB/sec execute 379 sec latency 2645.642 ms 2024-05-09T05:47:43.655 INFO:tasks.workunit.client.0.smithi039.stdout: 1 934233 11.79 MB/sec execute 380 sec latency 3642.396 ms 2024-05-09T05:47:43.794 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:47:43 smithi060 ceph-mon[34555]: pgmap v680: 97 pgs: 97 active+clean; 299 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 351 KiB/s rd, 2.1 MiB/s wr, 129 op/s 2024-05-09T05:47:43.858 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:47:43 smithi039 ceph-mon[30439]: pgmap v680: 97 pgs: 97 active+clean; 299 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 351 KiB/s rd, 2.1 MiB/s wr, 129 op/s 2024-05-09T05:47:43.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:47:43 smithi100 ceph-mon[34353]: pgmap v680: 97 pgs: 97 active+clean; 299 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 351 KiB/s rd, 2.1 MiB/s wr, 129 op/s 2024-05-09T05:47:44.655 INFO:tasks.workunit.client.0.smithi039.stdout: 1 935951 11.78 MB/sec execute 381 sec latency 18.750 ms 2024-05-09T05:47:45.655 INFO:tasks.workunit.client.0.smithi039.stdout: 1 937819 11.77 MB/sec execute 382 sec latency 486.771 ms 2024-05-09T05:47:45.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:47:45 smithi060 ceph-mon[34555]: pgmap v681: 97 pgs: 97 active+clean; 295 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 340 KiB/s rd, 2.1 MiB/s wr, 128 op/s 2024-05-09T05:47:45.861 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:47:45 smithi039 ceph-mon[30439]: pgmap v681: 97 pgs: 97 active+clean; 295 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 340 KiB/s rd, 2.1 MiB/s wr, 128 op/s 2024-05-09T05:47:45.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:47:45 smithi100 ceph-mon[34353]: pgmap v681: 97 pgs: 97 active+clean; 295 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 340 KiB/s rd, 2.1 MiB/s wr, 128 op/s 2024-05-09T05:47:46.655 INFO:tasks.workunit.client.0.smithi039.stdout: 1 937819 11.74 MB/sec execute 383 sec latency 1486.896 ms 2024-05-09T05:47:47.655 INFO:tasks.workunit.client.0.smithi039.stdout: 1 937819 11.71 MB/sec execute 384 sec latency 2487.017 ms 2024-05-09T05:47:47.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:47:47 smithi060 ceph-mon[34555]: pgmap v682: 97 pgs: 97 active+clean; 294 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 2.0 MiB/s wr, 109 op/s 2024-05-09T05:47:47.858 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:47:47 smithi039 ceph-mon[30439]: pgmap v682: 97 pgs: 97 active+clean; 294 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 2.0 MiB/s wr, 109 op/s 2024-05-09T05:47:47.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:47:47 smithi100 ceph-mon[34353]: pgmap v682: 97 pgs: 97 active+clean; 294 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 2.0 MiB/s wr, 109 op/s 2024-05-09T05:47:48.655 INFO:tasks.workunit.client.0.smithi039.stdout: 1 937826 11.68 MB/sec execute 385 sec latency 3480.036 ms 2024-05-09T05:47:49.655 INFO:tasks.workunit.client.0.smithi039.stdout: 1 939219 11.67 MB/sec execute 386 sec latency 31.545 ms 2024-05-09T05:47:49.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:47:49 smithi060 ceph-mon[34555]: pgmap v683: 97 pgs: 97 active+clean; 300 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 269 KiB/s rd, 2.4 MiB/s wr, 128 op/s 2024-05-09T05:47:49.862 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:47:49 smithi039 ceph-mon[30439]: pgmap v683: 97 pgs: 97 active+clean; 300 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 269 KiB/s rd, 2.4 MiB/s wr, 128 op/s 2024-05-09T05:47:49.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:47:49 smithi100 ceph-mon[34353]: pgmap v683: 97 pgs: 97 active+clean; 300 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 269 KiB/s rd, 2.4 MiB/s wr, 128 op/s 2024-05-09T05:47:50.655 INFO:tasks.workunit.client.0.smithi039.stdout: 1 941363 11.67 MB/sec execute 387 sec latency 345.490 ms 2024-05-09T05:47:51.655 INFO:tasks.workunit.client.0.smithi039.stdout: 1 941363 11.64 MB/sec execute 388 sec latency 1345.610 ms 2024-05-09T05:47:51.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:47:51 smithi060 ceph-mon[34555]: pgmap v684: 97 pgs: 97 active+clean; 299 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 2.2 MiB/s wr, 120 op/s 2024-05-09T05:47:51.858 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:47:51 smithi039 ceph-mon[30439]: pgmap v684: 97 pgs: 97 active+clean; 299 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 2.2 MiB/s wr, 120 op/s 2024-05-09T05:47:51.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:47:51 smithi100 ceph-mon[34353]: pgmap v684: 97 pgs: 97 active+clean; 299 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 2.2 MiB/s wr, 120 op/s 2024-05-09T05:47:52.656 INFO:tasks.workunit.client.0.smithi039.stdout: 1 941363 11.61 MB/sec execute 389 sec latency 2345.760 ms 2024-05-09T05:47:53.656 INFO:tasks.workunit.client.0.smithi039.stdout: 1 941370 11.58 MB/sec execute 390 sec latency 3337.065 ms 2024-05-09T05:47:53.794 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:47:53 smithi060 ceph-mon[34555]: pgmap v685: 97 pgs: 97 active+clean; 297 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 361 KiB/s rd, 2.3 MiB/s wr, 140 op/s 2024-05-09T05:47:53.858 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:47:53 smithi039 ceph-mon[30439]: pgmap v685: 97 pgs: 97 active+clean; 297 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 361 KiB/s rd, 2.3 MiB/s wr, 140 op/s 2024-05-09T05:47:53.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:47:53 smithi100 ceph-mon[34353]: pgmap v685: 97 pgs: 97 active+clean; 297 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 361 KiB/s rd, 2.3 MiB/s wr, 140 op/s 2024-05-09T05:47:54.658 INFO:tasks.workunit.client.0.smithi039.stdout: 1 943035 11.58 MB/sec execute 391 sec latency 33.702 ms 2024-05-09T05:47:55.656 INFO:tasks.workunit.client.0.smithi039.stdout: 1 945538 11.58 MB/sec execute 392 sec latency 11.673 ms 2024-05-09T05:47:55.794 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:47:55 smithi060 ceph-mon[34555]: pgmap v686: 97 pgs: 97 active+clean; 296 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 351 KiB/s rd, 2.5 MiB/s wr, 142 op/s 2024-05-09T05:47:55.858 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:47:55 smithi039 ceph-mon[30439]: pgmap v686: 97 pgs: 97 active+clean; 296 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 351 KiB/s rd, 2.5 MiB/s wr, 142 op/s 2024-05-09T05:47:55.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:47:55 smithi100 ceph-mon[34353]: pgmap v686: 97 pgs: 97 active+clean; 296 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 351 KiB/s rd, 2.5 MiB/s wr, 142 op/s 2024-05-09T05:47:56.656 INFO:tasks.workunit.client.0.smithi039.stdout: 1 947713 11.57 MB/sec execute 393 sec latency 57.552 ms 2024-05-09T05:47:57.656 INFO:tasks.workunit.client.0.smithi039.stdout: 1 949329 11.57 MB/sec execute 394 sec latency 106.627 ms 2024-05-09T05:47:57.794 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:47:57 smithi060 ceph-mon[34555]: pgmap v687: 97 pgs: 97 active+clean; 295 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 2.3 MiB/s wr, 122 op/s 2024-05-09T05:47:57.858 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:47:57 smithi039 ceph-mon[30439]: pgmap v687: 97 pgs: 97 active+clean; 295 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 2.3 MiB/s wr, 122 op/s 2024-05-09T05:47:57.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:47:57 smithi100 ceph-mon[34353]: pgmap v687: 97 pgs: 97 active+clean; 295 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 2.3 MiB/s wr, 122 op/s 2024-05-09T05:47:58.656 INFO:tasks.workunit.client.0.smithi039.stdout: 1 952001 11.58 MB/sec execute 395 sec latency 9.512 ms 2024-05-09T05:47:59.656 INFO:tasks.workunit.client.0.smithi039.stdout: 1 953702 11.58 MB/sec execute 396 sec latency 16.301 ms 2024-05-09T05:47:59.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:47:59 smithi060 ceph-mon[34555]: pgmap v688: 97 pgs: 97 active+clean; 302 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 3.4 MiB/s wr, 159 op/s 2024-05-09T05:47:59.858 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:47:59 smithi039 ceph-mon[30439]: pgmap v688: 97 pgs: 97 active+clean; 302 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 3.4 MiB/s wr, 159 op/s 2024-05-09T05:47:59.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:47:59 smithi100 ceph-mon[34353]: pgmap v688: 97 pgs: 97 active+clean; 302 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 3.4 MiB/s wr, 159 op/s 2024-05-09T05:48:00.656 INFO:tasks.workunit.client.0.smithi039.stdout: 1 956131 11.58 MB/sec execute 397 sec latency 27.400 ms 2024-05-09T05:48:01.656 INFO:tasks.workunit.client.0.smithi039.stdout: 1 958643 11.58 MB/sec execute 398 sec latency 31.765 ms 2024-05-09T05:48:01.794 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:48:01 smithi060 ceph-mon[34555]: pgmap v689: 97 pgs: 97 active+clean; 296 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 505 KiB/s rd, 3.6 MiB/s wr, 180 op/s 2024-05-09T05:48:01.858 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:48:01 smithi039 ceph-mon[30439]: pgmap v689: 97 pgs: 97 active+clean; 296 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 505 KiB/s rd, 3.6 MiB/s wr, 180 op/s 2024-05-09T05:48:01.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:48:01 smithi100 ceph-mon[34353]: pgmap v689: 97 pgs: 97 active+clean; 296 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 505 KiB/s rd, 3.6 MiB/s wr, 180 op/s 2024-05-09T05:48:02.656 INFO:tasks.workunit.client.0.smithi039.stdout: 1 960172 11.57 MB/sec execute 399 sec latency 39.181 ms 2024-05-09T05:48:03.656 INFO:tasks.workunit.client.0.smithi039.stdout: 1 962950 11.59 MB/sec execute 400 sec latency 12.480 ms 2024-05-09T05:48:03.794 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:48:03 smithi060 ceph-mon[34555]: pgmap v690: 97 pgs: 97 active+clean; 289 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 603 KiB/s rd, 4.1 MiB/s wr, 196 op/s 2024-05-09T05:48:03.858 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:48:03 smithi039 ceph-mon[30439]: pgmap v690: 97 pgs: 97 active+clean; 289 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 603 KiB/s rd, 4.1 MiB/s wr, 196 op/s 2024-05-09T05:48:03.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:48:03 smithi100 ceph-mon[34353]: pgmap v690: 97 pgs: 97 active+clean; 289 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 603 KiB/s rd, 4.1 MiB/s wr, 196 op/s 2024-05-09T05:48:04.656 INFO:tasks.workunit.client.0.smithi039.stdout: 1 964926 11.58 MB/sec execute 401 sec latency 17.303 ms 2024-05-09T05:48:05.656 INFO:tasks.workunit.client.0.smithi039.stdout: 1 966934 11.58 MB/sec execute 402 sec latency 13.156 ms 2024-05-09T05:48:05.794 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:48:05 smithi060 ceph-mon[34555]: pgmap v691: 97 pgs: 97 active+clean; 291 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 568 KiB/s rd, 4.2 MiB/s wr, 195 op/s 2024-05-09T05:48:05.858 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:48:05 smithi039 ceph-mon[30439]: pgmap v691: 97 pgs: 97 active+clean; 291 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 568 KiB/s rd, 4.2 MiB/s wr, 195 op/s 2024-05-09T05:48:05.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:48:05 smithi100 ceph-mon[34353]: pgmap v691: 97 pgs: 97 active+clean; 291 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 568 KiB/s rd, 4.2 MiB/s wr, 195 op/s 2024-05-09T05:48:06.656 INFO:tasks.workunit.client.0.smithi039.stdout: 1 969551 11.58 MB/sec execute 403 sec latency 18.210 ms 2024-05-09T05:48:07.656 INFO:tasks.workunit.client.0.smithi039.stdout: 1 970848 11.57 MB/sec execute 404 sec latency 23.536 ms 2024-05-09T05:48:07.794 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:48:07 smithi060 ceph-mon[34555]: pgmap v692: 97 pgs: 97 active+clean; 292 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 4.3 MiB/s wr, 220 op/s 2024-05-09T05:48:07.858 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:48:07 smithi039 ceph-mon[30439]: pgmap v692: 97 pgs: 97 active+clean; 292 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 4.3 MiB/s wr, 220 op/s 2024-05-09T05:48:07.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:48:07 smithi100 ceph-mon[34353]: pgmap v692: 97 pgs: 97 active+clean; 292 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 4.3 MiB/s wr, 220 op/s 2024-05-09T05:48:08.656 INFO:tasks.workunit.client.0.smithi039.stdout: 1 973628 11.59 MB/sec execute 405 sec latency 15.501 ms 2024-05-09T05:48:09.656 INFO:tasks.workunit.client.0.smithi039.stdout: 1 975851 11.58 MB/sec execute 406 sec latency 17.042 ms 2024-05-09T05:48:09.794 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:48:09 smithi060 ceph-mon[34555]: pgmap v693: 97 pgs: 97 active+clean; 295 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.5 MiB/s wr, 274 op/s 2024-05-09T05:48:09.858 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:48:09 smithi039 ceph-mon[30439]: pgmap v693: 97 pgs: 97 active+clean; 295 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.5 MiB/s wr, 274 op/s 2024-05-09T05:48:09.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:48:09 smithi100 ceph-mon[34353]: pgmap v693: 97 pgs: 97 active+clean; 295 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.5 MiB/s wr, 274 op/s 2024-05-09T05:48:10.656 INFO:tasks.workunit.client.0.smithi039.stdout: 1 977678 11.58 MB/sec execute 407 sec latency 16.721 ms 2024-05-09T05:48:11.656 INFO:tasks.workunit.client.0.smithi039.stdout: 1 980524 11.59 MB/sec execute 408 sec latency 15.377 ms 2024-05-09T05:48:11.794 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:48:11 smithi060 ceph-mon[34555]: pgmap v694: 97 pgs: 97 active+clean; 295 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.2 MiB/s wr, 225 op/s 2024-05-09T05:48:11.858 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:48:11 smithi039 ceph-mon[30439]: pgmap v694: 97 pgs: 97 active+clean; 295 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.2 MiB/s wr, 225 op/s 2024-05-09T05:48:11.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:48:11 smithi100 ceph-mon[34353]: pgmap v694: 97 pgs: 97 active+clean; 295 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.2 MiB/s wr, 225 op/s 2024-05-09T05:48:12.656 INFO:tasks.workunit.client.0.smithi039.stdout: 1 982148 11.58 MB/sec execute 409 sec latency 47.679 ms 2024-05-09T05:48:12.794 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:48:12 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:48:12.858 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:48:12 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:48:12.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:48:12 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:48:13.656 INFO:tasks.workunit.client.0.smithi039.stdout: 1 984634 11.59 MB/sec execute 410 sec latency 12.282 ms 2024-05-09T05:48:13.858 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:48:13 smithi039 ceph-mon[30439]: pgmap v695: 97 pgs: 97 active+clean; 296 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.4 MiB/s wr, 188 op/s 2024-05-09T05:48:13.858 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:48:13 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:48:13.858 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:48:13 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:48:13.858 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:48:13 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:48:13.858 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:48:13 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:48:13.858 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:48:13 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:48:13.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:48:13 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:48:13.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:48:13 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:48:13.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:48:13 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:48:13.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:48:13 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:48:13.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:48:13 smithi100 ceph-mon[34353]: pgmap v695: 97 pgs: 97 active+clean; 296 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.4 MiB/s wr, 188 op/s 2024-05-09T05:48:13.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:48:13 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:48:13.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:48:13 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:48:13.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:48:13 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:48:13.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:48:13 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:48:13.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:48:13 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:48:13.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:48:13 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:48:13.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:48:13 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:48:13.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:48:13 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:48:13.923 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:48:13 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:48:14.044 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:48:13 smithi060 ceph-mon[34555]: pgmap v695: 97 pgs: 97 active+clean; 296 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.4 MiB/s wr, 188 op/s 2024-05-09T05:48:14.045 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:48:13 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:48:14.045 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:48:13 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:48:14.045 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:48:13 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:48:14.045 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:48:13 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:48:14.045 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:48:13 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:48:14.045 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:48:13 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:48:14.045 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:48:13 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:48:14.045 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:48:13 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:48:14.045 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:48:13 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:48:14.656 INFO:tasks.workunit.client.0.smithi039.stdout: 1 987469 11.59 MB/sec execute 411 sec latency 22.015 ms 2024-05-09T05:48:15.656 INFO:tasks.workunit.client.0.smithi039.stdout: 1 989260 11.59 MB/sec execute 412 sec latency 55.325 ms 2024-05-09T05:48:15.858 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:48:15 smithi039 ceph-mon[30439]: pgmap v696: 97 pgs: 97 active+clean; 301 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 228 op/s 2024-05-09T05:48:15.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:48:15 smithi100 ceph-mon[34353]: pgmap v696: 97 pgs: 97 active+clean; 301 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 228 op/s 2024-05-09T05:48:16.044 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:48:15 smithi060 ceph-mon[34555]: pgmap v696: 97 pgs: 97 active+clean; 301 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 228 op/s 2024-05-09T05:48:16.656 INFO:tasks.workunit.client.0.smithi039.stdout: 1 991690 11.60 MB/sec execute 413 sec latency 14.962 ms 2024-05-09T05:48:17.656 INFO:tasks.workunit.client.0.smithi039.stdout: 1 994110 11.60 MB/sec execute 414 sec latency 72.395 ms 2024-05-09T05:48:17.858 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:48:17 smithi039 ceph-mon[30439]: pgmap v697: 97 pgs: 97 active+clean; 301 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.0 MiB/s wr, 212 op/s 2024-05-09T05:48:17.921 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:48:17 smithi100 ceph-mon[34353]: pgmap v697: 97 pgs: 97 active+clean; 301 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.0 MiB/s wr, 212 op/s 2024-05-09T05:48:18.044 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:48:17 smithi060 ceph-mon[34555]: pgmap v697: 97 pgs: 97 active+clean; 301 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.0 MiB/s wr, 212 op/s 2024-05-09T05:48:18.656 INFO:tasks.workunit.client.0.smithi039.stdout: 1 995753 11.59 MB/sec execute 415 sec latency 28.469 ms 2024-05-09T05:48:19.656 INFO:tasks.workunit.client.0.smithi039.stdout: 1 998469 11.60 MB/sec execute 416 sec latency 22.581 ms 2024-05-09T05:48:19.858 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:48:19 smithi039 ceph-mon[30439]: pgmap v698: 97 pgs: 97 active+clean; 303 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 1.7 MiB/s wr, 223 op/s 2024-05-09T05:48:19.921 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:48:19 smithi100 ceph-mon[34353]: pgmap v698: 97 pgs: 97 active+clean; 303 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 1.7 MiB/s wr, 223 op/s 2024-05-09T05:48:20.044 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:48:19 smithi060 ceph-mon[34555]: pgmap v698: 97 pgs: 97 active+clean; 303 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 1.7 MiB/s wr, 223 op/s 2024-05-09T05:48:20.657 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1000659 11.59 MB/sec execute 417 sec latency 16.573 ms 2024-05-09T05:48:21.657 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1002406 11.59 MB/sec execute 418 sec latency 15.550 ms 2024-05-09T05:48:21.859 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:48:21 smithi039 ceph-mon[30439]: pgmap v699: 97 pgs: 97 active+clean; 304 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 1.5 MiB/s wr, 163 op/s 2024-05-09T05:48:21.921 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:48:21 smithi100 ceph-mon[34353]: pgmap v699: 97 pgs: 97 active+clean; 304 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 1.5 MiB/s wr, 163 op/s 2024-05-09T05:48:22.044 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:48:21 smithi060 ceph-mon[34555]: pgmap v699: 97 pgs: 97 active+clean; 304 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 1.5 MiB/s wr, 163 op/s 2024-05-09T05:48:22.657 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1005038 11.60 MB/sec execute 419 sec latency 21.467 ms 2024-05-09T05:48:23.657 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1006695 11.59 MB/sec execute 420 sec latency 24.610 ms 2024-05-09T05:48:23.858 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:48:23 smithi039 ceph-mon[30439]: pgmap v700: 97 pgs: 97 active+clean; 307 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 1.8 MiB/s wr, 228 op/s 2024-05-09T05:48:23.921 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:48:23 smithi100 ceph-mon[34353]: pgmap v700: 97 pgs: 97 active+clean; 307 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 1.8 MiB/s wr, 228 op/s 2024-05-09T05:48:24.044 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:48:23 smithi060 ceph-mon[34555]: pgmap v700: 97 pgs: 97 active+clean; 307 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 1.8 MiB/s wr, 228 op/s 2024-05-09T05:48:24.657 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1009386 11.60 MB/sec execute 421 sec latency 11.673 ms 2024-05-09T05:48:25.657 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1011951 11.61 MB/sec execute 422 sec latency 28.745 ms 2024-05-09T05:48:25.921 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:48:25 smithi100 ceph-mon[34353]: pgmap v701: 97 pgs: 97 active+clean; 308 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.0 MiB/s wr, 224 op/s 2024-05-09T05:48:26.044 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:48:25 smithi060 ceph-mon[34555]: pgmap v701: 97 pgs: 97 active+clean; 308 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.0 MiB/s wr, 224 op/s 2024-05-09T05:48:26.108 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:48:25 smithi039 ceph-mon[30439]: pgmap v701: 97 pgs: 97 active+clean; 308 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.0 MiB/s wr, 224 op/s 2024-05-09T05:48:26.657 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1013659 11.60 MB/sec execute 423 sec latency 17.026 ms 2024-05-09T05:48:27.657 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1016281 11.61 MB/sec execute 424 sec latency 72.258 ms 2024-05-09T05:48:27.921 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:48:27 smithi100 ceph-mon[34353]: pgmap v702: 97 pgs: 97 active+clean; 312 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 1.8 MiB/s wr, 218 op/s 2024-05-09T05:48:28.044 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:48:27 smithi060 ceph-mon[34555]: pgmap v702: 97 pgs: 97 active+clean; 312 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 1.8 MiB/s wr, 218 op/s 2024-05-09T05:48:28.108 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:48:27 smithi039 ceph-mon[30439]: pgmap v702: 97 pgs: 97 active+clean; 312 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 1.8 MiB/s wr, 218 op/s 2024-05-09T05:48:28.657 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1018438 11.60 MB/sec execute 425 sec latency 23.465 ms 2024-05-09T05:48:29.657 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1020199 11.60 MB/sec execute 426 sec latency 16.110 ms 2024-05-09T05:48:29.909 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:48:29 smithi039 ceph-mon[30439]: pgmap v703: 97 pgs: 97 active+clean; 312 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.0 MiB/s wr, 232 op/s 2024-05-09T05:48:29.921 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:48:29 smithi100 ceph-mon[34353]: pgmap v703: 97 pgs: 97 active+clean; 312 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.0 MiB/s wr, 232 op/s 2024-05-09T05:48:30.044 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:48:29 smithi060 ceph-mon[34555]: pgmap v703: 97 pgs: 97 active+clean; 312 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.0 MiB/s wr, 232 op/s 2024-05-09T05:48:30.657 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1023124 11.62 MB/sec execute 427 sec latency 17.046 ms 2024-05-09T05:48:31.657 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1025279 11.61 MB/sec execute 428 sec latency 15.891 ms 2024-05-09T05:48:31.921 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:48:31 smithi100 ceph-mon[34353]: pgmap v704: 97 pgs: 97 active+clean; 314 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 226 op/s 2024-05-09T05:48:32.044 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:48:31 smithi060 ceph-mon[34555]: pgmap v704: 97 pgs: 97 active+clean; 314 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 226 op/s 2024-05-09T05:48:32.108 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:48:31 smithi039 ceph-mon[30439]: pgmap v704: 97 pgs: 97 active+clean; 314 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.0 MiB/s wr, 226 op/s 2024-05-09T05:48:32.657 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1027135 11.61 MB/sec execute 429 sec latency 86.035 ms 2024-05-09T05:48:33.657 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1029853 11.61 MB/sec execute 430 sec latency 35.403 ms 2024-05-09T05:48:33.921 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:48:33 smithi100 ceph-mon[34353]: pgmap v705: 97 pgs: 97 active+clean; 316 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 241 op/s 2024-05-09T05:48:34.044 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:48:33 smithi060 ceph-mon[34555]: pgmap v705: 97 pgs: 97 active+clean; 316 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 241 op/s 2024-05-09T05:48:34.108 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:48:33 smithi039 ceph-mon[30439]: pgmap v705: 97 pgs: 97 active+clean; 316 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 241 op/s 2024-05-09T05:48:34.657 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1031641 11.61 MB/sec execute 431 sec latency 18.897 ms 2024-05-09T05:48:35.657 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1034154 11.62 MB/sec execute 432 sec latency 11.766 ms 2024-05-09T05:48:35.921 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:48:35 smithi100 ceph-mon[34353]: pgmap v706: 97 pgs: 97 active+clean; 308 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.5 MiB/s wr, 235 op/s 2024-05-09T05:48:36.044 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:48:35 smithi060 ceph-mon[34555]: pgmap v706: 97 pgs: 97 active+clean; 308 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.5 MiB/s wr, 235 op/s 2024-05-09T05:48:36.108 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:48:35 smithi039 ceph-mon[30439]: pgmap v706: 97 pgs: 97 active+clean; 308 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.5 MiB/s wr, 235 op/s 2024-05-09T05:48:36.657 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1036752 11.62 MB/sec execute 433 sec latency 18.606 ms 2024-05-09T05:48:37.657 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1038189 11.61 MB/sec execute 434 sec latency 42.528 ms 2024-05-09T05:48:37.921 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:48:37 smithi100 ceph-mon[34353]: pgmap v707: 97 pgs: 97 active+clean; 296 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.7 MiB/s wr, 249 op/s 2024-05-09T05:48:38.044 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:48:37 smithi060 ceph-mon[34555]: pgmap v707: 97 pgs: 97 active+clean; 296 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.7 MiB/s wr, 249 op/s 2024-05-09T05:48:38.108 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:48:37 smithi039 ceph-mon[30439]: pgmap v707: 97 pgs: 97 active+clean; 296 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.7 MiB/s wr, 249 op/s 2024-05-09T05:48:38.657 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1040863 11.62 MB/sec execute 435 sec latency 18.976 ms 2024-05-09T05:48:39.657 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1042523 11.61 MB/sec execute 436 sec latency 17.169 ms 2024-05-09T05:48:39.921 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:48:39 smithi100 ceph-mon[34353]: pgmap v708: 97 pgs: 97 active+clean; 296 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.8 MiB/s wr, 238 op/s 2024-05-09T05:48:40.044 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:48:39 smithi060 ceph-mon[34555]: pgmap v708: 97 pgs: 97 active+clean; 296 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.8 MiB/s wr, 238 op/s 2024-05-09T05:48:40.108 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:48:39 smithi039 ceph-mon[30439]: pgmap v708: 97 pgs: 97 active+clean; 296 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.8 MiB/s wr, 238 op/s 2024-05-09T05:48:40.657 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1044803 11.62 MB/sec execute 437 sec latency 15.164 ms 2024-05-09T05:48:41.657 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1047023 11.61 MB/sec execute 438 sec latency 18.108 ms 2024-05-09T05:48:41.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:48:41 smithi100 ceph-mon[34353]: pgmap v709: 97 pgs: 97 active+clean; 296 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.8 MiB/s wr, 225 op/s 2024-05-09T05:48:42.044 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:48:41 smithi060 ceph-mon[34555]: pgmap v709: 97 pgs: 97 active+clean; 296 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.8 MiB/s wr, 225 op/s 2024-05-09T05:48:42.108 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:48:41 smithi039 ceph-mon[30439]: pgmap v709: 97 pgs: 97 active+clean; 296 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.8 MiB/s wr, 225 op/s 2024-05-09T05:48:42.657 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1048584 11.61 MB/sec execute 439 sec latency 51.145 ms 2024-05-09T05:48:43.657 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1050964 11.61 MB/sec execute 440 sec latency 53.930 ms 2024-05-09T05:48:43.921 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:48:43 smithi100 ceph-mon[34353]: pgmap v710: 97 pgs: 97 active+clean; 300 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.1 MiB/s wr, 251 op/s 2024-05-09T05:48:44.044 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:48:43 smithi060 ceph-mon[34555]: pgmap v710: 97 pgs: 97 active+clean; 300 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.1 MiB/s wr, 251 op/s 2024-05-09T05:48:44.107 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:48:43 smithi039 ceph-mon[30439]: pgmap v710: 97 pgs: 97 active+clean; 300 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.1 MiB/s wr, 251 op/s 2024-05-09T05:48:44.657 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1052577 11.60 MB/sec execute 441 sec latency 17.677 ms 2024-05-09T05:48:45.657 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1055186 11.61 MB/sec execute 442 sec latency 14.487 ms 2024-05-09T05:48:45.921 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:48:45 smithi100 ceph-mon[34353]: pgmap v711: 97 pgs: 97 active+clean; 302 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.2 MiB/s wr, 263 op/s 2024-05-09T05:48:46.044 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:48:45 smithi060 ceph-mon[34555]: pgmap v711: 97 pgs: 97 active+clean; 302 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.2 MiB/s wr, 263 op/s 2024-05-09T05:48:46.107 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:48:45 smithi039 ceph-mon[30439]: pgmap v711: 97 pgs: 97 active+clean; 302 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.2 MiB/s wr, 263 op/s 2024-05-09T05:48:46.657 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1057380 11.60 MB/sec execute 443 sec latency 16.900 ms 2024-05-09T05:48:47.657 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1059201 11.61 MB/sec execute 444 sec latency 17.713 ms 2024-05-09T05:48:47.921 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:48:47 smithi100 ceph-mon[34353]: pgmap v712: 97 pgs: 97 active+clean; 302 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.0 MiB/s wr, 235 op/s 2024-05-09T05:48:48.044 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:48:47 smithi060 ceph-mon[34555]: pgmap v712: 97 pgs: 97 active+clean; 302 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.0 MiB/s wr, 235 op/s 2024-05-09T05:48:48.108 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:48:47 smithi039 ceph-mon[30439]: pgmap v712: 97 pgs: 97 active+clean; 302 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.0 MiB/s wr, 235 op/s 2024-05-09T05:48:48.657 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1061577 11.61 MB/sec execute 445 sec latency 70.443 ms 2024-05-09T05:48:49.657 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1063595 11.61 MB/sec execute 446 sec latency 15.824 ms 2024-05-09T05:48:49.921 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:48:49 smithi100 ceph-mon[34353]: pgmap v713: 97 pgs: 97 active+clean; 301 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.0 MiB/s wr, 237 op/s 2024-05-09T05:48:50.044 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:48:49 smithi060 ceph-mon[34555]: pgmap v713: 97 pgs: 97 active+clean; 301 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.0 MiB/s wr, 237 op/s 2024-05-09T05:48:50.107 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:48:49 smithi039 ceph-mon[30439]: pgmap v713: 97 pgs: 97 active+clean; 301 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.0 MiB/s wr, 237 op/s 2024-05-09T05:48:50.657 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1066139 11.61 MB/sec execute 447 sec latency 13.630 ms 2024-05-09T05:48:51.658 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1068621 11.61 MB/sec execute 448 sec latency 24.105 ms 2024-05-09T05:48:51.921 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:48:51 smithi100 ceph-mon[34353]: pgmap v714: 97 pgs: 97 active+clean; 304 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.8 MiB/s wr, 244 op/s 2024-05-09T05:48:52.044 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:48:51 smithi060 ceph-mon[34555]: pgmap v714: 97 pgs: 97 active+clean; 304 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.8 MiB/s wr, 244 op/s 2024-05-09T05:48:52.107 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:48:51 smithi039 ceph-mon[30439]: pgmap v714: 97 pgs: 97 active+clean; 304 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.8 MiB/s wr, 244 op/s 2024-05-09T05:48:52.658 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1070426 11.61 MB/sec execute 449 sec latency 24.376 ms 2024-05-09T05:48:53.658 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1072842 11.62 MB/sec execute 450 sec latency 82.643 ms 2024-05-09T05:48:53.921 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:48:53 smithi100 ceph-mon[34353]: pgmap v715: 97 pgs: 97 active+clean; 306 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.2 MiB/s wr, 291 op/s 2024-05-09T05:48:54.044 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:48:53 smithi060 ceph-mon[34555]: pgmap v715: 97 pgs: 97 active+clean; 306 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.2 MiB/s wr, 291 op/s 2024-05-09T05:48:54.107 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:48:53 smithi039 ceph-mon[30439]: pgmap v715: 97 pgs: 97 active+clean; 306 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.2 MiB/s wr, 291 op/s 2024-05-09T05:48:54.658 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1074749 11.61 MB/sec execute 451 sec latency 16.632 ms 2024-05-09T05:48:55.658 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1076885 11.61 MB/sec execute 452 sec latency 13.509 ms 2024-05-09T05:48:55.921 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:48:55 smithi100 ceph-mon[34353]: pgmap v716: 97 pgs: 97 active+clean; 307 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.9 MiB/s wr, 246 op/s 2024-05-09T05:48:56.044 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:48:55 smithi060 ceph-mon[34555]: pgmap v716: 97 pgs: 97 active+clean; 307 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.9 MiB/s wr, 246 op/s 2024-05-09T05:48:56.107 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:48:55 smithi039 ceph-mon[30439]: pgmap v716: 97 pgs: 97 active+clean; 307 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.9 MiB/s wr, 246 op/s 2024-05-09T05:48:56.658 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1079705 11.62 MB/sec execute 453 sec latency 16.976 ms 2024-05-09T05:48:57.658 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1081480 11.61 MB/sec execute 454 sec latency 44.892 ms 2024-05-09T05:48:57.921 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:48:57 smithi100 ceph-mon[34353]: pgmap v717: 97 pgs: 97 active+clean; 310 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.1 MiB/s wr, 276 op/s 2024-05-09T05:48:58.044 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:48:57 smithi060 ceph-mon[34555]: pgmap v717: 97 pgs: 97 active+clean; 310 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.1 MiB/s wr, 276 op/s 2024-05-09T05:48:58.107 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:48:57 smithi039 ceph-mon[30439]: pgmap v717: 97 pgs: 97 active+clean; 310 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.1 MiB/s wr, 276 op/s 2024-05-09T05:48:58.658 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1083737 11.62 MB/sec execute 455 sec latency 81.064 ms 2024-05-09T05:48:59.658 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1085917 11.61 MB/sec execute 456 sec latency 23.120 ms 2024-05-09T05:48:59.909 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:48:59 smithi039 ceph-mon[30439]: pgmap v718: 97 pgs: 97 active+clean; 312 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.1 MiB/s wr, 269 op/s 2024-05-09T05:48:59.921 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:48:59 smithi100 ceph-mon[34353]: pgmap v718: 97 pgs: 97 active+clean; 312 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.1 MiB/s wr, 269 op/s 2024-05-09T05:49:00.044 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:48:59 smithi060 ceph-mon[34555]: pgmap v718: 97 pgs: 97 active+clean; 312 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.1 MiB/s wr, 269 op/s 2024-05-09T05:49:00.658 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1087787 11.61 MB/sec execute 457 sec latency 25.249 ms 2024-05-09T05:49:01.658 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1090751 11.63 MB/sec execute 458 sec latency 13.874 ms 2024-05-09T05:49:01.921 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:49:01 smithi100 ceph-mon[34353]: pgmap v719: 97 pgs: 97 active+clean; 312 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.9 MiB/s wr, 251 op/s 2024-05-09T05:49:02.044 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:49:01 smithi060 ceph-mon[34555]: pgmap v719: 97 pgs: 97 active+clean; 312 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.9 MiB/s wr, 251 op/s 2024-05-09T05:49:02.107 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:49:01 smithi039 ceph-mon[30439]: pgmap v719: 97 pgs: 97 active+clean; 312 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.9 MiB/s wr, 251 op/s 2024-05-09T05:49:02.658 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1092941 11.62 MB/sec execute 459 sec latency 18.631 ms 2024-05-09T05:49:03.658 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1094770 11.62 MB/sec execute 460 sec latency 71.159 ms 2024-05-09T05:49:03.921 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:49:03 smithi100 ceph-mon[34353]: pgmap v720: 97 pgs: 97 active+clean; 315 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.3 MiB/s wr, 267 op/s 2024-05-09T05:49:04.044 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:49:03 smithi060 ceph-mon[34555]: pgmap v720: 97 pgs: 97 active+clean; 315 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.3 MiB/s wr, 267 op/s 2024-05-09T05:49:04.107 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:49:03 smithi039 ceph-mon[30439]: pgmap v720: 97 pgs: 97 active+clean; 315 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.3 MiB/s wr, 267 op/s 2024-05-09T05:49:04.658 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1097606 11.63 MB/sec execute 461 sec latency 17.742 ms 2024-05-09T05:49:05.658 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1099579 11.62 MB/sec execute 462 sec latency 16.676 ms 2024-05-09T05:49:05.921 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:49:05 smithi100 ceph-mon[34353]: pgmap v721: 97 pgs: 97 active+clean; 318 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.3 MiB/s wr, 262 op/s 2024-05-09T05:49:06.044 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:49:05 smithi060 ceph-mon[34555]: pgmap v721: 97 pgs: 97 active+clean; 318 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.3 MiB/s wr, 262 op/s 2024-05-09T05:49:06.107 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:49:05 smithi039 ceph-mon[30439]: pgmap v721: 97 pgs: 97 active+clean; 318 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.3 MiB/s wr, 262 op/s 2024-05-09T05:49:06.658 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1101698 11.62 MB/sec execute 463 sec latency 16.991 ms 2024-05-09T05:49:07.658 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1104166 11.63 MB/sec execute 464 sec latency 24.044 ms 2024-05-09T05:49:07.921 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:49:07 smithi100 ceph-mon[34353]: pgmap v722: 97 pgs: 97 active+clean; 317 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.3 MiB/s wr, 257 op/s 2024-05-09T05:49:08.044 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:49:07 smithi060 ceph-mon[34555]: pgmap v722: 97 pgs: 97 active+clean; 317 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.3 MiB/s wr, 257 op/s 2024-05-09T05:49:08.107 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:49:07 smithi039 ceph-mon[30439]: pgmap v722: 97 pgs: 97 active+clean; 317 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.3 MiB/s wr, 257 op/s 2024-05-09T05:49:08.658 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1105516 11.62 MB/sec execute 465 sec latency 68.472 ms 2024-05-09T05:49:09.658 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1108064 11.62 MB/sec execute 466 sec latency 25.358 ms 2024-05-09T05:49:09.921 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:49:09 smithi100 ceph-mon[34353]: pgmap v723: 97 pgs: 97 active+clean; 319 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.1 MiB/s wr, 255 op/s 2024-05-09T05:49:10.044 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:49:09 smithi060 ceph-mon[34555]: pgmap v723: 97 pgs: 97 active+clean; 319 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.1 MiB/s wr, 255 op/s 2024-05-09T05:49:10.107 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:49:09 smithi039 ceph-mon[30439]: pgmap v723: 97 pgs: 97 active+clean; 319 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.1 MiB/s wr, 255 op/s 2024-05-09T05:49:10.658 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1109620 11.62 MB/sec execute 467 sec latency 17.141 ms 2024-05-09T05:49:11.658 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1112081 11.62 MB/sec execute 468 sec latency 12.735 ms 2024-05-09T05:49:11.921 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:49:11 smithi100 ceph-mon[34353]: pgmap v724: 97 pgs: 97 active+clean; 321 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.0 MiB/s wr, 273 op/s 2024-05-09T05:49:12.044 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:49:11 smithi060 ceph-mon[34555]: pgmap v724: 97 pgs: 97 active+clean; 321 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.0 MiB/s wr, 273 op/s 2024-05-09T05:49:12.107 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:49:11 smithi039 ceph-mon[30439]: pgmap v724: 97 pgs: 97 active+clean; 321 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.0 MiB/s wr, 273 op/s 2024-05-09T05:49:12.658 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1114232 11.61 MB/sec execute 469 sec latency 16.814 ms 2024-05-09T05:49:13.658 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1115873 11.61 MB/sec execute 470 sec latency 90.751 ms 2024-05-09T05:49:13.921 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:49:13 smithi100 ceph-mon[34353]: pgmap v725: 97 pgs: 97 active+clean; 320 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.2 MiB/s wr, 282 op/s 2024-05-09T05:49:13.921 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:49:13 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:49:14.044 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:49:13 smithi060 ceph-mon[34555]: pgmap v725: 97 pgs: 97 active+clean; 320 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.2 MiB/s wr, 282 op/s 2024-05-09T05:49:14.044 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:49:13 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:49:14.107 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:49:13 smithi039 ceph-mon[30439]: pgmap v725: 97 pgs: 97 active+clean; 320 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.2 MiB/s wr, 282 op/s 2024-05-09T05:49:14.108 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:49:13 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:49:14.658 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1118104 11.61 MB/sec execute 471 sec latency 33.921 ms 2024-05-09T05:49:14.921 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:49:14 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:49:14.921 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:49:14 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:49:14.921 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:49:14 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:49:15.044 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:49:14 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:49:15.044 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:49:14 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:49:15.044 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:49:14 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:49:15.107 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:49:14 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:49:15.108 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:49:14 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:49:15.108 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:49:14 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:49:15.658 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1119700 11.61 MB/sec execute 472 sec latency 17.203 ms 2024-05-09T05:49:15.922 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:49:15 smithi100 ceph-mon[34353]: pgmap v726: 97 pgs: 97 active+clean; 321 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.8 MiB/s wr, 240 op/s 2024-05-09T05:49:16.044 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:49:15 smithi060 ceph-mon[34555]: pgmap v726: 97 pgs: 97 active+clean; 321 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.8 MiB/s wr, 240 op/s 2024-05-09T05:49:16.107 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:49:15 smithi039 ceph-mon[30439]: pgmap v726: 97 pgs: 97 active+clean; 321 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.8 MiB/s wr, 240 op/s 2024-05-09T05:49:16.658 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1122416 11.62 MB/sec execute 473 sec latency 21.291 ms 2024-05-09T05:49:17.658 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1124109 11.61 MB/sec execute 474 sec latency 18.394 ms 2024-05-09T05:49:18.044 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:49:17 smithi060 ceph-mon[34555]: pgmap v727: 97 pgs: 97 active+clean; 315 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.7 MiB/s wr, 236 op/s 2024-05-09T05:49:18.107 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:49:17 smithi039 ceph-mon[30439]: pgmap v727: 97 pgs: 97 active+clean; 315 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.7 MiB/s wr, 236 op/s 2024-05-09T05:49:18.171 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:49:17 smithi100 ceph-mon[34353]: pgmap v727: 97 pgs: 97 active+clean; 315 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.7 MiB/s wr, 236 op/s 2024-05-09T05:49:18.658 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1126219 11.61 MB/sec execute 475 sec latency 60.522 ms 2024-05-09T05:49:19.659 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1128216 11.60 MB/sec execute 476 sec latency 37.243 ms 2024-05-09T05:49:20.044 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:49:19 smithi060 ceph-mon[34555]: pgmap v728: 97 pgs: 97 active+clean; 299 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.8 MiB/s wr, 238 op/s 2024-05-09T05:49:20.107 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:49:19 smithi039 ceph-mon[30439]: pgmap v728: 97 pgs: 97 active+clean; 299 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.8 MiB/s wr, 238 op/s 2024-05-09T05:49:20.171 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:49:19 smithi100 ceph-mon[34353]: pgmap v728: 97 pgs: 97 active+clean; 299 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.8 MiB/s wr, 238 op/s 2024-05-09T05:49:20.659 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1129964 11.60 MB/sec execute 477 sec latency 14.613 ms 2024-05-09T05:49:21.658 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1132503 11.61 MB/sec execute 478 sec latency 16.283 ms 2024-05-09T05:49:22.044 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:49:21 smithi060 ceph-mon[34555]: pgmap v729: 97 pgs: 97 active+clean; 299 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.9 MiB/s wr, 233 op/s 2024-05-09T05:49:22.107 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:49:21 smithi039 ceph-mon[30439]: pgmap v729: 97 pgs: 97 active+clean; 299 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.9 MiB/s wr, 233 op/s 2024-05-09T05:49:22.171 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:49:21 smithi100 ceph-mon[34353]: pgmap v729: 97 pgs: 97 active+clean; 299 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.9 MiB/s wr, 233 op/s 2024-05-09T05:49:22.659 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1134246 11.60 MB/sec execute 479 sec latency 25.240 ms 2024-05-09T05:49:23.659 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1136727 11.61 MB/sec execute 480 sec latency 104.712 ms 2024-05-09T05:49:24.043 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:49:23 smithi060 ceph-mon[34555]: pgmap v730: 97 pgs: 97 active+clean; 298 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.8 MiB/s wr, 203 op/s 2024-05-09T05:49:24.107 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:49:23 smithi039 ceph-mon[30439]: pgmap v730: 97 pgs: 97 active+clean; 298 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.8 MiB/s wr, 203 op/s 2024-05-09T05:49:24.171 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:49:23 smithi100 ceph-mon[34353]: pgmap v730: 97 pgs: 97 active+clean; 298 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.8 MiB/s wr, 203 op/s 2024-05-09T05:49:24.659 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1137905 11.59 MB/sec execute 481 sec latency 230.111 ms 2024-05-09T05:49:25.659 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1140486 11.60 MB/sec execute 482 sec latency 45.984 ms 2024-05-09T05:49:26.044 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:49:25 smithi060 ceph-mon[34555]: pgmap v731: 97 pgs: 97 active+clean; 300 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.9 MiB/s wr, 222 op/s 2024-05-09T05:49:26.107 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:49:25 smithi039 ceph-mon[30439]: pgmap v731: 97 pgs: 97 active+clean; 300 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.9 MiB/s wr, 222 op/s 2024-05-09T05:49:26.171 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:49:25 smithi100 ceph-mon[34353]: pgmap v731: 97 pgs: 97 active+clean; 300 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.9 MiB/s wr, 222 op/s 2024-05-09T05:49:26.659 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1142792 11.60 MB/sec execute 483 sec latency 18.560 ms 2024-05-09T05:49:27.659 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1144556 11.60 MB/sec execute 484 sec latency 25.288 ms 2024-05-09T05:49:28.043 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:49:27 smithi060 ceph-mon[34555]: pgmap v732: 97 pgs: 97 active+clean; 302 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.3 MiB/s wr, 264 op/s 2024-05-09T05:49:28.107 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:49:27 smithi039 ceph-mon[30439]: pgmap v732: 97 pgs: 97 active+clean; 302 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.3 MiB/s wr, 264 op/s 2024-05-09T05:49:28.171 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:49:27 smithi100 ceph-mon[34353]: pgmap v732: 97 pgs: 97 active+clean; 302 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.3 MiB/s wr, 264 op/s 2024-05-09T05:49:28.659 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1147296 11.61 MB/sec execute 485 sec latency 36.848 ms 2024-05-09T05:49:29.659 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1148717 11.60 MB/sec execute 486 sec latency 61.876 ms 2024-05-09T05:49:30.043 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:49:29 smithi060 ceph-mon[34555]: pgmap v733: 97 pgs: 97 active+clean; 303 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.3 MiB/s wr, 249 op/s 2024-05-09T05:49:30.107 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:49:29 smithi039 ceph-mon[30439]: pgmap v733: 97 pgs: 97 active+clean; 303 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.3 MiB/s wr, 249 op/s 2024-05-09T05:49:30.171 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:49:29 smithi100 ceph-mon[34353]: pgmap v733: 97 pgs: 97 active+clean; 303 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.3 MiB/s wr, 249 op/s 2024-05-09T05:49:30.659 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1151140 11.60 MB/sec execute 487 sec latency 15.245 ms 2024-05-09T05:49:31.659 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1153443 11.59 MB/sec execute 488 sec latency 17.014 ms 2024-05-09T05:49:32.043 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:49:31 smithi060 ceph-mon[34555]: pgmap v734: 97 pgs: 97 active+clean; 304 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.1 MiB/s wr, 257 op/s 2024-05-09T05:49:32.107 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:49:31 smithi039 ceph-mon[30439]: pgmap v734: 97 pgs: 97 active+clean; 304 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.1 MiB/s wr, 257 op/s 2024-05-09T05:49:32.173 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:49:31 smithi100 ceph-mon[34353]: pgmap v734: 97 pgs: 97 active+clean; 304 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.1 MiB/s wr, 257 op/s 2024-05-09T05:49:32.659 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1155329 11.59 MB/sec execute 489 sec latency 17.661 ms 2024-05-09T05:49:33.659 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1158150 11.61 MB/sec execute 490 sec latency 16.190 ms 2024-05-09T05:49:34.043 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:49:33 smithi060 ceph-mon[34555]: pgmap v735: 97 pgs: 97 active+clean; 304 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.8 MiB/s wr, 216 op/s 2024-05-09T05:49:34.107 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:49:33 smithi039 ceph-mon[30439]: pgmap v735: 97 pgs: 97 active+clean; 304 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.8 MiB/s wr, 216 op/s 2024-05-09T05:49:34.171 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:49:33 smithi100 ceph-mon[34353]: pgmap v735: 97 pgs: 97 active+clean; 304 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.8 MiB/s wr, 216 op/s 2024-05-09T05:49:34.659 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1159485 11.60 MB/sec execute 491 sec latency 54.055 ms 2024-05-09T05:49:35.043 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:49:34 smithi060 ceph-mon[34555]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-09T05:49:35.107 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:49:34 smithi039 ceph-mon[30439]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-09T05:49:35.171 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:49:34 smithi100 ceph-mon[34353]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-09T05:49:35.659 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1161854 11.60 MB/sec execute 492 sec latency 12.828 ms 2024-05-09T05:49:36.043 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:49:35 smithi060 ceph-mon[34555]: pgmap v736: 97 pgs: 97 active+clean; 307 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.3 MiB/s wr, 277 op/s 2024-05-09T05:49:36.044 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:49:35 smithi060 ceph-mon[34555]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-09T05:49:36.107 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:49:35 smithi039 ceph-mon[30439]: pgmap v736: 97 pgs: 97 active+clean; 307 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.3 MiB/s wr, 277 op/s 2024-05-09T05:49:36.107 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:49:35 smithi039 ceph-mon[30439]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-09T05:49:36.171 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:49:35 smithi100 ceph-mon[34353]: pgmap v736: 97 pgs: 97 active+clean; 307 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.3 MiB/s wr, 277 op/s 2024-05-09T05:49:36.171 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:49:35 smithi100 ceph-mon[34353]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-09T05:49:36.659 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1163960 11.59 MB/sec execute 493 sec latency 24.064 ms 2024-05-09T05:49:37.043 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:49:36 smithi060 ceph-mon[34555]: pgmap v737: 97 pgs: 97 active+clean; 308 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.3 MiB/s wr, 259 op/s 2024-05-09T05:49:37.107 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:49:36 smithi039 ceph-mon[30439]: pgmap v737: 97 pgs: 97 active+clean; 308 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.3 MiB/s wr, 259 op/s 2024-05-09T05:49:37.171 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:49:36 smithi100 ceph-mon[34353]: pgmap v737: 97 pgs: 97 active+clean; 308 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.3 MiB/s wr, 259 op/s 2024-05-09T05:49:37.659 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1165807 11.59 MB/sec execute 494 sec latency 17.224 ms 2024-05-09T05:49:38.659 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1168544 11.60 MB/sec execute 495 sec latency 20.128 ms 2024-05-09T05:49:39.659 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1169776 11.59 MB/sec execute 496 sec latency 46.914 ms 2024-05-09T05:49:39.793 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:49:39 smithi060 ceph-mon[34555]: pgmap v738: 97 pgs: 97 active+clean; 310 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.2 MiB/s wr, 260 op/s 2024-05-09T05:49:39.857 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:49:39 smithi039 ceph-mon[30439]: pgmap v738: 97 pgs: 97 active+clean; 310 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.2 MiB/s wr, 260 op/s 2024-05-09T05:49:39.873 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:49:39 smithi100 ceph-mon[34353]: pgmap v738: 97 pgs: 97 active+clean; 310 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.2 MiB/s wr, 260 op/s 2024-05-09T05:49:40.659 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1172380 11.60 MB/sec execute 497 sec latency 12.628 ms 2024-05-09T05:49:41.659 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1174680 11.59 MB/sec execute 498 sec latency 16.958 ms 2024-05-09T05:49:41.793 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:49:41 smithi060 ceph-mon[34555]: pgmap v739: 97 pgs: 97 active+clean; 310 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.9 MiB/s wr, 236 op/s 2024-05-09T05:49:41.857 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:49:41 smithi039 ceph-mon[30439]: pgmap v739: 97 pgs: 97 active+clean; 310 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.9 MiB/s wr, 236 op/s 2024-05-09T05:49:41.921 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:49:41 smithi100 ceph-mon[34353]: pgmap v739: 97 pgs: 97 active+clean; 310 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.9 MiB/s wr, 236 op/s 2024-05-09T05:49:42.659 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1176458 11.59 MB/sec execute 499 sec latency 17.938 ms 2024-05-09T05:49:43.659 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1179183 11.60 MB/sec execute 500 sec latency 14.561 ms 2024-05-09T05:49:43.793 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:49:43 smithi060 ceph-mon[34555]: pgmap v740: 97 pgs: 97 active+clean; 311 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.9 MiB/s wr, 236 op/s 2024-05-09T05:49:43.858 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:49:43 smithi039 ceph-mon[30439]: pgmap v740: 97 pgs: 97 active+clean; 311 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.9 MiB/s wr, 236 op/s 2024-05-09T05:49:43.921 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:49:43 smithi100 ceph-mon[34353]: pgmap v740: 97 pgs: 97 active+clean; 311 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.9 MiB/s wr, 236 op/s 2024-05-09T05:49:44.659 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1180388 11.59 MB/sec execute 501 sec latency 97.888 ms 2024-05-09T05:49:45.660 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1182890 11.59 MB/sec execute 502 sec latency 33.875 ms 2024-05-09T05:49:45.793 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:49:45 smithi060 ceph-mon[34555]: pgmap v741: 97 pgs: 97 active+clean; 313 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.1 MiB/s wr, 260 op/s 2024-05-09T05:49:45.794 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:49:45 smithi060 ceph-mon[34555]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-09T05:49:45.857 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:49:45 smithi039 ceph-mon[30439]: pgmap v741: 97 pgs: 97 active+clean; 313 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.1 MiB/s wr, 260 op/s 2024-05-09T05:49:45.857 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:49:45 smithi039 ceph-mon[30439]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-09T05:49:45.921 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:49:45 smithi100 ceph-mon[34353]: pgmap v741: 97 pgs: 97 active+clean; 313 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.1 MiB/s wr, 260 op/s 2024-05-09T05:49:45.921 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:49:45 smithi100 ceph-mon[34353]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-09T05:49:46.660 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1185008 11.59 MB/sec execute 503 sec latency 24.665 ms 2024-05-09T05:49:46.793 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:49:46 smithi060 ceph-mon[34555]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-09T05:49:46.857 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:49:46 smithi039 ceph-mon[30439]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-09T05:49:46.921 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:49:46 smithi100 ceph-mon[34353]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-09T05:49:47.660 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1186760 11.59 MB/sec execute 504 sec latency 14.194 ms 2024-05-09T05:49:47.793 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:49:47 smithi060 ceph-mon[34555]: pgmap v742: 97 pgs: 97 active+clean; 314 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.9 MiB/s wr, 205 op/s 2024-05-09T05:49:47.857 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:49:47 smithi039 ceph-mon[30439]: pgmap v742: 97 pgs: 97 active+clean; 314 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.9 MiB/s wr, 205 op/s 2024-05-09T05:49:47.920 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:49:47 smithi100 ceph-mon[34353]: pgmap v742: 97 pgs: 97 active+clean; 314 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.9 MiB/s wr, 205 op/s 2024-05-09T05:49:48.660 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1189257 11.59 MB/sec execute 505 sec latency 26.863 ms 2024-05-09T05:49:49.660 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1190629 11.58 MB/sec execute 506 sec latency 38.650 ms 2024-05-09T05:49:49.793 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:49:49 smithi060 ceph-mon[34555]: pgmap v743: 97 pgs: 97 active+clean; 318 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.2 MiB/s wr, 263 op/s 2024-05-09T05:49:49.857 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:49:49 smithi039 ceph-mon[30439]: pgmap v743: 97 pgs: 97 active+clean; 318 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.2 MiB/s wr, 263 op/s 2024-05-09T05:49:49.921 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:49:49 smithi100 ceph-mon[34353]: pgmap v743: 97 pgs: 97 active+clean; 318 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.2 MiB/s wr, 263 op/s 2024-05-09T05:49:50.660 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1193208 11.59 MB/sec execute 507 sec latency 37.026 ms 2024-05-09T05:49:51.660 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1194665 11.58 MB/sec execute 508 sec latency 20.000 ms 2024-05-09T05:49:51.793 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:49:51 smithi060 ceph-mon[34555]: pgmap v744: 97 pgs: 97 active+clean; 317 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.6 MiB/s wr, 203 op/s 2024-05-09T05:49:51.857 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:49:51 smithi039 ceph-mon[30439]: pgmap v744: 97 pgs: 97 active+clean; 317 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.6 MiB/s wr, 203 op/s 2024-05-09T05:49:51.921 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:49:51 smithi100 ceph-mon[34353]: pgmap v744: 97 pgs: 97 active+clean; 317 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.6 MiB/s wr, 203 op/s 2024-05-09T05:49:52.660 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1197137 11.59 MB/sec execute 509 sec latency 17.217 ms 2024-05-09T05:49:53.660 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1199114 11.58 MB/sec execute 510 sec latency 21.375 ms 2024-05-09T05:49:53.793 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:49:53 smithi060 ceph-mon[34555]: pgmap v745: 97 pgs: 97 active+clean; 317 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.8 MiB/s wr, 218 op/s 2024-05-09T05:49:53.857 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:49:53 smithi039 ceph-mon[30439]: pgmap v745: 97 pgs: 97 active+clean; 317 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.8 MiB/s wr, 218 op/s 2024-05-09T05:49:53.920 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:49:53 smithi100 ceph-mon[34353]: pgmap v745: 97 pgs: 97 active+clean; 317 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.8 MiB/s wr, 218 op/s 2024-05-09T05:49:54.660 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1200843 11.58 MB/sec execute 511 sec latency 93.030 ms 2024-05-09T05:49:55.660 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1203082 11.57 MB/sec execute 512 sec latency 18.134 ms 2024-05-09T05:49:55.793 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:49:55 smithi060 ceph-mon[34555]: pgmap v746: 97 pgs: 97 active+clean; 308 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.1 MiB/s wr, 251 op/s 2024-05-09T05:49:55.857 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:49:55 smithi039 ceph-mon[30439]: pgmap v746: 97 pgs: 97 active+clean; 308 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.1 MiB/s wr, 251 op/s 2024-05-09T05:49:55.920 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:49:55 smithi100 ceph-mon[34353]: pgmap v746: 97 pgs: 97 active+clean; 308 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.1 MiB/s wr, 251 op/s 2024-05-09T05:49:56.660 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1204923 11.57 MB/sec execute 513 sec latency 23.349 ms 2024-05-09T05:49:57.660 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1207643 11.58 MB/sec execute 514 sec latency 50.469 ms 2024-05-09T05:49:57.793 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:49:57 smithi060 ceph-mon[34555]: pgmap v747: 97 pgs: 97 active+clean; 298 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.0 MiB/s wr, 246 op/s 2024-05-09T05:49:57.857 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:49:57 smithi039 ceph-mon[30439]: pgmap v747: 97 pgs: 97 active+clean; 298 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.0 MiB/s wr, 246 op/s 2024-05-09T05:49:57.920 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:49:57 smithi100 ceph-mon[34353]: pgmap v747: 97 pgs: 97 active+clean; 298 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.0 MiB/s wr, 246 op/s 2024-05-09T05:49:58.660 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1209909 11.58 MB/sec execute 515 sec latency 17.597 ms 2024-05-09T05:49:59.660 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1211526 11.58 MB/sec execute 516 sec latency 62.088 ms 2024-05-09T05:49:59.793 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:49:59 smithi060 ceph-mon[34555]: pgmap v748: 97 pgs: 97 active+clean; 299 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.1 MiB/s wr, 257 op/s 2024-05-09T05:49:59.857 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:49:59 smithi039 ceph-mon[30439]: pgmap v748: 97 pgs: 97 active+clean; 299 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.1 MiB/s wr, 257 op/s 2024-05-09T05:49:59.921 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:49:59 smithi100 ceph-mon[34353]: pgmap v748: 97 pgs: 97 active+clean; 299 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.1 MiB/s wr, 257 op/s 2024-05-09T05:50:00.660 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1213717 11.57 MB/sec execute 517 sec latency 19.331 ms 2024-05-09T05:50:00.793 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:50:00 smithi060 ceph-mon[34555]: overall HEALTH_OK 2024-05-09T05:50:00.857 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:50:00 smithi039 ceph-mon[30439]: overall HEALTH_OK 2024-05-09T05:50:00.920 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:50:00 smithi100 ceph-mon[34353]: overall HEALTH_OK 2024-05-09T05:50:01.660 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1215385 11.57 MB/sec execute 518 sec latency 18.258 ms 2024-05-09T05:50:01.793 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:50:01 smithi060 ceph-mon[34555]: pgmap v749: 97 pgs: 97 active+clean; 302 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.8 MiB/s wr, 238 op/s 2024-05-09T05:50:01.857 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:50:01 smithi039 ceph-mon[30439]: pgmap v749: 97 pgs: 97 active+clean; 302 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.8 MiB/s wr, 238 op/s 2024-05-09T05:50:01.921 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:50:01 smithi100 ceph-mon[34353]: pgmap v749: 97 pgs: 97 active+clean; 302 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.8 MiB/s wr, 238 op/s 2024-05-09T05:50:02.660 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1218019 11.58 MB/sec execute 519 sec latency 20.810 ms 2024-05-09T05:50:03.660 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1219620 11.57 MB/sec execute 520 sec latency 18.506 ms 2024-05-09T05:50:03.793 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:50:03 smithi060 ceph-mon[34555]: pgmap v750: 97 pgs: 97 active+clean; 303 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.1 MiB/s wr, 259 op/s 2024-05-09T05:50:03.857 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:50:03 smithi039 ceph-mon[30439]: pgmap v750: 97 pgs: 97 active+clean; 303 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.1 MiB/s wr, 259 op/s 2024-05-09T05:50:03.920 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:50:03 smithi100 ceph-mon[34353]: pgmap v750: 97 pgs: 97 active+clean; 303 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.1 MiB/s wr, 259 op/s 2024-05-09T05:50:04.660 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1221899 11.58 MB/sec execute 521 sec latency 79.818 ms 2024-05-09T05:50:05.660 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1223733 11.57 MB/sec execute 522 sec latency 22.419 ms 2024-05-09T05:50:05.793 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:50:05 smithi060 ceph-mon[34555]: pgmap v751: 97 pgs: 97 active+clean; 303 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.1 MiB/s wr, 250 op/s 2024-05-09T05:50:05.857 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:50:05 smithi039 ceph-mon[30439]: pgmap v751: 97 pgs: 97 active+clean; 303 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.1 MiB/s wr, 250 op/s 2024-05-09T05:50:05.920 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:50:05 smithi100 ceph-mon[34353]: pgmap v751: 97 pgs: 97 active+clean; 303 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.1 MiB/s wr, 250 op/s 2024-05-09T05:50:06.661 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1225724 11.57 MB/sec execute 523 sec latency 12.587 ms 2024-05-09T05:50:07.661 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1228201 11.57 MB/sec execute 524 sec latency 19.119 ms 2024-05-09T05:50:07.793 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:50:07 smithi060 ceph-mon[34555]: pgmap v752: 97 pgs: 97 active+clean; 303 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.9 MiB/s wr, 214 op/s 2024-05-09T05:50:07.857 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:50:07 smithi039 ceph-mon[30439]: pgmap v752: 97 pgs: 97 active+clean; 303 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.9 MiB/s wr, 214 op/s 2024-05-09T05:50:07.920 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:50:07 smithi100 ceph-mon[34353]: pgmap v752: 97 pgs: 97 active+clean; 303 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.9 MiB/s wr, 214 op/s 2024-05-09T05:50:08.661 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1229951 11.57 MB/sec execute 525 sec latency 17.619 ms 2024-05-09T05:50:09.661 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1232617 11.58 MB/sec execute 526 sec latency 46.679 ms 2024-05-09T05:50:09.793 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:50:09 smithi060 ceph-mon[34555]: pgmap v753: 97 pgs: 97 active+clean; 306 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.2 MiB/s wr, 243 op/s 2024-05-09T05:50:09.857 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:50:09 smithi039 ceph-mon[30439]: pgmap v753: 97 pgs: 97 active+clean; 306 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.2 MiB/s wr, 243 op/s 2024-05-09T05:50:09.920 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:50:09 smithi100 ceph-mon[34353]: pgmap v753: 97 pgs: 97 active+clean; 306 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.2 MiB/s wr, 243 op/s 2024-05-09T05:50:10.661 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1234534 11.57 MB/sec execute 527 sec latency 69.134 ms 2024-05-09T05:50:11.661 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1236492 11.57 MB/sec execute 528 sec latency 17.622 ms 2024-05-09T05:50:11.793 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:50:11 smithi060 ceph-mon[34555]: pgmap v754: 97 pgs: 97 active+clean; 305 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.7 MiB/s wr, 222 op/s 2024-05-09T05:50:11.857 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:50:11 smithi039 ceph-mon[30439]: pgmap v754: 97 pgs: 97 active+clean; 305 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.7 MiB/s wr, 222 op/s 2024-05-09T05:50:11.920 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:50:11 smithi100 ceph-mon[34353]: pgmap v754: 97 pgs: 97 active+clean; 305 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.7 MiB/s wr, 222 op/s 2024-05-09T05:50:12.661 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1239144 11.57 MB/sec execute 529 sec latency 26.075 ms 2024-05-09T05:50:13.661 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1240893 11.57 MB/sec execute 530 sec latency 17.530 ms 2024-05-09T05:50:13.793 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:50:13 smithi060 ceph-mon[34555]: pgmap v755: 97 pgs: 97 active+clean; 308 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.0 MiB/s wr, 234 op/s 2024-05-09T05:50:13.857 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:50:13 smithi039 ceph-mon[30439]: pgmap v755: 97 pgs: 97 active+clean; 308 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.0 MiB/s wr, 234 op/s 2024-05-09T05:50:13.921 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:50:13 smithi100 ceph-mon[34353]: pgmap v755: 97 pgs: 97 active+clean; 308 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.0 MiB/s wr, 234 op/s 2024-05-09T05:50:14.661 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1243336 11.58 MB/sec execute 531 sec latency 16.516 ms 2024-05-09T05:50:15.661 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1244900 11.56 MB/sec execute 532 sec latency 51.672 ms 2024-05-09T05:50:15.793 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:50:15 smithi060 ceph-mon[34555]: pgmap v756: 97 pgs: 97 active+clean; 309 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.9 MiB/s wr, 220 op/s 2024-05-09T05:50:15.793 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:50:15 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:50:15.793 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:50:15 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:50:15.794 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:50:15 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:50:15.794 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:50:15 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:50:15.857 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:50:15 smithi039 ceph-mon[30439]: pgmap v756: 97 pgs: 97 active+clean; 309 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.9 MiB/s wr, 220 op/s 2024-05-09T05:50:15.857 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:50:15 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:50:15.857 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:50:15 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:50:15.857 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:50:15 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:50:15.857 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:50:15 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:50:15.920 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:50:15 smithi100 ceph-mon[34353]: pgmap v756: 97 pgs: 97 active+clean; 309 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.9 MiB/s wr, 220 op/s 2024-05-09T05:50:15.920 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:50:15 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:50:15.921 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:50:15 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:50:15.921 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:50:15 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:50:15.921 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:50:15 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:50:16.661 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1247048 11.57 MB/sec execute 533 sec latency 13.969 ms 2024-05-09T05:50:17.661 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1249564 11.57 MB/sec execute 534 sec latency 23.512 ms 2024-05-09T05:50:17.793 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:50:17 smithi060 ceph-mon[34555]: pgmap v757: 97 pgs: 97 active+clean; 312 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.2 MiB/s wr, 258 op/s 2024-05-09T05:50:17.857 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:50:17 smithi039 ceph-mon[30439]: pgmap v757: 97 pgs: 97 active+clean; 312 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.2 MiB/s wr, 258 op/s 2024-05-09T05:50:17.920 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:50:17 smithi100 ceph-mon[34353]: pgmap v757: 97 pgs: 97 active+clean; 312 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.2 MiB/s wr, 258 op/s 2024-05-09T05:50:18.661 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1251162 11.56 MB/sec execute 535 sec latency 19.900 ms 2024-05-09T05:50:19.661 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1253768 11.57 MB/sec execute 536 sec latency 12.228 ms 2024-05-09T05:50:19.793 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:50:19 smithi060 ceph-mon[34555]: pgmap v758: 97 pgs: 97 active+clean; 314 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.3 MiB/s wr, 296 op/s 2024-05-09T05:50:19.857 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:50:19 smithi039 ceph-mon[30439]: pgmap v758: 97 pgs: 97 active+clean; 314 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.3 MiB/s wr, 296 op/s 2024-05-09T05:50:19.920 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:50:19 smithi100 ceph-mon[34353]: pgmap v758: 97 pgs: 97 active+clean; 314 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.3 MiB/s wr, 296 op/s 2024-05-09T05:50:20.661 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1255285 11.56 MB/sec execute 537 sec latency 52.638 ms 2024-05-09T05:50:21.661 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1257598 11.57 MB/sec execute 538 sec latency 13.824 ms 2024-05-09T05:50:21.793 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:50:21 smithi060 ceph-mon[34555]: pgmap v759: 97 pgs: 97 active+clean; 313 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.7 MiB/s wr, 239 op/s 2024-05-09T05:50:21.857 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:50:21 smithi039 ceph-mon[30439]: pgmap v759: 97 pgs: 97 active+clean; 313 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.7 MiB/s wr, 239 op/s 2024-05-09T05:50:21.920 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:50:21 smithi100 ceph-mon[34353]: pgmap v759: 97 pgs: 97 active+clean; 313 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.7 MiB/s wr, 239 op/s 2024-05-09T05:50:22.661 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1259815 11.56 MB/sec execute 539 sec latency 21.054 ms 2024-05-09T05:50:23.661 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1261668 11.56 MB/sec execute 540 sec latency 17.980 ms 2024-05-09T05:50:23.793 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:50:23 smithi060 ceph-mon[34555]: pgmap v760: 97 pgs: 97 active+clean; 314 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.1 MiB/s wr, 254 op/s 2024-05-09T05:50:23.857 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:50:23 smithi039 ceph-mon[30439]: pgmap v760: 97 pgs: 97 active+clean; 314 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.1 MiB/s wr, 254 op/s 2024-05-09T05:50:23.920 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:50:23 smithi100 ceph-mon[34353]: pgmap v760: 97 pgs: 97 active+clean; 314 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.1 MiB/s wr, 254 op/s 2024-05-09T05:50:24.661 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1264386 11.57 MB/sec execute 541 sec latency 16.695 ms 2024-05-09T05:50:25.661 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1265804 11.56 MB/sec execute 542 sec latency 44.385 ms 2024-05-09T05:50:25.793 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:50:25 smithi060 ceph-mon[34555]: pgmap v761: 97 pgs: 97 active+clean; 316 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.8 MiB/s wr, 246 op/s 2024-05-09T05:50:25.858 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:50:25 smithi039 ceph-mon[30439]: pgmap v761: 97 pgs: 97 active+clean; 316 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.8 MiB/s wr, 246 op/s 2024-05-09T05:50:25.920 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:50:25 smithi100 ceph-mon[34353]: pgmap v761: 97 pgs: 97 active+clean; 316 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.8 MiB/s wr, 246 op/s 2024-05-09T05:50:26.661 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1268171 11.57 MB/sec execute 543 sec latency 12.166 ms 2024-05-09T05:50:27.661 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1270408 11.56 MB/sec execute 544 sec latency 19.618 ms 2024-05-09T05:50:27.793 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:50:27 smithi060 ceph-mon[34555]: pgmap v762: 97 pgs: 97 active+clean; 317 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.9 MiB/s wr, 251 op/s 2024-05-09T05:50:27.857 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:50:27 smithi039 ceph-mon[30439]: pgmap v762: 97 pgs: 97 active+clean; 317 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.9 MiB/s wr, 251 op/s 2024-05-09T05:50:27.920 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:50:27 smithi100 ceph-mon[34353]: pgmap v762: 97 pgs: 97 active+clean; 317 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.9 MiB/s wr, 251 op/s 2024-05-09T05:50:28.661 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1272332 11.56 MB/sec execute 545 sec latency 17.211 ms 2024-05-09T05:50:29.661 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1275177 11.57 MB/sec execute 546 sec latency 14.487 ms 2024-05-09T05:50:29.793 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:50:29 smithi060 ceph-mon[34555]: pgmap v763: 97 pgs: 97 active+clean; 319 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.8 MiB/s wr, 254 op/s 2024-05-09T05:50:29.856 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:50:29 smithi039 ceph-mon[30439]: pgmap v763: 97 pgs: 97 active+clean; 319 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.8 MiB/s wr, 254 op/s 2024-05-09T05:50:29.920 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:50:29 smithi100 ceph-mon[34353]: pgmap v763: 97 pgs: 97 active+clean; 319 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.8 MiB/s wr, 254 op/s 2024-05-09T05:50:30.661 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1276971 11.56 MB/sec execute 547 sec latency 100.522 ms 2024-05-09T05:50:31.661 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1278875 11.57 MB/sec execute 548 sec latency 54.783 ms 2024-05-09T05:50:31.793 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:50:31 smithi060 ceph-mon[34555]: pgmap v764: 97 pgs: 97 active+clean; 320 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.5 MiB/s wr, 201 op/s 2024-05-09T05:50:31.857 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:50:31 smithi039 ceph-mon[30439]: pgmap v764: 97 pgs: 97 active+clean; 320 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.5 MiB/s wr, 201 op/s 2024-05-09T05:50:31.920 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:50:31 smithi100 ceph-mon[34353]: pgmap v764: 97 pgs: 97 active+clean; 320 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.5 MiB/s wr, 201 op/s 2024-05-09T05:50:32.661 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1281477 11.57 MB/sec execute 549 sec latency 17.383 ms 2024-05-09T05:50:33.661 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1283183 11.56 MB/sec execute 550 sec latency 20.915 ms 2024-05-09T05:50:33.793 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:50:33 smithi060 ceph-mon[34555]: pgmap v765: 97 pgs: 97 active+clean; 315 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.0 MiB/s wr, 264 op/s 2024-05-09T05:50:33.857 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:50:33 smithi039 ceph-mon[30439]: pgmap v765: 97 pgs: 97 active+clean; 315 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.0 MiB/s wr, 264 op/s 2024-05-09T05:50:33.920 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:50:33 smithi100 ceph-mon[34353]: pgmap v765: 97 pgs: 97 active+clean; 315 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.0 MiB/s wr, 264 op/s 2024-05-09T05:50:34.661 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1285958 11.57 MB/sec execute 551 sec latency 8.174 ms 2024-05-09T05:50:35.661 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1288013 11.56 MB/sec execute 552 sec latency 70.717 ms 2024-05-09T05:50:35.793 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:50:35 smithi060 ceph-mon[34555]: pgmap v766: 97 pgs: 97 active+clean; 303 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.1 MiB/s wr, 259 op/s 2024-05-09T05:50:35.856 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:50:35 smithi039 ceph-mon[30439]: pgmap v766: 97 pgs: 97 active+clean; 303 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.1 MiB/s wr, 259 op/s 2024-05-09T05:50:35.920 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:50:35 smithi100 ceph-mon[34353]: pgmap v766: 97 pgs: 97 active+clean; 303 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.1 MiB/s wr, 259 op/s 2024-05-09T05:50:36.661 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1289701 11.57 MB/sec execute 553 sec latency 56.120 ms 2024-05-09T05:50:37.661 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1292646 11.58 MB/sec execute 554 sec latency 17.437 ms 2024-05-09T05:50:37.793 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:50:37 smithi060 ceph-mon[34555]: pgmap v767: 97 pgs: 97 active+clean; 302 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.0 MiB/s wr, 241 op/s 2024-05-09T05:50:37.856 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:50:37 smithi039 ceph-mon[30439]: pgmap v767: 97 pgs: 97 active+clean; 302 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.0 MiB/s wr, 241 op/s 2024-05-09T05:50:37.920 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:50:37 smithi100 ceph-mon[34353]: pgmap v767: 97 pgs: 97 active+clean; 302 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.0 MiB/s wr, 241 op/s 2024-05-09T05:50:38.662 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1294350 11.57 MB/sec execute 555 sec latency 23.350 ms 2024-05-09T05:50:39.661 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1296691 11.57 MB/sec execute 556 sec latency 8.812 ms 2024-05-09T05:50:39.793 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:50:39 smithi060 ceph-mon[34555]: pgmap v768: 97 pgs: 97 active+clean; 302 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.1 MiB/s wr, 238 op/s 2024-05-09T05:50:39.856 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:50:39 smithi039 ceph-mon[30439]: pgmap v768: 97 pgs: 97 active+clean; 302 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.1 MiB/s wr, 238 op/s 2024-05-09T05:50:39.920 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:50:39 smithi100 ceph-mon[34353]: pgmap v768: 97 pgs: 97 active+clean; 302 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.1 MiB/s wr, 238 op/s 2024-05-09T05:50:40.662 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1298813 11.56 MB/sec execute 557 sec latency 60.745 ms 2024-05-09T05:50:41.661 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1300602 11.57 MB/sec execute 558 sec latency 21.843 ms 2024-05-09T05:50:41.793 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:50:41 smithi060 ceph-mon[34555]: pgmap v769: 97 pgs: 97 active+clean; 304 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.0 MiB/s wr, 245 op/s 2024-05-09T05:50:41.856 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:50:41 smithi039 ceph-mon[30439]: pgmap v769: 97 pgs: 97 active+clean; 304 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.0 MiB/s wr, 245 op/s 2024-05-09T05:50:41.920 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:50:41 smithi100 ceph-mon[34353]: pgmap v769: 97 pgs: 97 active+clean; 304 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.0 MiB/s wr, 245 op/s 2024-05-09T05:50:42.662 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1303469 11.58 MB/sec execute 559 sec latency 17.551 ms 2024-05-09T05:50:43.662 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1305702 11.57 MB/sec execute 560 sec latency 21.200 ms 2024-05-09T05:50:43.793 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:50:43 smithi060 ceph-mon[34555]: pgmap v770: 97 pgs: 97 active+clean; 306 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.0 MiB/s wr, 264 op/s 2024-05-09T05:50:43.856 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:50:43 smithi039 ceph-mon[30439]: pgmap v770: 97 pgs: 97 active+clean; 306 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.0 MiB/s wr, 264 op/s 2024-05-09T05:50:43.920 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:50:43 smithi100 ceph-mon[34353]: pgmap v770: 97 pgs: 97 active+clean; 306 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.0 MiB/s wr, 264 op/s 2024-05-09T05:50:44.662 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1307584 11.57 MB/sec execute 561 sec latency 18.432 ms 2024-05-09T05:50:45.662 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1310073 11.57 MB/sec execute 562 sec latency 68.902 ms 2024-05-09T05:50:45.793 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:50:45 smithi060 ceph-mon[34555]: pgmap v771: 97 pgs: 97 active+clean; 307 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.9 MiB/s wr, 226 op/s 2024-05-09T05:50:45.856 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:50:45 smithi039 ceph-mon[30439]: pgmap v771: 97 pgs: 97 active+clean; 307 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.9 MiB/s wr, 226 op/s 2024-05-09T05:50:45.920 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:50:45 smithi100 ceph-mon[34353]: pgmap v771: 97 pgs: 97 active+clean; 307 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.9 MiB/s wr, 226 op/s 2024-05-09T05:50:46.662 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1311444 11.57 MB/sec execute 563 sec latency 23.469 ms 2024-05-09T05:50:47.662 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1314116 11.57 MB/sec execute 564 sec latency 15.636 ms 2024-05-09T05:50:47.793 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:50:47 smithi060 ceph-mon[34555]: pgmap v772: 97 pgs: 97 active+clean; 311 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.2 MiB/s wr, 277 op/s 2024-05-09T05:50:47.856 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:50:47 smithi039 ceph-mon[30439]: pgmap v772: 97 pgs: 97 active+clean; 311 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.2 MiB/s wr, 277 op/s 2024-05-09T05:50:47.920 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:50:47 smithi100 ceph-mon[34353]: pgmap v772: 97 pgs: 97 active+clean; 311 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.2 MiB/s wr, 277 op/s 2024-05-09T05:50:48.662 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1315692 11.57 MB/sec execute 565 sec latency 20.300 ms 2024-05-09T05:50:49.662 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1317934 11.57 MB/sec execute 566 sec latency 10.210 ms 2024-05-09T05:50:49.793 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:50:49 smithi060 ceph-mon[34555]: pgmap v773: 97 pgs: 97 active+clean; 311 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.1 MiB/s wr, 251 op/s 2024-05-09T05:50:49.856 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:50:49 smithi039 ceph-mon[30439]: pgmap v773: 97 pgs: 97 active+clean; 311 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.1 MiB/s wr, 251 op/s 2024-05-09T05:50:49.920 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:50:49 smithi100 ceph-mon[34353]: pgmap v773: 97 pgs: 97 active+clean; 311 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.1 MiB/s wr, 251 op/s 2024-05-09T05:50:50.662 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1320001 11.56 MB/sec execute 567 sec latency 51.610 ms 2024-05-09T05:50:51.662 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1321649 11.56 MB/sec execute 568 sec latency 29.294 ms 2024-05-09T05:50:51.793 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:50:51 smithi060 ceph-mon[34555]: pgmap v774: 97 pgs: 97 active+clean; 313 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.0 MiB/s wr, 275 op/s 2024-05-09T05:50:51.856 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:50:51 smithi039 ceph-mon[30439]: pgmap v774: 97 pgs: 97 active+clean; 313 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.0 MiB/s wr, 275 op/s 2024-05-09T05:50:51.920 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:50:51 smithi100 ceph-mon[34353]: pgmap v774: 97 pgs: 97 active+clean; 313 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.0 MiB/s wr, 275 op/s 2024-05-09T05:50:52.662 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1324098 11.56 MB/sec execute 569 sec latency 17.285 ms 2024-05-09T05:50:53.662 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1325626 11.56 MB/sec execute 570 sec latency 27.557 ms 2024-05-09T05:50:53.856 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:50:53 smithi039 ceph-mon[30439]: pgmap v775: 97 pgs: 97 active+clean; 314 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.9 MiB/s wr, 231 op/s 2024-05-09T05:50:53.920 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:50:53 smithi100 ceph-mon[34353]: pgmap v775: 97 pgs: 97 active+clean; 314 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.9 MiB/s wr, 231 op/s 2024-05-09T05:50:54.043 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:50:53 smithi060 ceph-mon[34555]: pgmap v775: 97 pgs: 97 active+clean; 314 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.9 MiB/s wr, 231 op/s 2024-05-09T05:50:54.662 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1328268 11.57 MB/sec execute 571 sec latency 11.902 ms 2024-05-09T05:50:55.662 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1329801 11.56 MB/sec execute 572 sec latency 19.848 ms 2024-05-09T05:50:55.856 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:50:55 smithi039 ceph-mon[30439]: pgmap v776: 97 pgs: 97 active+clean; 316 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.1 MiB/s wr, 251 op/s 2024-05-09T05:50:55.920 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:50:55 smithi100 ceph-mon[34353]: pgmap v776: 97 pgs: 97 active+clean; 316 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.1 MiB/s wr, 251 op/s 2024-05-09T05:50:56.043 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:50:55 smithi060 ceph-mon[34555]: pgmap v776: 97 pgs: 97 active+clean; 316 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.1 MiB/s wr, 251 op/s 2024-05-09T05:50:56.662 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1331884 11.56 MB/sec execute 573 sec latency 61.611 ms 2024-05-09T05:50:57.662 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1333423 11.55 MB/sec execute 574 sec latency 27.771 ms 2024-05-09T05:50:57.857 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:50:57 smithi039 ceph-mon[30439]: pgmap v777: 97 pgs: 97 active+clean; 315 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.0 MiB/s wr, 246 op/s 2024-05-09T05:50:57.920 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:50:57 smithi100 ceph-mon[34353]: pgmap v777: 97 pgs: 97 active+clean; 315 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.0 MiB/s wr, 246 op/s 2024-05-09T05:50:58.043 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:50:57 smithi060 ceph-mon[34555]: pgmap v777: 97 pgs: 97 active+clean; 315 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.0 MiB/s wr, 246 op/s 2024-05-09T05:50:58.662 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1335615 11.55 MB/sec execute 575 sec latency 13.406 ms 2024-05-09T05:50:59.662 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1337713 11.55 MB/sec execute 576 sec latency 16.262 ms 2024-05-09T05:50:59.856 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:50:59 smithi039 ceph-mon[30439]: pgmap v778: 97 pgs: 97 active+clean; 318 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.7 MiB/s wr, 228 op/s 2024-05-09T05:50:59.920 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:50:59 smithi100 ceph-mon[34353]: pgmap v778: 97 pgs: 97 active+clean; 318 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.7 MiB/s wr, 228 op/s 2024-05-09T05:51:00.043 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:50:59 smithi060 ceph-mon[34555]: pgmap v778: 97 pgs: 97 active+clean; 318 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.7 MiB/s wr, 228 op/s 2024-05-09T05:51:00.662 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1339387 11.55 MB/sec execute 577 sec latency 18.135 ms 2024-05-09T05:51:01.662 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1341720 11.55 MB/sec execute 578 sec latency 77.912 ms 2024-05-09T05:51:01.856 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:51:01 smithi039 ceph-mon[30439]: pgmap v779: 97 pgs: 97 active+clean; 318 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.6 MiB/s wr, 225 op/s 2024-05-09T05:51:01.920 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:51:01 smithi100 ceph-mon[34353]: pgmap v779: 97 pgs: 97 active+clean; 318 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.6 MiB/s wr, 225 op/s 2024-05-09T05:51:02.043 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:51:01 smithi060 ceph-mon[34555]: pgmap v779: 97 pgs: 97 active+clean; 318 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.6 MiB/s wr, 225 op/s 2024-05-09T05:51:02.662 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1343421 11.54 MB/sec execute 579 sec latency 19.416 ms 2024-05-09T05:51:03.662 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1346016 11.55 MB/sec execute 580 sec latency 50.350 ms 2024-05-09T05:51:03.856 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:51:03 smithi039 ceph-mon[30439]: pgmap v780: 97 pgs: 97 active+clean; 320 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.7 MiB/s wr, 240 op/s 2024-05-09T05:51:03.920 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:51:03 smithi100 ceph-mon[34353]: pgmap v780: 97 pgs: 97 active+clean; 320 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.7 MiB/s wr, 240 op/s 2024-05-09T05:51:04.043 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:51:03 smithi060 ceph-mon[34555]: pgmap v780: 97 pgs: 97 active+clean; 320 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.7 MiB/s wr, 240 op/s 2024-05-09T05:51:04.662 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1347481 11.54 MB/sec execute 581 sec latency 22.115 ms 2024-05-09T05:51:05.662 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1349844 11.55 MB/sec execute 582 sec latency 24.685 ms 2024-05-09T05:51:05.856 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:51:05 smithi039 ceph-mon[30439]: pgmap v781: 97 pgs: 97 active+clean; 320 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.7 MiB/s wr, 238 op/s 2024-05-09T05:51:05.920 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:51:05 smithi100 ceph-mon[34353]: pgmap v781: 97 pgs: 97 active+clean; 320 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.7 MiB/s wr, 238 op/s 2024-05-09T05:51:06.043 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:51:05 smithi060 ceph-mon[34555]: pgmap v781: 97 pgs: 97 active+clean; 320 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.7 MiB/s wr, 238 op/s 2024-05-09T05:51:06.662 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1351844 11.54 MB/sec execute 583 sec latency 72.436 ms 2024-05-09T05:51:07.662 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1353582 11.54 MB/sec execute 584 sec latency 44.097 ms 2024-05-09T05:51:07.856 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:51:07 smithi039 ceph-mon[30439]: pgmap v782: 97 pgs: 97 active+clean; 323 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.9 MiB/s wr, 260 op/s 2024-05-09T05:51:07.921 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:51:07 smithi100 ceph-mon[34353]: pgmap v782: 97 pgs: 97 active+clean; 323 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.9 MiB/s wr, 260 op/s 2024-05-09T05:51:08.043 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:51:07 smithi060 ceph-mon[34555]: pgmap v782: 97 pgs: 97 active+clean; 323 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.9 MiB/s wr, 260 op/s 2024-05-09T05:51:08.662 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1356357 11.55 MB/sec execute 585 sec latency 15.155 ms 2024-05-09T05:51:09.662 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1357962 11.54 MB/sec execute 586 sec latency 46.248 ms 2024-05-09T05:51:09.856 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:51:09 smithi039 ceph-mon[30439]: pgmap v783: 97 pgs: 97 active+clean; 324 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.3 MiB/s wr, 274 op/s 2024-05-09T05:51:09.920 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:51:09 smithi100 ceph-mon[34353]: pgmap v783: 97 pgs: 97 active+clean; 324 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.3 MiB/s wr, 274 op/s 2024-05-09T05:51:10.043 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:51:09 smithi060 ceph-mon[34555]: pgmap v783: 97 pgs: 97 active+clean; 324 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.3 MiB/s wr, 274 op/s 2024-05-09T05:51:10.662 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1360369 11.55 MB/sec execute 587 sec latency 14.277 ms 2024-05-09T05:51:11.662 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1361939 11.54 MB/sec execute 588 sec latency 66.357 ms 2024-05-09T05:51:11.844 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:51:11 smithi060 ceph-mon[34555]: pgmap v784: 97 pgs: 97 active+clean; 324 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.0 MiB/s wr, 237 op/s 2024-05-09T05:51:11.856 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:51:11 smithi039 ceph-mon[30439]: pgmap v784: 97 pgs: 97 active+clean; 324 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.0 MiB/s wr, 237 op/s 2024-05-09T05:51:11.920 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:51:11 smithi100 ceph-mon[34353]: pgmap v784: 97 pgs: 97 active+clean; 324 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.0 MiB/s wr, 237 op/s 2024-05-09T05:51:12.662 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1364100 11.54 MB/sec execute 589 sec latency 13.682 ms 2024-05-09T05:51:13.663 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1366558 11.54 MB/sec execute 590 sec latency 21.883 ms 2024-05-09T05:51:13.858 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:51:13 smithi039 ceph-mon[30439]: pgmap v785: 97 pgs: 97 active+clean; 312 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.9 MiB/s wr, 235 op/s 2024-05-09T05:51:13.920 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:51:13 smithi100 ceph-mon[34353]: pgmap v785: 97 pgs: 97 active+clean; 312 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.9 MiB/s wr, 235 op/s 2024-05-09T05:51:14.042 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:51:13 smithi060 ceph-mon[34555]: pgmap v785: 97 pgs: 97 active+clean; 312 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.9 MiB/s wr, 235 op/s 2024-05-09T05:51:14.663 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1368186 11.53 MB/sec execute 591 sec latency 21.084 ms 2024-05-09T05:51:15.663 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1370865 11.54 MB/sec execute 592 sec latency 13.313 ms 2024-05-09T05:51:15.856 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:51:15 smithi039 ceph-mon[30439]: pgmap v786: 97 pgs: 97 active+clean; 307 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.1 MiB/s wr, 241 op/s 2024-05-09T05:51:15.856 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:51:15 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:51:15.920 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:51:15 smithi100 ceph-mon[34353]: pgmap v786: 97 pgs: 97 active+clean; 307 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.1 MiB/s wr, 241 op/s 2024-05-09T05:51:15.920 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:51:15 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:51:16.043 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:51:15 smithi060 ceph-mon[34555]: pgmap v786: 97 pgs: 97 active+clean; 307 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.1 MiB/s wr, 241 op/s 2024-05-09T05:51:16.043 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:51:15 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:51:16.663 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1372213 11.54 MB/sec execute 593 sec latency 61.477 ms 2024-05-09T05:51:17.663 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1374574 11.54 MB/sec execute 594 sec latency 12.898 ms 2024-05-09T05:51:17.856 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:51:17 smithi039 ceph-mon[30439]: pgmap v787: 97 pgs: 97 active+clean; 305 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.4 MiB/s wr, 270 op/s 2024-05-09T05:51:17.920 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:51:17 smithi100 ceph-mon[34353]: pgmap v787: 97 pgs: 97 active+clean; 305 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.4 MiB/s wr, 270 op/s 2024-05-09T05:51:18.043 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:51:17 smithi060 ceph-mon[34555]: pgmap v787: 97 pgs: 97 active+clean; 305 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.4 MiB/s wr, 270 op/s 2024-05-09T05:51:18.663 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1375574 11.55 MB/sec execute 595 sec latency 61.378 ms 2024-05-09T05:51:18.856 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:51:18 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:51:18.856 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:51:18 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:51:18.856 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:51:18 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:51:18.920 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:51:18 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:51:18.920 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:51:18 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:51:18.920 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:51:18 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:51:19.043 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:51:18 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:51:19.043 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:51:18 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:51:19.043 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:51:18 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:51:19.663 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1378404 11.56 MB/sec execute 596 sec latency 11.034 ms 2024-05-09T05:51:19.856 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:51:19 smithi039 ceph-mon[30439]: pgmap v788: 97 pgs: 97 active+clean; 305 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.1 MiB/s wr, 218 op/s 2024-05-09T05:51:19.920 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:51:19 smithi100 ceph-mon[34353]: pgmap v788: 97 pgs: 97 active+clean; 305 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.1 MiB/s wr, 218 op/s 2024-05-09T05:51:20.043 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:51:19 smithi060 ceph-mon[34555]: pgmap v788: 97 pgs: 97 active+clean; 305 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.1 MiB/s wr, 218 op/s 2024-05-09T05:51:20.663 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1380110 11.56 MB/sec execute 597 sec latency 27.576 ms 2024-05-09T05:51:21.663 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1382447 11.56 MB/sec execute 598 sec latency 49.869 ms 2024-05-09T05:51:21.856 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:51:21 smithi039 ceph-mon[30439]: pgmap v789: 97 pgs: 97 active+clean; 307 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.9 MiB/s wr, 238 op/s 2024-05-09T05:51:21.920 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:51:21 smithi100 ceph-mon[34353]: pgmap v789: 97 pgs: 97 active+clean; 307 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.9 MiB/s wr, 238 op/s 2024-05-09T05:51:22.042 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:51:21 smithi060 ceph-mon[34555]: pgmap v789: 97 pgs: 97 active+clean; 307 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.9 MiB/s wr, 238 op/s 2024-05-09T05:51:22.666 INFO:tasks.workunit.client.0.smithi039.stdout: 1 1385011 11.56 MB/sec execute 599 sec latency 19.567 ms 2024-05-09T05:51:23.663 INFO:tasks.workunit.client.0.smithi039.stdout: 1 cleanup 600 sec 2024-05-09T05:51:23.841 INFO:tasks.workunit.client.0.smithi039.stdout: 0 cleanup 600 sec 2024-05-09T05:51:23.841 INFO:tasks.workunit.client.0.smithi039.stdout: 2024-05-09T05:51:23.842 INFO:tasks.workunit.client.0.smithi039.stdout: Operation Count AvgLat MaxLat 2024-05-09T05:51:23.842 INFO:tasks.workunit.client.0.smithi039.stdout: ---------------------------------------- 2024-05-09T05:51:23.842 INFO:tasks.workunit.client.0.smithi039.stdout: NTCreateX 220781 1.070 3676.268 2024-05-09T05:51:23.842 INFO:tasks.workunit.client.0.smithi039.stdout: Close 162156 0.003 0.094 2024-05-09T05:51:23.842 INFO:tasks.workunit.client.0.smithi039.stdout: Rename 9348 4.641 135.293 2024-05-09T05:51:23.842 INFO:tasks.workunit.client.0.smithi039.stdout: Unlink 44613 1.703 133.467 2024-05-09T05:51:23.842 INFO:tasks.workunit.client.0.smithi039.stdout: Deltree 6 87.762 126.236 2024-05-09T05:51:23.842 INFO:tasks.workunit.client.0.smithi039.stdout: Mkdir 3 0.007 0.011 2024-05-09T05:51:23.842 INFO:tasks.workunit.client.0.smithi039.stdout: Qpathinfo 200076 0.803 3927.668 2024-05-09T05:51:23.842 INFO:tasks.workunit.client.0.smithi039.stdout: Qfileinfo 35057 0.001 0.035 2024-05-09T05:51:23.842 INFO:tasks.workunit.client.0.smithi039.stdout: Qfsinfo 36702 0.187 12.308 2024-05-09T05:51:23.842 INFO:tasks.workunit.client.0.smithi039.stdout: Sfileinfo 17985 0.019 3.579 2024-05-09T05:51:23.843 INFO:tasks.workunit.client.0.smithi039.stdout: Find 77341 0.233 66.352 2024-05-09T05:51:23.843 INFO:tasks.workunit.client.0.smithi039.stdout: WriteX 110126 0.014 14.887 2024-05-09T05:51:23.843 INFO:tasks.workunit.client.0.smithi039.stdout: ReadX 345905 0.011 15.229 2024-05-09T05:51:23.843 INFO:tasks.workunit.client.0.smithi039.stdout: LockX 718 0.953 2.631 2024-05-09T05:51:23.843 INFO:tasks.workunit.client.0.smithi039.stdout: UnlockX 718 0.820 2.761 2024-05-09T05:51:23.843 INFO:tasks.workunit.client.0.smithi039.stdout: Flush 15479 3.089 106.901 2024-05-09T05:51:23.843 INFO:tasks.workunit.client.0.smithi039.stdout: 2024-05-09T05:51:23.843 INFO:tasks.workunit.client.0.smithi039.stdout:Throughput 11.5611 MB/sec 1 clients 1 procs max_latency=3927.679 ms 2024-05-09T05:51:23.843 INFO:tasks.workunit.client.0.smithi039.stderr:+ dbench 10 2024-05-09T05:51:23.844 INFO:tasks.workunit.client.0.smithi039.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2024-05-09T05:51:23.844 INFO:tasks.workunit.client.0.smithi039.stdout: 2024-05-09T05:51:23.844 INFO:tasks.workunit.client.0.smithi039.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2024-05-09T05:51:23.844 INFO:tasks.workunit.client.0.smithi039.stdout:8 of 10 processes prepared for launch 0 sec 2024-05-09T05:51:23.856 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:51:23 smithi039 ceph-mon[30439]: pgmap v790: 97 pgs: 97 active+clean; 304 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.9 MiB/s wr, 249 op/s 2024-05-09T05:51:23.920 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:51:23 smithi100 ceph-mon[34353]: pgmap v790: 97 pgs: 97 active+clean; 304 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.9 MiB/s wr, 249 op/s 2024-05-09T05:51:23.943 INFO:tasks.workunit.client.0.smithi039.stdout:10 of 10 processes prepared for launch 0 sec 2024-05-09T05:51:23.943 INFO:tasks.workunit.client.0.smithi039.stdout:releasing clients 2024-05-09T05:51:24.042 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:51:23 smithi060 ceph-mon[34555]: pgmap v790: 97 pgs: 97 active+clean; 304 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.9 MiB/s wr, 249 op/s 2024-05-09T05:51:24.943 INFO:tasks.workunit.client.0.smithi039.stdout: 10 349 125.77 MB/sec warmup 1 sec latency 78.381 ms 2024-05-09T05:51:25.856 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:51:25 smithi039 ceph-mon[30439]: pgmap v791: 97 pgs: 97 active+clean; 299 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.2 MiB/s wr, 251 op/s 2024-05-09T05:51:25.856 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:51:25 smithi039 ceph-mon[30439]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-09T05:51:25.920 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:51:25 smithi100 ceph-mon[34353]: pgmap v791: 97 pgs: 97 active+clean; 299 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.2 MiB/s wr, 251 op/s 2024-05-09T05:51:25.920 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:51:25 smithi100 ceph-mon[34353]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-09T05:51:25.946 INFO:tasks.workunit.client.0.smithi039.stdout: 10 730 106.26 MB/sec warmup 2 sec latency 85.596 ms 2024-05-09T05:51:26.043 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:51:25 smithi060 ceph-mon[34555]: pgmap v791: 97 pgs: 97 active+clean; 299 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.2 MiB/s wr, 251 op/s 2024-05-09T05:51:26.043 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:51:25 smithi060 ceph-mon[34555]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-09T05:51:26.856 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:51:26 smithi039 ceph-mon[30439]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-09T05:51:26.920 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:51:26 smithi100 ceph-mon[34353]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-09T05:51:26.943 INFO:tasks.workunit.client.0.smithi039.stdout: 10 1092 76.16 MB/sec warmup 3 sec latency 101.065 ms 2024-05-09T05:51:27.042 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:51:26 smithi060 ceph-mon[34555]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-09T05:51:27.920 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:51:27 smithi100 ceph-mon[34353]: pgmap v792: 97 pgs: 97 active+clean; 296 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.9 MiB/s wr, 214 op/s 2024-05-09T05:51:27.943 INFO:tasks.workunit.client.0.smithi039.stdout: 10 1717 66.83 MB/sec warmup 4 sec latency 125.718 ms 2024-05-09T05:51:28.042 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:51:27 smithi060 ceph-mon[34555]: pgmap v792: 97 pgs: 97 active+clean; 296 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.9 MiB/s wr, 214 op/s 2024-05-09T05:51:28.106 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:51:27 smithi039 ceph-mon[30439]: pgmap v792: 97 pgs: 97 active+clean; 296 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.9 MiB/s wr, 214 op/s 2024-05-09T05:51:28.943 INFO:tasks.workunit.client.0.smithi039.stdout: 10 2554 58.43 MB/sec warmup 5 sec latency 54.848 ms 2024-05-09T05:51:29.908 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:51:29 smithi039 ceph-mon[30439]: pgmap v793: 97 pgs: 97 active+clean; 305 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.4 MiB/s wr, 258 op/s 2024-05-09T05:51:29.920 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:51:29 smithi100 ceph-mon[34353]: pgmap v793: 97 pgs: 97 active+clean; 305 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.4 MiB/s wr, 258 op/s 2024-05-09T05:51:29.943 INFO:tasks.workunit.client.0.smithi039.stdout: 10 3024 55.85 MB/sec warmup 6 sec latency 99.805 ms 2024-05-09T05:51:30.046 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:51:29 smithi060 ceph-mon[34555]: pgmap v793: 97 pgs: 97 active+clean; 305 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.4 MiB/s wr, 258 op/s 2024-05-09T05:51:30.920 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:51:30 smithi100 ceph-mon[34353]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-09T05:51:30.943 INFO:tasks.workunit.client.0.smithi039.stdout: 10 3570 53.79 MB/sec warmup 7 sec latency 79.304 ms 2024-05-09T05:51:31.042 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:51:30 smithi060 ceph-mon[34555]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-09T05:51:31.106 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:51:30 smithi039 ceph-mon[30439]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-09T05:51:31.920 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:51:31 smithi100 ceph-mon[34353]: pgmap v794: 97 pgs: 97 active+clean; 307 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 994 KiB/s rd, 3.4 MiB/s wr, 267 op/s 2024-05-09T05:51:31.943 INFO:tasks.workunit.client.0.smithi039.stdout: 10 4010 50.57 MB/sec warmup 8 sec latency 127.038 ms 2024-05-09T05:51:32.042 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:51:31 smithi060 ceph-mon[34555]: pgmap v794: 97 pgs: 97 active+clean; 307 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 994 KiB/s rd, 3.4 MiB/s wr, 267 op/s 2024-05-09T05:51:32.106 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:51:31 smithi039 ceph-mon[30439]: pgmap v794: 97 pgs: 97 active+clean; 307 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 994 KiB/s rd, 3.4 MiB/s wr, 267 op/s 2024-05-09T05:51:32.943 INFO:tasks.workunit.client.0.smithi039.stdout: 10 4278 46.57 MB/sec warmup 9 sec latency 101.691 ms 2024-05-09T05:51:33.920 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:51:33 smithi100 ceph-mon[34353]: pgmap v795: 97 pgs: 97 active+clean; 306 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 610 KiB/s rd, 3.3 MiB/s wr, 226 op/s 2024-05-09T05:51:33.943 INFO:tasks.workunit.client.0.smithi039.stdout: 10 4466 42.03 MB/sec warmup 10 sec latency 131.329 ms 2024-05-09T05:51:34.042 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:51:33 smithi060 ceph-mon[34555]: pgmap v795: 97 pgs: 97 active+clean; 306 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 610 KiB/s rd, 3.3 MiB/s wr, 226 op/s 2024-05-09T05:51:34.106 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:51:33 smithi039 ceph-mon[30439]: pgmap v795: 97 pgs: 97 active+clean; 306 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 610 KiB/s rd, 3.3 MiB/s wr, 226 op/s 2024-05-09T05:51:34.943 INFO:tasks.workunit.client.0.smithi039.stdout: 10 4656 38.48 MB/sec warmup 11 sec latency 120.732 ms 2024-05-09T05:51:35.920 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:51:35 smithi100 ceph-mon[34353]: pgmap v796: 97 pgs: 97 active+clean; 311 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 836 KiB/s rd, 3.6 MiB/s wr, 247 op/s 2024-05-09T05:51:35.943 INFO:tasks.workunit.client.0.smithi039.stdout: 10 5069 36.80 MB/sec warmup 12 sec latency 86.927 ms 2024-05-09T05:51:36.042 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:51:35 smithi060 ceph-mon[34555]: pgmap v796: 97 pgs: 97 active+clean; 311 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 836 KiB/s rd, 3.6 MiB/s wr, 247 op/s 2024-05-09T05:51:36.106 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:51:35 smithi039 ceph-mon[30439]: pgmap v796: 97 pgs: 97 active+clean; 311 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 836 KiB/s rd, 3.6 MiB/s wr, 247 op/s 2024-05-09T05:51:36.943 INFO:tasks.workunit.client.0.smithi039.stdout: 10 5625 36.67 MB/sec warmup 13 sec latency 125.199 ms 2024-05-09T05:51:37.920 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:51:37 smithi100 ceph-mon[34353]: pgmap v797: 97 pgs: 97 active+clean; 310 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.9 MiB/s wr, 274 op/s 2024-05-09T05:51:37.944 INFO:tasks.workunit.client.0.smithi039.stdout: 10 6395 35.73 MB/sec warmup 14 sec latency 83.640 ms 2024-05-09T05:51:38.042 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:51:37 smithi060 ceph-mon[34555]: pgmap v797: 97 pgs: 97 active+clean; 310 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.9 MiB/s wr, 274 op/s 2024-05-09T05:51:38.106 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:51:37 smithi039 ceph-mon[30439]: pgmap v797: 97 pgs: 97 active+clean; 310 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.9 MiB/s wr, 274 op/s 2024-05-09T05:51:38.944 INFO:tasks.workunit.client.0.smithi039.stdout: 10 6906 35.99 MB/sec warmup 15 sec latency 51.009 ms 2024-05-09T05:51:39.920 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:51:39 smithi100 ceph-mon[34353]: pgmap v798: 97 pgs: 97 active+clean; 312 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.6 MiB/s wr, 328 op/s 2024-05-09T05:51:39.944 INFO:tasks.workunit.client.0.smithi039.stdout: 10 7582 36.84 MB/sec warmup 16 sec latency 94.765 ms 2024-05-09T05:51:40.042 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:51:39 smithi060 ceph-mon[34555]: pgmap v798: 97 pgs: 97 active+clean; 312 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.6 MiB/s wr, 328 op/s 2024-05-09T05:51:40.106 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:51:39 smithi039 ceph-mon[30439]: pgmap v798: 97 pgs: 97 active+clean; 312 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.6 MiB/s wr, 328 op/s 2024-05-09T05:51:40.944 INFO:tasks.workunit.client.0.smithi039.stdout: 10 8026 36.59 MB/sec warmup 17 sec latency 80.989 ms 2024-05-09T05:51:41.920 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:51:41 smithi100 ceph-mon[34353]: pgmap v799: 97 pgs: 97 active+clean; 314 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.7 MiB/s wr, 256 op/s 2024-05-09T05:51:41.944 INFO:tasks.workunit.client.0.smithi039.stdout: 10 8213 34.92 MB/sec warmup 18 sec latency 149.971 ms 2024-05-09T05:51:42.042 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:51:41 smithi060 ceph-mon[34555]: pgmap v799: 97 pgs: 97 active+clean; 314 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.7 MiB/s wr, 256 op/s 2024-05-09T05:51:42.106 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:51:41 smithi039 ceph-mon[30439]: pgmap v799: 97 pgs: 97 active+clean; 314 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.7 MiB/s wr, 256 op/s 2024-05-09T05:51:42.944 INFO:tasks.workunit.client.0.smithi039.stdout: 10 8363 33.20 MB/sec warmup 19 sec latency 131.386 ms 2024-05-09T05:51:43.920 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:51:43 smithi100 ceph-mon[34353]: pgmap v800: 97 pgs: 97 active+clean; 319 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.1 MiB/s wr, 281 op/s 2024-05-09T05:51:43.944 INFO:tasks.workunit.client.0.smithi039.stdout: 10 8713 32.03 MB/sec warmup 20 sec latency 90.013 ms 2024-05-09T05:51:44.042 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:51:43 smithi060 ceph-mon[34555]: pgmap v800: 97 pgs: 97 active+clean; 319 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.1 MiB/s wr, 281 op/s 2024-05-09T05:51:44.106 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:51:43 smithi039 ceph-mon[30439]: pgmap v800: 97 pgs: 97 active+clean; 319 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.1 MiB/s wr, 281 op/s 2024-05-09T05:51:44.944 INFO:tasks.workunit.client.0.smithi039.stdout: 10 9205 31.74 MB/sec warmup 21 sec latency 55.058 ms 2024-05-09T05:51:45.920 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:51:45 smithi100 ceph-mon[34353]: pgmap v801: 97 pgs: 97 active+clean; 315 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.3 MiB/s wr, 311 op/s 2024-05-09T05:51:45.944 INFO:tasks.workunit.client.0.smithi039.stdout: 10 9738 31.51 MB/sec warmup 22 sec latency 108.627 ms 2024-05-09T05:51:46.042 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:51:45 smithi060 ceph-mon[34555]: pgmap v801: 97 pgs: 97 active+clean; 315 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.3 MiB/s wr, 311 op/s 2024-05-09T05:51:46.106 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:51:45 smithi039 ceph-mon[30439]: pgmap v801: 97 pgs: 97 active+clean; 315 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.3 MiB/s wr, 311 op/s 2024-05-09T05:51:46.944 INFO:tasks.workunit.client.0.smithi039.stdout: 10 10344 30.98 MB/sec warmup 23 sec latency 86.740 ms 2024-05-09T05:51:47.920 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:51:47 smithi100 ceph-mon[34353]: pgmap v802: 97 pgs: 97 active+clean; 309 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.4 MiB/s wr, 309 op/s 2024-05-09T05:51:47.944 INFO:tasks.workunit.client.0.smithi039.stdout: 10 10969 31.46 MB/sec warmup 24 sec latency 101.879 ms 2024-05-09T05:51:48.042 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:51:47 smithi060 ceph-mon[34555]: pgmap v802: 97 pgs: 97 active+clean; 309 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.4 MiB/s wr, 309 op/s 2024-05-09T05:51:48.106 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:51:47 smithi039 ceph-mon[30439]: pgmap v802: 97 pgs: 97 active+clean; 309 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.4 MiB/s wr, 309 op/s 2024-05-09T05:51:48.944 INFO:tasks.workunit.client.0.smithi039.stdout: 10 11637 32.40 MB/sec warmup 25 sec latency 43.356 ms 2024-05-09T05:51:49.920 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:51:49 smithi100 ceph-mon[34353]: pgmap v803: 97 pgs: 97 active+clean; 306 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.6 MiB/s wr, 335 op/s 2024-05-09T05:51:49.944 INFO:tasks.workunit.client.0.smithi039.stdout: 10 11962 31.96 MB/sec warmup 26 sec latency 126.258 ms 2024-05-09T05:51:50.042 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:51:49 smithi060 ceph-mon[34555]: pgmap v803: 97 pgs: 97 active+clean; 306 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.6 MiB/s wr, 335 op/s 2024-05-09T05:51:50.106 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:51:49 smithi039 ceph-mon[30439]: pgmap v803: 97 pgs: 97 active+clean; 306 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.6 MiB/s wr, 335 op/s 2024-05-09T05:51:50.944 INFO:tasks.workunit.client.0.smithi039.stdout: 10 12203 31.24 MB/sec warmup 27 sec latency 85.168 ms 2024-05-09T05:51:51.920 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:51:51 smithi100 ceph-mon[34353]: pgmap v804: 97 pgs: 97 active+clean; 306 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 992 KiB/s rd, 3.9 MiB/s wr, 271 op/s 2024-05-09T05:51:51.944 INFO:tasks.workunit.client.0.smithi039.stdout: 10 12519 30.48 MB/sec warmup 28 sec latency 121.152 ms 2024-05-09T05:51:52.042 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:51:51 smithi060 ceph-mon[34555]: pgmap v804: 97 pgs: 97 active+clean; 306 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 992 KiB/s rd, 3.9 MiB/s wr, 271 op/s 2024-05-09T05:51:52.106 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:51:51 smithi039 ceph-mon[30439]: pgmap v804: 97 pgs: 97 active+clean; 306 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 992 KiB/s rd, 3.9 MiB/s wr, 271 op/s 2024-05-09T05:51:52.944 INFO:tasks.workunit.client.0.smithi039.stdout: 10 12821 29.84 MB/sec warmup 29 sec latency 163.791 ms 2024-05-09T05:51:53.920 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:51:53 smithi100 ceph-mon[34353]: pgmap v805: 97 pgs: 97 active+clean; 312 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.4 MiB/s wr, 312 op/s 2024-05-09T05:51:53.944 INFO:tasks.workunit.client.0.smithi039.stdout: 10 13214 29.53 MB/sec warmup 30 sec latency 70.917 ms 2024-05-09T05:51:54.042 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:51:53 smithi060 ceph-mon[34555]: pgmap v805: 97 pgs: 97 active+clean; 312 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.4 MiB/s wr, 312 op/s 2024-05-09T05:51:54.106 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:51:53 smithi039 ceph-mon[30439]: pgmap v805: 97 pgs: 97 active+clean; 312 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 4.4 MiB/s wr, 312 op/s 2024-05-09T05:51:54.944 INFO:tasks.workunit.client.0.smithi039.stdout: 10 13784 29.27 MB/sec warmup 31 sec latency 65.374 ms 2024-05-09T05:51:55.919 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:51:55 smithi100 ceph-mon[34353]: pgmap v806: 97 pgs: 97 active+clean; 317 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.6 MiB/s wr, 312 op/s 2024-05-09T05:51:55.944 INFO:tasks.workunit.client.0.smithi039.stdout: 10 14393 29.20 MB/sec warmup 32 sec latency 221.193 ms 2024-05-09T05:51:56.042 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:51:55 smithi060 ceph-mon[34555]: pgmap v806: 97 pgs: 97 active+clean; 317 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.6 MiB/s wr, 312 op/s 2024-05-09T05:51:56.106 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:51:55 smithi039 ceph-mon[30439]: pgmap v806: 97 pgs: 97 active+clean; 317 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.6 MiB/s wr, 312 op/s 2024-05-09T05:51:56.944 INFO:tasks.workunit.client.0.smithi039.stdout: 10 15120 29.85 MB/sec warmup 33 sec latency 53.725 ms 2024-05-09T05:51:57.919 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:51:57 smithi100 ceph-mon[34353]: pgmap v807: 97 pgs: 97 active+clean; 319 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1006 KiB/s rd, 5.6 MiB/s wr, 292 op/s 2024-05-09T05:51:57.944 INFO:tasks.workunit.client.0.smithi039.stdout: 10 15337 29.46 MB/sec warmup 34 sec latency 282.418 ms 2024-05-09T05:51:58.042 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:51:57 smithi060 ceph-mon[34555]: pgmap v807: 97 pgs: 97 active+clean; 319 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1006 KiB/s rd, 5.6 MiB/s wr, 292 op/s 2024-05-09T05:51:58.106 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:51:57 smithi039 ceph-mon[30439]: pgmap v807: 97 pgs: 97 active+clean; 319 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1006 KiB/s rd, 5.6 MiB/s wr, 292 op/s 2024-05-09T05:51:58.944 INFO:tasks.workunit.client.0.smithi039.stdout: 10 15683 29.38 MB/sec warmup 35 sec latency 73.576 ms 2024-05-09T05:51:59.944 INFO:tasks.workunit.client.0.smithi039.stdout: 10 16099 29.30 MB/sec warmup 36 sec latency 65.486 ms 2024-05-09T05:52:00.042 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:51:59 smithi060 ceph-mon[34555]: pgmap v808: 97 pgs: 97 active+clean; 400 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 12 MiB/s wr, 350 op/s 2024-05-09T05:52:00.106 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:51:59 smithi039 ceph-mon[30439]: pgmap v808: 97 pgs: 97 active+clean; 400 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 12 MiB/s wr, 350 op/s 2024-05-09T05:52:00.169 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:51:59 smithi100 ceph-mon[34353]: pgmap v808: 97 pgs: 97 active+clean; 400 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 12 MiB/s wr, 350 op/s 2024-05-09T05:52:00.944 INFO:tasks.workunit.client.0.smithi039.stdout: 10 16397 28.87 MB/sec warmup 37 sec latency 66.373 ms 2024-05-09T05:52:01.944 INFO:tasks.workunit.client.0.smithi039.stdout: 10 16617 28.24 MB/sec warmup 38 sec latency 75.596 ms 2024-05-09T05:52:02.042 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:52:01 smithi060 ceph-mon[34555]: pgmap v809: 97 pgs: 97 active+clean; 454 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 16 MiB/s wr, 304 op/s 2024-05-09T05:52:02.106 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:52:01 smithi039 ceph-mon[30439]: pgmap v809: 97 pgs: 97 active+clean; 454 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 16 MiB/s wr, 304 op/s 2024-05-09T05:52:02.169 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:52:01 smithi100 ceph-mon[34353]: pgmap v809: 97 pgs: 97 active+clean; 454 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 16 MiB/s wr, 304 op/s 2024-05-09T05:52:02.944 INFO:tasks.workunit.client.0.smithi039.stdout: 10 16799 27.65 MB/sec warmup 39 sec latency 255.881 ms 2024-05-09T05:52:03.944 INFO:tasks.workunit.client.0.smithi039.stdout: 10 17239 27.49 MB/sec warmup 40 sec latency 135.855 ms 2024-05-09T05:52:04.042 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:52:03 smithi060 ceph-mon[34555]: pgmap v810: 97 pgs: 97 active+clean; 519 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 21 MiB/s wr, 319 op/s 2024-05-09T05:52:04.106 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:52:03 smithi039 ceph-mon[30439]: pgmap v810: 97 pgs: 97 active+clean; 519 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 21 MiB/s wr, 319 op/s 2024-05-09T05:52:04.169 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:52:03 smithi100 ceph-mon[34353]: pgmap v810: 97 pgs: 97 active+clean; 519 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 21 MiB/s wr, 319 op/s 2024-05-09T05:52:04.944 INFO:tasks.workunit.client.0.smithi039.stdout: 10 17824 27.55 MB/sec warmup 41 sec latency 50.472 ms 2024-05-09T05:52:05.944 INFO:tasks.workunit.client.0.smithi039.stdout: 10 18421 27.40 MB/sec warmup 42 sec latency 49.792 ms 2024-05-09T05:52:06.042 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:52:05 smithi060 ceph-mon[34555]: pgmap v811: 97 pgs: 97 active+clean; 534 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 22 MiB/s wr, 352 op/s 2024-05-09T05:52:06.106 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:52:05 smithi039 ceph-mon[30439]: pgmap v811: 97 pgs: 97 active+clean; 534 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 22 MiB/s wr, 352 op/s 2024-05-09T05:52:06.169 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:52:05 smithi100 ceph-mon[34353]: pgmap v811: 97 pgs: 97 active+clean; 534 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 22 MiB/s wr, 352 op/s 2024-05-09T05:52:06.944 INFO:tasks.workunit.client.0.smithi039.stdout: 10 18929 27.57 MB/sec warmup 43 sec latency 90.824 ms 2024-05-09T05:52:07.944 INFO:tasks.workunit.client.0.smithi039.stdout: 10 19439 27.73 MB/sec warmup 44 sec latency 168.632 ms 2024-05-09T05:52:08.042 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:52:07 smithi060 ceph-mon[34555]: pgmap v812: 97 pgs: 97 active+clean; 531 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 22 MiB/s wr, 355 op/s 2024-05-09T05:52:08.106 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:52:07 smithi039 ceph-mon[30439]: pgmap v812: 97 pgs: 97 active+clean; 531 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 22 MiB/s wr, 355 op/s 2024-05-09T05:52:08.170 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:52:07 smithi100 ceph-mon[34353]: pgmap v812: 97 pgs: 97 active+clean; 531 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 22 MiB/s wr, 355 op/s 2024-05-09T05:52:08.945 INFO:tasks.workunit.client.0.smithi039.stdout: 10 19887 28.01 MB/sec warmup 45 sec latency 61.174 ms 2024-05-09T05:52:09.945 INFO:tasks.workunit.client.0.smithi039.stdout: 10 20179 27.68 MB/sec warmup 46 sec latency 105.562 ms 2024-05-09T05:52:09.971 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:52:09 smithi100 ceph-mon[34353]: pgmap v813: 97 pgs: 97 active+clean; 517 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 22 MiB/s wr, 427 op/s 2024-05-09T05:52:10.042 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:52:09 smithi060 ceph-mon[34555]: pgmap v813: 97 pgs: 97 active+clean; 517 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 22 MiB/s wr, 427 op/s 2024-05-09T05:52:10.106 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:52:09 smithi039 ceph-mon[30439]: pgmap v813: 97 pgs: 97 active+clean; 517 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 22 MiB/s wr, 427 op/s 2024-05-09T05:52:10.945 INFO:tasks.workunit.client.0.smithi039.stdout: 10 20359 27.21 MB/sec warmup 47 sec latency 189.662 ms 2024-05-09T05:52:11.945 INFO:tasks.workunit.client.0.smithi039.stdout: 10 20672 26.86 MB/sec warmup 48 sec latency 119.694 ms 2024-05-09T05:52:12.042 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:52:11 smithi060 ceph-mon[34555]: pgmap v814: 97 pgs: 97 active+clean; 505 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 15 MiB/s wr, 350 op/s 2024-05-09T05:52:12.106 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:52:11 smithi039 ceph-mon[30439]: pgmap v814: 97 pgs: 97 active+clean; 505 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 15 MiB/s wr, 350 op/s 2024-05-09T05:52:12.169 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:52:11 smithi100 ceph-mon[34353]: pgmap v814: 97 pgs: 97 active+clean; 505 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 15 MiB/s wr, 350 op/s 2024-05-09T05:52:12.945 INFO:tasks.workunit.client.0.smithi039.stdout: 10 20968 26.66 MB/sec warmup 49 sec latency 229.136 ms 2024-05-09T05:52:13.945 INFO:tasks.workunit.client.0.smithi039.stdout: 10 21380 26.51 MB/sec warmup 50 sec latency 85.905 ms 2024-05-09T05:52:14.042 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:52:13 smithi060 ceph-mon[34555]: pgmap v815: 97 pgs: 97 active+clean; 510 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 11 MiB/s wr, 392 op/s 2024-05-09T05:52:14.106 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:52:13 smithi039 ceph-mon[30439]: pgmap v815: 97 pgs: 97 active+clean; 510 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 11 MiB/s wr, 392 op/s 2024-05-09T05:52:14.169 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:52:13 smithi100 ceph-mon[34353]: pgmap v815: 97 pgs: 97 active+clean; 510 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 11 MiB/s wr, 392 op/s 2024-05-09T05:52:14.945 INFO:tasks.workunit.client.0.smithi039.stdout: 10 21853 26.29 MB/sec warmup 51 sec latency 101.211 ms 2024-05-09T05:52:15.945 INFO:tasks.workunit.client.0.smithi039.stdout: 10 22354 26.36 MB/sec warmup 52 sec latency 86.325 ms 2024-05-09T05:52:16.042 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:52:15 smithi060 ceph-mon[34555]: pgmap v816: 97 pgs: 97 active+clean; 522 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 6.7 MiB/s wr, 433 op/s 2024-05-09T05:52:16.106 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:52:15 smithi039 ceph-mon[30439]: pgmap v816: 97 pgs: 97 active+clean; 522 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 6.7 MiB/s wr, 433 op/s 2024-05-09T05:52:16.169 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:52:15 smithi100 ceph-mon[34353]: pgmap v816: 97 pgs: 97 active+clean; 522 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 6.7 MiB/s wr, 433 op/s 2024-05-09T05:52:16.945 INFO:tasks.workunit.client.0.smithi039.stdout: 10 23105 26.64 MB/sec warmup 53 sec latency 63.182 ms 2024-05-09T05:52:17.945 INFO:tasks.workunit.client.0.smithi039.stdout: 10 23453 26.67 MB/sec warmup 54 sec latency 238.252 ms 2024-05-09T05:52:18.042 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:52:17 smithi060 ceph-mon[34555]: pgmap v817: 97 pgs: 97 active+clean; 523 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 6.4 MiB/s wr, 385 op/s 2024-05-09T05:52:18.106 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:52:17 smithi039 ceph-mon[30439]: pgmap v817: 97 pgs: 97 active+clean; 523 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 6.4 MiB/s wr, 385 op/s 2024-05-09T05:52:18.169 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:52:17 smithi100 ceph-mon[34353]: pgmap v817: 97 pgs: 97 active+clean; 523 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 6.4 MiB/s wr, 385 op/s 2024-05-09T05:52:18.945 INFO:tasks.workunit.client.0.smithi039.stdout: 10 23784 26.57 MB/sec warmup 55 sec latency 277.645 ms 2024-05-09T05:52:19.042 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:52:18 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:52:19.106 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:52:18 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:52:19.169 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:52:18 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:52:19.945 INFO:tasks.workunit.client.0.smithi039.stdout: 10 24084 26.41 MB/sec warmup 56 sec latency 128.921 ms 2024-05-09T05:52:20.042 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:52:19 smithi060 ceph-mon[34555]: pgmap v818: 97 pgs: 97 active+clean; 518 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.7 MiB/s wr, 388 op/s 2024-05-09T05:52:20.042 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:52:19 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:52:20.042 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:52:19 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:52:20.043 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:52:19 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:52:20.106 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:52:19 smithi039 ceph-mon[30439]: pgmap v818: 97 pgs: 97 active+clean; 518 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.7 MiB/s wr, 388 op/s 2024-05-09T05:52:20.106 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:52:19 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:52:20.106 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:52:19 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:52:20.106 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:52:19 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:52:20.169 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:52:19 smithi100 ceph-mon[34353]: pgmap v818: 97 pgs: 97 active+clean; 518 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.7 MiB/s wr, 388 op/s 2024-05-09T05:52:20.169 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:52:19 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:52:20.169 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:52:19 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:52:20.170 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:52:19 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:52:20.945 INFO:tasks.workunit.client.0.smithi039.stdout: 10 24417 26.24 MB/sec warmup 57 sec latency 143.004 ms 2024-05-09T05:52:21.945 INFO:tasks.workunit.client.0.smithi039.stdout: 10 24746 26.06 MB/sec warmup 58 sec latency 166.576 ms 2024-05-09T05:52:22.042 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:52:21 smithi060 ceph-mon[34555]: pgmap v819: 97 pgs: 97 active+clean; 521 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.4 MiB/s wr, 359 op/s 2024-05-09T05:52:22.106 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:52:21 smithi039 ceph-mon[30439]: pgmap v819: 97 pgs: 97 active+clean; 521 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.4 MiB/s wr, 359 op/s 2024-05-09T05:52:22.169 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:52:21 smithi100 ceph-mon[34353]: pgmap v819: 97 pgs: 97 active+clean; 521 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.4 MiB/s wr, 359 op/s 2024-05-09T05:52:22.945 INFO:tasks.workunit.client.0.smithi039.stdout: 10 24981 25.74 MB/sec warmup 59 sec latency 223.437 ms 2024-05-09T05:52:23.945 INFO:tasks.workunit.client.0.smithi039.stdout: 10 25300 25.59 MB/sec warmup 60 sec latency 127.626 ms 2024-05-09T05:52:24.042 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:52:23 smithi060 ceph-mon[34555]: pgmap v820: 97 pgs: 97 active+clean; 522 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.6 MiB/s wr, 389 op/s 2024-05-09T05:52:24.106 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:52:23 smithi039 ceph-mon[30439]: pgmap v820: 97 pgs: 97 active+clean; 522 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.6 MiB/s wr, 389 op/s 2024-05-09T05:52:24.169 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:52:23 smithi100 ceph-mon[34353]: pgmap v820: 97 pgs: 97 active+clean; 522 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.6 MiB/s wr, 389 op/s 2024-05-09T05:52:24.946 INFO:tasks.workunit.client.0.smithi039.stdout: 10 25852 25.52 MB/sec warmup 61 sec latency 138.087 ms 2024-05-09T05:52:25.945 INFO:tasks.workunit.client.0.smithi039.stdout: 10 26398 25.64 MB/sec warmup 62 sec latency 65.110 ms 2024-05-09T05:52:26.042 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:52:25 smithi060 ceph-mon[34555]: pgmap v821: 97 pgs: 97 active+clean; 526 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 5.8 MiB/s wr, 356 op/s 2024-05-09T05:52:26.106 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:52:25 smithi039 ceph-mon[30439]: pgmap v821: 97 pgs: 97 active+clean; 526 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 5.8 MiB/s wr, 356 op/s 2024-05-09T05:52:26.171 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:52:25 smithi100 ceph-mon[34353]: pgmap v821: 97 pgs: 97 active+clean; 526 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 5.8 MiB/s wr, 356 op/s 2024-05-09T05:52:26.945 INFO:tasks.workunit.client.0.smithi039.stdout: 10 26995 25.76 MB/sec warmup 63 sec latency 59.149 ms 2024-05-09T05:52:27.945 INFO:tasks.workunit.client.0.smithi039.stdout: 10 27339 25.79 MB/sec warmup 64 sec latency 72.971 ms 2024-05-09T05:52:28.042 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:52:27 smithi060 ceph-mon[34555]: pgmap v822: 97 pgs: 97 active+clean; 531 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.9 MiB/s wr, 362 op/s 2024-05-09T05:52:28.106 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:52:27 smithi039 ceph-mon[30439]: pgmap v822: 97 pgs: 97 active+clean; 531 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.9 MiB/s wr, 362 op/s 2024-05-09T05:52:28.169 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:52:27 smithi100 ceph-mon[34353]: pgmap v822: 97 pgs: 97 active+clean; 531 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.9 MiB/s wr, 362 op/s 2024-05-09T05:52:28.945 INFO:tasks.workunit.client.0.smithi039.stdout: 10 27581 25.58 MB/sec warmup 65 sec latency 294.320 ms 2024-05-09T05:52:29.945 INFO:tasks.workunit.client.0.smithi039.stdout: 10 27885 25.53 MB/sec warmup 66 sec latency 136.903 ms 2024-05-09T05:52:30.042 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:52:29 smithi060 ceph-mon[34555]: pgmap v823: 97 pgs: 97 active+clean; 537 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 6.1 MiB/s wr, 389 op/s 2024-05-09T05:52:30.106 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:52:29 smithi039 ceph-mon[30439]: pgmap v823: 97 pgs: 97 active+clean; 537 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 6.1 MiB/s wr, 389 op/s 2024-05-09T05:52:30.169 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:52:29 smithi100 ceph-mon[34353]: pgmap v823: 97 pgs: 97 active+clean; 537 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 6.1 MiB/s wr, 389 op/s 2024-05-09T05:52:30.945 INFO:tasks.workunit.client.0.smithi039.stdout: 10 28244 25.42 MB/sec warmup 67 sec latency 81.765 ms 2024-05-09T05:52:31.946 INFO:tasks.workunit.client.0.smithi039.stdout: 10 28546 25.26 MB/sec warmup 68 sec latency 60.687 ms 2024-05-09T05:52:32.042 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:52:31 smithi060 ceph-mon[34555]: pgmap v824: 97 pgs: 97 active+clean; 541 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 6.4 MiB/s wr, 401 op/s 2024-05-09T05:52:32.106 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:52:31 smithi039 ceph-mon[30439]: pgmap v824: 97 pgs: 97 active+clean; 541 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 6.4 MiB/s wr, 401 op/s 2024-05-09T05:52:32.169 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:52:31 smithi100 ceph-mon[34353]: pgmap v824: 97 pgs: 97 active+clean; 541 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 6.4 MiB/s wr, 401 op/s 2024-05-09T05:52:32.945 INFO:tasks.workunit.client.0.smithi039.stdout: 10 28816 25.04 MB/sec warmup 69 sec latency 71.834 ms 2024-05-09T05:52:33.945 INFO:tasks.workunit.client.0.smithi039.stdout: 10 29063 24.89 MB/sec warmup 70 sec latency 197.436 ms 2024-05-09T05:52:34.042 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:52:33 smithi060 ceph-mon[34555]: pgmap v825: 97 pgs: 97 active+clean; 533 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 6.2 MiB/s wr, 376 op/s 2024-05-09T05:52:34.106 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:52:33 smithi039 ceph-mon[30439]: pgmap v825: 97 pgs: 97 active+clean; 533 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 6.2 MiB/s wr, 376 op/s 2024-05-09T05:52:34.169 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:52:33 smithi100 ceph-mon[34353]: pgmap v825: 97 pgs: 97 active+clean; 533 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 6.2 MiB/s wr, 376 op/s 2024-05-09T05:52:34.945 INFO:tasks.workunit.client.0.smithi039.stdout: 10 29560 24.71 MB/sec warmup 71 sec latency 123.312 ms 2024-05-09T05:52:35.945 INFO:tasks.workunit.client.0.smithi039.stdout: 10 30041 24.78 MB/sec warmup 72 sec latency 56.594 ms 2024-05-09T05:52:36.042 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:52:35 smithi060 ceph-mon[34555]: pgmap v826: 97 pgs: 97 active+clean; 515 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 6.8 MiB/s wr, 376 op/s 2024-05-09T05:52:36.106 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:52:35 smithi039 ceph-mon[30439]: pgmap v826: 97 pgs: 97 active+clean; 515 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 6.8 MiB/s wr, 376 op/s 2024-05-09T05:52:36.169 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:52:35 smithi100 ceph-mon[34353]: pgmap v826: 97 pgs: 97 active+clean; 515 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 6.8 MiB/s wr, 376 op/s 2024-05-09T05:52:36.946 INFO:tasks.workunit.client.0.smithi039.stdout: 10 30709 24.95 MB/sec warmup 73 sec latency 50.408 ms 2024-05-09T05:52:37.946 INFO:tasks.workunit.client.0.smithi039.stdout: 10 31117 25.01 MB/sec warmup 74 sec latency 56.164 ms 2024-05-09T05:52:38.042 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:52:37 smithi060 ceph-mon[34555]: pgmap v827: 97 pgs: 97 active+clean; 522 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 MiB/s rd, 7.6 MiB/s wr, 433 op/s 2024-05-09T05:52:38.106 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:52:37 smithi039 ceph-mon[30439]: pgmap v827: 97 pgs: 97 active+clean; 522 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 MiB/s rd, 7.6 MiB/s wr, 433 op/s 2024-05-09T05:52:38.169 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:52:37 smithi100 ceph-mon[34353]: pgmap v827: 97 pgs: 97 active+clean; 522 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 MiB/s rd, 7.6 MiB/s wr, 433 op/s 2024-05-09T05:52:38.945 INFO:tasks.workunit.client.0.smithi039.stdout: 10 31337 24.89 MB/sec warmup 75 sec latency 246.697 ms 2024-05-09T05:52:39.946 INFO:tasks.workunit.client.0.smithi039.stdout: 10 31653 24.79 MB/sec warmup 76 sec latency 113.119 ms 2024-05-09T05:52:40.042 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:52:39 smithi060 ceph-mon[34555]: pgmap v828: 97 pgs: 97 active+clean; 524 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 MiB/s rd, 6.9 MiB/s wr, 407 op/s 2024-05-09T05:52:40.105 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:52:39 smithi039 ceph-mon[30439]: pgmap v828: 97 pgs: 97 active+clean; 524 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 MiB/s rd, 6.9 MiB/s wr, 407 op/s 2024-05-09T05:52:40.169 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:52:39 smithi100 ceph-mon[34353]: pgmap v828: 97 pgs: 97 active+clean; 524 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 MiB/s rd, 6.9 MiB/s wr, 407 op/s 2024-05-09T05:52:40.946 INFO:tasks.workunit.client.0.smithi039.stdout: 10 32054 24.73 MB/sec warmup 77 sec latency 73.954 ms 2024-05-09T05:52:41.946 INFO:tasks.workunit.client.0.smithi039.stdout: 10 32407 24.68 MB/sec warmup 78 sec latency 97.192 ms 2024-05-09T05:52:42.042 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:52:41 smithi060 ceph-mon[34555]: pgmap v829: 97 pgs: 97 active+clean; 524 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 6.0 MiB/s wr, 367 op/s 2024-05-09T05:52:42.106 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:52:41 smithi039 ceph-mon[30439]: pgmap v829: 97 pgs: 97 active+clean; 524 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 6.0 MiB/s wr, 367 op/s 2024-05-09T05:52:42.169 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:52:41 smithi100 ceph-mon[34353]: pgmap v829: 97 pgs: 97 active+clean; 524 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 6.0 MiB/s wr, 367 op/s 2024-05-09T05:52:42.946 INFO:tasks.workunit.client.0.smithi039.stdout: 10 32712 24.57 MB/sec warmup 79 sec latency 68.114 ms 2024-05-09T05:52:43.946 INFO:tasks.workunit.client.0.smithi039.stdout: 10 33029 24.42 MB/sec warmup 80 sec latency 88.881 ms 2024-05-09T05:52:44.042 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:52:43 smithi060 ceph-mon[34555]: pgmap v830: 97 pgs: 97 active+clean; 528 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 6.0 MiB/s wr, 379 op/s 2024-05-09T05:52:44.105 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:52:43 smithi039 ceph-mon[30439]: pgmap v830: 97 pgs: 97 active+clean; 528 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 6.0 MiB/s wr, 379 op/s 2024-05-09T05:52:44.169 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:52:43 smithi100 ceph-mon[34353]: pgmap v830: 97 pgs: 97 active+clean; 528 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 6.0 MiB/s wr, 379 op/s 2024-05-09T05:52:44.946 INFO:tasks.workunit.client.0.smithi039.stdout: 10 33486 24.31 MB/sec warmup 81 sec latency 146.240 ms 2024-05-09T05:52:45.946 INFO:tasks.workunit.client.0.smithi039.stdout: 10 34076 24.43 MB/sec warmup 82 sec latency 45.802 ms 2024-05-09T05:52:46.042 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:52:45 smithi060 ceph-mon[34555]: pgmap v831: 97 pgs: 97 active+clean; 528 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 6.4 MiB/s wr, 405 op/s 2024-05-09T05:52:46.106 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:52:45 smithi039 ceph-mon[30439]: pgmap v831: 97 pgs: 97 active+clean; 528 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 6.4 MiB/s wr, 405 op/s 2024-05-09T05:52:46.169 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:52:45 smithi100 ceph-mon[34353]: pgmap v831: 97 pgs: 97 active+clean; 528 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 6.4 MiB/s wr, 405 op/s 2024-05-09T05:52:46.946 INFO:tasks.workunit.client.0.smithi039.stdout: 10 34652 24.53 MB/sec warmup 83 sec latency 65.316 ms 2024-05-09T05:52:47.042 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:52:46 smithi060 ceph-mon[34555]: pgmap v832: 97 pgs: 97 active+clean; 530 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 6.0 MiB/s wr, 385 op/s 2024-05-09T05:52:47.105 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:52:46 smithi039 ceph-mon[30439]: pgmap v832: 97 pgs: 97 active+clean; 530 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 6.0 MiB/s wr, 385 op/s 2024-05-09T05:52:47.169 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:52:46 smithi100 ceph-mon[34353]: pgmap v832: 97 pgs: 97 active+clean; 530 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 6.0 MiB/s wr, 385 op/s 2024-05-09T05:52:47.946 INFO:tasks.workunit.client.0.smithi039.stdout: 10 35079 24.56 MB/sec warmup 84 sec latency 53.999 ms 2024-05-09T05:52:48.946 INFO:tasks.workunit.client.0.smithi039.stdout: 10 35326 24.53 MB/sec warmup 85 sec latency 247.670 ms 2024-05-09T05:52:49.792 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:52:49 smithi060 ceph-mon[34555]: pgmap v833: 97 pgs: 97 active+clean; 532 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 5.3 MiB/s wr, 349 op/s 2024-05-09T05:52:49.856 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:52:49 smithi039 ceph-mon[30439]: pgmap v833: 97 pgs: 97 active+clean; 532 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 5.3 MiB/s wr, 349 op/s 2024-05-09T05:52:49.919 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:52:49 smithi100 ceph-mon[34353]: pgmap v833: 97 pgs: 97 active+clean; 532 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 5.3 MiB/s wr, 349 op/s 2024-05-09T05:52:49.946 INFO:tasks.workunit.client.0.smithi039.stdout: 10 35659 24.44 MB/sec warmup 86 sec latency 92.252 ms 2024-05-09T05:52:50.946 INFO:tasks.workunit.client.0.smithi039.stdout: 10 36053 24.38 MB/sec warmup 87 sec latency 129.254 ms 2024-05-09T05:52:51.792 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:52:51 smithi060 ceph-mon[34555]: pgmap v834: 97 pgs: 97 active+clean; 534 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 5.3 MiB/s wr, 354 op/s 2024-05-09T05:52:51.855 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:52:51 smithi039 ceph-mon[30439]: pgmap v834: 97 pgs: 97 active+clean; 534 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 5.3 MiB/s wr, 354 op/s 2024-05-09T05:52:51.919 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:52:51 smithi100 ceph-mon[34353]: pgmap v834: 97 pgs: 97 active+clean; 534 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 5.3 MiB/s wr, 354 op/s 2024-05-09T05:52:51.946 INFO:tasks.workunit.client.0.smithi039.stdout: 10 36383 24.30 MB/sec warmup 88 sec latency 100.076 ms 2024-05-09T05:52:52.946 INFO:tasks.workunit.client.0.smithi039.stdout: 10 36709 24.24 MB/sec warmup 89 sec latency 93.745 ms 2024-05-09T05:52:53.792 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:52:53 smithi060 ceph-mon[34555]: pgmap v835: 97 pgs: 97 active+clean; 536 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 5.5 MiB/s wr, 372 op/s 2024-05-09T05:52:53.856 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:52:53 smithi039 ceph-mon[30439]: pgmap v835: 97 pgs: 97 active+clean; 536 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 5.5 MiB/s wr, 372 op/s 2024-05-09T05:52:53.919 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:52:53 smithi100 ceph-mon[34353]: pgmap v835: 97 pgs: 97 active+clean; 536 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 5.5 MiB/s wr, 372 op/s 2024-05-09T05:52:53.946 INFO:tasks.workunit.client.0.smithi039.stdout: 10 36993 24.05 MB/sec warmup 90 sec latency 98.349 ms 2024-05-09T05:52:54.946 INFO:tasks.workunit.client.0.smithi039.stdout: 10 37474 23.99 MB/sec warmup 91 sec latency 100.653 ms 2024-05-09T05:52:55.792 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:52:55 smithi060 ceph-mon[34555]: pgmap v836: 97 pgs: 97 active+clean; 541 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.7 MiB/s wr, 369 op/s 2024-05-09T05:52:55.856 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:52:55 smithi039 ceph-mon[30439]: pgmap v836: 97 pgs: 97 active+clean; 541 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.7 MiB/s wr, 369 op/s 2024-05-09T05:52:55.919 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:52:55 smithi100 ceph-mon[34353]: pgmap v836: 97 pgs: 97 active+clean; 541 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.7 MiB/s wr, 369 op/s 2024-05-09T05:52:55.946 INFO:tasks.workunit.client.0.smithi039.stdout: 10 38001 24.09 MB/sec warmup 92 sec latency 91.660 ms 2024-05-09T05:52:56.946 INFO:tasks.workunit.client.0.smithi039.stdout: 10 38535 24.21 MB/sec warmup 93 sec latency 63.118 ms 2024-05-09T05:52:57.792 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:52:57 smithi060 ceph-mon[34555]: pgmap v837: 97 pgs: 97 active+clean; 539 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 5.5 MiB/s wr, 343 op/s 2024-05-09T05:52:57.855 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:52:57 smithi039 ceph-mon[30439]: pgmap v837: 97 pgs: 97 active+clean; 539 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 5.5 MiB/s wr, 343 op/s 2024-05-09T05:52:57.919 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:52:57 smithi100 ceph-mon[34353]: pgmap v837: 97 pgs: 97 active+clean; 539 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 5.5 MiB/s wr, 343 op/s 2024-05-09T05:52:57.946 INFO:tasks.workunit.client.0.smithi039.stdout: 10 38937 24.15 MB/sec warmup 94 sec latency 57.736 ms 2024-05-09T05:52:58.946 INFO:tasks.workunit.client.0.smithi039.stdout: 10 39135 24.07 MB/sec warmup 95 sec latency 237.368 ms 2024-05-09T05:52:59.792 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:52:59 smithi060 ceph-mon[34555]: pgmap v838: 97 pgs: 97 active+clean; 525 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 5.5 MiB/s wr, 348 op/s 2024-05-09T05:52:59.855 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:52:59 smithi039 ceph-mon[30439]: pgmap v838: 97 pgs: 97 active+clean; 525 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 5.5 MiB/s wr, 348 op/s 2024-05-09T05:52:59.919 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:52:59 smithi100 ceph-mon[34353]: pgmap v838: 97 pgs: 97 active+clean; 525 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 5.5 MiB/s wr, 348 op/s 2024-05-09T05:52:59.946 INFO:tasks.workunit.client.0.smithi039.stdout: 10 39547 24.05 MB/sec warmup 96 sec latency 74.737 ms 2024-05-09T05:53:00.946 INFO:tasks.workunit.client.0.smithi039.stdout: 10 39992 24.07 MB/sec warmup 97 sec latency 46.017 ms 2024-05-09T05:53:01.792 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:53:01 smithi060 ceph-mon[34555]: pgmap v839: 97 pgs: 97 active+clean; 525 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.4 MiB/s wr, 366 op/s 2024-05-09T05:53:01.855 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:53:01 smithi039 ceph-mon[30439]: pgmap v839: 97 pgs: 97 active+clean; 525 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.4 MiB/s wr, 366 op/s 2024-05-09T05:53:01.919 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:53:01 smithi100 ceph-mon[34353]: pgmap v839: 97 pgs: 97 active+clean; 525 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.4 MiB/s wr, 366 op/s 2024-05-09T05:53:01.946 INFO:tasks.workunit.client.0.smithi039.stdout: 10 40274 23.93 MB/sec warmup 98 sec latency 81.740 ms 2024-05-09T05:53:02.946 INFO:tasks.workunit.client.0.smithi039.stdout: 10 40608 23.85 MB/sec warmup 99 sec latency 59.995 ms 2024-05-09T05:53:03.792 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:53:03 smithi060 ceph-mon[34555]: pgmap v840: 97 pgs: 97 active+clean; 526 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.1 MiB/s wr, 357 op/s 2024-05-09T05:53:03.855 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:53:03 smithi039 ceph-mon[30439]: pgmap v840: 97 pgs: 97 active+clean; 526 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.1 MiB/s wr, 357 op/s 2024-05-09T05:53:03.919 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:53:03 smithi100 ceph-mon[34353]: pgmap v840: 97 pgs: 97 active+clean; 526 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.1 MiB/s wr, 357 op/s 2024-05-09T05:53:03.946 INFO:tasks.workunit.client.0.smithi039.stdout: 10 41020 23.81 MB/sec warmup 100 sec latency 143.142 ms 2024-05-09T05:53:04.946 INFO:tasks.workunit.client.0.smithi039.stdout: 10 41530 23.78 MB/sec warmup 101 sec latency 165.459 ms 2024-05-09T05:53:05.792 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:53:05 smithi060 ceph-mon[34555]: pgmap v841: 97 pgs: 97 active+clean; 527 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 5.6 MiB/s wr, 361 op/s 2024-05-09T05:53:05.855 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:53:05 smithi039 ceph-mon[30439]: pgmap v841: 97 pgs: 97 active+clean; 527 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 5.6 MiB/s wr, 361 op/s 2024-05-09T05:53:05.919 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:53:05 smithi100 ceph-mon[34353]: pgmap v841: 97 pgs: 97 active+clean; 527 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 5.6 MiB/s wr, 361 op/s 2024-05-09T05:53:05.946 INFO:tasks.workunit.client.0.smithi039.stdout: 10 41958 23.81 MB/sec warmup 102 sec latency 53.412 ms 2024-05-09T05:53:06.950 INFO:tasks.workunit.client.0.smithi039.stdout: 10 42439 23.89 MB/sec warmup 103 sec latency 65.032 ms 2024-05-09T05:53:07.792 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:53:07 smithi060 ceph-mon[34555]: pgmap v842: 97 pgs: 97 active+clean; 529 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 5.1 MiB/s wr, 325 op/s 2024-05-09T05:53:07.855 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:53:07 smithi039 ceph-mon[30439]: pgmap v842: 97 pgs: 97 active+clean; 529 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 5.1 MiB/s wr, 325 op/s 2024-05-09T05:53:07.919 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:53:07 smithi100 ceph-mon[34353]: pgmap v842: 97 pgs: 97 active+clean; 529 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 5.1 MiB/s wr, 325 op/s 2024-05-09T05:53:07.946 INFO:tasks.workunit.client.0.smithi039.stdout: 10 42829 23.86 MB/sec warmup 104 sec latency 81.700 ms 2024-05-09T05:53:08.947 INFO:tasks.workunit.client.0.smithi039.stdout: 10 43163 23.83 MB/sec warmup 105 sec latency 103.646 ms 2024-05-09T05:53:09.792 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:53:09 smithi060 ceph-mon[34555]: pgmap v843: 97 pgs: 97 active+clean; 533 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.4 MiB/s wr, 341 op/s 2024-05-09T05:53:09.855 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:53:09 smithi039 ceph-mon[30439]: pgmap v843: 97 pgs: 97 active+clean; 533 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.4 MiB/s wr, 341 op/s 2024-05-09T05:53:09.919 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:53:09 smithi100 ceph-mon[34353]: pgmap v843: 97 pgs: 97 active+clean; 533 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.4 MiB/s wr, 341 op/s 2024-05-09T05:53:09.947 INFO:tasks.workunit.client.0.smithi039.stdout: 10 43466 23.82 MB/sec warmup 106 sec latency 286.697 ms 2024-05-09T05:53:10.947 INFO:tasks.workunit.client.0.smithi039.stdout: 10 43759 23.77 MB/sec warmup 107 sec latency 132.205 ms 2024-05-09T05:53:11.792 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:53:11 smithi060 ceph-mon[34555]: pgmap v844: 97 pgs: 97 active+clean; 540 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 5.6 MiB/s wr, 364 op/s 2024-05-09T05:53:11.855 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:53:11 smithi039 ceph-mon[30439]: pgmap v844: 97 pgs: 97 active+clean; 540 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 5.6 MiB/s wr, 364 op/s 2024-05-09T05:53:11.919 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:53:11 smithi100 ceph-mon[34353]: pgmap v844: 97 pgs: 97 active+clean; 540 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 5.6 MiB/s wr, 364 op/s 2024-05-09T05:53:11.947 INFO:tasks.workunit.client.0.smithi039.stdout: 10 44040 23.61 MB/sec warmup 108 sec latency 75.662 ms 2024-05-09T05:53:12.947 INFO:tasks.workunit.client.0.smithi039.stdout: 10 44447 23.54 MB/sec warmup 109 sec latency 76.180 ms 2024-05-09T05:53:13.792 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:53:13 smithi060 ceph-mon[34555]: pgmap v845: 97 pgs: 97 active+clean; 542 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 5.8 MiB/s wr, 336 op/s 2024-05-09T05:53:13.855 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:53:13 smithi039 ceph-mon[30439]: pgmap v845: 97 pgs: 97 active+clean; 542 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 5.8 MiB/s wr, 336 op/s 2024-05-09T05:53:13.919 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:53:13 smithi100 ceph-mon[34353]: pgmap v845: 97 pgs: 97 active+clean; 542 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 5.8 MiB/s wr, 336 op/s 2024-05-09T05:53:13.947 INFO:tasks.workunit.client.0.smithi039.stdout: 10 44982 23.64 MB/sec warmup 110 sec latency 68.557 ms 2024-05-09T05:53:14.947 INFO:tasks.workunit.client.0.smithi039.stdout: 10 45324 23.53 MB/sec warmup 111 sec latency 226.582 ms 2024-05-09T05:53:15.792 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:53:15 smithi060 ceph-mon[34555]: pgmap v846: 97 pgs: 97 active+clean; 543 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 6.3 MiB/s wr, 353 op/s 2024-05-09T05:53:15.855 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:53:15 smithi039 ceph-mon[30439]: pgmap v846: 97 pgs: 97 active+clean; 543 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 6.3 MiB/s wr, 353 op/s 2024-05-09T05:53:15.919 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:53:15 smithi100 ceph-mon[34353]: pgmap v846: 97 pgs: 97 active+clean; 543 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 6.3 MiB/s wr, 353 op/s 2024-05-09T05:53:15.947 INFO:tasks.workunit.client.0.smithi039.stdout: 10 45828 23.51 MB/sec warmup 112 sec latency 74.169 ms 2024-05-09T05:53:16.947 INFO:tasks.workunit.client.0.smithi039.stdout: 10 46309 23.64 MB/sec warmup 113 sec latency 55.700 ms 2024-05-09T05:53:17.791 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:53:17 smithi060 ceph-mon[34555]: pgmap v847: 97 pgs: 97 active+clean; 547 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 6.4 MiB/s wr, 389 op/s 2024-05-09T05:53:17.855 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:53:17 smithi039 ceph-mon[30439]: pgmap v847: 97 pgs: 97 active+clean; 547 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 6.4 MiB/s wr, 389 op/s 2024-05-09T05:53:17.919 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:53:17 smithi100 ceph-mon[34353]: pgmap v847: 97 pgs: 97 active+clean; 547 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 6.4 MiB/s wr, 389 op/s 2024-05-09T05:53:17.947 INFO:tasks.workunit.client.0.smithi039.stdout: 10 46890 23.67 MB/sec warmup 114 sec latency 60.284 ms 2024-05-09T05:53:18.947 INFO:tasks.workunit.client.0.smithi039.stdout: 10 47193 23.67 MB/sec warmup 115 sec latency 141.567 ms 2024-05-09T05:53:19.792 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:53:19 smithi060 ceph-mon[34555]: pgmap v848: 97 pgs: 97 active+clean; 549 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 6.3 MiB/s wr, 399 op/s 2024-05-09T05:53:19.792 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:53:19 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:53:19.855 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:53:19 smithi039 ceph-mon[30439]: pgmap v848: 97 pgs: 97 active+clean; 549 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 6.3 MiB/s wr, 399 op/s 2024-05-09T05:53:19.855 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:53:19 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:53:19.919 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:53:19 smithi100 ceph-mon[34353]: pgmap v848: 97 pgs: 97 active+clean; 549 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 6.3 MiB/s wr, 399 op/s 2024-05-09T05:53:19.919 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:53:19 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:53:19.947 INFO:tasks.workunit.client.0.smithi039.stdout: 10 47394 23.57 MB/sec warmup 116 sec latency 354.035 ms 2024-05-09T05:53:20.792 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:53:20 smithi060 ceph-mon[34555]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-09T05:53:20.792 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:53:20 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:53:20.792 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:53:20 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:53:20.792 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:53:20 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:53:20.792 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:53:20 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:53:20.792 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:53:20 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:53:20.792 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:53:20 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:53:20.792 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:53:20 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:53:20.855 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:53:20 smithi039 ceph-mon[30439]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-09T05:53:20.856 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:53:20 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:53:20.856 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:53:20 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:53:20.856 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:53:20 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:53:20.856 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:53:20 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:53:20.856 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:53:20 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:53:20.856 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:53:20 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:53:20.856 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:53:20 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:53:20.919 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:53:20 smithi100 ceph-mon[34353]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-09T05:53:20.919 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:53:20 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:53:20.919 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:53:20 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:53:20.919 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:53:20 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:53:20.919 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:53:20 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:53:20.919 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:53:20 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:53:20.920 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:53:20 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:53:20.920 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:53:20 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:53:20.947 INFO:tasks.workunit.client.0.smithi039.stdout: 10 47664 23.49 MB/sec warmup 117 sec latency 143.587 ms 2024-05-09T05:53:21.792 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:53:21 smithi060 ceph-mon[34555]: Adjusting osd_memory_target on smithi039 to 176.2M 2024-05-09T05:53:21.792 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:53:21 smithi060 ceph-mon[34555]: Unable to set osd_memory_target on smithi039 to 184773836: error parsing value: Value '184773836' is below minimum 939524096 2024-05-09T05:53:21.792 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:53:21 smithi060 ceph-mon[34555]: pgmap v849: 97 pgs: 97 active+clean; 551 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 6.4 MiB/s wr, 393 op/s 2024-05-09T05:53:21.855 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:53:21 smithi039 ceph-mon[30439]: Adjusting osd_memory_target on smithi039 to 176.2M 2024-05-09T05:53:21.855 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:53:21 smithi039 ceph-mon[30439]: Unable to set osd_memory_target on smithi039 to 184773836: error parsing value: Value '184773836' is below minimum 939524096 2024-05-09T05:53:21.855 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:53:21 smithi039 ceph-mon[30439]: pgmap v849: 97 pgs: 97 active+clean; 551 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 6.4 MiB/s wr, 393 op/s 2024-05-09T05:53:21.919 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:53:21 smithi100 ceph-mon[34353]: Adjusting osd_memory_target on smithi039 to 176.2M 2024-05-09T05:53:21.919 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:53:21 smithi100 ceph-mon[34353]: Unable to set osd_memory_target on smithi039 to 184773836: error parsing value: Value '184773836' is below minimum 939524096 2024-05-09T05:53:21.919 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:53:21 smithi100 ceph-mon[34353]: pgmap v849: 97 pgs: 97 active+clean; 551 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 6.4 MiB/s wr, 393 op/s 2024-05-09T05:53:21.947 INFO:tasks.workunit.client.0.smithi039.stdout: 10 48007 23.45 MB/sec warmup 118 sec latency 100.199 ms 2024-05-09T05:53:22.947 INFO:tasks.workunit.client.0.smithi039.stdout: 10 48463 23.41 MB/sec warmup 119 sec latency 88.054 ms 2024-05-09T05:53:23.792 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:53:23 smithi060 ceph-mon[34555]: pgmap v850: 97 pgs: 97 active+clean; 549 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 6.5 MiB/s wr, 382 op/s 2024-05-09T05:53:23.855 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:53:23 smithi039 ceph-mon[30439]: pgmap v850: 97 pgs: 97 active+clean; 549 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 6.5 MiB/s wr, 382 op/s 2024-05-09T05:53:23.919 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:53:23 smithi100 ceph-mon[34353]: pgmap v850: 97 pgs: 97 active+clean; 549 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 6.5 MiB/s wr, 382 op/s 2024-05-09T05:53:24.947 INFO:tasks.workunit.client.0.smithi039.stdout: 10 49273 15.46 MB/sec execute 1 sec latency 139.067 ms 2024-05-09T05:53:25.792 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:53:25 smithi060 ceph-mon[34555]: pgmap v851: 97 pgs: 97 active+clean; 538 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 6.0 MiB/s wr, 391 op/s 2024-05-09T05:53:25.855 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:53:25 smithi039 ceph-mon[30439]: pgmap v851: 97 pgs: 97 active+clean; 538 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 6.0 MiB/s wr, 391 op/s 2024-05-09T05:53:25.919 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:53:25 smithi100 ceph-mon[34353]: pgmap v851: 97 pgs: 97 active+clean; 538 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 6.0 MiB/s wr, 391 op/s 2024-05-09T05:53:25.947 INFO:tasks.workunit.client.0.smithi039.stdout: 10 49713 19.26 MB/sec execute 2 sec latency 91.952 ms 2024-05-09T05:53:26.947 INFO:tasks.workunit.client.0.smithi039.stdout: 10 50125 23.04 MB/sec execute 3 sec latency 83.144 ms 2024-05-09T05:53:27.791 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:53:27 smithi060 ceph-mon[34555]: pgmap v852: 97 pgs: 97 active+clean; 531 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 5.6 MiB/s wr, 367 op/s 2024-05-09T05:53:27.855 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:53:27 smithi039 ceph-mon[30439]: pgmap v852: 97 pgs: 97 active+clean; 531 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 5.6 MiB/s wr, 367 op/s 2024-05-09T05:53:27.919 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:53:27 smithi100 ceph-mon[34353]: pgmap v852: 97 pgs: 97 active+clean; 531 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 5.6 MiB/s wr, 367 op/s 2024-05-09T05:53:27.947 INFO:tasks.workunit.client.0.smithi039.stdout: 10 50677 24.59 MB/sec execute 4 sec latency 63.131 ms 2024-05-09T05:53:28.947 INFO:tasks.workunit.client.0.smithi039.stdout: 10 51006 23.66 MB/sec execute 5 sec latency 56.941 ms 2024-05-09T05:53:29.792 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:53:29 smithi060 ceph-mon[34555]: pgmap v853: 97 pgs: 97 active+clean; 538 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 5.4 MiB/s wr, 366 op/s 2024-05-09T05:53:29.855 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:53:29 smithi039 ceph-mon[30439]: pgmap v853: 97 pgs: 97 active+clean; 538 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 5.4 MiB/s wr, 366 op/s 2024-05-09T05:53:29.919 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:53:29 smithi100 ceph-mon[34353]: pgmap v853: 97 pgs: 97 active+clean; 538 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 5.4 MiB/s wr, 366 op/s 2024-05-09T05:53:29.947 INFO:tasks.workunit.client.0.smithi039.stdout: 10 51212 22.10 MB/sec execute 6 sec latency 241.553 ms 2024-05-09T05:53:30.947 INFO:tasks.workunit.client.0.smithi039.stdout: 10 51524 20.75 MB/sec execute 7 sec latency 95.955 ms 2024-05-09T05:53:31.792 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:53:31 smithi060 ceph-mon[34555]: pgmap v854: 97 pgs: 97 active+clean; 543 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 5.2 MiB/s wr, 350 op/s 2024-05-09T05:53:31.855 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:53:31 smithi039 ceph-mon[30439]: pgmap v854: 97 pgs: 97 active+clean; 543 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 5.2 MiB/s wr, 350 op/s 2024-05-09T05:53:31.919 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:53:31 smithi100 ceph-mon[34353]: pgmap v854: 97 pgs: 97 active+clean; 543 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 5.2 MiB/s wr, 350 op/s 2024-05-09T05:53:31.947 INFO:tasks.workunit.client.0.smithi039.stdout: 10 51967 21.81 MB/sec execute 8 sec latency 71.239 ms 2024-05-09T05:53:32.947 INFO:tasks.workunit.client.0.smithi039.stdout: 10 52418 21.06 MB/sec execute 9 sec latency 84.371 ms 2024-05-09T05:53:33.792 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:53:33 smithi060 ceph-mon[34555]: pgmap v855: 97 pgs: 97 active+clean; 546 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 5.2 MiB/s wr, 361 op/s 2024-05-09T05:53:33.855 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:53:33 smithi039 ceph-mon[30439]: pgmap v855: 97 pgs: 97 active+clean; 546 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 5.2 MiB/s wr, 361 op/s 2024-05-09T05:53:33.919 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:53:33 smithi100 ceph-mon[34353]: pgmap v855: 97 pgs: 97 active+clean; 546 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 5.2 MiB/s wr, 361 op/s 2024-05-09T05:53:33.947 INFO:tasks.workunit.client.0.smithi039.stdout: 10 52849 21.47 MB/sec execute 10 sec latency 38.977 ms 2024-05-09T05:53:34.947 INFO:tasks.workunit.client.0.smithi039.stdout: 10 53146 20.86 MB/sec execute 11 sec latency 214.949 ms 2024-05-09T05:53:35.855 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:53:35 smithi039 ceph-mon[30439]: pgmap v856: 97 pgs: 97 active+clean; 547 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 5.0 MiB/s wr, 362 op/s 2024-05-09T05:53:35.919 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:53:35 smithi100 ceph-mon[34353]: pgmap v856: 97 pgs: 97 active+clean; 547 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 5.0 MiB/s wr, 362 op/s 2024-05-09T05:53:35.947 INFO:tasks.workunit.client.0.smithi039.stdout: 10 53620 20.95 MB/sec execute 12 sec latency 93.272 ms 2024-05-09T05:53:36.042 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:53:35 smithi060 ceph-mon[34555]: pgmap v856: 97 pgs: 97 active+clean; 547 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 5.0 MiB/s wr, 362 op/s 2024-05-09T05:53:36.947 INFO:tasks.workunit.client.0.smithi039.stdout: 10 54054 21.58 MB/sec execute 13 sec latency 53.262 ms 2024-05-09T05:53:37.856 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:53:37 smithi039 ceph-mon[30439]: pgmap v857: 97 pgs: 97 active+clean; 549 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 5.5 MiB/s wr, 377 op/s 2024-05-09T05:53:37.919 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:53:37 smithi100 ceph-mon[34353]: pgmap v857: 97 pgs: 97 active+clean; 549 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 5.5 MiB/s wr, 377 op/s 2024-05-09T05:53:37.947 INFO:tasks.workunit.client.0.smithi039.stdout: 10 54661 22.41 MB/sec execute 14 sec latency 85.970 ms 2024-05-09T05:53:38.041 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:53:37 smithi060 ceph-mon[34555]: pgmap v857: 97 pgs: 97 active+clean; 549 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 5.5 MiB/s wr, 377 op/s 2024-05-09T05:53:38.947 INFO:tasks.workunit.client.0.smithi039.stdout: 10 54946 21.97 MB/sec execute 15 sec latency 62.681 ms 2024-05-09T05:53:39.855 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:53:39 smithi039 ceph-mon[30439]: pgmap v858: 97 pgs: 97 active+clean; 553 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 MiB/s rd, 5.7 MiB/s wr, 410 op/s 2024-05-09T05:53:39.919 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:53:39 smithi100 ceph-mon[34353]: pgmap v858: 97 pgs: 97 active+clean; 553 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 MiB/s rd, 5.7 MiB/s wr, 410 op/s 2024-05-09T05:53:39.947 INFO:tasks.workunit.client.0.smithi039.stdout: 10 55176 21.65 MB/sec execute 16 sec latency 301.578 ms 2024-05-09T05:53:40.041 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:53:39 smithi060 ceph-mon[34555]: pgmap v858: 97 pgs: 97 active+clean; 553 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 MiB/s rd, 5.7 MiB/s wr, 410 op/s 2024-05-09T05:53:40.855 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:53:40 smithi039 ceph-mon[30439]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-09T05:53:40.919 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:53:40 smithi100 ceph-mon[34353]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-09T05:53:40.947 INFO:tasks.workunit.client.0.smithi039.stdout: 10 55464 21.01 MB/sec execute 17 sec latency 110.419 ms 2024-05-09T05:53:41.041 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:53:40 smithi060 ceph-mon[34555]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-09T05:53:41.855 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:53:41 smithi039 ceph-mon[30439]: pgmap v859: 97 pgs: 97 active+clean; 555 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 5.5 MiB/s wr, 364 op/s 2024-05-09T05:53:41.919 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:53:41 smithi100 ceph-mon[34353]: pgmap v859: 97 pgs: 97 active+clean; 555 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 5.5 MiB/s wr, 364 op/s 2024-05-09T05:53:41.942 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:53:41 smithi060 ceph-mon[34555]: pgmap v859: 97 pgs: 97 active+clean; 555 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 5.5 MiB/s wr, 364 op/s 2024-05-09T05:53:41.947 INFO:tasks.workunit.client.0.smithi039.stdout: 10 55955 21.44 MB/sec execute 18 sec latency 75.748 ms 2024-05-09T05:53:42.948 INFO:tasks.workunit.client.0.smithi039.stdout: 10 56415 21.45 MB/sec execute 19 sec latency 67.366 ms 2024-05-09T05:53:43.855 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:53:43 smithi039 ceph-mon[30439]: pgmap v860: 97 pgs: 97 active+clean; 544 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 MiB/s rd, 6.1 MiB/s wr, 377 op/s 2024-05-09T05:53:43.918 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:53:43 smithi100 ceph-mon[34353]: pgmap v860: 97 pgs: 97 active+clean; 544 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 MiB/s rd, 6.1 MiB/s wr, 377 op/s 2024-05-09T05:53:43.948 INFO:tasks.workunit.client.0.smithi039.stdout: 10 56792 21.31 MB/sec execute 20 sec latency 67.860 ms 2024-05-09T05:53:44.041 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:53:43 smithi060 ceph-mon[34555]: pgmap v860: 97 pgs: 97 active+clean; 544 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 MiB/s rd, 6.1 MiB/s wr, 377 op/s 2024-05-09T05:53:44.948 INFO:tasks.workunit.client.0.smithi039.stdout: 10 57085 20.89 MB/sec execute 21 sec latency 234.403 ms 2024-05-09T05:53:45.855 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:53:45 smithi039 ceph-mon[30439]: pgmap v861: 97 pgs: 97 active+clean; 538 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 MiB/s rd, 6.1 MiB/s wr, 371 op/s 2024-05-09T05:53:45.919 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:53:45 smithi100 ceph-mon[34353]: pgmap v861: 97 pgs: 97 active+clean; 538 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 MiB/s rd, 6.1 MiB/s wr, 371 op/s 2024-05-09T05:53:45.948 INFO:tasks.workunit.client.0.smithi039.stdout: 10 57501 20.94 MB/sec execute 22 sec latency 103.385 ms 2024-05-09T05:53:46.041 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:53:45 smithi060 ceph-mon[34555]: pgmap v861: 97 pgs: 97 active+clean; 538 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 MiB/s rd, 6.1 MiB/s wr, 371 op/s 2024-05-09T05:53:46.948 INFO:tasks.workunit.client.0.smithi039.stdout: 10 58041 21.66 MB/sec execute 23 sec latency 49.892 ms 2024-05-09T05:53:47.855 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:53:47 smithi039 ceph-mon[30439]: pgmap v862: 97 pgs: 97 active+clean; 537 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 MiB/s rd, 6.2 MiB/s wr, 374 op/s 2024-05-09T05:53:47.919 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:53:47 smithi100 ceph-mon[34353]: pgmap v862: 97 pgs: 97 active+clean; 537 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 MiB/s rd, 6.2 MiB/s wr, 374 op/s 2024-05-09T05:53:47.948 INFO:tasks.workunit.client.0.smithi039.stdout: 10 58539 21.81 MB/sec execute 24 sec latency 51.818 ms 2024-05-09T05:53:48.041 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:53:47 smithi060 ceph-mon[34555]: pgmap v862: 97 pgs: 97 active+clean; 537 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 MiB/s rd, 6.2 MiB/s wr, 374 op/s 2024-05-09T05:53:48.948 INFO:tasks.workunit.client.0.smithi039.stdout: 10 58850 21.58 MB/sec execute 25 sec latency 65.156 ms 2024-05-09T05:53:49.855 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:53:49 smithi039 ceph-mon[30439]: pgmap v863: 97 pgs: 97 active+clean; 543 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 6.3 MiB/s wr, 392 op/s 2024-05-09T05:53:49.918 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:53:49 smithi100 ceph-mon[34353]: pgmap v863: 97 pgs: 97 active+clean; 543 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 6.3 MiB/s wr, 392 op/s 2024-05-09T05:53:49.948 INFO:tasks.workunit.client.0.smithi039.stdout: 10 59061 21.25 MB/sec execute 26 sec latency 179.230 ms 2024-05-09T05:53:50.041 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:53:49 smithi060 ceph-mon[34555]: pgmap v863: 97 pgs: 97 active+clean; 543 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 6.3 MiB/s wr, 392 op/s 2024-05-09T05:53:50.948 INFO:tasks.workunit.client.0.smithi039.stdout: 10 59371 21.08 MB/sec execute 27 sec latency 289.936 ms 2024-05-09T05:53:51.855 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:53:51 smithi039 ceph-mon[30439]: pgmap v864: 97 pgs: 97 active+clean; 544 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 6.1 MiB/s wr, 343 op/s 2024-05-09T05:53:51.918 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:53:51 smithi100 ceph-mon[34353]: pgmap v864: 97 pgs: 97 active+clean; 544 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 6.1 MiB/s wr, 343 op/s 2024-05-09T05:53:51.948 INFO:tasks.workunit.client.0.smithi039.stdout: 10 59872 21.42 MB/sec execute 28 sec latency 82.384 ms 2024-05-09T05:53:52.041 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:53:51 smithi060 ceph-mon[34555]: pgmap v864: 97 pgs: 97 active+clean; 544 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 6.1 MiB/s wr, 343 op/s 2024-05-09T05:53:52.948 INFO:tasks.workunit.client.0.smithi039.stdout: 10 60258 21.19 MB/sec execute 29 sec latency 60.567 ms 2024-05-09T05:53:53.855 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:53:53 smithi039 ceph-mon[30439]: pgmap v865: 97 pgs: 97 active+clean; 547 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 6.1 MiB/s wr, 355 op/s 2024-05-09T05:53:53.919 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:53:53 smithi100 ceph-mon[34353]: pgmap v865: 97 pgs: 97 active+clean; 547 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 6.1 MiB/s wr, 355 op/s 2024-05-09T05:53:53.948 INFO:tasks.workunit.client.0.smithi039.stdout: 10 60625 21.17 MB/sec execute 30 sec latency 68.866 ms 2024-05-09T05:53:54.041 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:53:53 smithi060 ceph-mon[34555]: pgmap v865: 97 pgs: 97 active+clean; 547 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 6.1 MiB/s wr, 355 op/s 2024-05-09T05:53:54.948 INFO:tasks.workunit.client.0.smithi039.stdout: 10 61054 21.05 MB/sec execute 31 sec latency 102.259 ms 2024-05-09T05:53:55.855 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:53:55 smithi039 ceph-mon[30439]: pgmap v866: 97 pgs: 97 active+clean; 552 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 6.3 MiB/s wr, 388 op/s 2024-05-09T05:53:55.919 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:53:55 smithi100 ceph-mon[34353]: pgmap v866: 97 pgs: 97 active+clean; 552 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 6.3 MiB/s wr, 388 op/s 2024-05-09T05:53:55.948 INFO:tasks.workunit.client.0.smithi039.stdout: 10 61459 20.95 MB/sec execute 32 sec latency 245.331 ms 2024-05-09T05:53:56.041 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:53:55 smithi060 ceph-mon[34555]: pgmap v866: 97 pgs: 97 active+clean; 552 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 6.3 MiB/s wr, 388 op/s 2024-05-09T05:53:56.919 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:53:56 smithi100 ceph-mon[34353]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-09T05:53:56.948 INFO:tasks.workunit.client.0.smithi039.stdout: 10 61981 21.44 MB/sec execute 33 sec latency 55.746 ms 2024-05-09T05:53:57.041 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:53:56 smithi060 ceph-mon[34555]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-09T05:53:57.105 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:53:56 smithi039 ceph-mon[30439]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-09T05:53:57.921 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:53:57 smithi100 ceph-mon[34353]: pgmap v867: 97 pgs: 97 active+clean; 552 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 5.9 MiB/s wr, 388 op/s 2024-05-09T05:53:57.948 INFO:tasks.workunit.client.0.smithi039.stdout: 10 62395 21.53 MB/sec execute 34 sec latency 58.031 ms 2024-05-09T05:53:58.041 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:53:57 smithi060 ceph-mon[34555]: pgmap v867: 97 pgs: 97 active+clean; 552 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 5.9 MiB/s wr, 388 op/s 2024-05-09T05:53:58.105 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:53:57 smithi039 ceph-mon[30439]: pgmap v867: 97 pgs: 97 active+clean; 552 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 5.9 MiB/s wr, 388 op/s 2024-05-09T05:53:58.948 INFO:tasks.workunit.client.0.smithi039.stdout: 10 62735 21.40 MB/sec execute 35 sec latency 84.859 ms 2024-05-09T05:53:59.906 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:53:59 smithi039 ceph-mon[30439]: pgmap v868: 97 pgs: 97 active+clean; 554 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 5.9 MiB/s wr, 395 op/s 2024-05-09T05:53:59.918 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:53:59 smithi100 ceph-mon[34353]: pgmap v868: 97 pgs: 97 active+clean; 554 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 5.9 MiB/s wr, 395 op/s 2024-05-09T05:53:59.948 INFO:tasks.workunit.client.0.smithi039.stdout: 10 63012 21.22 MB/sec execute 36 sec latency 146.300 ms 2024-05-09T05:54:00.041 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:53:59 smithi060 ceph-mon[34555]: pgmap v868: 97 pgs: 97 active+clean; 554 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 5.9 MiB/s wr, 395 op/s 2024-05-09T05:54:00.948 INFO:tasks.workunit.client.0.smithi039.stdout: 10 63375 21.25 MB/sec execute 37 sec latency 238.177 ms 2024-05-09T05:54:01.919 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:54:01 smithi100 ceph-mon[34353]: pgmap v869: 97 pgs: 97 active+clean; 557 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.1 MiB/s wr, 338 op/s 2024-05-09T05:54:01.948 INFO:tasks.workunit.client.0.smithi039.stdout: 10 63770 21.41 MB/sec execute 38 sec latency 117.367 ms 2024-05-09T05:54:02.041 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:54:01 smithi060 ceph-mon[34555]: pgmap v869: 97 pgs: 97 active+clean; 557 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.1 MiB/s wr, 338 op/s 2024-05-09T05:54:02.105 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:54:01 smithi039 ceph-mon[30439]: pgmap v869: 97 pgs: 97 active+clean; 557 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.1 MiB/s wr, 338 op/s 2024-05-09T05:54:02.948 INFO:tasks.workunit.client.0.smithi039.stdout: 10 64113 21.06 MB/sec execute 39 sec latency 59.531 ms 2024-05-09T05:54:03.919 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:54:03 smithi100 ceph-mon[34353]: pgmap v870: 97 pgs: 97 active+clean; 561 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.4 MiB/s wr, 355 op/s 2024-05-09T05:54:03.948 INFO:tasks.workunit.client.0.smithi039.stdout: 10 64405 20.97 MB/sec execute 40 sec latency 80.392 ms 2024-05-09T05:54:04.041 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:54:03 smithi060 ceph-mon[34555]: pgmap v870: 97 pgs: 97 active+clean; 561 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.4 MiB/s wr, 355 op/s 2024-05-09T05:54:04.105 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:54:03 smithi039 ceph-mon[30439]: pgmap v870: 97 pgs: 97 active+clean; 561 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.4 MiB/s wr, 355 op/s 2024-05-09T05:54:04.948 INFO:tasks.workunit.client.0.smithi039.stdout: 10 64957 21.11 MB/sec execute 41 sec latency 66.181 ms 2024-05-09T05:54:05.918 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:54:05 smithi100 ceph-mon[34353]: pgmap v871: 97 pgs: 97 active+clean; 551 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 5.7 MiB/s wr, 385 op/s 2024-05-09T05:54:05.948 INFO:tasks.workunit.client.0.smithi039.stdout: 10 65368 21.11 MB/sec execute 42 sec latency 217.514 ms 2024-05-09T05:54:06.041 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:54:05 smithi060 ceph-mon[34555]: pgmap v871: 97 pgs: 97 active+clean; 551 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 5.7 MiB/s wr, 385 op/s 2024-05-09T05:54:06.105 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:54:05 smithi039 ceph-mon[30439]: pgmap v871: 97 pgs: 97 active+clean; 551 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 5.7 MiB/s wr, 385 op/s 2024-05-09T05:54:06.948 INFO:tasks.workunit.client.0.smithi039.stdout: 10 65785 21.22 MB/sec execute 43 sec latency 67.050 ms 2024-05-09T05:54:07.918 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:54:07 smithi100 ceph-mon[34353]: pgmap v872: 97 pgs: 97 active+clean; 542 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.1 MiB/s wr, 349 op/s 2024-05-09T05:54:07.948 INFO:tasks.workunit.client.0.smithi039.stdout: 10 66231 21.38 MB/sec execute 44 sec latency 76.830 ms 2024-05-09T05:54:08.041 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:54:07 smithi060 ceph-mon[34555]: pgmap v872: 97 pgs: 97 active+clean; 542 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.1 MiB/s wr, 349 op/s 2024-05-09T05:54:08.105 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:54:07 smithi039 ceph-mon[30439]: pgmap v872: 97 pgs: 97 active+clean; 542 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.1 MiB/s wr, 349 op/s 2024-05-09T05:54:08.950 INFO:tasks.workunit.client.0.smithi039.stdout: 10 66669 21.38 MB/sec execute 45 sec latency 88.021 ms 2024-05-09T05:54:09.919 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:54:09 smithi100 ceph-mon[34353]: pgmap v873: 97 pgs: 97 active+clean; 542 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 5.5 MiB/s wr, 359 op/s 2024-05-09T05:54:09.948 INFO:tasks.workunit.client.0.smithi039.stdout: 10 67006 21.30 MB/sec execute 46 sec latency 214.924 ms 2024-05-09T05:54:10.041 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:54:09 smithi060 ceph-mon[34555]: pgmap v873: 97 pgs: 97 active+clean; 542 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 5.5 MiB/s wr, 359 op/s 2024-05-09T05:54:10.105 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:54:09 smithi039 ceph-mon[30439]: pgmap v873: 97 pgs: 97 active+clean; 542 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 5.5 MiB/s wr, 359 op/s 2024-05-09T05:54:10.948 INFO:tasks.workunit.client.0.smithi039.stdout: 10 67329 21.30 MB/sec execute 47 sec latency 216.019 ms 2024-05-09T05:54:11.918 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:54:11 smithi100 ceph-mon[34353]: pgmap v874: 97 pgs: 97 active+clean; 543 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 5.2 MiB/s wr, 319 op/s 2024-05-09T05:54:11.948 INFO:tasks.workunit.client.0.smithi039.stdout: 10 67708 21.28 MB/sec execute 48 sec latency 80.093 ms 2024-05-09T05:54:12.041 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:54:11 smithi060 ceph-mon[34555]: pgmap v874: 97 pgs: 97 active+clean; 543 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 5.2 MiB/s wr, 319 op/s 2024-05-09T05:54:12.105 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:54:11 smithi039 ceph-mon[30439]: pgmap v874: 97 pgs: 97 active+clean; 543 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 5.2 MiB/s wr, 319 op/s 2024-05-09T05:54:12.948 INFO:tasks.workunit.client.0.smithi039.stdout: 10 68028 21.05 MB/sec execute 49 sec latency 62.185 ms 2024-05-09T05:54:13.918 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:54:13 smithi100 ceph-mon[34353]: pgmap v875: 97 pgs: 97 active+clean; 551 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.8 MiB/s wr, 352 op/s 2024-05-09T05:54:13.948 INFO:tasks.workunit.client.0.smithi039.stdout: 10 68455 21.15 MB/sec execute 50 sec latency 79.386 ms 2024-05-09T05:54:14.041 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:54:13 smithi060 ceph-mon[34555]: pgmap v875: 97 pgs: 97 active+clean; 551 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.8 MiB/s wr, 352 op/s 2024-05-09T05:54:14.105 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:54:13 smithi039 ceph-mon[30439]: pgmap v875: 97 pgs: 97 active+clean; 551 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.8 MiB/s wr, 352 op/s 2024-05-09T05:54:14.948 INFO:tasks.workunit.client.0.smithi039.stdout: 10 68978 21.38 MB/sec execute 51 sec latency 59.919 ms 2024-05-09T05:54:15.919 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:54:15 smithi100 ceph-mon[34353]: pgmap v876: 97 pgs: 97 active+clean; 555 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 6.2 MiB/s wr, 376 op/s 2024-05-09T05:54:15.948 INFO:tasks.workunit.client.0.smithi039.stdout: 10 69253 21.10 MB/sec execute 52 sec latency 353.325 ms 2024-05-09T05:54:16.041 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:54:15 smithi060 ceph-mon[34555]: pgmap v876: 97 pgs: 97 active+clean; 555 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 6.2 MiB/s wr, 376 op/s 2024-05-09T05:54:16.105 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:54:15 smithi039 ceph-mon[30439]: pgmap v876: 97 pgs: 97 active+clean; 555 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 6.2 MiB/s wr, 376 op/s 2024-05-09T05:54:16.948 INFO:tasks.workunit.client.0.smithi039.stdout: 10 69635 21.02 MB/sec execute 53 sec latency 83.319 ms 2024-05-09T05:54:17.918 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:54:17 smithi100 ceph-mon[34353]: pgmap v877: 97 pgs: 97 active+clean; 556 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 6.0 MiB/s wr, 370 op/s 2024-05-09T05:54:17.948 INFO:tasks.workunit.client.0.smithi039.stdout: 10 70105 21.28 MB/sec execute 54 sec latency 57.316 ms 2024-05-09T05:54:18.041 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:54:17 smithi060 ceph-mon[34555]: pgmap v877: 97 pgs: 97 active+clean; 556 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 6.0 MiB/s wr, 370 op/s 2024-05-09T05:54:18.105 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:54:17 smithi039 ceph-mon[30439]: pgmap v877: 97 pgs: 97 active+clean; 556 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 6.0 MiB/s wr, 370 op/s 2024-05-09T05:54:18.949 INFO:tasks.workunit.client.0.smithi039.stdout: 10 70675 21.31 MB/sec execute 55 sec latency 80.152 ms 2024-05-09T05:54:19.918 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:54:19 smithi100 ceph-mon[34353]: pgmap v878: 97 pgs: 97 active+clean; 555 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 6.1 MiB/s wr, 372 op/s 2024-05-09T05:54:19.949 INFO:tasks.workunit.client.0.smithi039.stdout: 10 71022 21.37 MB/sec execute 56 sec latency 51.227 ms 2024-05-09T05:54:20.041 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:54:19 smithi060 ceph-mon[34555]: pgmap v878: 97 pgs: 97 active+clean; 555 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 6.1 MiB/s wr, 372 op/s 2024-05-09T05:54:20.105 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:54:19 smithi039 ceph-mon[30439]: pgmap v878: 97 pgs: 97 active+clean; 555 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 6.1 MiB/s wr, 372 op/s 2024-05-09T05:54:20.918 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:54:20 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:54:20.949 INFO:tasks.workunit.client.0.smithi039.stdout: 10 71290 21.31 MB/sec execute 57 sec latency 295.682 ms 2024-05-09T05:54:21.041 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:54:20 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:54:21.105 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:54:20 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:54:21.919 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:54:21 smithi100 ceph-mon[34353]: pgmap v879: 97 pgs: 97 active+clean; 557 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.6 MiB/s wr, 342 op/s 2024-05-09T05:54:21.919 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:54:21 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:54:21.919 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:54:21 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:54:21.919 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:54:21 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:54:21.919 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:54:21 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:54:21.919 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:54:21 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:54:21.920 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:54:21 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:54:21.920 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:54:21 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:54:21.920 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:54:21 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:54:21.920 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:54:21 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:54:21.920 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:54:21 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:54:21.920 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:54:21 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:54:21.949 INFO:tasks.workunit.client.0.smithi039.stdout: 10 71598 21.18 MB/sec execute 58 sec latency 116.784 ms 2024-05-09T05:54:22.041 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:54:21 smithi060 ceph-mon[34555]: pgmap v879: 97 pgs: 97 active+clean; 557 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.6 MiB/s wr, 342 op/s 2024-05-09T05:54:22.041 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:54:21 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:54:22.041 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:54:21 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:54:22.041 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:54:21 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:54:22.042 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:54:21 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:54:22.042 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:54:21 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:54:22.042 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:54:21 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:54:22.042 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:54:21 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:54:22.042 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:54:21 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:54:22.042 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:54:21 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:54:22.042 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:54:21 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:54:22.042 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:54:21 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:54:22.105 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:54:21 smithi039 ceph-mon[30439]: pgmap v879: 97 pgs: 97 active+clean; 557 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.6 MiB/s wr, 342 op/s 2024-05-09T05:54:22.105 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:54:21 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:54:22.105 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:54:21 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:54:22.105 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:54:21 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:54:22.105 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:54:21 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:54:22.105 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:54:21 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:54:22.106 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:54:21 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:54:22.106 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:54:21 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:54:22.106 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:54:21 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-09T05:54:22.106 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:54:21 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:54:22.106 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:54:21 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:54:22.106 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:54:21 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:54:22.918 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:54:22 smithi100 ceph-mon[34353]: Adjusting osd_memory_target on smithi100 to 176.1M 2024-05-09T05:54:22.919 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:54:22 smithi100 ceph-mon[34353]: Unable to set osd_memory_target on smithi100 to 184727961: error parsing value: Value '184727961' is below minimum 939524096 2024-05-09T05:54:22.919 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:54:22 smithi100 ceph-mon[34353]: Adjusting osd_memory_target on smithi060 to 177.2M 2024-05-09T05:54:22.919 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:54:22 smithi100 ceph-mon[34353]: Unable to set osd_memory_target on smithi060 to 185897062: error parsing value: Value '185897062' is below minimum 939524096 2024-05-09T05:54:22.949 INFO:tasks.workunit.client.0.smithi039.stdout: 10 72000 21.15 MB/sec execute 59 sec latency 143.465 ms 2024-05-09T05:54:23.041 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:54:22 smithi060 ceph-mon[34555]: Adjusting osd_memory_target on smithi100 to 176.1M 2024-05-09T05:54:23.041 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:54:22 smithi060 ceph-mon[34555]: Unable to set osd_memory_target on smithi100 to 184727961: error parsing value: Value '184727961' is below minimum 939524096 2024-05-09T05:54:23.041 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:54:22 smithi060 ceph-mon[34555]: Adjusting osd_memory_target on smithi060 to 177.2M 2024-05-09T05:54:23.042 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:54:22 smithi060 ceph-mon[34555]: Unable to set osd_memory_target on smithi060 to 185897062: error parsing value: Value '185897062' is below minimum 939524096 2024-05-09T05:54:23.105 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:54:22 smithi039 ceph-mon[30439]: Adjusting osd_memory_target on smithi100 to 176.1M 2024-05-09T05:54:23.105 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:54:22 smithi039 ceph-mon[30439]: Unable to set osd_memory_target on smithi100 to 184727961: error parsing value: Value '184727961' is below minimum 939524096 2024-05-09T05:54:23.105 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:54:22 smithi039 ceph-mon[30439]: Adjusting osd_memory_target on smithi060 to 177.2M 2024-05-09T05:54:23.105 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:54:22 smithi039 ceph-mon[30439]: Unable to set osd_memory_target on smithi060 to 185897062: error parsing value: Value '185897062' is below minimum 939524096 2024-05-09T05:54:23.949 INFO:tasks.workunit.client.0.smithi039.stdout: 10 72356 21.23 MB/sec execute 60 sec latency 93.214 ms 2024-05-09T05:54:24.041 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:54:23 smithi060 ceph-mon[34555]: pgmap v880: 97 pgs: 97 active+clean; 562 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 6.0 MiB/s wr, 362 op/s 2024-05-09T05:54:24.105 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:54:23 smithi039 ceph-mon[30439]: pgmap v880: 97 pgs: 97 active+clean; 562 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 6.0 MiB/s wr, 362 op/s 2024-05-09T05:54:24.168 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:54:23 smithi100 ceph-mon[34353]: pgmap v880: 97 pgs: 97 active+clean; 562 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 6.0 MiB/s wr, 362 op/s 2024-05-09T05:54:24.949 INFO:tasks.workunit.client.0.smithi039.stdout: 10 72687 21.11 MB/sec execute 61 sec latency 85.493 ms 2024-05-09T05:54:25.949 INFO:tasks.workunit.client.0.smithi039.stdout: 10 72967 21.00 MB/sec execute 62 sec latency 187.636 ms 2024-05-09T05:54:26.041 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:54:25 smithi060 ceph-mon[34555]: pgmap v881: 97 pgs: 97 active+clean; 560 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 6.0 MiB/s wr, 350 op/s 2024-05-09T05:54:26.105 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:54:25 smithi039 ceph-mon[30439]: pgmap v881: 97 pgs: 97 active+clean; 560 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 6.0 MiB/s wr, 350 op/s 2024-05-09T05:54:26.168 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:54:25 smithi100 ceph-mon[34353]: pgmap v881: 97 pgs: 97 active+clean; 560 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 6.0 MiB/s wr, 350 op/s 2024-05-09T05:54:26.949 INFO:tasks.workunit.client.0.smithi039.stdout: 10 73308 20.84 MB/sec execute 63 sec latency 100.045 ms 2024-05-09T05:54:27.949 INFO:tasks.workunit.client.0.smithi039.stdout: 10 73809 20.88 MB/sec execute 64 sec latency 59.638 ms 2024-05-09T05:54:28.041 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:54:27 smithi060 ceph-mon[34555]: pgmap v882: 97 pgs: 97 active+clean; 556 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 5.9 MiB/s wr, 378 op/s 2024-05-09T05:54:28.105 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:54:27 smithi039 ceph-mon[30439]: pgmap v882: 97 pgs: 97 active+clean; 556 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 5.9 MiB/s wr, 378 op/s 2024-05-09T05:54:28.168 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:54:27 smithi100 ceph-mon[34353]: pgmap v882: 97 pgs: 97 active+clean; 556 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 5.9 MiB/s wr, 378 op/s 2024-05-09T05:54:28.949 INFO:tasks.workunit.client.0.smithi039.stdout: 10 74317 21.12 MB/sec execute 65 sec latency 81.872 ms 2024-05-09T05:54:29.949 INFO:tasks.workunit.client.0.smithi039.stdout: 10 74698 21.03 MB/sec execute 66 sec latency 139.201 ms 2024-05-09T05:54:30.041 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:54:29 smithi060 ceph-mon[34555]: pgmap v883: 97 pgs: 97 active+clean; 541 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 5.3 MiB/s wr, 331 op/s 2024-05-09T05:54:30.105 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:54:29 smithi039 ceph-mon[30439]: pgmap v883: 97 pgs: 97 active+clean; 541 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 5.3 MiB/s wr, 331 op/s 2024-05-09T05:54:30.168 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:54:29 smithi100 ceph-mon[34353]: pgmap v883: 97 pgs: 97 active+clean; 541 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 5.3 MiB/s wr, 331 op/s 2024-05-09T05:54:30.949 INFO:tasks.workunit.client.0.smithi039.stdout: 10 74947 20.99 MB/sec execute 67 sec latency 187.244 ms 2024-05-09T05:54:31.949 INFO:tasks.workunit.client.0.smithi039.stdout: 10 75257 21.02 MB/sec execute 68 sec latency 254.563 ms 2024-05-09T05:54:32.041 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:54:31 smithi060 ceph-mon[34555]: pgmap v884: 97 pgs: 97 active+clean; 548 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 5.5 MiB/s wr, 375 op/s 2024-05-09T05:54:32.105 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:54:31 smithi039 ceph-mon[30439]: pgmap v884: 97 pgs: 97 active+clean; 548 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 5.5 MiB/s wr, 375 op/s 2024-05-09T05:54:32.168 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:54:31 smithi100 ceph-mon[34353]: pgmap v884: 97 pgs: 97 active+clean; 548 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 5.5 MiB/s wr, 375 op/s 2024-05-09T05:54:32.949 INFO:tasks.workunit.client.0.smithi039.stdout: 10 75647 20.95 MB/sec execute 69 sec latency 90.352 ms 2024-05-09T05:54:33.949 INFO:tasks.workunit.client.0.smithi039.stdout: 10 76045 21.00 MB/sec execute 70 sec latency 53.220 ms 2024-05-09T05:54:34.041 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:54:33 smithi060 ceph-mon[34555]: pgmap v885: 97 pgs: 97 active+clean; 550 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.5 MiB/s wr, 363 op/s 2024-05-09T05:54:34.105 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:54:33 smithi039 ceph-mon[30439]: pgmap v885: 97 pgs: 97 active+clean; 550 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.5 MiB/s wr, 363 op/s 2024-05-09T05:54:34.168 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:54:33 smithi100 ceph-mon[34353]: pgmap v885: 97 pgs: 97 active+clean; 550 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.5 MiB/s wr, 363 op/s 2024-05-09T05:54:34.949 INFO:tasks.workunit.client.0.smithi039.stdout: 10 76409 20.98 MB/sec execute 71 sec latency 68.878 ms 2024-05-09T05:54:35.949 INFO:tasks.workunit.client.0.smithi039.stdout: 10 76772 20.94 MB/sec execute 72 sec latency 156.123 ms 2024-05-09T05:54:36.041 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:54:35 smithi060 ceph-mon[34555]: pgmap v886: 97 pgs: 97 active+clean; 550 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 5.1 MiB/s wr, 351 op/s 2024-05-09T05:54:36.105 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:54:35 smithi039 ceph-mon[30439]: pgmap v886: 97 pgs: 97 active+clean; 550 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 5.1 MiB/s wr, 351 op/s 2024-05-09T05:54:36.168 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:54:35 smithi100 ceph-mon[34353]: pgmap v886: 97 pgs: 97 active+clean; 550 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 5.1 MiB/s wr, 351 op/s 2024-05-09T05:54:36.949 INFO:tasks.workunit.client.0.smithi039.stdout: 10 76980 20.76 MB/sec execute 73 sec latency 304.146 ms 2024-05-09T05:54:37.949 INFO:tasks.workunit.client.0.smithi039.stdout: 10 77477 20.82 MB/sec execute 74 sec latency 55.008 ms 2024-05-09T05:54:38.041 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:54:37 smithi060 ceph-mon[34555]: pgmap v887: 97 pgs: 97 active+clean; 555 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 5.6 MiB/s wr, 405 op/s 2024-05-09T05:54:38.105 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:54:37 smithi039 ceph-mon[30439]: pgmap v887: 97 pgs: 97 active+clean; 555 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 5.6 MiB/s wr, 405 op/s 2024-05-09T05:54:38.168 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:54:37 smithi100 ceph-mon[34353]: pgmap v887: 97 pgs: 97 active+clean; 555 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 5.6 MiB/s wr, 405 op/s 2024-05-09T05:54:38.949 INFO:tasks.workunit.client.0.smithi039.stdout: 10 77985 20.84 MB/sec execute 75 sec latency 116.820 ms 2024-05-09T05:54:39.949 INFO:tasks.workunit.client.0.smithi039.stdout: 10 78404 20.93 MB/sec execute 76 sec latency 88.549 ms 2024-05-09T05:54:39.969 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:54:39 smithi100 ceph-mon[34353]: pgmap v888: 97 pgs: 97 active+clean; 553 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 5.3 MiB/s wr, 358 op/s 2024-05-09T05:54:40.041 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:54:39 smithi060 ceph-mon[34555]: pgmap v888: 97 pgs: 97 active+clean; 553 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 5.3 MiB/s wr, 358 op/s 2024-05-09T05:54:40.105 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:54:39 smithi039 ceph-mon[30439]: pgmap v888: 97 pgs: 97 active+clean; 553 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 5.3 MiB/s wr, 358 op/s 2024-05-09T05:54:40.950 INFO:tasks.workunit.client.0.smithi039.stdout: 10 78872 21.01 MB/sec execute 77 sec latency 51.007 ms 2024-05-09T05:54:41.950 INFO:tasks.workunit.client.0.smithi039.stdout: 10 79105 20.89 MB/sec execute 78 sec latency 249.444 ms 2024-05-09T05:54:42.041 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:54:41 smithi060 ceph-mon[34555]: pgmap v889: 97 pgs: 97 active+clean; 554 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 5.2 MiB/s wr, 356 op/s 2024-05-09T05:54:42.105 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:54:41 smithi039 ceph-mon[30439]: pgmap v889: 97 pgs: 97 active+clean; 554 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 5.2 MiB/s wr, 356 op/s 2024-05-09T05:54:42.168 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:54:41 smithi100 ceph-mon[34353]: pgmap v889: 97 pgs: 97 active+clean; 554 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 5.2 MiB/s wr, 356 op/s 2024-05-09T05:54:42.949 INFO:tasks.workunit.client.0.smithi039.stdout: 10 79615 20.97 MB/sec execute 79 sec latency 70.791 ms 2024-05-09T05:54:43.950 INFO:tasks.workunit.client.0.smithi039.stdout: 10 80043 21.09 MB/sec execute 80 sec latency 58.750 ms 2024-05-09T05:54:44.041 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:54:43 smithi060 ceph-mon[34555]: pgmap v890: 97 pgs: 97 active+clean; 564 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 5.5 MiB/s wr, 348 op/s 2024-05-09T05:54:44.105 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:54:43 smithi039 ceph-mon[30439]: pgmap v890: 97 pgs: 97 active+clean; 564 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 5.5 MiB/s wr, 348 op/s 2024-05-09T05:54:44.168 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:54:43 smithi100 ceph-mon[34353]: pgmap v890: 97 pgs: 97 active+clean; 564 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 5.5 MiB/s wr, 348 op/s 2024-05-09T05:54:44.950 INFO:tasks.workunit.client.0.smithi039.stdout: 10 80340 21.04 MB/sec execute 81 sec latency 72.767 ms 2024-05-09T05:54:45.950 INFO:tasks.workunit.client.0.smithi039.stdout: 10 80667 20.93 MB/sec execute 82 sec latency 86.962 ms 2024-05-09T05:54:46.041 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:54:45 smithi060 ceph-mon[34555]: pgmap v891: 97 pgs: 97 active+clean; 565 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 5.6 MiB/s wr, 367 op/s 2024-05-09T05:54:46.105 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:54:45 smithi039 ceph-mon[30439]: pgmap v891: 97 pgs: 97 active+clean; 565 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 5.6 MiB/s wr, 367 op/s 2024-05-09T05:54:46.168 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:54:45 smithi100 ceph-mon[34353]: pgmap v891: 97 pgs: 97 active+clean; 565 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 5.6 MiB/s wr, 367 op/s 2024-05-09T05:54:46.950 INFO:tasks.workunit.client.0.smithi039.stdout: 10 80950 20.88 MB/sec execute 83 sec latency 197.150 ms 2024-05-09T05:54:47.950 INFO:tasks.workunit.client.0.smithi039.stdout: 10 81495 20.94 MB/sec execute 84 sec latency 57.538 ms 2024-05-09T05:54:48.041 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:54:47 smithi060 ceph-mon[34555]: pgmap v892: 97 pgs: 97 active+clean; 568 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 6.3 MiB/s wr, 408 op/s 2024-05-09T05:54:48.105 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:54:47 smithi039 ceph-mon[30439]: pgmap v892: 97 pgs: 97 active+clean; 568 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 6.3 MiB/s wr, 408 op/s 2024-05-09T05:54:48.168 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:54:47 smithi100 ceph-mon[34353]: pgmap v892: 97 pgs: 97 active+clean; 568 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 6.3 MiB/s wr, 408 op/s 2024-05-09T05:54:48.950 INFO:tasks.workunit.client.0.smithi039.stdout: 10 81781 20.85 MB/sec execute 85 sec latency 296.086 ms 2024-05-09T05:54:49.950 INFO:tasks.workunit.client.0.smithi039.stdout: 10 82212 20.88 MB/sec execute 86 sec latency 71.704 ms 2024-05-09T05:54:50.041 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:54:49 smithi060 ceph-mon[34555]: pgmap v893: 97 pgs: 97 active+clean; 567 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 5.8 MiB/s wr, 374 op/s 2024-05-09T05:54:50.105 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:54:49 smithi039 ceph-mon[30439]: pgmap v893: 97 pgs: 97 active+clean; 567 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 5.8 MiB/s wr, 374 op/s 2024-05-09T05:54:50.168 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:54:49 smithi100 ceph-mon[34353]: pgmap v893: 97 pgs: 97 active+clean; 567 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 5.8 MiB/s wr, 374 op/s 2024-05-09T05:54:50.950 INFO:tasks.workunit.client.0.smithi039.stdout: 10 82674 20.94 MB/sec execute 87 sec latency 67.782 ms 2024-05-09T05:54:51.950 INFO:tasks.workunit.client.0.smithi039.stdout: 10 83035 20.88 MB/sec execute 88 sec latency 167.115 ms 2024-05-09T05:54:52.041 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:54:51 smithi060 ceph-mon[34555]: pgmap v894: 97 pgs: 97 active+clean; 559 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 5.5 MiB/s wr, 385 op/s 2024-05-09T05:54:52.105 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:54:51 smithi039 ceph-mon[30439]: pgmap v894: 97 pgs: 97 active+clean; 559 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 5.5 MiB/s wr, 385 op/s 2024-05-09T05:54:52.168 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:54:51 smithi100 ceph-mon[34353]: pgmap v894: 97 pgs: 97 active+clean; 559 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 5.5 MiB/s wr, 385 op/s 2024-05-09T05:54:52.950 INFO:tasks.workunit.client.0.smithi039.stdout: 10 83574 21.04 MB/sec execute 89 sec latency 76.183 ms 2024-05-09T05:54:53.950 INFO:tasks.workunit.client.0.smithi039.stdout: 10 83976 21.12 MB/sec execute 90 sec latency 68.942 ms 2024-05-09T05:54:54.041 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:54:53 smithi060 ceph-mon[34555]: pgmap v895: 97 pgs: 97 active+clean; 551 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 6.0 MiB/s wr, 442 op/s 2024-05-09T05:54:54.105 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:54:53 smithi039 ceph-mon[30439]: pgmap v895: 97 pgs: 97 active+clean; 551 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 6.0 MiB/s wr, 442 op/s 2024-05-09T05:54:54.168 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:54:53 smithi100 ceph-mon[34353]: pgmap v895: 97 pgs: 97 active+clean; 551 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 6.0 MiB/s wr, 442 op/s 2024-05-09T05:54:54.950 INFO:tasks.workunit.client.0.smithi039.stdout: 10 84284 21.02 MB/sec execute 91 sec latency 78.378 ms 2024-05-09T05:54:55.950 INFO:tasks.workunit.client.0.smithi039.stdout: 10 84646 21.00 MB/sec execute 92 sec latency 77.126 ms 2024-05-09T05:54:56.041 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:54:55 smithi060 ceph-mon[34555]: pgmap v896: 97 pgs: 97 active+clean; 556 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 6.2 MiB/s wr, 480 op/s 2024-05-09T05:54:56.105 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:54:55 smithi039 ceph-mon[30439]: pgmap v896: 97 pgs: 97 active+clean; 556 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 6.2 MiB/s wr, 480 op/s 2024-05-09T05:54:56.168 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:54:55 smithi100 ceph-mon[34353]: pgmap v896: 97 pgs: 97 active+clean; 556 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 6.2 MiB/s wr, 480 op/s 2024-05-09T05:54:56.950 INFO:tasks.workunit.client.0.smithi039.stdout: 10 85025 21.01 MB/sec execute 93 sec latency 140.198 ms 2024-05-09T05:54:57.950 INFO:tasks.workunit.client.0.smithi039.stdout: 10 85452 21.00 MB/sec execute 94 sec latency 67.757 ms 2024-05-09T05:54:58.041 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:54:57 smithi060 ceph-mon[34555]: pgmap v897: 97 pgs: 97 active+clean; 552 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 6.1 MiB/s wr, 467 op/s 2024-05-09T05:54:58.105 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:54:57 smithi039 ceph-mon[30439]: pgmap v897: 97 pgs: 97 active+clean; 552 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 6.1 MiB/s wr, 467 op/s 2024-05-09T05:54:58.168 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:54:57 smithi100 ceph-mon[34353]: pgmap v897: 97 pgs: 97 active+clean; 552 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 6.1 MiB/s wr, 467 op/s 2024-05-09T05:54:58.950 INFO:tasks.workunit.client.0.smithi039.stdout: 10 85850 20.94 MB/sec execute 95 sec latency 77.645 ms 2024-05-09T05:54:59.950 INFO:tasks.workunit.client.0.smithi039.stdout: 10 86342 21.02 MB/sec execute 96 sec latency 61.104 ms 2024-05-09T05:55:00.041 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:54:59 smithi060 ceph-mon[34555]: pgmap v898: 97 pgs: 97 active+clean; 556 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.8 MiB/s wr, 477 op/s 2024-05-09T05:55:00.105 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:54:59 smithi039 ceph-mon[30439]: pgmap v898: 97 pgs: 97 active+clean; 556 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.8 MiB/s wr, 477 op/s 2024-05-09T05:55:00.168 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:54:59 smithi100 ceph-mon[34353]: pgmap v898: 97 pgs: 97 active+clean; 556 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.8 MiB/s wr, 477 op/s 2024-05-09T05:55:00.950 INFO:tasks.workunit.client.0.smithi039.stdout: 10 86977 21.11 MB/sec execute 97 sec latency 81.658 ms 2024-05-09T05:55:01.105 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:55:00 smithi039 ceph-mon[30439]: pgmap v899: 97 pgs: 97 active+clean; 556 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 5.3 MiB/s wr, 428 op/s 2024-05-09T05:55:01.168 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:55:00 smithi100 ceph-mon[34353]: pgmap v899: 97 pgs: 97 active+clean; 556 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 5.3 MiB/s wr, 428 op/s 2024-05-09T05:55:01.291 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:55:00 smithi060 ceph-mon[34555]: pgmap v899: 97 pgs: 97 active+clean; 556 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 5.3 MiB/s wr, 428 op/s 2024-05-09T05:55:01.950 INFO:tasks.workunit.client.0.smithi039.stdout: 10 87377 21.15 MB/sec execute 98 sec latency 280.801 ms 2024-05-09T05:55:02.950 INFO:tasks.workunit.client.0.smithi039.stdout: 10 87796 21.25 MB/sec execute 99 sec latency 84.962 ms 2024-05-09T05:55:03.792 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:55:03 smithi060 ceph-mon[34555]: pgmap v900: 97 pgs: 97 active+clean; 563 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 5.8 MiB/s wr, 469 op/s 2024-05-09T05:55:03.855 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:55:03 smithi039 ceph-mon[30439]: pgmap v900: 97 pgs: 97 active+clean; 563 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 5.8 MiB/s wr, 469 op/s 2024-05-09T05:55:03.918 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:55:03 smithi100 ceph-mon[34353]: pgmap v900: 97 pgs: 97 active+clean; 563 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 5.8 MiB/s wr, 469 op/s 2024-05-09T05:55:03.950 INFO:tasks.workunit.client.0.smithi039.stdout: 10 88152 21.21 MB/sec execute 100 sec latency 93.637 ms 2024-05-09T05:55:04.950 INFO:tasks.workunit.client.0.smithi039.stdout: 10 88461 21.18 MB/sec execute 101 sec latency 120.992 ms 2024-05-09T05:55:05.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:55:05 smithi060 ceph-mon[34555]: pgmap v901: 97 pgs: 97 active+clean; 565 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.6 MiB/s wr, 413 op/s 2024-05-09T05:55:05.855 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:55:05 smithi039 ceph-mon[30439]: pgmap v901: 97 pgs: 97 active+clean; 565 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.6 MiB/s wr, 413 op/s 2024-05-09T05:55:05.918 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:55:05 smithi100 ceph-mon[34353]: pgmap v901: 97 pgs: 97 active+clean; 565 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.6 MiB/s wr, 413 op/s 2024-05-09T05:55:05.950 INFO:tasks.workunit.client.0.smithi039.stdout: 10 88937 21.25 MB/sec execute 102 sec latency 50.998 ms 2024-05-09T05:55:06.951 INFO:tasks.workunit.client.0.smithi039.stdout: 10 89217 21.14 MB/sec execute 103 sec latency 194.258 ms 2024-05-09T05:55:07.791 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:55:07 smithi060 ceph-mon[34555]: pgmap v902: 97 pgs: 97 active+clean; 570 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 5.4 MiB/s wr, 379 op/s 2024-05-09T05:55:07.855 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:55:07 smithi039 ceph-mon[30439]: pgmap v902: 97 pgs: 97 active+clean; 570 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 5.4 MiB/s wr, 379 op/s 2024-05-09T05:55:07.918 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:55:07 smithi100 ceph-mon[34353]: pgmap v902: 97 pgs: 97 active+clean; 570 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 5.4 MiB/s wr, 379 op/s 2024-05-09T05:55:07.950 INFO:tasks.workunit.client.0.smithi039.stdout: 10 89483 21.02 MB/sec execute 104 sec latency 125.103 ms 2024-05-09T05:55:08.950 INFO:tasks.workunit.client.0.smithi039.stdout: 10 89865 20.99 MB/sec execute 105 sec latency 147.803 ms 2024-05-09T05:55:09.791 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:55:09 smithi060 ceph-mon[34555]: pgmap v903: 97 pgs: 97 active+clean; 572 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 5.7 MiB/s wr, 403 op/s 2024-05-09T05:55:09.854 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:55:09 smithi039 ceph-mon[30439]: pgmap v903: 97 pgs: 97 active+clean; 572 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 5.7 MiB/s wr, 403 op/s 2024-05-09T05:55:09.918 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:55:09 smithi100 ceph-mon[34353]: pgmap v903: 97 pgs: 97 active+clean; 572 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 5.7 MiB/s wr, 403 op/s 2024-05-09T05:55:09.951 INFO:tasks.workunit.client.0.smithi039.stdout: 10 90450 21.11 MB/sec execute 106 sec latency 107.713 ms 2024-05-09T05:55:10.951 INFO:tasks.workunit.client.0.smithi039.stdout: 10 91020 21.17 MB/sec execute 107 sec latency 87.205 ms 2024-05-09T05:55:11.791 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:55:11 smithi060 ceph-mon[34555]: pgmap v904: 97 pgs: 97 active+clean; 573 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 5.2 MiB/s wr, 346 op/s 2024-05-09T05:55:11.855 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:55:11 smithi039 ceph-mon[30439]: pgmap v904: 97 pgs: 97 active+clean; 573 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 5.2 MiB/s wr, 346 op/s 2024-05-09T05:55:11.918 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:55:11 smithi100 ceph-mon[34353]: pgmap v904: 97 pgs: 97 active+clean; 573 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 5.2 MiB/s wr, 346 op/s 2024-05-09T05:55:11.951 INFO:tasks.workunit.client.0.smithi039.stdout: 10 91352 21.20 MB/sec execute 108 sec latency 247.066 ms 2024-05-09T05:55:12.951 INFO:tasks.workunit.client.0.smithi039.stdout: 10 91755 21.27 MB/sec execute 109 sec latency 269.226 ms 2024-05-09T05:55:13.791 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:55:13 smithi060 ceph-mon[34555]: pgmap v905: 97 pgs: 97 active+clean; 566 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.3 MiB/s wr, 354 op/s 2024-05-09T05:55:13.854 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:55:13 smithi039 ceph-mon[30439]: pgmap v905: 97 pgs: 97 active+clean; 566 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.3 MiB/s wr, 354 op/s 2024-05-09T05:55:13.918 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:55:13 smithi100 ceph-mon[34353]: pgmap v905: 97 pgs: 97 active+clean; 566 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.3 MiB/s wr, 354 op/s 2024-05-09T05:55:13.951 INFO:tasks.workunit.client.0.smithi039.stdout: 10 92108 21.24 MB/sec execute 110 sec latency 149.507 ms 2024-05-09T05:55:14.951 INFO:tasks.workunit.client.0.smithi039.stdout: 10 92497 21.25 MB/sec execute 111 sec latency 94.712 ms 2024-05-09T05:55:15.791 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:55:15 smithi060 ceph-mon[34555]: pgmap v906: 97 pgs: 97 active+clean; 561 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 5.7 MiB/s wr, 359 op/s 2024-05-09T05:55:15.854 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:55:15 smithi039 ceph-mon[30439]: pgmap v906: 97 pgs: 97 active+clean; 561 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 5.7 MiB/s wr, 359 op/s 2024-05-09T05:55:15.918 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:55:15 smithi100 ceph-mon[34353]: pgmap v906: 97 pgs: 97 active+clean; 561 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 5.7 MiB/s wr, 359 op/s 2024-05-09T05:55:15.951 INFO:tasks.workunit.client.0.smithi039.stdout: 10 92924 21.26 MB/sec execute 112 sec latency 55.528 ms 2024-05-09T05:55:16.951 INFO:tasks.workunit.client.0.smithi039.stdout: 10 93161 21.14 MB/sec execute 113 sec latency 284.335 ms 2024-05-09T05:55:17.791 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:55:17 smithi060 ceph-mon[34555]: pgmap v907: 97 pgs: 97 active+clean; 556 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 5.8 MiB/s wr, 373 op/s 2024-05-09T05:55:17.855 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:55:17 smithi039 ceph-mon[30439]: pgmap v907: 97 pgs: 97 active+clean; 556 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 5.8 MiB/s wr, 373 op/s 2024-05-09T05:55:17.918 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:55:17 smithi100 ceph-mon[34353]: pgmap v907: 97 pgs: 97 active+clean; 556 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 5.8 MiB/s wr, 373 op/s 2024-05-09T05:55:17.951 INFO:tasks.workunit.client.0.smithi039.stdout: 10 93447 21.07 MB/sec execute 114 sec latency 334.453 ms 2024-05-09T05:55:18.951 INFO:tasks.workunit.client.0.smithi039.stdout: 10 93827 21.02 MB/sec execute 115 sec latency 120.816 ms 2024-05-09T05:55:19.791 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:55:19 smithi060 ceph-mon[34555]: pgmap v908: 97 pgs: 97 active+clean; 562 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 5.5 MiB/s wr, 359 op/s 2024-05-09T05:55:19.855 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:55:19 smithi039 ceph-mon[30439]: pgmap v908: 97 pgs: 97 active+clean; 562 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 5.5 MiB/s wr, 359 op/s 2024-05-09T05:55:19.918 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:55:19 smithi100 ceph-mon[34353]: pgmap v908: 97 pgs: 97 active+clean; 562 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 5.5 MiB/s wr, 359 op/s 2024-05-09T05:55:19.951 INFO:tasks.workunit.client.0.smithi039.stdout: 10 94434 21.12 MB/sec execute 116 sec latency 94.788 ms 2024-05-09T05:55:20.951 INFO:tasks.workunit.client.0.smithi039.stdout: 10 95016 21.22 MB/sec execute 117 sec latency 71.195 ms 2024-05-09T05:55:21.791 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:55:21 smithi060 ceph-mon[34555]: pgmap v909: 97 pgs: 97 active+clean; 563 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.1 MiB/s wr, 337 op/s 2024-05-09T05:55:21.791 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:55:21 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:55:21.854 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:55:21 smithi039 ceph-mon[30439]: pgmap v909: 97 pgs: 97 active+clean; 563 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.1 MiB/s wr, 337 op/s 2024-05-09T05:55:21.855 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:55:21 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:55:21.920 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:55:21 smithi100 ceph-mon[34353]: pgmap v909: 97 pgs: 97 active+clean; 563 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.1 MiB/s wr, 337 op/s 2024-05-09T05:55:21.920 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:55:21 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:55:21.951 INFO:tasks.workunit.client.0.smithi039.stdout: 10 95443 21.30 MB/sec execute 118 sec latency 81.143 ms 2024-05-09T05:55:22.791 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:55:22 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:55:22.791 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:55:22 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:55:22.791 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:55:22 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:55:22.854 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:55:22 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:55:22.855 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:55:22 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:55:22.855 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:55:22 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:55:22.918 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:55:22 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:55:22.918 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:55:22 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:55:22.918 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:55:22 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:55:22.951 INFO:tasks.workunit.client.0.smithi039.stdout: 10 95686 21.24 MB/sec execute 119 sec latency 272.623 ms 2024-05-09T05:55:23.791 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:55:23 smithi060 ceph-mon[34555]: pgmap v910: 97 pgs: 97 active+clean; 566 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 5.5 MiB/s wr, 375 op/s 2024-05-09T05:55:23.854 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:55:23 smithi039 ceph-mon[30439]: pgmap v910: 97 pgs: 97 active+clean; 566 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 5.5 MiB/s wr, 375 op/s 2024-05-09T05:55:23.918 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:55:23 smithi100 ceph-mon[34353]: pgmap v910: 97 pgs: 97 active+clean; 566 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 5.5 MiB/s wr, 375 op/s 2024-05-09T05:55:23.951 INFO:tasks.workunit.client.0.smithi039.stdout: 10 96016 21.23 MB/sec execute 120 sec latency 111.703 ms 2024-05-09T05:55:24.951 INFO:tasks.workunit.client.0.smithi039.stdout: 10 96412 21.24 MB/sec execute 121 sec latency 79.191 ms 2024-05-09T05:55:25.791 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:55:25 smithi060 ceph-mon[34555]: pgmap v911: 97 pgs: 97 active+clean; 568 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 5.6 MiB/s wr, 394 op/s 2024-05-09T05:55:25.854 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:55:25 smithi039 ceph-mon[30439]: pgmap v911: 97 pgs: 97 active+clean; 568 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 5.6 MiB/s wr, 394 op/s 2024-05-09T05:55:25.918 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:55:25 smithi100 ceph-mon[34353]: pgmap v911: 97 pgs: 97 active+clean; 568 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 5.6 MiB/s wr, 394 op/s 2024-05-09T05:55:25.951 INFO:tasks.workunit.client.0.smithi039.stdout: 10 96831 21.25 MB/sec execute 122 sec latency 50.942 ms 2024-05-09T05:55:26.951 INFO:tasks.workunit.client.0.smithi039.stdout: 10 97115 21.14 MB/sec execute 123 sec latency 82.339 ms 2024-05-09T05:55:27.791 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:55:27 smithi060 ceph-mon[34555]: pgmap v912: 97 pgs: 97 active+clean; 570 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 5.4 MiB/s wr, 355 op/s 2024-05-09T05:55:27.854 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:55:27 smithi039 ceph-mon[30439]: pgmap v912: 97 pgs: 97 active+clean; 570 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 5.4 MiB/s wr, 355 op/s 2024-05-09T05:55:27.918 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:55:27 smithi100 ceph-mon[34353]: pgmap v912: 97 pgs: 97 active+clean; 570 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 5.4 MiB/s wr, 355 op/s 2024-05-09T05:55:27.951 INFO:tasks.workunit.client.0.smithi039.stdout: 10 97350 21.07 MB/sec execute 124 sec latency 242.952 ms 2024-05-09T05:55:28.952 INFO:tasks.workunit.client.0.smithi039.stdout: 10 97684 21.02 MB/sec execute 125 sec latency 157.734 ms 2024-05-09T05:55:29.791 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:55:29 smithi060 ceph-mon[34555]: pgmap v913: 97 pgs: 97 active+clean; 565 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 6.1 MiB/s wr, 385 op/s 2024-05-09T05:55:29.854 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:55:29 smithi039 ceph-mon[30439]: pgmap v913: 97 pgs: 97 active+clean; 565 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 6.1 MiB/s wr, 385 op/s 2024-05-09T05:55:29.918 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:55:29 smithi100 ceph-mon[34353]: pgmap v913: 97 pgs: 97 active+clean; 565 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 6.1 MiB/s wr, 385 op/s 2024-05-09T05:55:29.951 INFO:tasks.workunit.client.0.smithi039.stdout: 10 98338 21.15 MB/sec execute 126 sec latency 62.143 ms 2024-05-09T05:55:30.951 INFO:tasks.workunit.client.0.smithi039.stdout: 10 98779 21.16 MB/sec execute 127 sec latency 61.405 ms 2024-05-09T05:55:31.791 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:55:31 smithi060 ceph-mon[34555]: pgmap v914: 97 pgs: 97 active+clean; 566 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 5.7 MiB/s wr, 343 op/s 2024-05-09T05:55:31.854 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:55:31 smithi039 ceph-mon[30439]: pgmap v914: 97 pgs: 97 active+clean; 566 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 5.7 MiB/s wr, 343 op/s 2024-05-09T05:55:31.918 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:55:31 smithi100 ceph-mon[34353]: pgmap v914: 97 pgs: 97 active+clean; 566 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 5.7 MiB/s wr, 343 op/s 2024-05-09T05:55:31.951 INFO:tasks.workunit.client.0.smithi039.stdout: 10 99229 21.20 MB/sec execute 128 sec latency 73.291 ms 2024-05-09T05:55:32.951 INFO:tasks.workunit.client.0.smithi039.stdout: 10 99484 21.20 MB/sec execute 129 sec latency 294.489 ms 2024-05-09T05:55:33.791 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:55:33 smithi060 ceph-mon[34555]: pgmap v915: 97 pgs: 97 active+clean; 559 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 6.4 MiB/s wr, 391 op/s 2024-05-09T05:55:33.854 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:55:33 smithi039 ceph-mon[30439]: pgmap v915: 97 pgs: 97 active+clean; 559 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 6.4 MiB/s wr, 391 op/s 2024-05-09T05:55:33.918 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:55:33 smithi100 ceph-mon[34353]: pgmap v915: 97 pgs: 97 active+clean; 559 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 6.4 MiB/s wr, 391 op/s 2024-05-09T05:55:33.951 INFO:tasks.workunit.client.0.smithi039.stdout: 10 99790 21.19 MB/sec execute 130 sec latency 189.210 ms 2024-05-09T05:55:34.951 INFO:tasks.workunit.client.0.smithi039.stdout: 10 100143 21.14 MB/sec execute 131 sec latency 78.533 ms 2024-05-09T05:55:35.791 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:55:35 smithi060 ceph-mon[34555]: pgmap v916: 97 pgs: 97 active+clean; 560 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 6.2 MiB/s wr, 364 op/s 2024-05-09T05:55:35.854 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:55:35 smithi039 ceph-mon[30439]: pgmap v916: 97 pgs: 97 active+clean; 560 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 6.2 MiB/s wr, 364 op/s 2024-05-09T05:55:35.918 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:55:35 smithi100 ceph-mon[34353]: pgmap v916: 97 pgs: 97 active+clean; 560 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 6.2 MiB/s wr, 364 op/s 2024-05-09T05:55:35.951 INFO:tasks.workunit.client.0.smithi039.stdout: 10 100530 21.14 MB/sec execute 132 sec latency 91.201 ms 2024-05-09T05:55:36.952 INFO:tasks.workunit.client.0.smithi039.stdout: 10 100832 21.08 MB/sec execute 133 sec latency 98.721 ms 2024-05-09T05:55:37.791 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:55:37 smithi060 ceph-mon[34555]: pgmap v917: 97 pgs: 97 active+clean; 565 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 7.0 MiB/s wr, 407 op/s 2024-05-09T05:55:37.855 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:55:37 smithi039 ceph-mon[30439]: pgmap v917: 97 pgs: 97 active+clean; 565 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 7.0 MiB/s wr, 407 op/s 2024-05-09T05:55:37.918 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:55:37 smithi100 ceph-mon[34353]: pgmap v917: 97 pgs: 97 active+clean; 565 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 7.0 MiB/s wr, 407 op/s 2024-05-09T05:55:37.952 INFO:tasks.workunit.client.0.smithi039.stdout: 10 101134 21.00 MB/sec execute 134 sec latency 203.007 ms 2024-05-09T05:55:38.952 INFO:tasks.workunit.client.0.smithi039.stdout: 10 101465 21.00 MB/sec execute 135 sec latency 133.640 ms 2024-05-09T05:55:39.854 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:55:39 smithi039 ceph-mon[30439]: pgmap v918: 97 pgs: 97 active+clean; 563 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 6.7 MiB/s wr, 386 op/s 2024-05-09T05:55:39.918 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:55:39 smithi100 ceph-mon[34353]: pgmap v918: 97 pgs: 97 active+clean; 563 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 6.7 MiB/s wr, 386 op/s 2024-05-09T05:55:39.952 INFO:tasks.workunit.client.0.smithi039.stdout: 10 102093 21.08 MB/sec execute 136 sec latency 72.829 ms 2024-05-09T05:55:40.041 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:55:39 smithi060 ceph-mon[34555]: pgmap v918: 97 pgs: 97 active+clean; 563 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 6.7 MiB/s wr, 386 op/s 2024-05-09T05:55:40.952 INFO:tasks.workunit.client.0.smithi039.stdout: 10 102577 21.13 MB/sec execute 137 sec latency 61.847 ms 2024-05-09T05:55:41.842 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:55:41 smithi060 ceph-mon[34555]: pgmap v919: 97 pgs: 97 active+clean; 565 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 5.6 MiB/s wr, 346 op/s 2024-05-09T05:55:41.854 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:55:41 smithi039 ceph-mon[30439]: pgmap v919: 97 pgs: 97 active+clean; 565 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 5.6 MiB/s wr, 346 op/s 2024-05-09T05:55:41.918 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:55:41 smithi100 ceph-mon[34353]: pgmap v919: 97 pgs: 97 active+clean; 565 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 5.6 MiB/s wr, 346 op/s 2024-05-09T05:55:41.951 INFO:tasks.workunit.client.0.smithi039.stdout: 10 102980 21.12 MB/sec execute 138 sec latency 82.611 ms 2024-05-09T05:55:42.952 INFO:tasks.workunit.client.0.smithi039.stdout: 10 103264 21.09 MB/sec execute 139 sec latency 242.348 ms 2024-05-09T05:55:43.854 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:55:43 smithi039 ceph-mon[30439]: pgmap v920: 97 pgs: 97 active+clean; 571 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 6.2 MiB/s wr, 399 op/s 2024-05-09T05:55:43.918 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:55:43 smithi100 ceph-mon[34353]: pgmap v920: 97 pgs: 97 active+clean; 571 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 6.2 MiB/s wr, 399 op/s 2024-05-09T05:55:43.952 INFO:tasks.workunit.client.0.smithi039.stdout: 10 103643 21.14 MB/sec execute 140 sec latency 133.780 ms 2024-05-09T05:55:44.041 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:55:43 smithi060 ceph-mon[34555]: pgmap v920: 97 pgs: 97 active+clean; 571 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 6.2 MiB/s wr, 399 op/s 2024-05-09T05:55:44.952 INFO:tasks.workunit.client.0.smithi039.stdout: 10 104162 21.17 MB/sec execute 141 sec latency 46.503 ms 2024-05-09T05:55:45.854 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:55:45 smithi039 ceph-mon[30439]: pgmap v921: 97 pgs: 97 active+clean; 572 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 5.6 MiB/s wr, 345 op/s 2024-05-09T05:55:45.918 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:55:45 smithi100 ceph-mon[34353]: pgmap v921: 97 pgs: 97 active+clean; 572 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 5.6 MiB/s wr, 345 op/s 2024-05-09T05:55:45.952 INFO:tasks.workunit.client.0.smithi039.stdout: 10 104497 21.13 MB/sec execute 142 sec latency 79.305 ms 2024-05-09T05:55:46.041 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:55:45 smithi060 ceph-mon[34555]: pgmap v921: 97 pgs: 97 active+clean; 572 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 5.6 MiB/s wr, 345 op/s 2024-05-09T05:55:46.952 INFO:tasks.workunit.client.0.smithi039.stdout: 10 104803 21.08 MB/sec execute 143 sec latency 76.466 ms 2024-05-09T05:55:47.854 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:55:47 smithi039 ceph-mon[30439]: pgmap v922: 97 pgs: 97 active+clean; 572 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 5.9 MiB/s wr, 359 op/s 2024-05-09T05:55:47.918 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:55:47 smithi100 ceph-mon[34353]: pgmap v922: 97 pgs: 97 active+clean; 572 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 5.9 MiB/s wr, 359 op/s 2024-05-09T05:55:47.952 INFO:tasks.workunit.client.0.smithi039.stdout: 10 105134 21.04 MB/sec execute 144 sec latency 156.352 ms 2024-05-09T05:55:48.041 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:55:47 smithi060 ceph-mon[34555]: pgmap v922: 97 pgs: 97 active+clean; 572 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 5.9 MiB/s wr, 359 op/s 2024-05-09T05:55:48.952 INFO:tasks.workunit.client.0.smithi039.stdout: 10 105606 21.07 MB/sec execute 145 sec latency 82.990 ms 2024-05-09T05:55:49.854 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:55:49 smithi039 ceph-mon[30439]: pgmap v923: 97 pgs: 97 active+clean; 579 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 5.8 MiB/s wr, 367 op/s 2024-05-09T05:55:49.918 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:55:49 smithi100 ceph-mon[34353]: pgmap v923: 97 pgs: 97 active+clean; 579 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 5.8 MiB/s wr, 367 op/s 2024-05-09T05:55:49.952 INFO:tasks.workunit.client.0.smithi039.stdout: 10 106171 21.15 MB/sec execute 146 sec latency 52.919 ms 2024-05-09T05:55:50.041 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:55:49 smithi060 ceph-mon[34555]: pgmap v923: 97 pgs: 97 active+clean; 579 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 5.8 MiB/s wr, 367 op/s 2024-05-09T05:55:50.952 INFO:tasks.workunit.client.0.smithi039.stdout: 10 106649 21.17 MB/sec execute 147 sec latency 68.562 ms 2024-05-09T05:55:51.854 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:55:51 smithi039 ceph-mon[30439]: pgmap v924: 97 pgs: 97 active+clean; 579 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.4 MiB/s wr, 352 op/s 2024-05-09T05:55:51.918 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:55:51 smithi100 ceph-mon[34353]: pgmap v924: 97 pgs: 97 active+clean; 579 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.4 MiB/s wr, 352 op/s 2024-05-09T05:55:51.952 INFO:tasks.workunit.client.0.smithi039.stdout: 10 106986 21.17 MB/sec execute 148 sec latency 110.268 ms 2024-05-09T05:55:52.041 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:55:51 smithi060 ceph-mon[34555]: pgmap v924: 97 pgs: 97 active+clean; 579 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.4 MiB/s wr, 352 op/s 2024-05-09T05:55:52.952 INFO:tasks.workunit.client.0.smithi039.stdout: 10 107354 21.18 MB/sec execute 149 sec latency 281.915 ms 2024-05-09T05:55:53.854 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:55:53 smithi039 ceph-mon[30439]: pgmap v925: 97 pgs: 97 active+clean; 583 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 5.9 MiB/s wr, 409 op/s 2024-05-09T05:55:53.918 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:55:53 smithi100 ceph-mon[34353]: pgmap v925: 97 pgs: 97 active+clean; 583 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 5.9 MiB/s wr, 409 op/s 2024-05-09T05:55:53.952 INFO:tasks.workunit.client.0.smithi039.stdout: 10 107812 21.22 MB/sec execute 150 sec latency 327.259 ms 2024-05-09T05:55:54.041 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:55:53 smithi060 ceph-mon[34555]: pgmap v925: 97 pgs: 97 active+clean; 583 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 5.9 MiB/s wr, 409 op/s 2024-05-09T05:55:54.952 INFO:tasks.workunit.client.0.smithi039.stdout: 10 108167 21.21 MB/sec execute 151 sec latency 120.187 ms 2024-05-09T05:55:55.854 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:55:55 smithi039 ceph-mon[30439]: pgmap v926: 97 pgs: 97 active+clean; 575 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 5.7 MiB/s wr, 356 op/s 2024-05-09T05:55:55.918 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:55:55 smithi100 ceph-mon[34353]: pgmap v926: 97 pgs: 97 active+clean; 575 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 5.7 MiB/s wr, 356 op/s 2024-05-09T05:55:55.952 INFO:tasks.workunit.client.0.smithi039.stdout: 10 108435 21.15 MB/sec execute 152 sec latency 73.763 ms 2024-05-09T05:55:56.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:55:55 smithi060 ceph-mon[34555]: pgmap v926: 97 pgs: 97 active+clean; 575 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 5.7 MiB/s wr, 356 op/s 2024-05-09T05:55:56.952 INFO:tasks.workunit.client.0.smithi039.stdout: 10 108783 21.10 MB/sec execute 153 sec latency 80.026 ms 2024-05-09T05:55:57.854 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:55:57 smithi039 ceph-mon[30439]: pgmap v927: 97 pgs: 97 active+clean; 562 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 5.8 MiB/s wr, 366 op/s 2024-05-09T05:55:57.918 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:55:57 smithi100 ceph-mon[34353]: pgmap v927: 97 pgs: 97 active+clean; 562 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 5.8 MiB/s wr, 366 op/s 2024-05-09T05:55:57.952 INFO:tasks.workunit.client.0.smithi039.stdout: 10 109207 21.12 MB/sec execute 154 sec latency 152.987 ms 2024-05-09T05:55:58.041 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:55:57 smithi060 ceph-mon[34555]: pgmap v927: 97 pgs: 97 active+clean; 562 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 5.8 MiB/s wr, 366 op/s 2024-05-09T05:55:58.952 INFO:tasks.workunit.client.0.smithi039.stdout: 10 109658 21.14 MB/sec execute 155 sec latency 194.207 ms 2024-05-09T05:55:59.854 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:55:59 smithi039 ceph-mon[30439]: pgmap v928: 97 pgs: 97 active+clean; 563 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 6.0 MiB/s wr, 417 op/s 2024-05-09T05:55:59.918 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:55:59 smithi100 ceph-mon[34353]: pgmap v928: 97 pgs: 97 active+clean; 563 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 6.0 MiB/s wr, 417 op/s 2024-05-09T05:55:59.952 INFO:tasks.workunit.client.0.smithi039.stdout: 10 110083 21.14 MB/sec execute 156 sec latency 76.320 ms 2024-05-09T05:56:00.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:55:59 smithi060 ceph-mon[34555]: pgmap v928: 97 pgs: 97 active+clean; 563 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 6.0 MiB/s wr, 417 op/s 2024-05-09T05:56:00.953 INFO:tasks.workunit.client.0.smithi039.stdout: 10 110435 21.13 MB/sec execute 157 sec latency 116.064 ms 2024-05-09T05:56:01.855 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:56:01 smithi039 ceph-mon[30439]: pgmap v929: 97 pgs: 97 active+clean; 564 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.2 MiB/s wr, 342 op/s 2024-05-09T05:56:01.918 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:56:01 smithi100 ceph-mon[34353]: pgmap v929: 97 pgs: 97 active+clean; 564 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.2 MiB/s wr, 342 op/s 2024-05-09T05:56:01.952 INFO:tasks.workunit.client.0.smithi039.stdout: 10 110846 21.16 MB/sec execute 158 sec latency 78.044 ms 2024-05-09T05:56:02.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:56:01 smithi060 ceph-mon[34555]: pgmap v929: 97 pgs: 97 active+clean; 564 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.2 MiB/s wr, 342 op/s 2024-05-09T05:56:02.953 INFO:tasks.workunit.client.0.smithi039.stdout: 10 111248 21.15 MB/sec execute 159 sec latency 103.641 ms 2024-05-09T05:56:03.854 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:56:03 smithi039 ceph-mon[30439]: pgmap v930: 97 pgs: 97 active+clean; 570 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 5.7 MiB/s wr, 400 op/s 2024-05-09T05:56:03.918 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:56:03 smithi100 ceph-mon[34353]: pgmap v930: 97 pgs: 97 active+clean; 570 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 5.7 MiB/s wr, 400 op/s 2024-05-09T05:56:03.953 INFO:tasks.workunit.client.0.smithi039.stdout: 10 111681 21.17 MB/sec execute 160 sec latency 272.904 ms 2024-05-09T05:56:04.041 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:56:03 smithi060 ceph-mon[34555]: pgmap v930: 97 pgs: 97 active+clean; 570 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 5.7 MiB/s wr, 400 op/s 2024-05-09T05:56:04.953 INFO:tasks.workunit.client.0.smithi039.stdout: 10 111985 21.16 MB/sec execute 161 sec latency 68.763 ms 2024-05-09T05:56:05.854 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:56:05 smithi039 ceph-mon[30439]: pgmap v931: 97 pgs: 97 active+clean; 573 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 5.7 MiB/s wr, 340 op/s 2024-05-09T05:56:05.918 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:56:05 smithi100 ceph-mon[34353]: pgmap v931: 97 pgs: 97 active+clean; 573 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 5.7 MiB/s wr, 340 op/s 2024-05-09T05:56:05.953 INFO:tasks.workunit.client.0.smithi039.stdout: 10 112357 21.14 MB/sec execute 162 sec latency 65.272 ms 2024-05-09T05:56:06.041 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:56:05 smithi060 ceph-mon[34555]: pgmap v931: 97 pgs: 97 active+clean; 573 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 5.7 MiB/s wr, 340 op/s 2024-05-09T05:56:06.953 INFO:tasks.workunit.client.0.smithi039.stdout: 10 112687 21.11 MB/sec execute 163 sec latency 100.345 ms 2024-05-09T05:56:07.854 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:56:07 smithi039 ceph-mon[30439]: pgmap v932: 97 pgs: 97 active+clean; 576 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 6.1 MiB/s wr, 383 op/s 2024-05-09T05:56:07.918 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:56:07 smithi100 ceph-mon[34353]: pgmap v932: 97 pgs: 97 active+clean; 576 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 6.1 MiB/s wr, 383 op/s 2024-05-09T05:56:07.953 INFO:tasks.workunit.client.0.smithi039.stdout: 10 113117 21.13 MB/sec execute 164 sec latency 62.380 ms 2024-05-09T05:56:08.041 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:56:07 smithi060 ceph-mon[34555]: pgmap v932: 97 pgs: 97 active+clean; 576 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 6.1 MiB/s wr, 383 op/s 2024-05-09T05:56:08.953 INFO:tasks.workunit.client.0.smithi039.stdout: 10 113428 21.11 MB/sec execute 165 sec latency 221.362 ms 2024-05-09T05:56:09.854 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:56:09 smithi039 ceph-mon[30439]: pgmap v933: 97 pgs: 97 active+clean; 574 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 6.2 MiB/s wr, 398 op/s 2024-05-09T05:56:09.918 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:56:09 smithi100 ceph-mon[34353]: pgmap v933: 97 pgs: 97 active+clean; 574 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 6.2 MiB/s wr, 398 op/s 2024-05-09T05:56:09.953 INFO:tasks.workunit.client.0.smithi039.stdout: 10 113820 21.08 MB/sec execute 166 sec latency 88.813 ms 2024-05-09T05:56:10.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:56:09 smithi060 ceph-mon[34555]: pgmap v933: 97 pgs: 97 active+clean; 574 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 6.2 MiB/s wr, 398 op/s 2024-05-09T05:56:10.953 INFO:tasks.workunit.client.0.smithi039.stdout: 10 114185 21.09 MB/sec execute 167 sec latency 60.805 ms 2024-05-09T05:56:11.842 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:56:11 smithi060 ceph-mon[34555]: pgmap v934: 97 pgs: 97 active+clean; 578 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 5.8 MiB/s wr, 364 op/s 2024-05-09T05:56:11.854 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:56:11 smithi039 ceph-mon[30439]: pgmap v934: 97 pgs: 97 active+clean; 578 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 5.8 MiB/s wr, 364 op/s 2024-05-09T05:56:11.918 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:56:11 smithi100 ceph-mon[34353]: pgmap v934: 97 pgs: 97 active+clean; 578 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 5.8 MiB/s wr, 364 op/s 2024-05-09T05:56:11.953 INFO:tasks.workunit.client.0.smithi039.stdout: 10 114539 21.04 MB/sec execute 168 sec latency 76.572 ms 2024-05-09T05:56:12.953 INFO:tasks.workunit.client.0.smithi039.stdout: 10 114941 21.07 MB/sec execute 169 sec latency 55.347 ms 2024-05-09T05:56:13.854 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:56:13 smithi039 ceph-mon[30439]: pgmap v935: 97 pgs: 97 active+clean; 578 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 5.7 MiB/s wr, 359 op/s 2024-05-09T05:56:13.918 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:56:13 smithi100 ceph-mon[34353]: pgmap v935: 97 pgs: 97 active+clean; 578 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 5.7 MiB/s wr, 359 op/s 2024-05-09T05:56:13.953 INFO:tasks.workunit.client.0.smithi039.stdout: 10 115266 21.07 MB/sec execute 170 sec latency 277.713 ms 2024-05-09T05:56:14.041 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:56:13 smithi060 ceph-mon[34555]: pgmap v935: 97 pgs: 97 active+clean; 578 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 5.7 MiB/s wr, 359 op/s 2024-05-09T05:56:14.953 INFO:tasks.workunit.client.0.smithi039.stdout: 10 115697 21.07 MB/sec execute 171 sec latency 103.954 ms 2024-05-09T05:56:15.854 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:56:15 smithi039 ceph-mon[30439]: pgmap v936: 97 pgs: 97 active+clean; 586 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.8 MiB/s wr, 347 op/s 2024-05-09T05:56:15.918 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:56:15 smithi100 ceph-mon[34353]: pgmap v936: 97 pgs: 97 active+clean; 586 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.8 MiB/s wr, 347 op/s 2024-05-09T05:56:15.953 INFO:tasks.workunit.client.0.smithi039.stdout: 10 116054 21.08 MB/sec execute 172 sec latency 64.150 ms 2024-05-09T05:56:16.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:56:15 smithi060 ceph-mon[34555]: pgmap v936: 97 pgs: 97 active+clean; 586 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.8 MiB/s wr, 347 op/s 2024-05-09T05:56:16.953 INFO:tasks.workunit.client.0.smithi039.stdout: 10 116384 21.03 MB/sec execute 173 sec latency 162.398 ms 2024-05-09T05:56:17.854 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:56:17 smithi039 ceph-mon[30439]: pgmap v937: 97 pgs: 97 active+clean; 582 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.7 MiB/s wr, 369 op/s 2024-05-09T05:56:17.918 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:56:17 smithi100 ceph-mon[34353]: pgmap v937: 97 pgs: 97 active+clean; 582 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.7 MiB/s wr, 369 op/s 2024-05-09T05:56:17.953 INFO:tasks.workunit.client.0.smithi039.stdout: 10 116798 21.05 MB/sec execute 174 sec latency 66.877 ms 2024-05-09T05:56:18.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:56:17 smithi060 ceph-mon[34555]: pgmap v937: 97 pgs: 97 active+clean; 582 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.7 MiB/s wr, 369 op/s 2024-05-09T05:56:18.953 INFO:tasks.workunit.client.0.smithi039.stdout: 10 117146 21.04 MB/sec execute 175 sec latency 275.333 ms 2024-05-09T05:56:19.854 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:56:19 smithi039 ceph-mon[30439]: pgmap v938: 97 pgs: 97 active+clean; 578 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.5 MiB/s wr, 374 op/s 2024-05-09T05:56:19.918 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:56:19 smithi100 ceph-mon[34353]: pgmap v938: 97 pgs: 97 active+clean; 578 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.5 MiB/s wr, 374 op/s 2024-05-09T05:56:19.953 INFO:tasks.workunit.client.0.smithi039.stdout: 10 117604 21.07 MB/sec execute 176 sec latency 124.723 ms 2024-05-09T05:56:20.041 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:56:19 smithi060 ceph-mon[34555]: pgmap v938: 97 pgs: 97 active+clean; 578 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.5 MiB/s wr, 374 op/s 2024-05-09T05:56:20.954 INFO:tasks.workunit.client.0.smithi039.stdout: 10 118010 21.08 MB/sec execute 177 sec latency 72.894 ms 2024-05-09T05:56:21.854 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:56:21 smithi039 ceph-mon[30439]: pgmap v939: 97 pgs: 97 active+clean; 570 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 5.0 MiB/s wr, 357 op/s 2024-05-09T05:56:21.918 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:56:21 smithi100 ceph-mon[34353]: pgmap v939: 97 pgs: 97 active+clean; 570 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 5.0 MiB/s wr, 357 op/s 2024-05-09T05:56:21.953 INFO:tasks.workunit.client.0.smithi039.stdout: 10 118343 21.05 MB/sec execute 178 sec latency 70.723 ms 2024-05-09T05:56:22.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:56:21 smithi060 ceph-mon[34555]: pgmap v939: 97 pgs: 97 active+clean; 570 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 5.0 MiB/s wr, 357 op/s 2024-05-09T05:56:22.854 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:56:22 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:56:22.918 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:56:22 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:56:22.953 INFO:tasks.workunit.client.0.smithi039.stdout: 10 118743 21.03 MB/sec execute 179 sec latency 103.898 ms 2024-05-09T05:56:23.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:56:22 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:56:23.854 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:56:23 smithi039 ceph-mon[30439]: pgmap v940: 97 pgs: 97 active+clean; 566 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 4.9 MiB/s wr, 318 op/s 2024-05-09T05:56:23.854 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:56:23 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:56:23.855 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:56:23 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:56:23.855 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:56:23 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:56:23.918 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:56:23 smithi100 ceph-mon[34353]: pgmap v940: 97 pgs: 97 active+clean; 566 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 4.9 MiB/s wr, 318 op/s 2024-05-09T05:56:23.918 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:56:23 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:56:23.918 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:56:23 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:56:23.918 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:56:23 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:56:23.953 INFO:tasks.workunit.client.0.smithi039.stdout: 10 119070 21.04 MB/sec execute 180 sec latency 226.250 ms 2024-05-09T05:56:24.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:56:23 smithi060 ceph-mon[34555]: pgmap v940: 97 pgs: 97 active+clean; 566 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 4.9 MiB/s wr, 318 op/s 2024-05-09T05:56:24.041 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:56:23 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:56:24.041 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:56:23 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:56:24.041 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:56:23 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:56:24.953 INFO:tasks.workunit.client.0.smithi039.stdout: 10 119446 21.03 MB/sec execute 181 sec latency 106.940 ms 2024-05-09T05:56:25.854 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:56:25 smithi039 ceph-mon[30439]: pgmap v941: 97 pgs: 97 active+clean; 570 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.4 MiB/s wr, 365 op/s 2024-05-09T05:56:25.918 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:56:25 smithi100 ceph-mon[34353]: pgmap v941: 97 pgs: 97 active+clean; 570 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.4 MiB/s wr, 365 op/s 2024-05-09T05:56:25.953 INFO:tasks.workunit.client.0.smithi039.stdout: 10 119837 21.01 MB/sec execute 182 sec latency 82.603 ms 2024-05-09T05:56:26.041 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:56:25 smithi060 ceph-mon[34555]: pgmap v941: 97 pgs: 97 active+clean; 570 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.4 MiB/s wr, 365 op/s 2024-05-09T05:56:26.953 INFO:tasks.workunit.client.0.smithi039.stdout: 10 120236 21.00 MB/sec execute 183 sec latency 64.527 ms 2024-05-09T05:56:27.854 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:56:27 smithi039 ceph-mon[30439]: pgmap v942: 97 pgs: 97 active+clean; 572 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 5.4 MiB/s wr, 355 op/s 2024-05-09T05:56:27.918 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:56:27 smithi100 ceph-mon[34353]: pgmap v942: 97 pgs: 97 active+clean; 572 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 5.4 MiB/s wr, 355 op/s 2024-05-09T05:56:27.953 INFO:tasks.workunit.client.0.smithi039.stdout: 10 120706 21.04 MB/sec execute 184 sec latency 80.377 ms 2024-05-09T05:56:28.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:56:27 smithi060 ceph-mon[34555]: pgmap v942: 97 pgs: 97 active+clean; 572 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 5.4 MiB/s wr, 355 op/s 2024-05-09T05:56:28.953 INFO:tasks.workunit.client.0.smithi039.stdout: 10 121106 21.06 MB/sec execute 185 sec latency 232.031 ms 2024-05-09T05:56:29.854 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:56:29 smithi039 ceph-mon[30439]: pgmap v943: 97 pgs: 97 active+clean; 576 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 5.7 MiB/s wr, 377 op/s 2024-05-09T05:56:29.918 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:56:29 smithi100 ceph-mon[34353]: pgmap v943: 97 pgs: 97 active+clean; 576 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 5.7 MiB/s wr, 377 op/s 2024-05-09T05:56:29.954 INFO:tasks.workunit.client.0.smithi039.stdout: 10 121450 21.04 MB/sec execute 186 sec latency 80.663 ms 2024-05-09T05:56:30.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:56:29 smithi060 ceph-mon[34555]: pgmap v943: 97 pgs: 97 active+clean; 576 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 5.7 MiB/s wr, 377 op/s 2024-05-09T05:56:30.954 INFO:tasks.workunit.client.0.smithi039.stdout: 10 121887 21.07 MB/sec execute 187 sec latency 54.935 ms 2024-05-09T05:56:31.918 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:56:31 smithi100 ceph-mon[34353]: pgmap v944: 97 pgs: 97 active+clean; 580 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 5.3 MiB/s wr, 356 op/s 2024-05-09T05:56:31.954 INFO:tasks.workunit.client.0.smithi039.stdout: 10 122195 21.05 MB/sec execute 188 sec latency 96.274 ms 2024-05-09T05:56:32.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:56:31 smithi060 ceph-mon[34555]: pgmap v944: 97 pgs: 97 active+clean; 580 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 5.3 MiB/s wr, 356 op/s 2024-05-09T05:56:32.104 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:56:31 smithi039 ceph-mon[30439]: pgmap v944: 97 pgs: 97 active+clean; 580 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 5.3 MiB/s wr, 356 op/s 2024-05-09T05:56:32.954 INFO:tasks.workunit.client.0.smithi039.stdout: 10 122665 21.06 MB/sec execute 189 sec latency 53.520 ms 2024-05-09T05:56:33.918 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:56:33 smithi100 ceph-mon[34353]: pgmap v945: 97 pgs: 97 active+clean; 580 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 5.3 MiB/s wr, 344 op/s 2024-05-09T05:56:33.954 INFO:tasks.workunit.client.0.smithi039.stdout: 10 122946 21.03 MB/sec execute 190 sec latency 341.205 ms 2024-05-09T05:56:34.041 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:56:33 smithi060 ceph-mon[34555]: pgmap v945: 97 pgs: 97 active+clean; 580 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 5.3 MiB/s wr, 344 op/s 2024-05-09T05:56:34.104 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:56:33 smithi039 ceph-mon[30439]: pgmap v945: 97 pgs: 97 active+clean; 580 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 5.3 MiB/s wr, 344 op/s 2024-05-09T05:56:34.954 INFO:tasks.workunit.client.0.smithi039.stdout: 10 123236 21.00 MB/sec execute 191 sec latency 358.113 ms 2024-05-09T05:56:35.918 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:56:35 smithi100 ceph-mon[34353]: pgmap v946: 97 pgs: 97 active+clean; 584 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.8 MiB/s wr, 365 op/s 2024-05-09T05:56:35.954 INFO:tasks.workunit.client.0.smithi039.stdout: 10 123592 20.98 MB/sec execute 192 sec latency 80.529 ms 2024-05-09T05:56:36.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:56:35 smithi060 ceph-mon[34555]: pgmap v946: 97 pgs: 97 active+clean; 584 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.8 MiB/s wr, 365 op/s 2024-05-09T05:56:36.104 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:56:35 smithi039 ceph-mon[30439]: pgmap v946: 97 pgs: 97 active+clean; 584 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.8 MiB/s wr, 365 op/s 2024-05-09T05:56:36.954 INFO:tasks.workunit.client.0.smithi039.stdout: 10 124043 21.00 MB/sec execute 193 sec latency 123.539 ms 2024-05-09T05:56:37.918 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:56:37 smithi100 ceph-mon[34353]: pgmap v947: 97 pgs: 97 active+clean; 587 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 6.1 MiB/s wr, 368 op/s 2024-05-09T05:56:37.954 INFO:tasks.workunit.client.0.smithi039.stdout: 10 124568 21.04 MB/sec execute 194 sec latency 63.742 ms 2024-05-09T05:56:38.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:56:37 smithi060 ceph-mon[34555]: pgmap v947: 97 pgs: 97 active+clean; 587 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 6.1 MiB/s wr, 368 op/s 2024-05-09T05:56:38.104 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:56:37 smithi039 ceph-mon[30439]: pgmap v947: 97 pgs: 97 active+clean; 587 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 6.1 MiB/s wr, 368 op/s 2024-05-09T05:56:38.954 INFO:tasks.workunit.client.0.smithi039.stdout: 10 124891 21.01 MB/sec execute 195 sec latency 249.903 ms 2024-05-09T05:56:39.918 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:56:39 smithi100 ceph-mon[34353]: pgmap v948: 97 pgs: 97 active+clean; 592 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 6.5 MiB/s wr, 397 op/s 2024-05-09T05:56:39.954 INFO:tasks.workunit.client.0.smithi039.stdout: 10 125241 20.99 MB/sec execute 196 sec latency 149.781 ms 2024-05-09T05:56:40.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:56:39 smithi060 ceph-mon[34555]: pgmap v948: 97 pgs: 97 active+clean; 592 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 6.5 MiB/s wr, 397 op/s 2024-05-09T05:56:40.104 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:56:39 smithi039 ceph-mon[30439]: pgmap v948: 97 pgs: 97 active+clean; 592 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 6.5 MiB/s wr, 397 op/s 2024-05-09T05:56:40.955 INFO:tasks.workunit.client.0.smithi039.stdout: 10 125568 21.02 MB/sec execute 197 sec latency 152.885 ms 2024-05-09T05:56:41.918 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:56:41 smithi100 ceph-mon[34353]: pgmap v949: 97 pgs: 97 active+clean; 586 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 5.7 MiB/s wr, 341 op/s 2024-05-09T05:56:41.954 INFO:tasks.workunit.client.0.smithi039.stdout: 10 126026 21.01 MB/sec execute 198 sec latency 127.194 ms 2024-05-09T05:56:42.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:56:41 smithi060 ceph-mon[34555]: pgmap v949: 97 pgs: 97 active+clean; 586 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 5.7 MiB/s wr, 341 op/s 2024-05-09T05:56:42.104 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:56:41 smithi039 ceph-mon[30439]: pgmap v949: 97 pgs: 97 active+clean; 586 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 5.7 MiB/s wr, 341 op/s 2024-05-09T05:56:42.954 INFO:tasks.workunit.client.0.smithi039.stdout: 10 126487 21.05 MB/sec execute 199 sec latency 50.461 ms 2024-05-09T05:56:43.917 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:56:43 smithi100 ceph-mon[34353]: pgmap v950: 97 pgs: 97 active+clean; 575 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.6 MiB/s wr, 330 op/s 2024-05-09T05:56:43.954 INFO:tasks.workunit.client.0.smithi039.stdout: 10 126804 21.02 MB/sec execute 200 sec latency 113.951 ms 2024-05-09T05:56:44.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:56:43 smithi060 ceph-mon[34555]: pgmap v950: 97 pgs: 97 active+clean; 575 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.6 MiB/s wr, 330 op/s 2024-05-09T05:56:44.104 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:56:43 smithi039 ceph-mon[30439]: pgmap v950: 97 pgs: 97 active+clean; 575 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.6 MiB/s wr, 330 op/s 2024-05-09T05:56:44.954 INFO:tasks.workunit.client.0.smithi039.stdout: 10 127045 20.98 MB/sec execute 201 sec latency 223.734 ms 2024-05-09T05:56:45.918 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:56:45 smithi100 ceph-mon[34353]: pgmap v951: 97 pgs: 97 active+clean; 572 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 6.2 MiB/s wr, 380 op/s 2024-05-09T05:56:45.954 INFO:tasks.workunit.client.0.smithi039.stdout: 10 127422 20.95 MB/sec execute 202 sec latency 83.989 ms 2024-05-09T05:56:46.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:56:45 smithi060 ceph-mon[34555]: pgmap v951: 97 pgs: 97 active+clean; 572 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 6.2 MiB/s wr, 380 op/s 2024-05-09T05:56:46.104 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:56:45 smithi039 ceph-mon[30439]: pgmap v951: 97 pgs: 97 active+clean; 572 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 6.2 MiB/s wr, 380 op/s 2024-05-09T05:56:46.954 INFO:tasks.workunit.client.0.smithi039.stdout: 10 127962 21.01 MB/sec execute 203 sec latency 100.318 ms 2024-05-09T05:56:47.918 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:56:47 smithi100 ceph-mon[34353]: pgmap v952: 97 pgs: 97 active+clean; 573 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 6.1 MiB/s wr, 392 op/s 2024-05-09T05:56:47.955 INFO:tasks.workunit.client.0.smithi039.stdout: 10 128482 21.03 MB/sec execute 204 sec latency 88.643 ms 2024-05-09T05:56:48.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:56:47 smithi060 ceph-mon[34555]: pgmap v952: 97 pgs: 97 active+clean; 573 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 6.1 MiB/s wr, 392 op/s 2024-05-09T05:56:48.104 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:56:47 smithi039 ceph-mon[30439]: pgmap v952: 97 pgs: 97 active+clean; 573 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 6.1 MiB/s wr, 392 op/s 2024-05-09T05:56:48.955 INFO:tasks.workunit.client.0.smithi039.stdout: 10 128848 21.02 MB/sec execute 205 sec latency 65.896 ms 2024-05-09T05:56:49.918 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:56:49 smithi100 ceph-mon[34353]: pgmap v953: 97 pgs: 97 active+clean; 577 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 5.7 MiB/s wr, 382 op/s 2024-05-09T05:56:49.955 INFO:tasks.workunit.client.0.smithi039.stdout: 10 129114 20.99 MB/sec execute 206 sec latency 235.984 ms 2024-05-09T05:56:50.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:56:49 smithi060 ceph-mon[34555]: pgmap v953: 97 pgs: 97 active+clean; 577 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 5.7 MiB/s wr, 382 op/s 2024-05-09T05:56:50.104 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:56:49 smithi039 ceph-mon[30439]: pgmap v953: 97 pgs: 97 active+clean; 577 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 5.7 MiB/s wr, 382 op/s 2024-05-09T05:56:50.955 INFO:tasks.workunit.client.0.smithi039.stdout: 10 129513 21.04 MB/sec execute 207 sec latency 109.251 ms 2024-05-09T05:56:51.917 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:56:51 smithi100 ceph-mon[34353]: pgmap v954: 97 pgs: 97 active+clean; 581 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.1 MiB/s wr, 352 op/s 2024-05-09T05:56:51.955 INFO:tasks.workunit.client.0.smithi039.stdout: 10 130019 21.05 MB/sec execute 208 sec latency 79.357 ms 2024-05-09T05:56:52.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:56:51 smithi060 ceph-mon[34555]: pgmap v954: 97 pgs: 97 active+clean; 581 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.1 MiB/s wr, 352 op/s 2024-05-09T05:56:52.104 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:56:51 smithi039 ceph-mon[30439]: pgmap v954: 97 pgs: 97 active+clean; 581 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.1 MiB/s wr, 352 op/s 2024-05-09T05:56:52.955 INFO:tasks.workunit.client.0.smithi039.stdout: 10 130358 21.04 MB/sec execute 209 sec latency 76.486 ms 2024-05-09T05:56:53.917 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:56:53 smithi100 ceph-mon[34353]: pgmap v955: 97 pgs: 97 active+clean; 582 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 5.4 MiB/s wr, 379 op/s 2024-05-09T05:56:53.955 INFO:tasks.workunit.client.0.smithi039.stdout: 10 130644 21.00 MB/sec execute 210 sec latency 69.840 ms 2024-05-09T05:56:54.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:56:53 smithi060 ceph-mon[34555]: pgmap v955: 97 pgs: 97 active+clean; 582 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 5.4 MiB/s wr, 379 op/s 2024-05-09T05:56:54.104 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:56:53 smithi039 ceph-mon[30439]: pgmap v955: 97 pgs: 97 active+clean; 582 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 5.4 MiB/s wr, 379 op/s 2024-05-09T05:56:54.955 INFO:tasks.workunit.client.0.smithi039.stdout: 10 130906 20.97 MB/sec execute 211 sec latency 292.970 ms 2024-05-09T05:56:55.917 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:56:55 smithi100 ceph-mon[34353]: pgmap v956: 97 pgs: 97 active+clean; 585 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 5.8 MiB/s wr, 382 op/s 2024-05-09T05:56:55.955 INFO:tasks.workunit.client.0.smithi039.stdout: 10 131326 20.95 MB/sec execute 212 sec latency 86.107 ms 2024-05-09T05:56:56.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:56:55 smithi060 ceph-mon[34555]: pgmap v956: 97 pgs: 97 active+clean; 585 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 5.8 MiB/s wr, 382 op/s 2024-05-09T05:56:56.104 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:56:55 smithi039 ceph-mon[30439]: pgmap v956: 97 pgs: 97 active+clean; 585 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 5.8 MiB/s wr, 382 op/s 2024-05-09T05:56:56.955 INFO:tasks.workunit.client.0.smithi039.stdout: 10 131783 21.01 MB/sec execute 213 sec latency 106.600 ms 2024-05-09T05:56:57.918 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:56:57 smithi100 ceph-mon[34353]: pgmap v957: 97 pgs: 97 active+clean; 589 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 5.7 MiB/s wr, 366 op/s 2024-05-09T05:56:57.955 INFO:tasks.workunit.client.0.smithi039.stdout: 10 132288 21.02 MB/sec execute 214 sec latency 59.602 ms 2024-05-09T05:56:58.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:56:57 smithi060 ceph-mon[34555]: pgmap v957: 97 pgs: 97 active+clean; 589 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 5.7 MiB/s wr, 366 op/s 2024-05-09T05:56:58.104 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:56:57 smithi039 ceph-mon[30439]: pgmap v957: 97 pgs: 97 active+clean; 589 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 5.7 MiB/s wr, 366 op/s 2024-05-09T05:56:58.955 INFO:tasks.workunit.client.0.smithi039.stdout: 10 132736 21.01 MB/sec execute 215 sec latency 81.706 ms 2024-05-09T05:56:59.906 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:56:59 smithi039 ceph-mon[30439]: pgmap v958: 97 pgs: 97 active+clean; 591 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.3 MiB/s wr, 341 op/s 2024-05-09T05:56:59.917 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:56:59 smithi100 ceph-mon[34353]: pgmap v958: 97 pgs: 97 active+clean; 591 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.3 MiB/s wr, 341 op/s 2024-05-09T05:56:59.955 INFO:tasks.workunit.client.0.smithi039.stdout: 10 132983 20.97 MB/sec execute 216 sec latency 272.697 ms 2024-05-09T05:57:00.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:56:59 smithi060 ceph-mon[34555]: pgmap v958: 97 pgs: 97 active+clean; 591 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.3 MiB/s wr, 341 op/s 2024-05-09T05:57:00.955 INFO:tasks.workunit.client.0.smithi039.stdout: 10 133510 21.04 MB/sec execute 217 sec latency 63.734 ms 2024-05-09T05:57:01.918 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:57:01 smithi100 ceph-mon[34353]: pgmap v959: 97 pgs: 97 active+clean; 595 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.3 MiB/s wr, 342 op/s 2024-05-09T05:57:01.955 INFO:tasks.workunit.client.0.smithi039.stdout: 10 133978 21.08 MB/sec execute 218 sec latency 99.574 ms 2024-05-09T05:57:02.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:57:01 smithi060 ceph-mon[34555]: pgmap v959: 97 pgs: 97 active+clean; 595 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.3 MiB/s wr, 342 op/s 2024-05-09T05:57:02.104 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:57:01 smithi039 ceph-mon[30439]: pgmap v959: 97 pgs: 97 active+clean; 595 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.3 MiB/s wr, 342 op/s 2024-05-09T05:57:02.955 INFO:tasks.workunit.client.0.smithi039.stdout: 10 134308 21.05 MB/sec execute 219 sec latency 56.144 ms 2024-05-09T05:57:03.917 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:57:03 smithi100 ceph-mon[34353]: pgmap v960: 97 pgs: 97 active+clean; 600 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 5.5 MiB/s wr, 363 op/s 2024-05-09T05:57:03.955 INFO:tasks.workunit.client.0.smithi039.stdout: 10 134565 21.02 MB/sec execute 220 sec latency 78.742 ms 2024-05-09T05:57:04.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:57:03 smithi060 ceph-mon[34555]: pgmap v960: 97 pgs: 97 active+clean; 600 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 5.5 MiB/s wr, 363 op/s 2024-05-09T05:57:04.104 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:57:03 smithi039 ceph-mon[30439]: pgmap v960: 97 pgs: 97 active+clean; 600 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 5.5 MiB/s wr, 363 op/s 2024-05-09T05:57:04.955 INFO:tasks.workunit.client.0.smithi039.stdout: 10 134886 21.00 MB/sec execute 221 sec latency 247.679 ms 2024-05-09T05:57:05.917 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:57:05 smithi100 ceph-mon[34353]: pgmap v961: 97 pgs: 97 active+clean; 600 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 5.6 MiB/s wr, 352 op/s 2024-05-09T05:57:05.955 INFO:tasks.workunit.client.0.smithi039.stdout: 10 135274 20.96 MB/sec execute 222 sec latency 147.143 ms 2024-05-09T05:57:06.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:57:05 smithi060 ceph-mon[34555]: pgmap v961: 97 pgs: 97 active+clean; 600 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 5.6 MiB/s wr, 352 op/s 2024-05-09T05:57:06.104 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:57:05 smithi039 ceph-mon[30439]: pgmap v961: 97 pgs: 97 active+clean; 600 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 5.6 MiB/s wr, 352 op/s 2024-05-09T05:57:06.955 INFO:tasks.workunit.client.0.smithi039.stdout: 10 135666 20.98 MB/sec execute 223 sec latency 174.169 ms 2024-05-09T05:57:07.918 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:57:07 smithi100 ceph-mon[34353]: pgmap v962: 97 pgs: 97 active+clean; 590 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 6.0 MiB/s wr, 385 op/s 2024-05-09T05:57:07.955 INFO:tasks.workunit.client.0.smithi039.stdout: 10 136101 20.98 MB/sec execute 224 sec latency 58.251 ms 2024-05-09T05:57:08.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:57:07 smithi060 ceph-mon[34555]: pgmap v962: 97 pgs: 97 active+clean; 590 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 6.0 MiB/s wr, 385 op/s 2024-05-09T05:57:08.104 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:57:07 smithi039 ceph-mon[30439]: pgmap v962: 97 pgs: 97 active+clean; 590 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 6.0 MiB/s wr, 385 op/s 2024-05-09T05:57:08.955 INFO:tasks.workunit.client.0.smithi039.stdout: 10 136529 20.99 MB/sec execute 225 sec latency 80.741 ms 2024-05-09T05:57:09.917 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:57:09 smithi100 ceph-mon[34353]: pgmap v963: 97 pgs: 97 active+clean; 586 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 5.5 MiB/s wr, 360 op/s 2024-05-09T05:57:09.955 INFO:tasks.workunit.client.0.smithi039.stdout: 10 136813 20.96 MB/sec execute 226 sec latency 232.612 ms 2024-05-09T05:57:10.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:57:09 smithi060 ceph-mon[34555]: pgmap v963: 97 pgs: 97 active+clean; 586 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 5.5 MiB/s wr, 360 op/s 2024-05-09T05:57:10.104 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:57:09 smithi039 ceph-mon[30439]: pgmap v963: 97 pgs: 97 active+clean; 586 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 5.5 MiB/s wr, 360 op/s 2024-05-09T05:57:10.955 INFO:tasks.workunit.client.0.smithi039.stdout: 10 137279 21.00 MB/sec execute 227 sec latency 77.261 ms 2024-05-09T05:57:11.918 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:57:11 smithi100 ceph-mon[34353]: pgmap v964: 97 pgs: 97 active+clean; 586 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 5.7 MiB/s wr, 401 op/s 2024-05-09T05:57:11.955 INFO:tasks.workunit.client.0.smithi039.stdout: 10 137774 21.05 MB/sec execute 228 sec latency 75.580 ms 2024-05-09T05:57:12.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:57:11 smithi060 ceph-mon[34555]: pgmap v964: 97 pgs: 97 active+clean; 586 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 5.7 MiB/s wr, 401 op/s 2024-05-09T05:57:12.104 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:57:11 smithi039 ceph-mon[30439]: pgmap v964: 97 pgs: 97 active+clean; 586 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 5.7 MiB/s wr, 401 op/s 2024-05-09T05:57:12.955 INFO:tasks.workunit.client.0.smithi039.stdout: 10 138063 21.02 MB/sec execute 229 sec latency 93.874 ms 2024-05-09T05:57:13.918 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:57:13 smithi100 ceph-mon[34353]: pgmap v965: 97 pgs: 97 active+clean; 586 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 5.7 MiB/s wr, 370 op/s 2024-05-09T05:57:13.955 INFO:tasks.workunit.client.0.smithi039.stdout: 10 138364 20.99 MB/sec execute 230 sec latency 67.593 ms 2024-05-09T05:57:14.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:57:13 smithi060 ceph-mon[34555]: pgmap v965: 97 pgs: 97 active+clean; 586 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 5.7 MiB/s wr, 370 op/s 2024-05-09T05:57:14.104 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:57:13 smithi039 ceph-mon[30439]: pgmap v965: 97 pgs: 97 active+clean; 586 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 5.7 MiB/s wr, 370 op/s 2024-05-09T05:57:14.955 INFO:tasks.workunit.client.0.smithi039.stdout: 10 138570 20.96 MB/sec execute 231 sec latency 329.686 ms 2024-05-09T05:57:15.917 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:57:15 smithi100 ceph-mon[34353]: pgmap v966: 97 pgs: 97 active+clean; 589 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.8 MiB/s wr, 349 op/s 2024-05-09T05:57:15.955 INFO:tasks.workunit.client.0.smithi039.stdout: 10 138971 20.93 MB/sec execute 232 sec latency 114.914 ms 2024-05-09T05:57:16.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:57:15 smithi060 ceph-mon[34555]: pgmap v966: 97 pgs: 97 active+clean; 589 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.8 MiB/s wr, 349 op/s 2024-05-09T05:57:16.104 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:57:15 smithi039 ceph-mon[30439]: pgmap v966: 97 pgs: 97 active+clean; 589 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.8 MiB/s wr, 349 op/s 2024-05-09T05:57:16.956 INFO:tasks.workunit.client.0.smithi039.stdout: 10 139463 20.97 MB/sec execute 233 sec latency 82.963 ms 2024-05-09T05:57:17.917 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:57:17 smithi100 ceph-mon[34353]: pgmap v967: 97 pgs: 97 active+clean; 596 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 6.3 MiB/s wr, 389 op/s 2024-05-09T05:57:17.955 INFO:tasks.workunit.client.0.smithi039.stdout: 10 139921 20.98 MB/sec execute 234 sec latency 74.095 ms 2024-05-09T05:57:18.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:57:17 smithi060 ceph-mon[34555]: pgmap v967: 97 pgs: 97 active+clean; 596 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 6.3 MiB/s wr, 389 op/s 2024-05-09T05:57:18.104 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:57:17 smithi039 ceph-mon[30439]: pgmap v967: 97 pgs: 97 active+clean; 596 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 6.3 MiB/s wr, 389 op/s 2024-05-09T05:57:18.955 INFO:tasks.workunit.client.0.smithi039.stdout: 10 140339 20.96 MB/sec execute 235 sec latency 67.392 ms 2024-05-09T05:57:19.917 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:57:19 smithi100 ceph-mon[34353]: pgmap v968: 97 pgs: 97 active+clean; 597 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 5.7 MiB/s wr, 340 op/s 2024-05-09T05:57:19.955 INFO:tasks.workunit.client.0.smithi039.stdout: 10 140627 20.96 MB/sec execute 236 sec latency 280.933 ms 2024-05-09T05:57:20.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:57:19 smithi060 ceph-mon[34555]: pgmap v968: 97 pgs: 97 active+clean; 597 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 5.7 MiB/s wr, 340 op/s 2024-05-09T05:57:20.104 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:57:19 smithi039 ceph-mon[30439]: pgmap v968: 97 pgs: 97 active+clean; 597 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 5.7 MiB/s wr, 340 op/s 2024-05-09T05:57:20.956 INFO:tasks.workunit.client.0.smithi039.stdout: 10 141088 20.98 MB/sec execute 237 sec latency 333.675 ms 2024-05-09T05:57:21.956 INFO:tasks.workunit.client.0.smithi039.stdout: 10 141565 21.01 MB/sec execute 238 sec latency 57.962 ms 2024-05-09T05:57:22.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:57:21 smithi060 ceph-mon[34555]: pgmap v969: 97 pgs: 97 active+clean; 601 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 6.0 MiB/s wr, 374 op/s 2024-05-09T05:57:22.104 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:57:21 smithi039 ceph-mon[30439]: pgmap v969: 97 pgs: 97 active+clean; 601 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 6.0 MiB/s wr, 374 op/s 2024-05-09T05:57:22.167 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:57:21 smithi100 ceph-mon[34353]: pgmap v969: 97 pgs: 97 active+clean; 601 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 6.0 MiB/s wr, 374 op/s 2024-05-09T05:57:22.956 INFO:tasks.workunit.client.0.smithi039.stdout: 10 141865 21.00 MB/sec execute 239 sec latency 96.368 ms 2024-05-09T05:57:23.956 INFO:tasks.workunit.client.0.smithi039.stdout: 10 142200 20.98 MB/sec execute 240 sec latency 72.820 ms 2024-05-09T05:57:24.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:57:23 smithi060 ceph-mon[34555]: pgmap v970: 97 pgs: 97 active+clean; 602 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 6.0 MiB/s wr, 350 op/s 2024-05-09T05:57:24.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:57:23 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:57:24.104 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:57:23 smithi039 ceph-mon[30439]: pgmap v970: 97 pgs: 97 active+clean; 602 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 6.0 MiB/s wr, 350 op/s 2024-05-09T05:57:24.104 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:57:23 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:57:24.167 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:57:23 smithi100 ceph-mon[34353]: pgmap v970: 97 pgs: 97 active+clean; 602 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 6.0 MiB/s wr, 350 op/s 2024-05-09T05:57:24.168 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:57:23 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:57:24.956 INFO:tasks.workunit.client.0.smithi039.stdout: 10 142442 20.95 MB/sec execute 241 sec latency 146.763 ms 2024-05-09T05:57:25.956 INFO:tasks.workunit.client.0.smithi039.stdout: 10 142765 20.92 MB/sec execute 242 sec latency 184.064 ms 2024-05-09T05:57:26.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:57:25 smithi060 ceph-mon[34555]: pgmap v971: 97 pgs: 97 active+clean; 601 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.8 MiB/s wr, 351 op/s 2024-05-09T05:57:26.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:57:25 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:57:26.041 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:57:25 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:57:26.041 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:57:25 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:57:26.041 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:57:25 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:57:26.104 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:57:25 smithi039 ceph-mon[30439]: pgmap v971: 97 pgs: 97 active+clean; 601 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.8 MiB/s wr, 351 op/s 2024-05-09T05:57:26.104 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:57:25 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:57:26.104 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:57:25 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:57:26.104 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:57:25 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:57:26.104 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:57:25 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:57:26.167 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:57:25 smithi100 ceph-mon[34353]: pgmap v971: 97 pgs: 97 active+clean; 601 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.8 MiB/s wr, 351 op/s 2024-05-09T05:57:26.168 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:57:25 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:57:26.168 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:57:25 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:57:26.168 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:57:25 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:57:26.168 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:57:25 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:57:26.956 INFO:tasks.workunit.client.0.smithi039.stdout: 10 143239 20.93 MB/sec execute 243 sec latency 71.441 ms 2024-05-09T05:57:27.354 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:57:27 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:57:27.354 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:57:27 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:57:27.354 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:57:27 smithi039 ceph-mon[30439]: pgmap v972: 97 pgs: 97 active+clean; 608 MiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 6.0 MiB/s wr, 386 op/s 2024-05-09T05:57:27.354 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:57:27 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:57:27.355 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:57:27 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:57:27.355 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:57:27 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:57:27.417 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:57:27 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:57:27.418 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:57:27 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:57:27.418 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:57:27 smithi100 ceph-mon[34353]: pgmap v972: 97 pgs: 97 active+clean; 608 MiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 6.0 MiB/s wr, 386 op/s 2024-05-09T05:57:27.418 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:57:27 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:57:27.418 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:57:27 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:57:27.418 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:57:27 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:57:27.541 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:57:27 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:57:27.541 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:57:27 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:57:27.541 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:57:27 smithi060 ceph-mon[34555]: pgmap v972: 97 pgs: 97 active+clean; 608 MiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 6.0 MiB/s wr, 386 op/s 2024-05-09T05:57:27.541 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:57:27 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:57:27.541 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:57:27 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:57:27.541 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:57:27 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:57:27.956 INFO:tasks.workunit.client.0.smithi039.stdout: 10 143615 20.93 MB/sec execute 244 sec latency 63.525 ms 2024-05-09T05:57:28.956 INFO:tasks.workunit.client.0.smithi039.stdout: 10 144084 20.92 MB/sec execute 245 sec latency 77.564 ms 2024-05-09T05:57:29.854 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:57:29 smithi039 ceph-mon[30439]: pgmap v973: 97 pgs: 97 active+clean; 611 MiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.5 MiB/s wr, 365 op/s 2024-05-09T05:57:29.917 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:57:29 smithi100 ceph-mon[34353]: pgmap v973: 97 pgs: 97 active+clean; 611 MiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.5 MiB/s wr, 365 op/s 2024-05-09T05:57:29.956 INFO:tasks.workunit.client.0.smithi039.stdout: 10 144400 20.92 MB/sec execute 246 sec latency 84.396 ms 2024-05-09T05:57:30.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:57:29 smithi060 ceph-mon[34555]: pgmap v973: 97 pgs: 97 active+clean; 611 MiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.5 MiB/s wr, 365 op/s 2024-05-09T05:57:30.956 INFO:tasks.workunit.client.0.smithi039.stdout: 10 144788 20.94 MB/sec execute 247 sec latency 160.877 ms 2024-05-09T05:57:31.854 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:57:31 smithi039 ceph-mon[30439]: pgmap v974: 97 pgs: 97 active+clean; 610 MiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 5.2 MiB/s wr, 355 op/s 2024-05-09T05:57:31.917 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:57:31 smithi100 ceph-mon[34353]: pgmap v974: 97 pgs: 97 active+clean; 610 MiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 5.2 MiB/s wr, 355 op/s 2024-05-09T05:57:31.956 INFO:tasks.workunit.client.0.smithi039.stdout: 10 145377 21.01 MB/sec execute 248 sec latency 64.547 ms 2024-05-09T05:57:32.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:57:31 smithi060 ceph-mon[34555]: pgmap v974: 97 pgs: 97 active+clean; 610 MiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 5.2 MiB/s wr, 355 op/s 2024-05-09T05:57:32.956 INFO:tasks.workunit.client.0.smithi039.stdout: 10 145661 20.98 MB/sec execute 249 sec latency 182.454 ms 2024-05-09T05:57:33.854 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:57:33 smithi039 ceph-mon[30439]: pgmap v975: 97 pgs: 97 active+clean; 612 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 5.4 MiB/s wr, 355 op/s 2024-05-09T05:57:33.917 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:57:33 smithi100 ceph-mon[34353]: pgmap v975: 97 pgs: 97 active+clean; 612 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 5.4 MiB/s wr, 355 op/s 2024-05-09T05:57:33.956 INFO:tasks.workunit.client.0.smithi039.stdout: 10 145968 20.95 MB/sec execute 250 sec latency 82.664 ms 2024-05-09T05:57:34.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:57:33 smithi060 ceph-mon[34555]: pgmap v975: 97 pgs: 97 active+clean; 612 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 5.4 MiB/s wr, 355 op/s 2024-05-09T05:57:34.956 INFO:tasks.workunit.client.0.smithi039.stdout: 10 146274 20.93 MB/sec execute 251 sec latency 73.478 ms 2024-05-09T05:57:35.854 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:57:35 smithi039 ceph-mon[30439]: pgmap v976: 97 pgs: 97 active+clean; 598 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 5.2 MiB/s wr, 352 op/s 2024-05-09T05:57:35.917 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:57:35 smithi100 ceph-mon[34353]: pgmap v976: 97 pgs: 97 active+clean; 598 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 5.2 MiB/s wr, 352 op/s 2024-05-09T05:57:35.956 INFO:tasks.workunit.client.0.smithi039.stdout: 10 146532 20.88 MB/sec execute 252 sec latency 181.419 ms 2024-05-09T05:57:36.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:57:35 smithi060 ceph-mon[34555]: pgmap v976: 97 pgs: 97 active+clean; 598 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 5.2 MiB/s wr, 352 op/s 2024-05-09T05:57:36.956 INFO:tasks.workunit.client.0.smithi039.stdout: 10 146951 20.89 MB/sec execute 253 sec latency 167.325 ms 2024-05-09T05:57:37.854 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:57:37 smithi039 ceph-mon[30439]: pgmap v977: 97 pgs: 97 active+clean; 596 MiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 5.5 MiB/s wr, 374 op/s 2024-05-09T05:57:37.917 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:57:37 smithi100 ceph-mon[34353]: pgmap v977: 97 pgs: 97 active+clean; 596 MiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 5.5 MiB/s wr, 374 op/s 2024-05-09T05:57:37.956 INFO:tasks.workunit.client.0.smithi039.stdout: 10 147404 20.93 MB/sec execute 254 sec latency 92.907 ms 2024-05-09T05:57:38.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:57:37 smithi060 ceph-mon[34555]: pgmap v977: 97 pgs: 97 active+clean; 596 MiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 5.5 MiB/s wr, 374 op/s 2024-05-09T05:57:38.956 INFO:tasks.workunit.client.0.smithi039.stdout: 10 147971 20.93 MB/sec execute 255 sec latency 49.900 ms 2024-05-09T05:57:39.854 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:57:39 smithi039 ceph-mon[30439]: pgmap v978: 97 pgs: 97 active+clean; 598 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 5.3 MiB/s wr, 361 op/s 2024-05-09T05:57:39.917 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:57:39 smithi100 ceph-mon[34353]: pgmap v978: 97 pgs: 97 active+clean; 598 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 5.3 MiB/s wr, 361 op/s 2024-05-09T05:57:39.956 INFO:tasks.workunit.client.0.smithi039.stdout: 10 148281 20.92 MB/sec execute 256 sec latency 84.980 ms 2024-05-09T05:57:40.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:57:39 smithi060 ceph-mon[34555]: pgmap v978: 97 pgs: 97 active+clean; 598 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 5.3 MiB/s wr, 361 op/s 2024-05-09T05:57:40.956 INFO:tasks.workunit.client.0.smithi039.stdout: 10 148647 20.93 MB/sec execute 257 sec latency 279.755 ms 2024-05-09T05:57:41.842 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:57:41 smithi060 ceph-mon[34555]: pgmap v979: 97 pgs: 97 active+clean; 597 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.2 MiB/s wr, 326 op/s 2024-05-09T05:57:41.854 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:57:41 smithi039 ceph-mon[30439]: pgmap v979: 97 pgs: 97 active+clean; 597 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.2 MiB/s wr, 326 op/s 2024-05-09T05:57:41.917 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:57:41 smithi100 ceph-mon[34353]: pgmap v979: 97 pgs: 97 active+clean; 597 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.2 MiB/s wr, 326 op/s 2024-05-09T05:57:41.957 INFO:tasks.workunit.client.0.smithi039.stdout: 10 149133 20.99 MB/sec execute 258 sec latency 52.974 ms 2024-05-09T05:57:42.956 INFO:tasks.workunit.client.0.smithi039.stdout: 10 149495 20.96 MB/sec execute 259 sec latency 83.821 ms 2024-05-09T05:57:43.854 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:57:43 smithi039 ceph-mon[30439]: pgmap v980: 97 pgs: 97 active+clean; 602 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 5.7 MiB/s wr, 388 op/s 2024-05-09T05:57:43.917 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:57:43 smithi100 ceph-mon[34353]: pgmap v980: 97 pgs: 97 active+clean; 602 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 5.7 MiB/s wr, 388 op/s 2024-05-09T05:57:43.956 INFO:tasks.workunit.client.0.smithi039.stdout: 10 149724 20.91 MB/sec execute 260 sec latency 105.530 ms 2024-05-09T05:57:44.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:57:43 smithi060 ceph-mon[34555]: pgmap v980: 97 pgs: 97 active+clean; 602 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 5.7 MiB/s wr, 388 op/s 2024-05-09T05:57:44.956 INFO:tasks.workunit.client.0.smithi039.stdout: 10 150040 20.89 MB/sec execute 261 sec latency 74.742 ms 2024-05-09T05:57:45.854 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:57:45 smithi039 ceph-mon[30439]: pgmap v981: 97 pgs: 97 active+clean; 604 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 5.3 MiB/s wr, 372 op/s 2024-05-09T05:57:45.917 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:57:45 smithi100 ceph-mon[34353]: pgmap v981: 97 pgs: 97 active+clean; 604 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 5.3 MiB/s wr, 372 op/s 2024-05-09T05:57:45.957 INFO:tasks.workunit.client.0.smithi039.stdout: 10 150355 20.86 MB/sec execute 262 sec latency 198.867 ms 2024-05-09T05:57:46.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:57:45 smithi060 ceph-mon[34555]: pgmap v981: 97 pgs: 97 active+clean; 604 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 5.3 MiB/s wr, 372 op/s 2024-05-09T05:57:46.956 INFO:tasks.workunit.client.0.smithi039.stdout: 10 150911 20.92 MB/sec execute 263 sec latency 77.564 ms 2024-05-09T05:57:47.854 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:57:47 smithi039 ceph-mon[30439]: pgmap v982: 97 pgs: 97 active+clean; 606 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 5.8 MiB/s wr, 360 op/s 2024-05-09T05:57:47.917 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:57:47 smithi100 ceph-mon[34353]: pgmap v982: 97 pgs: 97 active+clean; 606 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 5.8 MiB/s wr, 360 op/s 2024-05-09T05:57:47.957 INFO:tasks.workunit.client.0.smithi039.stdout: 10 151382 20.93 MB/sec execute 264 sec latency 79.243 ms 2024-05-09T05:57:48.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:57:47 smithi060 ceph-mon[34555]: pgmap v982: 97 pgs: 97 active+clean; 606 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 5.8 MiB/s wr, 360 op/s 2024-05-09T05:57:48.957 INFO:tasks.workunit.client.0.smithi039.stdout: 10 151838 20.93 MB/sec execute 265 sec latency 64.433 ms 2024-05-09T05:57:49.854 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:57:49 smithi039 ceph-mon[30439]: pgmap v983: 97 pgs: 97 active+clean; 612 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 6.1 MiB/s wr, 401 op/s 2024-05-09T05:57:49.917 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:57:49 smithi100 ceph-mon[34353]: pgmap v983: 97 pgs: 97 active+clean; 612 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 6.1 MiB/s wr, 401 op/s 2024-05-09T05:57:49.957 INFO:tasks.workunit.client.0.smithi039.stdout: 10 152205 20.93 MB/sec execute 266 sec latency 79.783 ms 2024-05-09T05:57:50.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:57:49 smithi060 ceph-mon[34555]: pgmap v983: 97 pgs: 97 active+clean; 612 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 6.1 MiB/s wr, 401 op/s 2024-05-09T05:57:50.957 INFO:tasks.workunit.client.0.smithi039.stdout: 10 152578 20.95 MB/sec execute 267 sec latency 306.901 ms 2024-05-09T05:57:51.854 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:57:51 smithi039 ceph-mon[30439]: pgmap v984: 97 pgs: 97 active+clean; 612 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 5.6 MiB/s wr, 343 op/s 2024-05-09T05:57:51.917 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:57:51 smithi100 ceph-mon[34353]: pgmap v984: 97 pgs: 97 active+clean; 612 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 5.6 MiB/s wr, 343 op/s 2024-05-09T05:57:51.957 INFO:tasks.workunit.client.0.smithi039.stdout: 10 152999 20.98 MB/sec execute 268 sec latency 126.811 ms 2024-05-09T05:57:52.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:57:51 smithi060 ceph-mon[34555]: pgmap v984: 97 pgs: 97 active+clean; 612 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 5.6 MiB/s wr, 343 op/s 2024-05-09T05:57:52.957 INFO:tasks.workunit.client.0.smithi039.stdout: 10 153353 20.96 MB/sec execute 269 sec latency 81.152 ms 2024-05-09T05:57:53.854 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:57:53 smithi039 ceph-mon[30439]: pgmap v985: 97 pgs: 97 active+clean; 618 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 5.8 MiB/s wr, 387 op/s 2024-05-09T05:57:53.917 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:57:53 smithi100 ceph-mon[34353]: pgmap v985: 97 pgs: 97 active+clean; 618 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 5.8 MiB/s wr, 387 op/s 2024-05-09T05:57:53.957 INFO:tasks.workunit.client.0.smithi039.stdout: 10 153650 20.92 MB/sec execute 270 sec latency 76.381 ms 2024-05-09T05:57:54.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:57:53 smithi060 ceph-mon[34555]: pgmap v985: 97 pgs: 97 active+clean; 618 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 5.8 MiB/s wr, 387 op/s 2024-05-09T05:57:54.957 INFO:tasks.workunit.client.0.smithi039.stdout: 10 154091 20.93 MB/sec execute 271 sec latency 61.496 ms 2024-05-09T05:57:55.854 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:57:55 smithi039 ceph-mon[30439]: pgmap v986: 97 pgs: 97 active+clean; 619 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 5.7 MiB/s wr, 342 op/s 2024-05-09T05:57:55.917 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:57:55 smithi100 ceph-mon[34353]: pgmap v986: 97 pgs: 97 active+clean; 619 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 5.7 MiB/s wr, 342 op/s 2024-05-09T05:57:55.957 INFO:tasks.workunit.client.0.smithi039.stdout: 10 154517 20.93 MB/sec execute 272 sec latency 222.069 ms 2024-05-09T05:57:56.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:57:55 smithi060 ceph-mon[34555]: pgmap v986: 97 pgs: 97 active+clean; 619 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 5.7 MiB/s wr, 342 op/s 2024-05-09T05:57:56.957 INFO:tasks.workunit.client.0.smithi039.stdout: 10 155010 20.96 MB/sec execute 273 sec latency 105.105 ms 2024-05-09T05:57:57.854 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:57:57 smithi039 ceph-mon[30439]: pgmap v987: 97 pgs: 97 active+clean; 619 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 6.0 MiB/s wr, 346 op/s 2024-05-09T05:57:57.917 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:57:57 smithi100 ceph-mon[34353]: pgmap v987: 97 pgs: 97 active+clean; 619 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 6.0 MiB/s wr, 346 op/s 2024-05-09T05:57:57.957 INFO:tasks.workunit.client.0.smithi039.stdout: 10 155478 20.97 MB/sec execute 274 sec latency 62.295 ms 2024-05-09T05:57:58.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:57:57 smithi060 ceph-mon[34555]: pgmap v987: 97 pgs: 97 active+clean; 619 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 6.0 MiB/s wr, 346 op/s 2024-05-09T05:57:58.957 INFO:tasks.workunit.client.0.smithi039.stdout: 10 155904 20.98 MB/sec execute 275 sec latency 144.906 ms 2024-05-09T05:57:59.854 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:57:59 smithi039 ceph-mon[30439]: pgmap v988: 97 pgs: 97 active+clean; 623 MiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 6.1 MiB/s wr, 411 op/s 2024-05-09T05:57:59.917 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:57:59 smithi100 ceph-mon[34353]: pgmap v988: 97 pgs: 97 active+clean; 623 MiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 6.1 MiB/s wr, 411 op/s 2024-05-09T05:57:59.957 INFO:tasks.workunit.client.0.smithi039.stdout: 10 156355 21.00 MB/sec execute 276 sec latency 105.455 ms 2024-05-09T05:58:00.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:57:59 smithi060 ceph-mon[34555]: pgmap v988: 97 pgs: 97 active+clean; 623 MiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 6.1 MiB/s wr, 411 op/s 2024-05-09T05:58:00.957 INFO:tasks.workunit.client.0.smithi039.stdout: 10 156600 21.00 MB/sec execute 277 sec latency 227.401 ms 2024-05-09T05:58:01.854 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:58:01 smithi039 ceph-mon[30439]: pgmap v989: 97 pgs: 97 active+clean; 608 MiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 5.3 MiB/s wr, 344 op/s 2024-05-09T05:58:01.917 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:58:01 smithi100 ceph-mon[34353]: pgmap v989: 97 pgs: 97 active+clean; 608 MiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 5.3 MiB/s wr, 344 op/s 2024-05-09T05:58:01.957 INFO:tasks.workunit.client.0.smithi039.stdout: 10 156933 20.99 MB/sec execute 278 sec latency 97.942 ms 2024-05-09T05:58:02.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:58:01 smithi060 ceph-mon[34555]: pgmap v989: 97 pgs: 97 active+clean; 608 MiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 5.3 MiB/s wr, 344 op/s 2024-05-09T05:58:02.957 INFO:tasks.workunit.client.0.smithi039.stdout: 10 157203 20.96 MB/sec execute 279 sec latency 111.457 ms 2024-05-09T05:58:03.854 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:58:03 smithi039 ceph-mon[30439]: pgmap v990: 97 pgs: 97 active+clean; 609 MiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 5.7 MiB/s wr, 378 op/s 2024-05-09T05:58:03.917 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:58:03 smithi100 ceph-mon[34353]: pgmap v990: 97 pgs: 97 active+clean; 609 MiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 5.7 MiB/s wr, 378 op/s 2024-05-09T05:58:03.957 INFO:tasks.workunit.client.0.smithi039.stdout: 10 157453 20.91 MB/sec execute 280 sec latency 106.273 ms 2024-05-09T05:58:04.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:58:03 smithi060 ceph-mon[34555]: pgmap v990: 97 pgs: 97 active+clean; 609 MiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 5.7 MiB/s wr, 378 op/s 2024-05-09T05:58:04.957 INFO:tasks.workunit.client.0.smithi039.stdout: 10 157834 20.90 MB/sec execute 281 sec latency 85.826 ms 2024-05-09T05:58:05.854 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:58:05 smithi039 ceph-mon[30439]: pgmap v991: 97 pgs: 97 active+clean; 606 MiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 MiB/s rd, 5.5 MiB/s wr, 363 op/s 2024-05-09T05:58:05.917 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:58:05 smithi100 ceph-mon[34353]: pgmap v991: 97 pgs: 97 active+clean; 606 MiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 MiB/s rd, 5.5 MiB/s wr, 363 op/s 2024-05-09T05:58:05.957 INFO:tasks.workunit.client.0.smithi039.stdout: 10 158232 20.90 MB/sec execute 282 sec latency 185.138 ms 2024-05-09T05:58:06.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:58:05 smithi060 ceph-mon[34555]: pgmap v991: 97 pgs: 97 active+clean; 606 MiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 MiB/s rd, 5.5 MiB/s wr, 363 op/s 2024-05-09T05:58:06.957 INFO:tasks.workunit.client.0.smithi039.stdout: 10 158679 20.92 MB/sec execute 283 sec latency 268.166 ms 2024-05-09T05:58:07.854 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:58:07 smithi039 ceph-mon[30439]: pgmap v992: 97 pgs: 97 active+clean; 607 MiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 MiB/s rd, 5.9 MiB/s wr, 401 op/s 2024-05-09T05:58:07.917 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:58:07 smithi100 ceph-mon[34353]: pgmap v992: 97 pgs: 97 active+clean; 607 MiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 MiB/s rd, 5.9 MiB/s wr, 401 op/s 2024-05-09T05:58:07.958 INFO:tasks.workunit.client.0.smithi039.stdout: 10 159200 20.94 MB/sec execute 284 sec latency 78.283 ms 2024-05-09T05:58:08.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:58:07 smithi060 ceph-mon[34555]: pgmap v992: 97 pgs: 97 active+clean; 607 MiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 MiB/s rd, 5.9 MiB/s wr, 401 op/s 2024-05-09T05:58:08.957 INFO:tasks.workunit.client.0.smithi039.stdout: 10 159587 20.93 MB/sec execute 285 sec latency 71.046 ms 2024-05-09T05:58:09.854 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:58:09 smithi039 ceph-mon[30439]: pgmap v993: 97 pgs: 97 active+clean; 609 MiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 5.4 MiB/s wr, 392 op/s 2024-05-09T05:58:09.917 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:58:09 smithi100 ceph-mon[34353]: pgmap v993: 97 pgs: 97 active+clean; 609 MiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 5.4 MiB/s wr, 392 op/s 2024-05-09T05:58:09.957 INFO:tasks.workunit.client.0.smithi039.stdout: 10 160052 20.96 MB/sec execute 286 sec latency 105.490 ms 2024-05-09T05:58:10.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:58:09 smithi060 ceph-mon[34555]: pgmap v993: 97 pgs: 97 active+clean; 609 MiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 5.4 MiB/s wr, 392 op/s 2024-05-09T05:58:10.958 INFO:tasks.workunit.client.0.smithi039.stdout: 10 160479 21.00 MB/sec execute 287 sec latency 68.590 ms 2024-05-09T05:58:11.854 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:58:11 smithi039 ceph-mon[30439]: pgmap v994: 97 pgs: 97 active+clean; 612 MiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 4.9 MiB/s wr, 337 op/s 2024-05-09T05:58:11.917 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:58:11 smithi100 ceph-mon[34353]: pgmap v994: 97 pgs: 97 active+clean; 612 MiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 4.9 MiB/s wr, 337 op/s 2024-05-09T05:58:11.958 INFO:tasks.workunit.client.0.smithi039.stdout: 10 160773 20.98 MB/sec execute 288 sec latency 248.434 ms 2024-05-09T05:58:12.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:58:11 smithi060 ceph-mon[34555]: pgmap v994: 97 pgs: 97 active+clean; 612 MiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 4.9 MiB/s wr, 337 op/s 2024-05-09T05:58:12.958 INFO:tasks.workunit.client.0.smithi039.stdout: 10 161054 20.95 MB/sec execute 289 sec latency 144.178 ms 2024-05-09T05:58:13.854 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:58:13 smithi039 ceph-mon[30439]: pgmap v995: 97 pgs: 97 active+clean; 617 MiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 5.5 MiB/s wr, 375 op/s 2024-05-09T05:58:13.917 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:58:13 smithi100 ceph-mon[34353]: pgmap v995: 97 pgs: 97 active+clean; 617 MiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 5.5 MiB/s wr, 375 op/s 2024-05-09T05:58:13.958 INFO:tasks.workunit.client.0.smithi039.stdout: 10 161320 20.92 MB/sec execute 290 sec latency 58.980 ms 2024-05-09T05:58:14.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:58:13 smithi060 ceph-mon[34555]: pgmap v995: 97 pgs: 97 active+clean; 617 MiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 5.5 MiB/s wr, 375 op/s 2024-05-09T05:58:14.958 INFO:tasks.workunit.client.0.smithi039.stdout: 10 161780 20.91 MB/sec execute 291 sec latency 76.130 ms 2024-05-09T05:58:15.917 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:58:15 smithi100 ceph-mon[34353]: pgmap v996: 97 pgs: 97 active+clean; 617 MiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 5.3 MiB/s wr, 359 op/s 2024-05-09T05:58:15.958 INFO:tasks.workunit.client.0.smithi039.stdout: 10 162291 20.92 MB/sec execute 292 sec latency 79.306 ms 2024-05-09T05:58:16.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:58:15 smithi060 ceph-mon[34555]: pgmap v996: 97 pgs: 97 active+clean; 617 MiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 5.3 MiB/s wr, 359 op/s 2024-05-09T05:58:16.104 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:58:15 smithi039 ceph-mon[30439]: pgmap v996: 97 pgs: 97 active+clean; 617 MiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 5.3 MiB/s wr, 359 op/s 2024-05-09T05:58:16.958 INFO:tasks.workunit.client.0.smithi039.stdout: 10 162629 20.92 MB/sec execute 293 sec latency 136.037 ms 2024-05-09T05:58:17.917 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:58:17 smithi100 ceph-mon[34353]: pgmap v997: 97 pgs: 97 active+clean; 621 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 6.0 MiB/s wr, 408 op/s 2024-05-09T05:58:17.958 INFO:tasks.workunit.client.0.smithi039.stdout: 10 163148 20.95 MB/sec execute 294 sec latency 76.781 ms 2024-05-09T05:58:18.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:58:17 smithi060 ceph-mon[34555]: pgmap v997: 97 pgs: 97 active+clean; 621 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 6.0 MiB/s wr, 408 op/s 2024-05-09T05:58:18.104 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:58:17 smithi039 ceph-mon[30439]: pgmap v997: 97 pgs: 97 active+clean; 621 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 6.0 MiB/s wr, 408 op/s 2024-05-09T05:58:18.958 INFO:tasks.workunit.client.0.smithi039.stdout: 10 163591 20.96 MB/sec execute 295 sec latency 71.903 ms 2024-05-09T05:58:19.917 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:58:19 smithi100 ceph-mon[34353]: pgmap v998: 97 pgs: 97 active+clean; 625 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.6 MiB/s wr, 386 op/s 2024-05-09T05:58:19.958 INFO:tasks.workunit.client.0.smithi039.stdout: 10 164061 20.99 MB/sec execute 296 sec latency 88.911 ms 2024-05-09T05:58:20.042 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:58:19 smithi060 ceph-mon[34555]: pgmap v998: 97 pgs: 97 active+clean; 625 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.6 MiB/s wr, 386 op/s 2024-05-09T05:58:20.103 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:58:19 smithi039 ceph-mon[30439]: pgmap v998: 97 pgs: 97 active+clean; 625 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.6 MiB/s wr, 386 op/s 2024-05-09T05:58:20.958 INFO:tasks.workunit.client.0.smithi039.stdout: 10 164471 21.01 MB/sec execute 297 sec latency 67.280 ms 2024-05-09T05:58:21.917 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:58:21 smithi100 ceph-mon[34353]: pgmap v999: 97 pgs: 97 active+clean; 625 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 5.5 MiB/s wr, 360 op/s 2024-05-09T05:58:21.958 INFO:tasks.workunit.client.0.smithi039.stdout: 10 164668 20.98 MB/sec execute 298 sec latency 306.723 ms 2024-05-09T05:58:22.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:58:21 smithi060 ceph-mon[34555]: pgmap v999: 97 pgs: 97 active+clean; 625 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 5.5 MiB/s wr, 360 op/s 2024-05-09T05:58:22.104 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:58:21 smithi039 ceph-mon[30439]: pgmap v999: 97 pgs: 97 active+clean; 625 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 5.5 MiB/s wr, 360 op/s 2024-05-09T05:58:22.958 INFO:tasks.workunit.client.0.smithi039.stdout: 10 164912 20.94 MB/sec execute 299 sec latency 214.809 ms 2024-05-09T05:58:23.917 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:58:23 smithi100 ceph-mon[34353]: pgmap v1000: 97 pgs: 97 active+clean; 629 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 5.5 MiB/s wr, 357 op/s 2024-05-09T05:58:23.958 INFO:tasks.workunit.client.0.smithi039.stdout: 10 165213 20.92 MB/sec execute 300 sec latency 92.726 ms 2024-05-09T05:58:24.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:58:23 smithi060 ceph-mon[34555]: pgmap v1000: 97 pgs: 97 active+clean; 629 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 5.5 MiB/s wr, 357 op/s 2024-05-09T05:58:24.103 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:58:23 smithi039 ceph-mon[30439]: pgmap v1000: 97 pgs: 97 active+clean; 629 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 5.5 MiB/s wr, 357 op/s 2024-05-09T05:58:24.958 INFO:tasks.workunit.client.0.smithi039.stdout: 10 165611 20.91 MB/sec execute 301 sec latency 134.032 ms 2024-05-09T05:58:25.917 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:58:25 smithi100 ceph-mon[34353]: pgmap v1001: 97 pgs: 97 active+clean; 629 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.9 MiB/s wr, 369 op/s 2024-05-09T05:58:25.958 INFO:tasks.workunit.client.0.smithi039.stdout: 10 166111 20.92 MB/sec execute 302 sec latency 140.410 ms 2024-05-09T05:58:26.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:58:25 smithi060 ceph-mon[34555]: pgmap v1001: 97 pgs: 97 active+clean; 629 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.9 MiB/s wr, 369 op/s 2024-05-09T05:58:26.104 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:58:25 smithi039 ceph-mon[30439]: pgmap v1001: 97 pgs: 97 active+clean; 629 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.9 MiB/s wr, 369 op/s 2024-05-09T05:58:26.958 INFO:tasks.workunit.client.0.smithi039.stdout: 10 166418 20.89 MB/sec execute 303 sec latency 236.372 ms 2024-05-09T05:58:27.917 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:58:27 smithi100 ceph-mon[34353]: pgmap v1002: 97 pgs: 97 active+clean; 612 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 6.4 MiB/s wr, 392 op/s 2024-05-09T05:58:27.917 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:58:27 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:58:27.958 INFO:tasks.workunit.client.0.smithi039.stdout: 10 166822 20.91 MB/sec execute 304 sec latency 70.361 ms 2024-05-09T05:58:28.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:58:27 smithi060 ceph-mon[34555]: pgmap v1002: 97 pgs: 97 active+clean; 612 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 6.4 MiB/s wr, 392 op/s 2024-05-09T05:58:28.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:58:27 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:58:28.104 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:58:27 smithi039 ceph-mon[30439]: pgmap v1002: 97 pgs: 97 active+clean; 612 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 6.4 MiB/s wr, 392 op/s 2024-05-09T05:58:28.104 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:58:27 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:58:28.958 INFO:tasks.workunit.client.0.smithi039.stdout: 10 167251 20.92 MB/sec execute 305 sec latency 89.799 ms 2024-05-09T05:58:29.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:58:28 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:58:29.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:58:28 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:58:29.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:58:28 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:58:29.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:58:28 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:58:29.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:58:28 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:58:29.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:58:28 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:58:29.104 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:58:28 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:58:29.104 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:58:28 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:58:29.104 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:58:28 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:58:29.104 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:58:28 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:58:29.104 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:58:28 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:58:29.104 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:58:28 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:58:29.167 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:58:28 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:58:29.167 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:58:28 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:58:29.167 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:58:28 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:58:29.167 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:58:28 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:58:29.167 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:58:28 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:58:29.167 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:58:28 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:58:29.958 INFO:tasks.workunit.client.0.smithi039.stdout: 10 167790 20.95 MB/sec execute 306 sec latency 75.262 ms 2024-05-09T05:58:30.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:58:29 smithi060 ceph-mon[34555]: pgmap v1003: 97 pgs: 97 active+clean; 613 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 6.1 MiB/s wr, 375 op/s 2024-05-09T05:58:30.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:58:29 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:58:30.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:58:29 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:58:30.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:58:29 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:58:30.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:58:29 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:58:30.041 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:58:29 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:58:30.041 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:58:29 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:58:30.041 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:58:29 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:58:30.041 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:58:29 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:58:30.041 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:58:29 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:58:30.104 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:58:29 smithi039 ceph-mon[30439]: pgmap v1003: 97 pgs: 97 active+clean; 613 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 6.1 MiB/s wr, 375 op/s 2024-05-09T05:58:30.104 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:58:29 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:58:30.104 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:58:29 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:58:30.104 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:58:29 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:58:30.104 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:58:29 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:58:30.104 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:58:29 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:58:30.104 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:58:29 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:58:30.104 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:58:29 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:58:30.104 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:58:29 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:58:30.104 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:58:29 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:58:30.167 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:58:29 smithi100 ceph-mon[34353]: pgmap v1003: 97 pgs: 97 active+clean; 613 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 6.1 MiB/s wr, 375 op/s 2024-05-09T05:58:30.167 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:58:29 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:58:30.168 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:58:29 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:58:30.168 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:58:29 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:58:30.168 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:58:29 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:58:30.168 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:58:29 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:58:30.168 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:58:29 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:58:30.168 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:58:29 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:58:30.168 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:58:29 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:58:30.168 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:58:29 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:58:30.958 INFO:tasks.workunit.client.0.smithi039.stdout: 10 168146 20.97 MB/sec execute 307 sec latency 73.564 ms 2024-05-09T05:58:31.958 INFO:tasks.workunit.client.0.smithi039.stdout: 10 168389 20.96 MB/sec execute 308 sec latency 289.869 ms 2024-05-09T05:58:32.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:58:31 smithi060 ceph-mon[34555]: pgmap v1004: 97 pgs: 97 active+clean; 613 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.7 MiB/s wr, 339 op/s 2024-05-09T05:58:32.104 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:58:31 smithi039 ceph-mon[30439]: pgmap v1004: 97 pgs: 97 active+clean; 613 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.7 MiB/s wr, 339 op/s 2024-05-09T05:58:32.167 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:58:31 smithi100 ceph-mon[34353]: pgmap v1004: 97 pgs: 97 active+clean; 613 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.7 MiB/s wr, 339 op/s 2024-05-09T05:58:32.959 INFO:tasks.workunit.client.0.smithi039.stdout: 10 168633 20.92 MB/sec execute 309 sec latency 97.251 ms 2024-05-09T05:58:33.958 INFO:tasks.workunit.client.0.smithi039.stdout: 10 168927 20.90 MB/sec execute 310 sec latency 94.584 ms 2024-05-09T05:58:34.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:58:33 smithi060 ceph-mon[34555]: pgmap v1005: 97 pgs: 97 active+clean; 617 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 6.1 MiB/s wr, 365 op/s 2024-05-09T05:58:34.104 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:58:33 smithi039 ceph-mon[30439]: pgmap v1005: 97 pgs: 97 active+clean; 617 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 6.1 MiB/s wr, 365 op/s 2024-05-09T05:58:34.167 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:58:33 smithi100 ceph-mon[34353]: pgmap v1005: 97 pgs: 97 active+clean; 617 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 6.1 MiB/s wr, 365 op/s 2024-05-09T05:58:34.959 INFO:tasks.workunit.client.0.smithi039.stdout: 10 169354 20.89 MB/sec execute 311 sec latency 67.435 ms 2024-05-09T05:58:35.959 INFO:tasks.workunit.client.0.smithi039.stdout: 10 169790 20.90 MB/sec execute 312 sec latency 52.373 ms 2024-05-09T05:58:36.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:58:35 smithi060 ceph-mon[34555]: pgmap v1006: 97 pgs: 97 active+clean; 619 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 6.4 MiB/s wr, 380 op/s 2024-05-09T05:58:36.103 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:58:35 smithi039 ceph-mon[30439]: pgmap v1006: 97 pgs: 97 active+clean; 619 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 6.4 MiB/s wr, 380 op/s 2024-05-09T05:58:36.167 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:58:35 smithi100 ceph-mon[34353]: pgmap v1006: 97 pgs: 97 active+clean; 619 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 6.4 MiB/s wr, 380 op/s 2024-05-09T05:58:36.959 INFO:tasks.workunit.client.0.smithi039.stdout: 10 170241 20.88 MB/sec execute 313 sec latency 161.876 ms 2024-05-09T05:58:37.959 INFO:tasks.workunit.client.0.smithi039.stdout: 10 170674 20.89 MB/sec execute 314 sec latency 63.333 ms 2024-05-09T05:58:38.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:58:37 smithi060 ceph-mon[34555]: pgmap v1007: 97 pgs: 97 active+clean; 621 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 6.1 MiB/s wr, 379 op/s 2024-05-09T05:58:38.103 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:58:37 smithi039 ceph-mon[30439]: pgmap v1007: 97 pgs: 97 active+clean; 621 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 6.1 MiB/s wr, 379 op/s 2024-05-09T05:58:38.167 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:58:37 smithi100 ceph-mon[34353]: pgmap v1007: 97 pgs: 97 active+clean; 621 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 6.1 MiB/s wr, 379 op/s 2024-05-09T05:58:38.959 INFO:tasks.workunit.client.0.smithi039.stdout: 10 171323 20.95 MB/sec execute 315 sec latency 52.090 ms 2024-05-09T05:58:39.959 INFO:tasks.workunit.client.0.smithi039.stdout: 10 171785 20.98 MB/sec execute 316 sec latency 109.583 ms 2024-05-09T05:58:40.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:58:39 smithi060 ceph-mon[34555]: pgmap v1008: 97 pgs: 97 active+clean; 623 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 5.7 MiB/s wr, 387 op/s 2024-05-09T05:58:40.103 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:58:39 smithi039 ceph-mon[30439]: pgmap v1008: 97 pgs: 97 active+clean; 623 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 5.7 MiB/s wr, 387 op/s 2024-05-09T05:58:40.167 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:58:39 smithi100 ceph-mon[34353]: pgmap v1008: 97 pgs: 97 active+clean; 623 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 5.7 MiB/s wr, 387 op/s 2024-05-09T05:58:40.959 INFO:tasks.workunit.client.0.smithi039.stdout: 10 172149 20.99 MB/sec execute 317 sec latency 220.168 ms 2024-05-09T05:58:41.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:58:40 smithi060 ceph-mon[34555]: pgmap v1009: 97 pgs: 97 active+clean; 623 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 5.0 MiB/s wr, 325 op/s 2024-05-09T05:58:41.105 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:58:40 smithi039 ceph-mon[30439]: pgmap v1009: 97 pgs: 97 active+clean; 623 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 5.0 MiB/s wr, 325 op/s 2024-05-09T05:58:41.167 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:58:40 smithi100 ceph-mon[34353]: pgmap v1009: 97 pgs: 97 active+clean; 623 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 5.0 MiB/s wr, 325 op/s 2024-05-09T05:58:41.959 INFO:tasks.workunit.client.0.smithi039.stdout: 10 172366 20.97 MB/sec execute 318 sec latency 256.218 ms 2024-05-09T05:58:42.959 INFO:tasks.workunit.client.0.smithi039.stdout: 10 172644 20.94 MB/sec execute 319 sec latency 317.115 ms 2024-05-09T05:58:43.853 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:58:43 smithi039 ceph-mon[30439]: pgmap v1010: 97 pgs: 97 active+clean; 628 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.3 MiB/s wr, 369 op/s 2024-05-09T05:58:43.917 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:58:43 smithi100 ceph-mon[34353]: pgmap v1010: 97 pgs: 97 active+clean; 628 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.3 MiB/s wr, 369 op/s 2024-05-09T05:58:43.959 INFO:tasks.workunit.client.0.smithi039.stdout: 10 172937 20.91 MB/sec execute 320 sec latency 161.961 ms 2024-05-09T05:58:44.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:58:43 smithi060 ceph-mon[34555]: pgmap v1010: 97 pgs: 97 active+clean; 628 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.3 MiB/s wr, 369 op/s 2024-05-09T05:58:44.959 INFO:tasks.workunit.client.0.smithi039.stdout: 10 173347 20.90 MB/sec execute 321 sec latency 116.433 ms 2024-05-09T05:58:45.853 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:58:45 smithi039 ceph-mon[30439]: pgmap v1011: 97 pgs: 97 active+clean; 632 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 5.1 MiB/s wr, 353 op/s 2024-05-09T05:58:45.859 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:58:45 smithi060 ceph-mon[34555]: pgmap v1011: 97 pgs: 97 active+clean; 632 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 5.1 MiB/s wr, 353 op/s 2024-05-09T05:58:45.917 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:58:45 smithi100 ceph-mon[34353]: pgmap v1011: 97 pgs: 97 active+clean; 632 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 5.1 MiB/s wr, 353 op/s 2024-05-09T05:58:45.959 INFO:tasks.workunit.client.0.smithi039.stdout: 10 173773 20.91 MB/sec execute 322 sec latency 61.163 ms 2024-05-09T05:58:46.959 INFO:tasks.workunit.client.0.smithi039.stdout: 10 174157 20.89 MB/sec execute 323 sec latency 227.091 ms 2024-05-09T05:58:47.853 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:58:47 smithi039 ceph-mon[30439]: pgmap v1012: 97 pgs: 97 active+clean; 626 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 5.6 MiB/s wr, 381 op/s 2024-05-09T05:58:47.917 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:58:47 smithi100 ceph-mon[34353]: pgmap v1012: 97 pgs: 97 active+clean; 626 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 5.6 MiB/s wr, 381 op/s 2024-05-09T05:58:47.959 INFO:tasks.workunit.client.0.smithi039.stdout: 10 174539 20.88 MB/sec execute 324 sec latency 276.119 ms 2024-05-09T05:58:48.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:58:47 smithi060 ceph-mon[34555]: pgmap v1012: 97 pgs: 97 active+clean; 626 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 5.6 MiB/s wr, 381 op/s 2024-05-09T05:58:48.959 INFO:tasks.workunit.client.0.smithi039.stdout: 10 175054 20.92 MB/sec execute 325 sec latency 119.092 ms 2024-05-09T05:58:49.853 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:58:49 smithi039 ceph-mon[30439]: pgmap v1013: 97 pgs: 97 active+clean; 608 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 5.3 MiB/s wr, 361 op/s 2024-05-09T05:58:49.917 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:58:49 smithi100 ceph-mon[34353]: pgmap v1013: 97 pgs: 97 active+clean; 608 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 5.3 MiB/s wr, 361 op/s 2024-05-09T05:58:49.959 INFO:tasks.workunit.client.0.smithi039.stdout: 10 175642 20.98 MB/sec execute 326 sec latency 56.202 ms 2024-05-09T05:58:50.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:58:49 smithi060 ceph-mon[34555]: pgmap v1013: 97 pgs: 97 active+clean; 608 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 5.3 MiB/s wr, 361 op/s 2024-05-09T05:58:50.959 INFO:tasks.workunit.client.0.smithi039.stdout: 10 175946 20.97 MB/sec execute 327 sec latency 89.836 ms 2024-05-09T05:58:51.826 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:58:51 smithi100 ceph-mon[34353]: pgmap v1014: 97 pgs: 97 active+clean; 611 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 5.1 MiB/s wr, 340 op/s 2024-05-09T05:58:51.853 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:58:51 smithi039 ceph-mon[30439]: pgmap v1014: 97 pgs: 97 active+clean; 611 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 5.1 MiB/s wr, 340 op/s 2024-05-09T05:58:51.959 INFO:tasks.workunit.client.0.smithi039.stdout: 10 176226 20.95 MB/sec execute 328 sec latency 142.408 ms 2024-05-09T05:58:52.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:58:51 smithi060 ceph-mon[34555]: pgmap v1014: 97 pgs: 97 active+clean; 611 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 5.1 MiB/s wr, 340 op/s 2024-05-09T05:58:52.959 INFO:tasks.workunit.client.0.smithi039.stdout: 10 176460 20.94 MB/sec execute 329 sec latency 307.468 ms 2024-05-09T05:58:53.853 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:58:53 smithi039 ceph-mon[30439]: pgmap v1015: 97 pgs: 97 active+clean; 613 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 5.3 MiB/s wr, 368 op/s 2024-05-09T05:58:53.917 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:58:53 smithi100 ceph-mon[34353]: pgmap v1015: 97 pgs: 97 active+clean; 613 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 5.3 MiB/s wr, 368 op/s 2024-05-09T05:58:53.959 INFO:tasks.workunit.client.0.smithi039.stdout: 10 176767 20.91 MB/sec execute 330 sec latency 140.521 ms 2024-05-09T05:58:54.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:58:53 smithi060 ceph-mon[34555]: pgmap v1015: 97 pgs: 97 active+clean; 613 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 5.3 MiB/s wr, 368 op/s 2024-05-09T05:58:54.959 INFO:tasks.workunit.client.0.smithi039.stdout: 10 177161 20.91 MB/sec execute 331 sec latency 66.842 ms 2024-05-09T05:58:55.853 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:58:55 smithi039 ceph-mon[30439]: pgmap v1016: 97 pgs: 97 active+clean; 618 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 5.4 MiB/s wr, 358 op/s 2024-05-09T05:58:55.917 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:58:55 smithi100 ceph-mon[34353]: pgmap v1016: 97 pgs: 97 active+clean; 618 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 5.4 MiB/s wr, 358 op/s 2024-05-09T05:58:55.959 INFO:tasks.workunit.client.0.smithi039.stdout: 10 177506 20.90 MB/sec execute 332 sec latency 73.751 ms 2024-05-09T05:58:56.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:58:55 smithi060 ceph-mon[34555]: pgmap v1016: 97 pgs: 97 active+clean; 618 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 5.4 MiB/s wr, 358 op/s 2024-05-09T05:58:56.959 INFO:tasks.workunit.client.0.smithi039.stdout: 10 177900 20.87 MB/sec execute 333 sec latency 115.538 ms 2024-05-09T05:58:57.854 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:58:57 smithi039 ceph-mon[30439]: pgmap v1017: 97 pgs: 97 active+clean; 617 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 5.8 MiB/s wr, 364 op/s 2024-05-09T05:58:57.917 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:58:57 smithi100 ceph-mon[34353]: pgmap v1017: 97 pgs: 97 active+clean; 617 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 5.8 MiB/s wr, 364 op/s 2024-05-09T05:58:57.959 INFO:tasks.workunit.client.0.smithi039.stdout: 10 178197 20.85 MB/sec execute 334 sec latency 259.188 ms 2024-05-09T05:58:58.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:58:57 smithi060 ceph-mon[34555]: pgmap v1017: 97 pgs: 97 active+clean; 617 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 5.8 MiB/s wr, 364 op/s 2024-05-09T05:58:58.959 INFO:tasks.workunit.client.0.smithi039.stdout: 10 178779 20.90 MB/sec execute 335 sec latency 76.054 ms 2024-05-09T05:58:59.854 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:58:59 smithi039 ceph-mon[30439]: pgmap v1018: 97 pgs: 97 active+clean; 619 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 5.5 MiB/s wr, 351 op/s 2024-05-09T05:58:59.917 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:58:59 smithi100 ceph-mon[34353]: pgmap v1018: 97 pgs: 97 active+clean; 619 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 5.5 MiB/s wr, 351 op/s 2024-05-09T05:58:59.959 INFO:tasks.workunit.client.0.smithi039.stdout: 10 179381 20.94 MB/sec execute 336 sec latency 72.072 ms 2024-05-09T05:59:00.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:58:59 smithi060 ceph-mon[34555]: pgmap v1018: 97 pgs: 97 active+clean; 619 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 5.5 MiB/s wr, 351 op/s 2024-05-09T05:59:00.959 INFO:tasks.workunit.client.0.smithi039.stdout: 10 179704 20.93 MB/sec execute 337 sec latency 102.539 ms 2024-05-09T05:59:01.853 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:59:01 smithi039 ceph-mon[30439]: pgmap v1019: 97 pgs: 97 active+clean; 623 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 5.3 MiB/s wr, 355 op/s 2024-05-09T05:59:01.917 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:59:01 smithi100 ceph-mon[34353]: pgmap v1019: 97 pgs: 97 active+clean; 623 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 5.3 MiB/s wr, 355 op/s 2024-05-09T05:59:01.960 INFO:tasks.workunit.client.0.smithi039.stdout: 10 180055 20.94 MB/sec execute 338 sec latency 76.645 ms 2024-05-09T05:59:02.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:59:01 smithi060 ceph-mon[34555]: pgmap v1019: 97 pgs: 97 active+clean; 623 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 5.3 MiB/s wr, 355 op/s 2024-05-09T05:59:02.960 INFO:tasks.workunit.client.0.smithi039.stdout: 10 180285 20.92 MB/sec execute 339 sec latency 272.360 ms 2024-05-09T05:59:03.853 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:59:03 smithi039 ceph-mon[30439]: pgmap v1020: 97 pgs: 97 active+clean; 626 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 5.4 MiB/s wr, 374 op/s 2024-05-09T05:59:03.917 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:59:03 smithi100 ceph-mon[34353]: pgmap v1020: 97 pgs: 97 active+clean; 626 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 5.4 MiB/s wr, 374 op/s 2024-05-09T05:59:03.960 INFO:tasks.workunit.client.0.smithi039.stdout: 10 180646 20.92 MB/sec execute 340 sec latency 109.742 ms 2024-05-09T05:59:04.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:59:03 smithi060 ceph-mon[34555]: pgmap v1020: 97 pgs: 97 active+clean; 626 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 5.4 MiB/s wr, 374 op/s 2024-05-09T05:59:04.960 INFO:tasks.workunit.client.0.smithi039.stdout: 10 181022 20.91 MB/sec execute 341 sec latency 87.246 ms 2024-05-09T05:59:05.854 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:59:05 smithi039 ceph-mon[30439]: pgmap v1021: 97 pgs: 97 active+clean; 632 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 5.8 MiB/s wr, 357 op/s 2024-05-09T05:59:05.917 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:59:05 smithi100 ceph-mon[34353]: pgmap v1021: 97 pgs: 97 active+clean; 632 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 5.8 MiB/s wr, 357 op/s 2024-05-09T05:59:05.960 INFO:tasks.workunit.client.0.smithi039.stdout: 10 181326 20.89 MB/sec execute 342 sec latency 107.204 ms 2024-05-09T05:59:06.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:59:05 smithi060 ceph-mon[34555]: pgmap v1021: 97 pgs: 97 active+clean; 632 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 5.8 MiB/s wr, 357 op/s 2024-05-09T05:59:06.960 INFO:tasks.workunit.client.0.smithi039.stdout: 10 181672 20.86 MB/sec execute 343 sec latency 92.713 ms 2024-05-09T05:59:07.853 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:59:07 smithi039 ceph-mon[30439]: pgmap v1022: 97 pgs: 97 active+clean; 638 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 6.7 MiB/s wr, 399 op/s 2024-05-09T05:59:07.917 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:59:07 smithi100 ceph-mon[34353]: pgmap v1022: 97 pgs: 97 active+clean; 638 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 6.7 MiB/s wr, 399 op/s 2024-05-09T05:59:07.960 INFO:tasks.workunit.client.0.smithi039.stdout: 10 181945 20.83 MB/sec execute 344 sec latency 270.016 ms 2024-05-09T05:59:08.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:59:07 smithi060 ceph-mon[34555]: pgmap v1022: 97 pgs: 97 active+clean; 638 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 6.7 MiB/s wr, 399 op/s 2024-05-09T05:59:08.960 INFO:tasks.workunit.client.0.smithi039.stdout: 10 182396 20.85 MB/sec execute 345 sec latency 101.201 ms 2024-05-09T05:59:09.853 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:59:09 smithi039 ceph-mon[30439]: pgmap v1023: 97 pgs: 97 active+clean; 638 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 6.5 MiB/s wr, 425 op/s 2024-05-09T05:59:09.917 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:59:09 smithi100 ceph-mon[34353]: pgmap v1023: 97 pgs: 97 active+clean; 638 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 6.5 MiB/s wr, 425 op/s 2024-05-09T05:59:09.960 INFO:tasks.workunit.client.0.smithi039.stdout: 10 182944 20.91 MB/sec execute 346 sec latency 55.168 ms 2024-05-09T05:59:10.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:59:09 smithi060 ceph-mon[34555]: pgmap v1023: 97 pgs: 97 active+clean; 638 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 6.5 MiB/s wr, 425 op/s 2024-05-09T05:59:10.960 INFO:tasks.workunit.client.0.smithi039.stdout: 10 183391 20.90 MB/sec execute 347 sec latency 150.413 ms 2024-05-09T05:59:11.853 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:59:11 smithi039 ceph-mon[30439]: pgmap v1024: 97 pgs: 97 active+clean; 636 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 5.7 MiB/s wr, 389 op/s 2024-05-09T05:59:11.917 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:59:11 smithi100 ceph-mon[34353]: pgmap v1024: 97 pgs: 97 active+clean; 636 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 5.7 MiB/s wr, 389 op/s 2024-05-09T05:59:11.960 INFO:tasks.workunit.client.0.smithi039.stdout: 10 183702 20.90 MB/sec execute 348 sec latency 67.732 ms 2024-05-09T05:59:12.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:59:11 smithi060 ceph-mon[34555]: pgmap v1024: 97 pgs: 97 active+clean; 636 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 5.7 MiB/s wr, 389 op/s 2024-05-09T05:59:12.960 INFO:tasks.workunit.client.0.smithi039.stdout: 10 183952 20.88 MB/sec execute 349 sec latency 261.561 ms 2024-05-09T05:59:13.853 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:59:13 smithi039 ceph-mon[30439]: pgmap v1025: 97 pgs: 97 active+clean; 617 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 5.6 MiB/s wr, 367 op/s 2024-05-09T05:59:13.917 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:59:13 smithi100 ceph-mon[34353]: pgmap v1025: 97 pgs: 97 active+clean; 617 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 5.6 MiB/s wr, 367 op/s 2024-05-09T05:59:13.960 INFO:tasks.workunit.client.0.smithi039.stdout: 10 184308 20.87 MB/sec execute 350 sec latency 172.523 ms 2024-05-09T05:59:14.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:59:13 smithi060 ceph-mon[34555]: pgmap v1025: 97 pgs: 97 active+clean; 617 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 5.6 MiB/s wr, 367 op/s 2024-05-09T05:59:14.960 INFO:tasks.workunit.client.0.smithi039.stdout: 10 184697 20.89 MB/sec execute 351 sec latency 67.300 ms 2024-05-09T05:59:15.853 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:59:15 smithi039 ceph-mon[30439]: pgmap v1026: 97 pgs: 97 active+clean; 625 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 5.9 MiB/s wr, 367 op/s 2024-05-09T05:59:15.917 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:59:15 smithi100 ceph-mon[34353]: pgmap v1026: 97 pgs: 97 active+clean; 625 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 5.9 MiB/s wr, 367 op/s 2024-05-09T05:59:15.960 INFO:tasks.workunit.client.0.smithi039.stdout: 10 185024 20.87 MB/sec execute 352 sec latency 55.729 ms 2024-05-09T05:59:16.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:59:15 smithi060 ceph-mon[34555]: pgmap v1026: 97 pgs: 97 active+clean; 625 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 5.9 MiB/s wr, 367 op/s 2024-05-09T05:59:16.960 INFO:tasks.workunit.client.0.smithi039.stdout: 10 185442 20.85 MB/sec execute 353 sec latency 52.925 ms 2024-05-09T05:59:17.917 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:59:17 smithi100 ceph-mon[34353]: pgmap v1027: 97 pgs: 97 active+clean; 628 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 6.4 MiB/s wr, 408 op/s 2024-05-09T05:59:17.963 INFO:tasks.workunit.client.0.smithi039.stdout: 10 185729 20.82 MB/sec execute 354 sec latency 279.237 ms 2024-05-09T05:59:18.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:59:17 smithi060 ceph-mon[34555]: pgmap v1027: 97 pgs: 97 active+clean; 628 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 6.4 MiB/s wr, 408 op/s 2024-05-09T05:59:18.103 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:59:17 smithi039 ceph-mon[30439]: pgmap v1027: 97 pgs: 97 active+clean; 628 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 6.4 MiB/s wr, 408 op/s 2024-05-09T05:59:18.960 INFO:tasks.workunit.client.0.smithi039.stdout: 10 186198 20.84 MB/sec execute 355 sec latency 84.570 ms 2024-05-09T05:59:19.917 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:59:19 smithi100 ceph-mon[34353]: pgmap v1028: 97 pgs: 97 active+clean; 624 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.2 MiB/s wr, 348 op/s 2024-05-09T05:59:19.960 INFO:tasks.workunit.client.0.smithi039.stdout: 10 186708 20.89 MB/sec execute 356 sec latency 92.061 ms 2024-05-09T05:59:20.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:59:19 smithi060 ceph-mon[34555]: pgmap v1028: 97 pgs: 97 active+clean; 624 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.2 MiB/s wr, 348 op/s 2024-05-09T05:59:20.103 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:59:19 smithi039 ceph-mon[30439]: pgmap v1028: 97 pgs: 97 active+clean; 624 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.2 MiB/s wr, 348 op/s 2024-05-09T05:59:20.960 INFO:tasks.workunit.client.0.smithi039.stdout: 10 187180 20.89 MB/sec execute 357 sec latency 60.088 ms 2024-05-09T05:59:21.917 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:59:21 smithi100 ceph-mon[34353]: pgmap v1029: 97 pgs: 97 active+clean; 626 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 4.8 MiB/s wr, 323 op/s 2024-05-09T05:59:21.960 INFO:tasks.workunit.client.0.smithi039.stdout: 10 187530 20.89 MB/sec execute 358 sec latency 62.540 ms 2024-05-09T05:59:22.043 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:59:21 smithi060 ceph-mon[34555]: pgmap v1029: 97 pgs: 97 active+clean; 626 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 4.8 MiB/s wr, 323 op/s 2024-05-09T05:59:22.103 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:59:21 smithi039 ceph-mon[30439]: pgmap v1029: 97 pgs: 97 active+clean; 626 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 4.8 MiB/s wr, 323 op/s 2024-05-09T05:59:22.960 INFO:tasks.workunit.client.0.smithi039.stdout: 10 187780 20.87 MB/sec execute 359 sec latency 240.137 ms 2024-05-09T05:59:23.917 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:59:23 smithi100 ceph-mon[34353]: pgmap v1030: 97 pgs: 97 active+clean; 626 MiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 4.9 MiB/s wr, 339 op/s 2024-05-09T05:59:23.960 INFO:tasks.workunit.client.0.smithi039.stdout: 10 188189 20.88 MB/sec execute 360 sec latency 128.412 ms 2024-05-09T05:59:24.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:59:23 smithi060 ceph-mon[34555]: pgmap v1030: 97 pgs: 97 active+clean; 626 MiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 4.9 MiB/s wr, 339 op/s 2024-05-09T05:59:24.103 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:59:23 smithi039 ceph-mon[30439]: pgmap v1030: 97 pgs: 97 active+clean; 626 MiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 4.9 MiB/s wr, 339 op/s 2024-05-09T05:59:24.960 INFO:tasks.workunit.client.0.smithi039.stdout: 10 188605 20.90 MB/sec execute 361 sec latency 55.789 ms 2024-05-09T05:59:25.917 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:59:25 smithi100 ceph-mon[34353]: pgmap v1031: 97 pgs: 97 active+clean; 632 MiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 5.3 MiB/s wr, 365 op/s 2024-05-09T05:59:25.960 INFO:tasks.workunit.client.0.smithi039.stdout: 10 188982 20.88 MB/sec execute 362 sec latency 67.777 ms 2024-05-09T05:59:26.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:59:25 smithi060 ceph-mon[34555]: pgmap v1031: 97 pgs: 97 active+clean; 632 MiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 5.3 MiB/s wr, 365 op/s 2024-05-09T05:59:26.103 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:59:25 smithi039 ceph-mon[30439]: pgmap v1031: 97 pgs: 97 active+clean; 632 MiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 5.3 MiB/s wr, 365 op/s 2024-05-09T05:59:26.962 INFO:tasks.workunit.client.0.smithi039.stdout: 10 189308 20.85 MB/sec execute 363 sec latency 59.463 ms 2024-05-09T05:59:27.917 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:59:27 smithi100 ceph-mon[34353]: pgmap v1032: 97 pgs: 97 active+clean; 636 MiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 5.6 MiB/s wr, 361 op/s 2024-05-09T05:59:27.960 INFO:tasks.workunit.client.0.smithi039.stdout: 10 189643 20.85 MB/sec execute 364 sec latency 171.703 ms 2024-05-09T05:59:28.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:59:27 smithi060 ceph-mon[34555]: pgmap v1032: 97 pgs: 97 active+clean; 636 MiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 5.6 MiB/s wr, 361 op/s 2024-05-09T05:59:28.103 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:59:27 smithi039 ceph-mon[30439]: pgmap v1032: 97 pgs: 97 active+clean; 636 MiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 5.6 MiB/s wr, 361 op/s 2024-05-09T05:59:28.960 INFO:tasks.workunit.client.0.smithi039.stdout: 10 190013 20.84 MB/sec execute 365 sec latency 306.288 ms 2024-05-09T05:59:29.905 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:59:29 smithi039 ceph-mon[30439]: pgmap v1033: 97 pgs: 97 active+clean; 637 MiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.3 MiB/s wr, 353 op/s 2024-05-09T05:59:29.916 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:59:29 smithi100 ceph-mon[34353]: pgmap v1033: 97 pgs: 97 active+clean; 637 MiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.3 MiB/s wr, 353 op/s 2024-05-09T05:59:29.960 INFO:tasks.workunit.client.0.smithi039.stdout: 10 190513 20.87 MB/sec execute 366 sec latency 112.378 ms 2024-05-09T05:59:30.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:59:29 smithi060 ceph-mon[34555]: pgmap v1033: 97 pgs: 97 active+clean; 637 MiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.3 MiB/s wr, 353 op/s 2024-05-09T05:59:30.917 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:59:30 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:59:30.917 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:59:30 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:59:30.917 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:59:30 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:59:30.917 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:59:30 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:59:30.960 INFO:tasks.workunit.client.0.smithi039.stdout: 10 190940 20.87 MB/sec execute 367 sec latency 199.135 ms 2024-05-09T05:59:31.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:59:30 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:59:31.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:59:30 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:59:31.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:59:30 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:59:31.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:59:30 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:59:31.103 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:59:30 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T05:59:31.103 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:59:30 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T05:59:31.104 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:59:30 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T05:59:31.104 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:59:30 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T05:59:31.917 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:59:31 smithi100 ceph-mon[34353]: pgmap v1034: 97 pgs: 97 active+clean; 637 MiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 4.9 MiB/s wr, 334 op/s 2024-05-09T05:59:31.961 INFO:tasks.workunit.client.0.smithi039.stdout: 10 191299 20.85 MB/sec execute 368 sec latency 67.027 ms 2024-05-09T05:59:32.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:59:31 smithi060 ceph-mon[34555]: pgmap v1034: 97 pgs: 97 active+clean; 637 MiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 4.9 MiB/s wr, 334 op/s 2024-05-09T05:59:32.103 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:59:31 smithi039 ceph-mon[30439]: pgmap v1034: 97 pgs: 97 active+clean; 637 MiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 4.9 MiB/s wr, 334 op/s 2024-05-09T05:59:32.960 INFO:tasks.workunit.client.0.smithi039.stdout: 10 191585 20.86 MB/sec execute 369 sec latency 179.534 ms 2024-05-09T05:59:33.917 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:59:33 smithi100 ceph-mon[34353]: pgmap v1035: 97 pgs: 97 active+clean; 640 MiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.2 MiB/s wr, 354 op/s 2024-05-09T05:59:33.961 INFO:tasks.workunit.client.0.smithi039.stdout: 10 191951 20.85 MB/sec execute 370 sec latency 253.658 ms 2024-05-09T05:59:34.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:59:33 smithi060 ceph-mon[34555]: pgmap v1035: 97 pgs: 97 active+clean; 640 MiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.2 MiB/s wr, 354 op/s 2024-05-09T05:59:34.103 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:59:33 smithi039 ceph-mon[30439]: pgmap v1035: 97 pgs: 97 active+clean; 640 MiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.2 MiB/s wr, 354 op/s 2024-05-09T05:59:34.961 INFO:tasks.workunit.client.0.smithi039.stdout: 10 192379 20.88 MB/sec execute 371 sec latency 229.529 ms 2024-05-09T05:59:35.917 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:59:35 smithi100 ceph-mon[34353]: pgmap v1036: 97 pgs: 97 active+clean; 649 MiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 6.0 MiB/s wr, 375 op/s 2024-05-09T05:59:35.961 INFO:tasks.workunit.client.0.smithi039.stdout: 10 192694 20.87 MB/sec execute 372 sec latency 96.438 ms 2024-05-09T05:59:36.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:59:35 smithi060 ceph-mon[34555]: pgmap v1036: 97 pgs: 97 active+clean; 649 MiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 6.0 MiB/s wr, 375 op/s 2024-05-09T05:59:36.103 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:59:35 smithi039 ceph-mon[30439]: pgmap v1036: 97 pgs: 97 active+clean; 649 MiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 6.0 MiB/s wr, 375 op/s 2024-05-09T05:59:36.961 INFO:tasks.workunit.client.0.smithi039.stdout: 10 193030 20.84 MB/sec execute 373 sec latency 86.277 ms 2024-05-09T05:59:37.917 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:59:37 smithi100 ceph-mon[34353]: pgmap v1037: 97 pgs: 97 active+clean; 647 MiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 6.4 MiB/s wr, 383 op/s 2024-05-09T05:59:37.961 INFO:tasks.workunit.client.0.smithi039.stdout: 10 193321 20.82 MB/sec execute 374 sec latency 74.850 ms 2024-05-09T05:59:38.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:59:37 smithi060 ceph-mon[34555]: pgmap v1037: 97 pgs: 97 active+clean; 647 MiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 6.4 MiB/s wr, 383 op/s 2024-05-09T05:59:38.103 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:59:37 smithi039 ceph-mon[30439]: pgmap v1037: 97 pgs: 97 active+clean; 647 MiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 6.4 MiB/s wr, 383 op/s 2024-05-09T05:59:38.961 INFO:tasks.workunit.client.0.smithi039.stdout: 10 193714 20.82 MB/sec execute 375 sec latency 241.126 ms 2024-05-09T05:59:39.917 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:59:39 smithi100 ceph-mon[34353]: pgmap v1038: 97 pgs: 97 active+clean; 622 MiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 5.8 MiB/s wr, 354 op/s 2024-05-09T05:59:39.961 INFO:tasks.workunit.client.0.smithi039.stdout: 10 194219 20.85 MB/sec execute 376 sec latency 78.165 ms 2024-05-09T05:59:40.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:59:39 smithi060 ceph-mon[34555]: pgmap v1038: 97 pgs: 97 active+clean; 622 MiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 5.8 MiB/s wr, 354 op/s 2024-05-09T05:59:40.103 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:59:39 smithi039 ceph-mon[30439]: pgmap v1038: 97 pgs: 97 active+clean; 622 MiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 5.8 MiB/s wr, 354 op/s 2024-05-09T05:59:40.961 INFO:tasks.workunit.client.0.smithi039.stdout: 10 194701 20.85 MB/sec execute 377 sec latency 52.528 ms 2024-05-09T05:59:41.917 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:59:41 smithi100 ceph-mon[34353]: pgmap v1039: 97 pgs: 97 active+clean; 624 MiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 5.2 MiB/s wr, 329 op/s 2024-05-09T05:59:41.961 INFO:tasks.workunit.client.0.smithi039.stdout: 10 195038 20.85 MB/sec execute 378 sec latency 90.315 ms 2024-05-09T05:59:42.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:59:41 smithi060 ceph-mon[34555]: pgmap v1039: 97 pgs: 97 active+clean; 624 MiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 5.2 MiB/s wr, 329 op/s 2024-05-09T05:59:42.103 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:59:41 smithi039 ceph-mon[30439]: pgmap v1039: 97 pgs: 97 active+clean; 624 MiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 5.2 MiB/s wr, 329 op/s 2024-05-09T05:59:42.961 INFO:tasks.workunit.client.0.smithi039.stdout: 10 195415 20.84 MB/sec execute 379 sec latency 91.315 ms 2024-05-09T05:59:43.917 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:59:43 smithi100 ceph-mon[34353]: pgmap v1040: 97 pgs: 97 active+clean; 629 MiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 6.0 MiB/s wr, 396 op/s 2024-05-09T05:59:43.961 INFO:tasks.workunit.client.0.smithi039.stdout: 10 195696 20.82 MB/sec execute 380 sec latency 226.611 ms 2024-05-09T05:59:44.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:59:43 smithi060 ceph-mon[34555]: pgmap v1040: 97 pgs: 97 active+clean; 629 MiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 6.0 MiB/s wr, 396 op/s 2024-05-09T05:59:44.103 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:59:43 smithi039 ceph-mon[30439]: pgmap v1040: 97 pgs: 97 active+clean; 629 MiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 6.0 MiB/s wr, 396 op/s 2024-05-09T05:59:44.961 INFO:tasks.workunit.client.0.smithi039.stdout: 10 196090 20.85 MB/sec execute 381 sec latency 109.774 ms 2024-05-09T05:59:45.917 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:59:45 smithi100 ceph-mon[34353]: pgmap v1041: 97 pgs: 97 active+clean; 632 MiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 5.7 MiB/s wr, 360 op/s 2024-05-09T05:59:45.961 INFO:tasks.workunit.client.0.smithi039.stdout: 10 196484 20.86 MB/sec execute 382 sec latency 80.608 ms 2024-05-09T05:59:46.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:59:45 smithi060 ceph-mon[34555]: pgmap v1041: 97 pgs: 97 active+clean; 632 MiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 5.7 MiB/s wr, 360 op/s 2024-05-09T05:59:46.103 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:59:45 smithi039 ceph-mon[30439]: pgmap v1041: 97 pgs: 97 active+clean; 632 MiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 5.7 MiB/s wr, 360 op/s 2024-05-09T05:59:46.961 INFO:tasks.workunit.client.0.smithi039.stdout: 10 196884 20.83 MB/sec execute 383 sec latency 55.152 ms 2024-05-09T05:59:47.917 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:59:47 smithi100 ceph-mon[34353]: pgmap v1042: 97 pgs: 97 active+clean; 638 MiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 6.3 MiB/s wr, 383 op/s 2024-05-09T05:59:47.961 INFO:tasks.workunit.client.0.smithi039.stdout: 10 197152 20.82 MB/sec execute 384 sec latency 108.730 ms 2024-05-09T05:59:48.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:59:47 smithi060 ceph-mon[34555]: pgmap v1042: 97 pgs: 97 active+clean; 638 MiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 6.3 MiB/s wr, 383 op/s 2024-05-09T05:59:48.103 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:59:47 smithi039 ceph-mon[30439]: pgmap v1042: 97 pgs: 97 active+clean; 638 MiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 6.3 MiB/s wr, 383 op/s 2024-05-09T05:59:48.961 INFO:tasks.workunit.client.0.smithi039.stdout: 10 197568 20.82 MB/sec execute 385 sec latency 252.714 ms 2024-05-09T05:59:49.917 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:59:49 smithi100 ceph-mon[34353]: pgmap v1043: 97 pgs: 97 active+clean; 637 MiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.6 MiB/s wr, 342 op/s 2024-05-09T05:59:49.961 INFO:tasks.workunit.client.0.smithi039.stdout: 10 198038 20.85 MB/sec execute 386 sec latency 120.473 ms 2024-05-09T05:59:50.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:59:49 smithi060 ceph-mon[34555]: pgmap v1043: 97 pgs: 97 active+clean; 637 MiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.6 MiB/s wr, 342 op/s 2024-05-09T05:59:50.103 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:59:49 smithi039 ceph-mon[30439]: pgmap v1043: 97 pgs: 97 active+clean; 637 MiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.6 MiB/s wr, 342 op/s 2024-05-09T05:59:50.961 INFO:tasks.workunit.client.0.smithi039.stdout: 10 198453 20.84 MB/sec execute 387 sec latency 89.019 ms 2024-05-09T05:59:51.917 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:59:51 smithi100 ceph-mon[34353]: pgmap v1044: 97 pgs: 97 active+clean; 637 MiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 5.0 MiB/s wr, 327 op/s 2024-05-09T05:59:51.962 INFO:tasks.workunit.client.0.smithi039.stdout: 10 198810 20.84 MB/sec execute 388 sec latency 55.335 ms 2024-05-09T05:59:52.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:59:51 smithi060 ceph-mon[34555]: pgmap v1044: 97 pgs: 97 active+clean; 637 MiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 5.0 MiB/s wr, 327 op/s 2024-05-09T05:59:52.103 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:59:51 smithi039 ceph-mon[30439]: pgmap v1044: 97 pgs: 97 active+clean; 637 MiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 5.0 MiB/s wr, 327 op/s 2024-05-09T05:59:52.961 INFO:tasks.workunit.client.0.smithi039.stdout: 10 199158 20.83 MB/sec execute 389 sec latency 97.478 ms 2024-05-09T05:59:53.917 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:59:53 smithi100 ceph-mon[34353]: pgmap v1045: 97 pgs: 97 active+clean; 645 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 5.7 MiB/s wr, 397 op/s 2024-05-09T05:59:53.961 INFO:tasks.workunit.client.0.smithi039.stdout: 10 199479 20.82 MB/sec execute 390 sec latency 249.603 ms 2024-05-09T05:59:54.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:59:53 smithi060 ceph-mon[34555]: pgmap v1045: 97 pgs: 97 active+clean; 645 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 5.7 MiB/s wr, 397 op/s 2024-05-09T05:59:54.103 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:59:53 smithi039 ceph-mon[30439]: pgmap v1045: 97 pgs: 97 active+clean; 645 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 5.7 MiB/s wr, 397 op/s 2024-05-09T05:59:54.961 INFO:tasks.workunit.client.0.smithi039.stdout: 10 199937 20.84 MB/sec execute 391 sec latency 92.187 ms 2024-05-09T05:59:55.917 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:59:55 smithi100 ceph-mon[34353]: pgmap v1046: 97 pgs: 97 active+clean; 644 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 4.9 MiB/s wr, 336 op/s 2024-05-09T05:59:55.961 INFO:tasks.workunit.client.0.smithi039.stdout: 10 200291 20.84 MB/sec execute 392 sec latency 69.866 ms 2024-05-09T05:59:56.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:59:55 smithi060 ceph-mon[34555]: pgmap v1046: 97 pgs: 97 active+clean; 644 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 4.9 MiB/s wr, 336 op/s 2024-05-09T05:59:56.103 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:59:55 smithi039 ceph-mon[30439]: pgmap v1046: 97 pgs: 97 active+clean; 644 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 4.9 MiB/s wr, 336 op/s 2024-05-09T05:59:56.961 INFO:tasks.workunit.client.0.smithi039.stdout: 10 200719 20.83 MB/sec execute 393 sec latency 58.806 ms 2024-05-09T05:59:57.917 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:59:57 smithi100 ceph-mon[34353]: pgmap v1047: 97 pgs: 97 active+clean; 647 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 5.9 MiB/s wr, 394 op/s 2024-05-09T05:59:57.962 INFO:tasks.workunit.client.0.smithi039.stdout: 10 200989 20.82 MB/sec execute 394 sec latency 118.208 ms 2024-05-09T05:59:58.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:59:57 smithi060 ceph-mon[34555]: pgmap v1047: 97 pgs: 97 active+clean; 647 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 5.9 MiB/s wr, 394 op/s 2024-05-09T05:59:58.103 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:59:57 smithi039 ceph-mon[30439]: pgmap v1047: 97 pgs: 97 active+clean; 647 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 5.9 MiB/s wr, 394 op/s 2024-05-09T05:59:58.962 INFO:tasks.workunit.client.0.smithi039.stdout: 10 201380 20.81 MB/sec execute 395 sec latency 212.002 ms 2024-05-09T05:59:59.917 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 05:59:59 smithi100 ceph-mon[34353]: pgmap v1048: 97 pgs: 97 active+clean; 649 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 5.0 MiB/s wr, 354 op/s 2024-05-09T05:59:59.962 INFO:tasks.workunit.client.0.smithi039.stdout: 10 201867 20.86 MB/sec execute 396 sec latency 155.128 ms 2024-05-09T06:00:00.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 05:59:59 smithi060 ceph-mon[34555]: pgmap v1048: 97 pgs: 97 active+clean; 649 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 5.0 MiB/s wr, 354 op/s 2024-05-09T06:00:00.103 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 05:59:59 smithi039 ceph-mon[30439]: pgmap v1048: 97 pgs: 97 active+clean; 649 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 5.0 MiB/s wr, 354 op/s 2024-05-09T06:00:00.962 INFO:tasks.workunit.client.0.smithi039.stdout: 10 202256 20.84 MB/sec execute 397 sec latency 78.343 ms 2024-05-09T06:00:01.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:00:00 smithi060 ceph-mon[34555]: overall HEALTH_OK 2024-05-09T06:00:01.103 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:00:00 smithi039 ceph-mon[30439]: overall HEALTH_OK 2024-05-09T06:00:01.167 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:00:00 smithi100 ceph-mon[34353]: overall HEALTH_OK 2024-05-09T06:00:01.962 INFO:tasks.workunit.client.0.smithi039.stdout: 10 202598 20.82 MB/sec execute 398 sec latency 63.938 ms 2024-05-09T06:00:02.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:00:01 smithi060 ceph-mon[34555]: pgmap v1049: 97 pgs: 97 active+clean; 645 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 4.8 MiB/s wr, 339 op/s 2024-05-09T06:00:02.103 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:00:01 smithi039 ceph-mon[30439]: pgmap v1049: 97 pgs: 97 active+clean; 645 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 4.8 MiB/s wr, 339 op/s 2024-05-09T06:00:02.167 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:00:01 smithi100 ceph-mon[34353]: pgmap v1049: 97 pgs: 97 active+clean; 645 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 4.8 MiB/s wr, 339 op/s 2024-05-09T06:00:02.962 INFO:tasks.workunit.client.0.smithi039.stdout: 10 202908 20.81 MB/sec execute 399 sec latency 83.058 ms 2024-05-09T06:00:03.962 INFO:tasks.workunit.client.0.smithi039.stdout: 10 203294 20.80 MB/sec execute 400 sec latency 239.924 ms 2024-05-09T06:00:04.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:00:03 smithi060 ceph-mon[34555]: pgmap v1050: 97 pgs: 97 active+clean; 651 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 5.8 MiB/s wr, 408 op/s 2024-05-09T06:00:04.103 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:00:03 smithi039 ceph-mon[30439]: pgmap v1050: 97 pgs: 97 active+clean; 651 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 5.8 MiB/s wr, 408 op/s 2024-05-09T06:00:04.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:00:03 smithi100 ceph-mon[34353]: pgmap v1050: 97 pgs: 97 active+clean; 651 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 5.8 MiB/s wr, 408 op/s 2024-05-09T06:00:04.962 INFO:tasks.workunit.client.0.smithi039.stdout: 10 203697 20.82 MB/sec execute 401 sec latency 123.260 ms 2024-05-09T06:00:05.962 INFO:tasks.workunit.client.0.smithi039.stdout: 10 204098 20.83 MB/sec execute 402 sec latency 60.724 ms 2024-05-09T06:00:06.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:00:05 smithi060 ceph-mon[34555]: pgmap v1051: 97 pgs: 97 active+clean; 633 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 5.1 MiB/s wr, 337 op/s 2024-05-09T06:00:06.106 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:00:05 smithi039 ceph-mon[30439]: pgmap v1051: 97 pgs: 97 active+clean; 633 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 5.1 MiB/s wr, 337 op/s 2024-05-09T06:00:06.167 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:00:05 smithi100 ceph-mon[34353]: pgmap v1051: 97 pgs: 97 active+clean; 633 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 5.1 MiB/s wr, 337 op/s 2024-05-09T06:00:06.962 INFO:tasks.workunit.client.0.smithi039.stdout: 10 204549 20.82 MB/sec execute 403 sec latency 57.109 ms 2024-05-09T06:00:07.962 INFO:tasks.workunit.client.0.smithi039.stdout: 10 204854 20.81 MB/sec execute 404 sec latency 94.086 ms 2024-05-09T06:00:08.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:00:07 smithi060 ceph-mon[34555]: pgmap v1052: 97 pgs: 97 active+clean; 638 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 6.2 MiB/s wr, 401 op/s 2024-05-09T06:00:08.103 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:00:07 smithi039 ceph-mon[30439]: pgmap v1052: 97 pgs: 97 active+clean; 638 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 6.2 MiB/s wr, 401 op/s 2024-05-09T06:00:08.167 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:00:07 smithi100 ceph-mon[34353]: pgmap v1052: 97 pgs: 97 active+clean; 638 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 6.2 MiB/s wr, 401 op/s 2024-05-09T06:00:08.962 INFO:tasks.workunit.client.0.smithi039.stdout: 10 205226 20.81 MB/sec execute 405 sec latency 275.214 ms 2024-05-09T06:00:09.962 INFO:tasks.workunit.client.0.smithi039.stdout: 10 205617 20.82 MB/sec execute 406 sec latency 158.736 ms 2024-05-09T06:00:09.968 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:00:09 smithi100 ceph-mon[34353]: pgmap v1053: 97 pgs: 97 active+clean; 638 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 5.5 MiB/s wr, 365 op/s 2024-05-09T06:00:10.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:00:09 smithi060 ceph-mon[34555]: pgmap v1053: 97 pgs: 97 active+clean; 638 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 5.5 MiB/s wr, 365 op/s 2024-05-09T06:00:10.103 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:00:09 smithi039 ceph-mon[30439]: pgmap v1053: 97 pgs: 97 active+clean; 638 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 5.5 MiB/s wr, 365 op/s 2024-05-09T06:00:10.962 INFO:tasks.workunit.client.0.smithi039.stdout: 10 205978 20.83 MB/sec execute 407 sec latency 77.005 ms 2024-05-09T06:00:11.962 INFO:tasks.workunit.client.0.smithi039.stdout: 10 206360 20.81 MB/sec execute 408 sec latency 68.785 ms 2024-05-09T06:00:12.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:00:11 smithi060 ceph-mon[34555]: pgmap v1054: 97 pgs: 97 active+clean; 638 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.2 MiB/s wr, 333 op/s 2024-05-09T06:00:12.103 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:00:11 smithi039 ceph-mon[30439]: pgmap v1054: 97 pgs: 97 active+clean; 638 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.2 MiB/s wr, 333 op/s 2024-05-09T06:00:12.167 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:00:11 smithi100 ceph-mon[34353]: pgmap v1054: 97 pgs: 97 active+clean; 638 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.2 MiB/s wr, 333 op/s 2024-05-09T06:00:12.962 INFO:tasks.workunit.client.0.smithi039.stdout: 10 206630 20.79 MB/sec execute 409 sec latency 80.875 ms 2024-05-09T06:00:13.962 INFO:tasks.workunit.client.0.smithi039.stdout: 10 206962 20.78 MB/sec execute 410 sec latency 171.084 ms 2024-05-09T06:00:14.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:00:13 smithi060 ceph-mon[34555]: pgmap v1055: 97 pgs: 97 active+clean; 640 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 5.9 MiB/s wr, 374 op/s 2024-05-09T06:00:14.103 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:00:13 smithi039 ceph-mon[30439]: pgmap v1055: 97 pgs: 97 active+clean; 640 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 5.9 MiB/s wr, 374 op/s 2024-05-09T06:00:14.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:00:13 smithi100 ceph-mon[34353]: pgmap v1055: 97 pgs: 97 active+clean; 640 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 5.9 MiB/s wr, 374 op/s 2024-05-09T06:00:14.962 INFO:tasks.workunit.client.0.smithi039.stdout: 10 207405 20.79 MB/sec execute 411 sec latency 225.755 ms 2024-05-09T06:00:15.963 INFO:tasks.workunit.client.0.smithi039.stdout: 10 207821 20.82 MB/sec execute 412 sec latency 58.757 ms 2024-05-09T06:00:16.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:00:15 smithi060 ceph-mon[34555]: pgmap v1056: 97 pgs: 97 active+clean; 647 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 5.5 MiB/s wr, 366 op/s 2024-05-09T06:00:16.103 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:00:15 smithi039 ceph-mon[30439]: pgmap v1056: 97 pgs: 97 active+clean; 647 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 5.5 MiB/s wr, 366 op/s 2024-05-09T06:00:16.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:00:15 smithi100 ceph-mon[34353]: pgmap v1056: 97 pgs: 97 active+clean; 647 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 5.5 MiB/s wr, 366 op/s 2024-05-09T06:00:16.963 INFO:tasks.workunit.client.0.smithi039.stdout: 10 208290 20.80 MB/sec execute 413 sec latency 74.665 ms 2024-05-09T06:00:17.963 INFO:tasks.workunit.client.0.smithi039.stdout: 10 208618 20.80 MB/sec execute 414 sec latency 60.738 ms 2024-05-09T06:00:18.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:00:17 smithi060 ceph-mon[34555]: pgmap v1057: 97 pgs: 97 active+clean; 648 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 6.1 MiB/s wr, 372 op/s 2024-05-09T06:00:18.103 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:00:17 smithi039 ceph-mon[30439]: pgmap v1057: 97 pgs: 97 active+clean; 648 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 6.1 MiB/s wr, 372 op/s 2024-05-09T06:00:18.167 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:00:17 smithi100 ceph-mon[34353]: pgmap v1057: 97 pgs: 97 active+clean; 648 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 6.1 MiB/s wr, 372 op/s 2024-05-09T06:00:18.963 INFO:tasks.workunit.client.0.smithi039.stdout: 10 208999 20.81 MB/sec execute 415 sec latency 115.205 ms 2024-05-09T06:00:19.963 INFO:tasks.workunit.client.0.smithi039.stdout: 10 209303 20.80 MB/sec execute 416 sec latency 226.419 ms 2024-05-09T06:00:20.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:00:19 smithi060 ceph-mon[34555]: pgmap v1058: 97 pgs: 97 active+clean; 648 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 5.3 MiB/s wr, 311 op/s 2024-05-09T06:00:20.103 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:00:19 smithi039 ceph-mon[30439]: pgmap v1058: 97 pgs: 97 active+clean; 648 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 5.3 MiB/s wr, 311 op/s 2024-05-09T06:00:20.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:00:19 smithi100 ceph-mon[34353]: pgmap v1058: 97 pgs: 97 active+clean; 648 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 5.3 MiB/s wr, 311 op/s 2024-05-09T06:00:20.963 INFO:tasks.workunit.client.0.smithi039.stdout: 10 209699 20.81 MB/sec execute 417 sec latency 205.964 ms 2024-05-09T06:00:21.963 INFO:tasks.workunit.client.0.smithi039.stdout: 10 210045 20.80 MB/sec execute 418 sec latency 86.019 ms 2024-05-09T06:00:22.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:00:21 smithi060 ceph-mon[34555]: pgmap v1059: 97 pgs: 97 active+clean; 651 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 5.2 MiB/s wr, 324 op/s 2024-05-09T06:00:22.103 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:00:21 smithi039 ceph-mon[30439]: pgmap v1059: 97 pgs: 97 active+clean; 651 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 5.2 MiB/s wr, 324 op/s 2024-05-09T06:00:22.167 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:00:21 smithi100 ceph-mon[34353]: pgmap v1059: 97 pgs: 97 active+clean; 651 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 5.2 MiB/s wr, 324 op/s 2024-05-09T06:00:22.963 INFO:tasks.workunit.client.0.smithi039.stdout: 10 210397 20.78 MB/sec execute 419 sec latency 73.553 ms 2024-05-09T06:00:23.963 INFO:tasks.workunit.client.0.smithi039.stdout: 10 210762 20.78 MB/sec execute 420 sec latency 95.350 ms 2024-05-09T06:00:24.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:00:23 smithi060 ceph-mon[34555]: pgmap v1060: 97 pgs: 97 active+clean; 654 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 5.8 MiB/s wr, 371 op/s 2024-05-09T06:00:24.103 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:00:23 smithi039 ceph-mon[30439]: pgmap v1060: 97 pgs: 97 active+clean; 654 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 5.8 MiB/s wr, 371 op/s 2024-05-09T06:00:24.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:00:23 smithi100 ceph-mon[34353]: pgmap v1060: 97 pgs: 97 active+clean; 654 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 5.8 MiB/s wr, 371 op/s 2024-05-09T06:00:24.963 INFO:tasks.workunit.client.0.smithi039.stdout: 10 211053 20.77 MB/sec execute 421 sec latency 244.597 ms 2024-05-09T06:00:25.963 INFO:tasks.workunit.client.0.smithi039.stdout: 10 211557 20.78 MB/sec execute 422 sec latency 73.585 ms 2024-05-09T06:00:26.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:00:25 smithi060 ceph-mon[34555]: pgmap v1061: 97 pgs: 97 active+clean; 642 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 5.6 MiB/s wr, 381 op/s 2024-05-09T06:00:26.103 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:00:25 smithi039 ceph-mon[30439]: pgmap v1061: 97 pgs: 97 active+clean; 642 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 5.6 MiB/s wr, 381 op/s 2024-05-09T06:00:26.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:00:25 smithi100 ceph-mon[34353]: pgmap v1061: 97 pgs: 97 active+clean; 642 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 5.6 MiB/s wr, 381 op/s 2024-05-09T06:00:26.963 INFO:tasks.workunit.client.0.smithi039.stdout: 10 211961 20.79 MB/sec execute 423 sec latency 78.975 ms 2024-05-09T06:00:27.963 INFO:tasks.workunit.client.0.smithi039.stdout: 10 212366 20.78 MB/sec execute 424 sec latency 70.603 ms 2024-05-09T06:00:28.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:00:27 smithi060 ceph-mon[34555]: pgmap v1062: 97 pgs: 97 active+clean; 635 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.4 MiB/s wr, 357 op/s 2024-05-09T06:00:28.103 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:00:27 smithi039 ceph-mon[30439]: pgmap v1062: 97 pgs: 97 active+clean; 635 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.4 MiB/s wr, 357 op/s 2024-05-09T06:00:28.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:00:27 smithi100 ceph-mon[34353]: pgmap v1062: 97 pgs: 97 active+clean; 635 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.4 MiB/s wr, 357 op/s 2024-05-09T06:00:28.963 INFO:tasks.workunit.client.0.smithi039.stdout: 10 212808 20.81 MB/sec execute 425 sec latency 76.951 ms 2024-05-09T06:00:29.963 INFO:tasks.workunit.client.0.smithi039.stdout: 10 213076 20.79 MB/sec execute 426 sec latency 291.345 ms 2024-05-09T06:00:30.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:00:29 smithi060 ceph-mon[34555]: pgmap v1063: 97 pgs: 97 active+clean; 638 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.4 MiB/s wr, 361 op/s 2024-05-09T06:00:30.103 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:00:29 smithi039 ceph-mon[30439]: pgmap v1063: 97 pgs: 97 active+clean; 638 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.4 MiB/s wr, 361 op/s 2024-05-09T06:00:30.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:00:29 smithi100 ceph-mon[34353]: pgmap v1063: 97 pgs: 97 active+clean; 638 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.4 MiB/s wr, 361 op/s 2024-05-09T06:00:30.963 INFO:tasks.workunit.client.0.smithi039.stdout: 10 213461 20.79 MB/sec execute 427 sec latency 155.620 ms 2024-05-09T06:00:31.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:00:30 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:00:31.103 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:00:30 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:00:31.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:00:30 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:00:31.963 INFO:tasks.workunit.client.0.smithi039.stdout: 10 213814 20.79 MB/sec execute 428 sec latency 66.995 ms 2024-05-09T06:00:32.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:00:31 smithi060 ceph-mon[34555]: pgmap v1064: 97 pgs: 97 active+clean; 640 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.3 MiB/s wr, 352 op/s 2024-05-09T06:00:32.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:00:31 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:00:32.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:00:31 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:00:32.040 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:00:31 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T06:00:32.103 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:00:31 smithi039 ceph-mon[30439]: pgmap v1064: 97 pgs: 97 active+clean; 640 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.3 MiB/s wr, 352 op/s 2024-05-09T06:00:32.104 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:00:31 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:00:32.104 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:00:31 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:00:32.104 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:00:31 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T06:00:32.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:00:31 smithi100 ceph-mon[34353]: pgmap v1064: 97 pgs: 97 active+clean; 640 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.3 MiB/s wr, 352 op/s 2024-05-09T06:00:32.167 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:00:31 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:00:32.167 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:00:31 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:00:32.167 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:00:31 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T06:00:32.963 INFO:tasks.workunit.client.0.smithi039.stdout: 10 214179 20.77 MB/sec execute 429 sec latency 113.594 ms 2024-05-09T06:00:33.963 INFO:tasks.workunit.client.0.smithi039.stdout: 10 214552 20.76 MB/sec execute 430 sec latency 117.663 ms 2024-05-09T06:00:34.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:00:33 smithi060 ceph-mon[34555]: pgmap v1065: 97 pgs: 97 active+clean; 645 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 6.0 MiB/s wr, 376 op/s 2024-05-09T06:00:34.103 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:00:33 smithi039 ceph-mon[30439]: pgmap v1065: 97 pgs: 97 active+clean; 645 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 6.0 MiB/s wr, 376 op/s 2024-05-09T06:00:34.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:00:33 smithi100 ceph-mon[34353]: pgmap v1065: 97 pgs: 97 active+clean; 645 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 6.0 MiB/s wr, 376 op/s 2024-05-09T06:00:34.963 INFO:tasks.workunit.client.0.smithi039.stdout: 10 214819 20.75 MB/sec execute 431 sec latency 317.701 ms 2024-05-09T06:00:35.963 INFO:tasks.workunit.client.0.smithi039.stdout: 10 215274 20.77 MB/sec execute 432 sec latency 82.261 ms 2024-05-09T06:00:36.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:00:35 smithi060 ceph-mon[34555]: pgmap v1066: 97 pgs: 97 active+clean; 647 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.5 MiB/s wr, 354 op/s 2024-05-09T06:00:36.103 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:00:35 smithi039 ceph-mon[30439]: pgmap v1066: 97 pgs: 97 active+clean; 647 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.5 MiB/s wr, 354 op/s 2024-05-09T06:00:36.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:00:35 smithi100 ceph-mon[34353]: pgmap v1066: 97 pgs: 97 active+clean; 647 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.5 MiB/s wr, 354 op/s 2024-05-09T06:00:36.963 INFO:tasks.workunit.client.0.smithi039.stdout: 10 215701 20.78 MB/sec execute 433 sec latency 78.570 ms 2024-05-09T06:00:37.964 INFO:tasks.workunit.client.0.smithi039.stdout: 10 216071 20.77 MB/sec execute 434 sec latency 121.709 ms 2024-05-09T06:00:38.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:00:37 smithi060 ceph-mon[34555]: pgmap v1067: 97 pgs: 97 active+clean; 648 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.5 MiB/s wr, 343 op/s 2024-05-09T06:00:38.103 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:00:37 smithi039 ceph-mon[30439]: pgmap v1067: 97 pgs: 97 active+clean; 648 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.5 MiB/s wr, 343 op/s 2024-05-09T06:00:38.167 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:00:37 smithi100 ceph-mon[34353]: pgmap v1067: 97 pgs: 97 active+clean; 648 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.5 MiB/s wr, 343 op/s 2024-05-09T06:00:38.963 INFO:tasks.workunit.client.0.smithi039.stdout: 10 216549 20.77 MB/sec execute 435 sec latency 64.639 ms 2024-05-09T06:00:39.963 INFO:tasks.workunit.client.0.smithi039.stdout: 10 216799 20.77 MB/sec execute 436 sec latency 233.095 ms 2024-05-09T06:00:40.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:00:39 smithi060 ceph-mon[34555]: pgmap v1068: 97 pgs: 97 active+clean; 653 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.8 MiB/s wr, 354 op/s 2024-05-09T06:00:40.103 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:00:39 smithi039 ceph-mon[30439]: pgmap v1068: 97 pgs: 97 active+clean; 653 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.8 MiB/s wr, 354 op/s 2024-05-09T06:00:40.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:00:39 smithi100 ceph-mon[34353]: pgmap v1068: 97 pgs: 97 active+clean; 653 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.8 MiB/s wr, 354 op/s 2024-05-09T06:00:40.963 INFO:tasks.workunit.client.0.smithi039.stdout: 10 217166 20.78 MB/sec execute 437 sec latency 148.585 ms 2024-05-09T06:00:41.964 INFO:tasks.workunit.client.0.smithi039.stdout: 10 217560 20.78 MB/sec execute 438 sec latency 80.090 ms 2024-05-09T06:00:42.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:00:41 smithi060 ceph-mon[34555]: pgmap v1069: 97 pgs: 97 active+clean; 653 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 5.2 MiB/s wr, 325 op/s 2024-05-09T06:00:42.103 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:00:41 smithi039 ceph-mon[30439]: pgmap v1069: 97 pgs: 97 active+clean; 653 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 5.2 MiB/s wr, 325 op/s 2024-05-09T06:00:42.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:00:41 smithi100 ceph-mon[34353]: pgmap v1069: 97 pgs: 97 active+clean; 653 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 5.2 MiB/s wr, 325 op/s 2024-05-09T06:00:42.964 INFO:tasks.workunit.client.0.smithi039.stdout: 10 217915 20.77 MB/sec execute 439 sec latency 80.560 ms 2024-05-09T06:00:43.964 INFO:tasks.workunit.client.0.smithi039.stdout: 10 218262 20.75 MB/sec execute 440 sec latency 72.029 ms 2024-05-09T06:00:44.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:00:43 smithi060 ceph-mon[34555]: pgmap v1070: 97 pgs: 97 active+clean; 660 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 6.1 MiB/s wr, 388 op/s 2024-05-09T06:00:44.103 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:00:43 smithi039 ceph-mon[30439]: pgmap v1070: 97 pgs: 97 active+clean; 660 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 6.1 MiB/s wr, 388 op/s 2024-05-09T06:00:44.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:00:43 smithi100 ceph-mon[34353]: pgmap v1070: 97 pgs: 97 active+clean; 660 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 6.1 MiB/s wr, 388 op/s 2024-05-09T06:00:44.964 INFO:tasks.workunit.client.0.smithi039.stdout: 10 218617 20.75 MB/sec execute 441 sec latency 285.313 ms 2024-05-09T06:00:45.964 INFO:tasks.workunit.client.0.smithi039.stdout: 10 218969 20.75 MB/sec execute 442 sec latency 130.708 ms 2024-05-09T06:00:46.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:00:45 smithi060 ceph-mon[34555]: pgmap v1071: 97 pgs: 97 active+clean; 661 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 5.4 MiB/s wr, 346 op/s 2024-05-09T06:00:46.103 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:00:45 smithi039 ceph-mon[30439]: pgmap v1071: 97 pgs: 97 active+clean; 661 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 5.4 MiB/s wr, 346 op/s 2024-05-09T06:00:46.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:00:45 smithi100 ceph-mon[34353]: pgmap v1071: 97 pgs: 97 active+clean; 661 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 5.4 MiB/s wr, 346 op/s 2024-05-09T06:00:46.964 INFO:tasks.workunit.client.0.smithi039.stdout: 10 219448 20.76 MB/sec execute 443 sec latency 54.896 ms 2024-05-09T06:00:47.964 INFO:tasks.workunit.client.0.smithi039.stdout: 10 219820 20.76 MB/sec execute 444 sec latency 92.373 ms 2024-05-09T06:00:48.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:00:47 smithi060 ceph-mon[34555]: pgmap v1072: 97 pgs: 97 active+clean; 657 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 6.2 MiB/s wr, 388 op/s 2024-05-09T06:00:48.103 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:00:47 smithi039 ceph-mon[30439]: pgmap v1072: 97 pgs: 97 active+clean; 657 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 6.2 MiB/s wr, 388 op/s 2024-05-09T06:00:48.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:00:47 smithi100 ceph-mon[34353]: pgmap v1072: 97 pgs: 97 active+clean; 657 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 6.2 MiB/s wr, 388 op/s 2024-05-09T06:00:48.964 INFO:tasks.workunit.client.0.smithi039.stdout: 10 220216 20.76 MB/sec execute 445 sec latency 90.678 ms 2024-05-09T06:00:49.964 INFO:tasks.workunit.client.0.smithi039.stdout: 10 220552 20.75 MB/sec execute 446 sec latency 368.578 ms 2024-05-09T06:00:50.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:00:49 smithi060 ceph-mon[34555]: pgmap v1073: 97 pgs: 97 active+clean; 645 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 5.8 MiB/s wr, 354 op/s 2024-05-09T06:00:50.103 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:00:49 smithi039 ceph-mon[30439]: pgmap v1073: 97 pgs: 97 active+clean; 645 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 5.8 MiB/s wr, 354 op/s 2024-05-09T06:00:50.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:00:49 smithi100 ceph-mon[34353]: pgmap v1073: 97 pgs: 97 active+clean; 645 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 5.8 MiB/s wr, 354 op/s 2024-05-09T06:00:50.964 INFO:tasks.workunit.client.0.smithi039.stdout: 10 220945 20.76 MB/sec execute 447 sec latency 430.065 ms 2024-05-09T06:00:51.964 INFO:tasks.workunit.client.0.smithi039.stdout: 10 221348 20.77 MB/sec execute 448 sec latency 139.382 ms 2024-05-09T06:00:52.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:00:51 smithi060 ceph-mon[34555]: pgmap v1074: 97 pgs: 97 active+clean; 646 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 5.5 MiB/s wr, 321 op/s 2024-05-09T06:00:52.103 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:00:51 smithi039 ceph-mon[30439]: pgmap v1074: 97 pgs: 97 active+clean; 646 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 5.5 MiB/s wr, 321 op/s 2024-05-09T06:00:52.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:00:51 smithi100 ceph-mon[34353]: pgmap v1074: 97 pgs: 97 active+clean; 646 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 5.5 MiB/s wr, 321 op/s 2024-05-09T06:00:52.966 INFO:tasks.workunit.client.0.smithi039.stdout: 10 221722 20.76 MB/sec execute 449 sec latency 109.412 ms 2024-05-09T06:00:53.964 INFO:tasks.workunit.client.0.smithi039.stdout: 10 222081 20.75 MB/sec execute 450 sec latency 76.631 ms 2024-05-09T06:00:54.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:00:53 smithi060 ceph-mon[34555]: pgmap v1075: 97 pgs: 97 active+clean; 652 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 6.4 MiB/s wr, 393 op/s 2024-05-09T06:00:54.103 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:00:53 smithi039 ceph-mon[30439]: pgmap v1075: 97 pgs: 97 active+clean; 652 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 6.4 MiB/s wr, 393 op/s 2024-05-09T06:00:54.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:00:53 smithi100 ceph-mon[34353]: pgmap v1075: 97 pgs: 97 active+clean; 652 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 6.4 MiB/s wr, 393 op/s 2024-05-09T06:00:54.964 INFO:tasks.workunit.client.0.smithi039.stdout: 10 222457 20.75 MB/sec execute 451 sec latency 247.746 ms 2024-05-09T06:00:55.964 INFO:tasks.workunit.client.0.smithi039.stdout: 10 222911 20.77 MB/sec execute 452 sec latency 259.783 ms 2024-05-09T06:00:56.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:00:55 smithi060 ceph-mon[34555]: pgmap v1076: 97 pgs: 97 active+clean; 653 MiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.5 MiB/s wr, 350 op/s 2024-05-09T06:00:56.103 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:00:55 smithi039 ceph-mon[30439]: pgmap v1076: 97 pgs: 97 active+clean; 653 MiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.5 MiB/s wr, 350 op/s 2024-05-09T06:00:56.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:00:55 smithi100 ceph-mon[34353]: pgmap v1076: 97 pgs: 97 active+clean; 653 MiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.5 MiB/s wr, 350 op/s 2024-05-09T06:00:56.964 INFO:tasks.workunit.client.0.smithi039.stdout: 10 223279 20.76 MB/sec execute 453 sec latency 139.238 ms 2024-05-09T06:00:57.964 INFO:tasks.workunit.client.0.smithi039.stdout: 10 223681 20.76 MB/sec execute 454 sec latency 81.237 ms 2024-05-09T06:00:58.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:00:57 smithi060 ceph-mon[34555]: pgmap v1077: 97 pgs: 97 active+clean; 653 MiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 5.8 MiB/s wr, 392 op/s 2024-05-09T06:00:58.103 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:00:57 smithi039 ceph-mon[30439]: pgmap v1077: 97 pgs: 97 active+clean; 653 MiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 5.8 MiB/s wr, 392 op/s 2024-05-09T06:00:58.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:00:57 smithi100 ceph-mon[34353]: pgmap v1077: 97 pgs: 97 active+clean; 653 MiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 5.8 MiB/s wr, 392 op/s 2024-05-09T06:00:58.964 INFO:tasks.workunit.client.0.smithi039.stdout: 10 224025 20.76 MB/sec execute 455 sec latency 87.674 ms 2024-05-09T06:00:59.964 INFO:tasks.workunit.client.0.smithi039.stdout: 10 224406 20.75 MB/sec execute 456 sec latency 182.781 ms 2024-05-09T06:01:00.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:00:59 smithi060 ceph-mon[34555]: pgmap v1078: 97 pgs: 97 active+clean; 654 MiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 5.1 MiB/s wr, 328 op/s 2024-05-09T06:01:00.103 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:00:59 smithi039 ceph-mon[30439]: pgmap v1078: 97 pgs: 97 active+clean; 654 MiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 5.1 MiB/s wr, 328 op/s 2024-05-09T06:01:00.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:00:59 smithi100 ceph-mon[34353]: pgmap v1078: 97 pgs: 97 active+clean; 654 MiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 5.1 MiB/s wr, 328 op/s 2024-05-09T06:01:00.964 INFO:tasks.workunit.client.0.smithi039.stdout: 10 224820 20.77 MB/sec execute 457 sec latency 264.934 ms 2024-05-09T06:01:01.917 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:01:01 smithi100 ceph-mon[34353]: pgmap v1079: 97 pgs: 97 active+clean; 661 MiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 5.4 MiB/s wr, 371 op/s 2024-05-09T06:01:01.964 INFO:tasks.workunit.client.0.smithi039.stdout: 10 225144 20.75 MB/sec execute 458 sec latency 113.486 ms 2024-05-09T06:01:02.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:01:01 smithi060 ceph-mon[34555]: pgmap v1079: 97 pgs: 97 active+clean; 661 MiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 5.4 MiB/s wr, 371 op/s 2024-05-09T06:01:02.103 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:01:01 smithi039 ceph-mon[30439]: pgmap v1079: 97 pgs: 97 active+clean; 661 MiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 5.4 MiB/s wr, 371 op/s 2024-05-09T06:01:02.964 INFO:tasks.workunit.client.0.smithi039.stdout: 10 225555 20.75 MB/sec execute 459 sec latency 73.503 ms 2024-05-09T06:01:03.964 INFO:tasks.workunit.client.0.smithi039.stdout: 10 225921 20.75 MB/sec execute 460 sec latency 96.262 ms 2024-05-09T06:01:04.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:01:03 smithi060 ceph-mon[34555]: pgmap v1080: 97 pgs: 97 active+clean; 662 MiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 5.6 MiB/s wr, 392 op/s 2024-05-09T06:01:04.103 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:01:03 smithi039 ceph-mon[30439]: pgmap v1080: 97 pgs: 97 active+clean; 662 MiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 5.6 MiB/s wr, 392 op/s 2024-05-09T06:01:04.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:01:03 smithi100 ceph-mon[34353]: pgmap v1080: 97 pgs: 97 active+clean; 662 MiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 MiB/s rd, 5.6 MiB/s wr, 392 op/s 2024-05-09T06:01:04.964 INFO:tasks.workunit.client.0.smithi039.stdout: 10 226350 20.76 MB/sec execute 461 sec latency 107.467 ms 2024-05-09T06:01:05.964 INFO:tasks.workunit.client.0.smithi039.stdout: 10 226672 20.76 MB/sec execute 462 sec latency 242.973 ms 2024-05-09T06:01:06.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:01:05 smithi060 ceph-mon[34555]: pgmap v1081: 97 pgs: 97 active+clean; 667 MiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 5.4 MiB/s wr, 374 op/s 2024-05-09T06:01:06.103 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:01:05 smithi039 ceph-mon[30439]: pgmap v1081: 97 pgs: 97 active+clean; 667 MiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 5.4 MiB/s wr, 374 op/s 2024-05-09T06:01:06.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:01:05 smithi100 ceph-mon[34353]: pgmap v1081: 97 pgs: 97 active+clean; 667 MiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 5.4 MiB/s wr, 374 op/s 2024-05-09T06:01:06.964 INFO:tasks.workunit.client.0.smithi039.stdout: 10 227051 20.76 MB/sec execute 463 sec latency 84.074 ms 2024-05-09T06:01:07.964 INFO:tasks.workunit.client.0.smithi039.stdout: 10 227400 20.75 MB/sec execute 464 sec latency 87.089 ms 2024-05-09T06:01:08.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:01:07 smithi060 ceph-mon[34555]: pgmap v1082: 97 pgs: 97 active+clean; 666 MiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 5.8 MiB/s wr, 393 op/s 2024-05-09T06:01:08.103 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:01:07 smithi039 ceph-mon[30439]: pgmap v1082: 97 pgs: 97 active+clean; 666 MiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 5.8 MiB/s wr, 393 op/s 2024-05-09T06:01:08.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:01:07 smithi100 ceph-mon[34353]: pgmap v1082: 97 pgs: 97 active+clean; 666 MiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 5.8 MiB/s wr, 393 op/s 2024-05-09T06:01:08.964 INFO:tasks.workunit.client.0.smithi039.stdout: 10 227845 20.75 MB/sec execute 465 sec latency 81.013 ms 2024-05-09T06:01:09.964 INFO:tasks.workunit.client.0.smithi039.stdout: 10 228219 20.75 MB/sec execute 466 sec latency 111.165 ms 2024-05-09T06:01:10.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:01:09 smithi060 ceph-mon[34555]: pgmap v1083: 97 pgs: 97 active+clean; 670 MiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 5.7 MiB/s wr, 373 op/s 2024-05-09T06:01:10.103 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:01:09 smithi039 ceph-mon[30439]: pgmap v1083: 97 pgs: 97 active+clean; 670 MiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 5.7 MiB/s wr, 373 op/s 2024-05-09T06:01:10.167 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:01:09 smithi100 ceph-mon[34353]: pgmap v1083: 97 pgs: 97 active+clean; 670 MiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 5.7 MiB/s wr, 373 op/s 2024-05-09T06:01:10.965 INFO:tasks.workunit.client.0.smithi039.stdout: 10 228418 20.74 MB/sec execute 467 sec latency 293.922 ms 2024-05-09T06:01:11.964 INFO:tasks.workunit.client.0.smithi039.stdout: 10 228721 20.73 MB/sec execute 468 sec latency 137.230 ms 2024-05-09T06:01:12.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:01:11 smithi060 ceph-mon[34555]: pgmap v1084: 97 pgs: 97 active+clean; 672 MiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.5 MiB/s wr, 377 op/s 2024-05-09T06:01:12.104 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:01:11 smithi039 ceph-mon[30439]: pgmap v1084: 97 pgs: 97 active+clean; 672 MiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.5 MiB/s wr, 377 op/s 2024-05-09T06:01:12.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:01:11 smithi100 ceph-mon[34353]: pgmap v1084: 97 pgs: 97 active+clean; 672 MiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.5 MiB/s wr, 377 op/s 2024-05-09T06:01:12.965 INFO:tasks.workunit.client.0.smithi039.stdout: 10 229138 20.72 MB/sec execute 469 sec latency 91.657 ms 2024-05-09T06:01:13.965 INFO:tasks.workunit.client.0.smithi039.stdout: 10 229678 20.74 MB/sec execute 470 sec latency 77.135 ms 2024-05-09T06:01:14.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:01:13 smithi060 ceph-mon[34555]: pgmap v1085: 97 pgs: 97 active+clean; 669 MiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.4 MiB/s wr, 362 op/s 2024-05-09T06:01:14.104 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:01:13 smithi039 ceph-mon[30439]: pgmap v1085: 97 pgs: 97 active+clean; 669 MiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.4 MiB/s wr, 362 op/s 2024-05-09T06:01:14.537 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:01:13 smithi100 ceph-mon[34353]: pgmap v1085: 97 pgs: 97 active+clean; 669 MiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.4 MiB/s wr, 362 op/s 2024-05-09T06:01:14.965 INFO:tasks.workunit.client.0.smithi039.stdout: 10 230148 20.76 MB/sec execute 471 sec latency 74.614 ms 2024-05-09T06:01:15.965 INFO:tasks.workunit.client.0.smithi039.stdout: 10 230451 20.75 MB/sec execute 472 sec latency 267.418 ms 2024-05-09T06:01:16.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:01:15 smithi060 ceph-mon[34555]: pgmap v1086: 97 pgs: 97 active+clean; 665 MiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 5.2 MiB/s wr, 372 op/s 2024-05-09T06:01:16.103 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:01:15 smithi039 ceph-mon[30439]: pgmap v1086: 97 pgs: 97 active+clean; 665 MiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 5.2 MiB/s wr, 372 op/s 2024-05-09T06:01:16.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:01:15 smithi100 ceph-mon[34353]: pgmap v1086: 97 pgs: 97 active+clean; 665 MiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 5.2 MiB/s wr, 372 op/s 2024-05-09T06:01:16.965 INFO:tasks.workunit.client.0.smithi039.stdout: 10 230820 20.74 MB/sec execute 473 sec latency 114.894 ms 2024-05-09T06:01:17.965 INFO:tasks.workunit.client.0.smithi039.stdout: 10 231243 20.75 MB/sec execute 474 sec latency 53.330 ms 2024-05-09T06:01:18.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:01:17 smithi060 ceph-mon[34555]: pgmap v1087: 97 pgs: 97 active+clean; 652 MiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 5.2 MiB/s wr, 356 op/s 2024-05-09T06:01:18.103 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:01:17 smithi039 ceph-mon[30439]: pgmap v1087: 97 pgs: 97 active+clean; 652 MiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 5.2 MiB/s wr, 356 op/s 2024-05-09T06:01:18.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:01:17 smithi100 ceph-mon[34353]: pgmap v1087: 97 pgs: 97 active+clean; 652 MiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 5.2 MiB/s wr, 356 op/s 2024-05-09T06:01:18.965 INFO:tasks.workunit.client.0.smithi039.stdout: 10 231792 20.77 MB/sec execute 475 sec latency 58.199 ms 2024-05-09T06:01:19.965 INFO:tasks.workunit.client.0.smithi039.stdout: 10 232115 20.76 MB/sec execute 476 sec latency 163.880 ms 2024-05-09T06:01:20.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:01:19 smithi060 ceph-mon[34555]: pgmap v1088: 97 pgs: 97 active+clean; 658 MiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 MiB/s rd, 5.6 MiB/s wr, 386 op/s 2024-05-09T06:01:20.103 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:01:19 smithi039 ceph-mon[30439]: pgmap v1088: 97 pgs: 97 active+clean; 658 MiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 MiB/s rd, 5.6 MiB/s wr, 386 op/s 2024-05-09T06:01:20.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:01:19 smithi100 ceph-mon[34353]: pgmap v1088: 97 pgs: 97 active+clean; 658 MiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 MiB/s rd, 5.6 MiB/s wr, 386 op/s 2024-05-09T06:01:20.965 INFO:tasks.workunit.client.0.smithi039.stdout: 10 232310 20.74 MB/sec execute 477 sec latency 317.401 ms 2024-05-09T06:01:21.965 INFO:tasks.workunit.client.0.smithi039.stdout: 10 232563 20.72 MB/sec execute 478 sec latency 148.998 ms 2024-05-09T06:01:22.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:01:21 smithi060 ceph-mon[34555]: pgmap v1089: 97 pgs: 97 active+clean; 660 MiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 5.3 MiB/s wr, 344 op/s 2024-05-09T06:01:22.103 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:01:21 smithi039 ceph-mon[30439]: pgmap v1089: 97 pgs: 97 active+clean; 660 MiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 5.3 MiB/s wr, 344 op/s 2024-05-09T06:01:22.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:01:21 smithi100 ceph-mon[34353]: pgmap v1089: 97 pgs: 97 active+clean; 660 MiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 5.3 MiB/s wr, 344 op/s 2024-05-09T06:01:22.965 INFO:tasks.workunit.client.0.smithi039.stdout: 10 233016 20.73 MB/sec execute 479 sec latency 81.809 ms 2024-05-09T06:01:23.965 INFO:tasks.workunit.client.0.smithi039.stdout: 10 233515 20.73 MB/sec execute 480 sec latency 124.114 ms 2024-05-09T06:01:24.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:01:23 smithi060 ceph-mon[34555]: pgmap v1090: 97 pgs: 97 active+clean; 661 MiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 MiB/s rd, 5.8 MiB/s wr, 368 op/s 2024-05-09T06:01:24.103 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:01:23 smithi039 ceph-mon[30439]: pgmap v1090: 97 pgs: 97 active+clean; 661 MiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 MiB/s rd, 5.8 MiB/s wr, 368 op/s 2024-05-09T06:01:24.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:01:23 smithi100 ceph-mon[34353]: pgmap v1090: 97 pgs: 97 active+clean; 661 MiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 MiB/s rd, 5.8 MiB/s wr, 368 op/s 2024-05-09T06:01:24.965 INFO:tasks.workunit.client.0.smithi039.stdout: 10 233898 20.74 MB/sec execute 481 sec latency 79.096 ms 2024-05-09T06:01:25.965 INFO:tasks.workunit.client.0.smithi039.stdout: 10 234180 20.73 MB/sec execute 482 sec latency 286.550 ms 2024-05-09T06:01:26.103 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:01:25 smithi039 ceph-mon[30439]: pgmap v1091: 97 pgs: 97 active+clean; 667 MiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 MiB/s rd, 5.9 MiB/s wr, 392 op/s 2024-05-09T06:01:26.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:01:25 smithi100 ceph-mon[34353]: pgmap v1091: 97 pgs: 97 active+clean; 667 MiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 MiB/s rd, 5.9 MiB/s wr, 392 op/s 2024-05-09T06:01:26.289 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:01:25 smithi060 ceph-mon[34555]: pgmap v1091: 97 pgs: 97 active+clean; 667 MiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 MiB/s rd, 5.9 MiB/s wr, 392 op/s 2024-05-09T06:01:26.965 INFO:tasks.workunit.client.0.smithi039.stdout: 10 234481 20.72 MB/sec execute 483 sec latency 146.565 ms 2024-05-09T06:01:27.103 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:01:26 smithi039 ceph-mon[30439]: pgmap v1092: 97 pgs: 97 active+clean; 669 MiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 MiB/s rd, 6.2 MiB/s wr, 370 op/s 2024-05-09T06:01:27.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:01:26 smithi100 ceph-mon[34353]: pgmap v1092: 97 pgs: 97 active+clean; 669 MiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 MiB/s rd, 6.2 MiB/s wr, 370 op/s 2024-05-09T06:01:27.290 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:01:26 smithi060 ceph-mon[34555]: pgmap v1092: 97 pgs: 97 active+clean; 669 MiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 MiB/s rd, 6.2 MiB/s wr, 370 op/s 2024-05-09T06:01:27.965 INFO:tasks.workunit.client.0.smithi039.stdout: 10 234860 20.72 MB/sec execute 484 sec latency 67.652 ms 2024-05-09T06:01:28.965 INFO:tasks.workunit.client.0.smithi039.stdout: 10 235298 20.73 MB/sec execute 485 sec latency 83.691 ms 2024-05-09T06:01:29.916 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:01:29 smithi100 ceph-mon[34353]: pgmap v1093: 97 pgs: 97 active+clean; 670 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 6.0 MiB/s wr, 361 op/s 2024-05-09T06:01:29.965 INFO:tasks.workunit.client.0.smithi039.stdout: 10 235712 20.74 MB/sec execute 486 sec latency 97.233 ms 2024-05-09T06:01:30.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:01:29 smithi060 ceph-mon[34555]: pgmap v1093: 97 pgs: 97 active+clean; 670 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 6.0 MiB/s wr, 361 op/s 2024-05-09T06:01:30.103 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:01:29 smithi039 ceph-mon[30439]: pgmap v1093: 97 pgs: 97 active+clean; 670 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 6.0 MiB/s wr, 361 op/s 2024-05-09T06:01:30.965 INFO:tasks.workunit.client.0.smithi039.stdout: 10 235963 20.72 MB/sec execute 487 sec latency 246.954 ms 2024-05-09T06:01:31.916 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:01:31 smithi100 ceph-mon[34353]: pgmap v1094: 97 pgs: 97 active+clean; 672 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.3 MiB/s wr, 340 op/s 2024-05-09T06:01:31.965 INFO:tasks.workunit.client.0.smithi039.stdout: 10 236216 20.70 MB/sec execute 488 sec latency 128.617 ms 2024-05-09T06:01:32.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:01:31 smithi060 ceph-mon[34555]: pgmap v1094: 97 pgs: 97 active+clean; 672 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.3 MiB/s wr, 340 op/s 2024-05-09T06:01:32.103 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:01:31 smithi039 ceph-mon[30439]: pgmap v1094: 97 pgs: 97 active+clean; 672 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.3 MiB/s wr, 340 op/s 2024-05-09T06:01:32.916 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:01:32 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:01:32.917 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:01:32 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:01:32.917 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:01:32 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:01:32.917 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:01:32 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T06:01:32.965 INFO:tasks.workunit.client.0.smithi039.stdout: 10 236558 20.70 MB/sec execute 489 sec latency 101.546 ms 2024-05-09T06:01:33.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:01:32 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:01:33.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:01:32 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:01:33.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:01:32 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:01:33.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:01:32 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T06:01:33.103 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:01:32 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:01:33.103 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:01:32 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:01:33.103 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:01:32 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:01:33.103 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:01:32 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T06:01:33.916 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:01:33 smithi100 ceph-mon[34353]: pgmap v1095: 97 pgs: 97 active+clean; 673 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 5.5 MiB/s wr, 368 op/s 2024-05-09T06:01:33.965 INFO:tasks.workunit.client.0.smithi039.stdout: 10 237125 20.71 MB/sec execute 490 sec latency 50.770 ms 2024-05-09T06:01:34.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:01:33 smithi060 ceph-mon[34555]: pgmap v1095: 97 pgs: 97 active+clean; 673 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 5.5 MiB/s wr, 368 op/s 2024-05-09T06:01:34.103 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:01:33 smithi039 ceph-mon[30439]: pgmap v1095: 97 pgs: 97 active+clean; 673 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 5.5 MiB/s wr, 368 op/s 2024-05-09T06:01:34.965 INFO:tasks.workunit.client.0.smithi039.stdout: 10 237610 20.72 MB/sec execute 491 sec latency 128.907 ms 2024-05-09T06:01:35.916 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:01:35 smithi100 ceph-mon[34353]: pgmap v1096: 97 pgs: 97 active+clean; 678 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 5.6 MiB/s wr, 386 op/s 2024-05-09T06:01:35.965 INFO:tasks.workunit.client.0.smithi039.stdout: 10 237864 20.71 MB/sec execute 492 sec latency 232.842 ms 2024-05-09T06:01:36.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:01:35 smithi060 ceph-mon[34555]: pgmap v1096: 97 pgs: 97 active+clean; 678 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 5.6 MiB/s wr, 386 op/s 2024-05-09T06:01:36.103 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:01:35 smithi039 ceph-mon[30439]: pgmap v1096: 97 pgs: 97 active+clean; 678 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 5.6 MiB/s wr, 386 op/s 2024-05-09T06:01:36.965 INFO:tasks.workunit.client.0.smithi039.stdout: 10 238239 20.71 MB/sec execute 493 sec latency 111.084 ms 2024-05-09T06:01:37.916 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:01:37 smithi100 ceph-mon[34353]: pgmap v1097: 97 pgs: 97 active+clean; 673 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 5.4 MiB/s wr, 368 op/s 2024-05-09T06:01:37.965 INFO:tasks.workunit.client.0.smithi039.stdout: 10 238628 20.71 MB/sec execute 494 sec latency 121.357 ms 2024-05-09T06:01:38.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:01:37 smithi060 ceph-mon[34555]: pgmap v1097: 97 pgs: 97 active+clean; 673 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 5.4 MiB/s wr, 368 op/s 2024-05-09T06:01:38.103 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:01:37 smithi039 ceph-mon[30439]: pgmap v1097: 97 pgs: 97 active+clean; 673 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 5.4 MiB/s wr, 368 op/s 2024-05-09T06:01:38.967 INFO:tasks.workunit.client.0.smithi039.stdout: 10 239089 20.72 MB/sec execute 495 sec latency 62.150 ms 2024-05-09T06:01:39.916 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:01:39 smithi100 ceph-mon[34353]: pgmap v1098: 97 pgs: 97 active+clean; 656 MiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 5.3 MiB/s wr, 377 op/s 2024-05-09T06:01:39.966 INFO:tasks.workunit.client.0.smithi039.stdout: 10 239482 20.73 MB/sec execute 496 sec latency 82.266 ms 2024-05-09T06:01:40.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:01:39 smithi060 ceph-mon[34555]: pgmap v1098: 97 pgs: 97 active+clean; 656 MiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 5.3 MiB/s wr, 377 op/s 2024-05-09T06:01:40.102 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:01:39 smithi039 ceph-mon[30439]: pgmap v1098: 97 pgs: 97 active+clean; 656 MiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 5.3 MiB/s wr, 377 op/s 2024-05-09T06:01:40.965 INFO:tasks.workunit.client.0.smithi039.stdout: 10 239799 20.72 MB/sec execute 497 sec latency 197.295 ms 2024-05-09T06:01:41.916 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:01:41 smithi100 ceph-mon[34353]: pgmap v1099: 97 pgs: 97 active+clean; 656 MiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 5.2 MiB/s wr, 370 op/s 2024-05-09T06:01:41.966 INFO:tasks.workunit.client.0.smithi039.stdout: 10 240054 20.70 MB/sec execute 498 sec latency 296.993 ms 2024-05-09T06:01:42.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:01:41 smithi060 ceph-mon[34555]: pgmap v1099: 97 pgs: 97 active+clean; 656 MiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 5.2 MiB/s wr, 370 op/s 2024-05-09T06:01:42.102 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:01:41 smithi039 ceph-mon[30439]: pgmap v1099: 97 pgs: 97 active+clean; 656 MiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 5.2 MiB/s wr, 370 op/s 2024-05-09T06:01:42.966 INFO:tasks.workunit.client.0.smithi039.stdout: 10 240306 20.70 MB/sec execute 499 sec latency 152.263 ms 2024-05-09T06:01:43.916 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:01:43 smithi100 ceph-mon[34353]: pgmap v1100: 97 pgs: 97 active+clean; 661 MiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 5.4 MiB/s wr, 360 op/s 2024-05-09T06:01:43.966 INFO:tasks.workunit.client.0.smithi039.stdout: 10 240696 20.71 MB/sec execute 500 sec latency 68.258 ms 2024-05-09T06:01:44.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:01:43 smithi060 ceph-mon[34555]: pgmap v1100: 97 pgs: 97 active+clean; 661 MiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 5.4 MiB/s wr, 360 op/s 2024-05-09T06:01:44.103 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:01:43 smithi039 ceph-mon[30439]: pgmap v1100: 97 pgs: 97 active+clean; 661 MiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 5.4 MiB/s wr, 360 op/s 2024-05-09T06:01:44.966 INFO:tasks.workunit.client.0.smithi039.stdout: 10 241124 20.72 MB/sec execute 501 sec latency 111.400 ms 2024-05-09T06:01:45.916 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:01:45 smithi100 ceph-mon[34353]: pgmap v1101: 97 pgs: 97 active+clean; 660 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 4.9 MiB/s wr, 342 op/s 2024-05-09T06:01:45.966 INFO:tasks.workunit.client.0.smithi039.stdout: 10 241578 20.73 MB/sec execute 502 sec latency 93.518 ms 2024-05-09T06:01:46.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:01:45 smithi060 ceph-mon[34555]: pgmap v1101: 97 pgs: 97 active+clean; 660 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 4.9 MiB/s wr, 342 op/s 2024-05-09T06:01:46.103 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:01:45 smithi039 ceph-mon[30439]: pgmap v1101: 97 pgs: 97 active+clean; 660 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 4.9 MiB/s wr, 342 op/s 2024-05-09T06:01:46.916 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:01:46 smithi100 ceph-mon[34353]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-09T06:01:46.966 INFO:tasks.workunit.client.0.smithi039.stdout: 10 241968 20.73 MB/sec execute 503 sec latency 253.608 ms 2024-05-09T06:01:47.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:01:46 smithi060 ceph-mon[34555]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-09T06:01:47.103 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:01:46 smithi039 ceph-mon[30439]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-09T06:01:47.916 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:01:47 smithi100 ceph-mon[34353]: pgmap v1102: 97 pgs: 97 active+clean; 659 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 5.3 MiB/s wr, 380 op/s 2024-05-09T06:01:47.966 INFO:tasks.workunit.client.0.smithi039.stdout: 10 242336 20.73 MB/sec execute 504 sec latency 109.858 ms 2024-05-09T06:01:48.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:01:47 smithi060 ceph-mon[34555]: pgmap v1102: 97 pgs: 97 active+clean; 659 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 5.3 MiB/s wr, 380 op/s 2024-05-09T06:01:48.103 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:01:47 smithi039 ceph-mon[30439]: pgmap v1102: 97 pgs: 97 active+clean; 659 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 5.3 MiB/s wr, 380 op/s 2024-05-09T06:01:48.966 INFO:tasks.workunit.client.0.smithi039.stdout: 10 242690 20.72 MB/sec execute 505 sec latency 715.056 ms 2024-05-09T06:01:49.916 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:01:49 smithi100 ceph-mon[34353]: pgmap v1103: 97 pgs: 97 active+clean; 657 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.4 MiB/s wr, 360 op/s 2024-05-09T06:01:49.966 INFO:tasks.workunit.client.0.smithi039.stdout: 10 242972 20.72 MB/sec execute 506 sec latency 1078.143 ms 2024-05-09T06:01:50.042 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:01:49 smithi060 ceph-mon[34555]: pgmap v1103: 97 pgs: 97 active+clean; 657 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.4 MiB/s wr, 360 op/s 2024-05-09T06:01:50.103 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:01:49 smithi039 ceph-mon[30439]: pgmap v1103: 97 pgs: 97 active+clean; 657 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.4 MiB/s wr, 360 op/s 2024-05-09T06:01:50.966 INFO:tasks.workunit.client.0.smithi039.stdout: 10 243279 20.72 MB/sec execute 507 sec latency 1563.947 ms 2024-05-09T06:01:51.049 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:01:50 smithi060 ceph-mon[34555]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-09T06:01:51.103 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:01:50 smithi039 ceph-mon[30439]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-09T06:01:51.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:01:50 smithi100 ceph-mon[34353]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-09T06:01:51.966 INFO:tasks.workunit.client.0.smithi039.stdout: 10 243516 20.69 MB/sec execute 508 sec latency 2563.983 ms 2024-05-09T06:01:52.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:01:51 smithi060 ceph-mon[34555]: pgmap v1104: 97 pgs: 97 active+clean; 658 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 5.2 MiB/s wr, 334 op/s 2024-05-09T06:01:52.103 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:01:51 smithi039 ceph-mon[30439]: pgmap v1104: 97 pgs: 97 active+clean; 658 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 5.2 MiB/s wr, 334 op/s 2024-05-09T06:01:52.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:01:51 smithi100 ceph-mon[34353]: pgmap v1104: 97 pgs: 97 active+clean; 658 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 5.2 MiB/s wr, 334 op/s 2024-05-09T06:01:52.966 INFO:tasks.workunit.client.0.smithi039.stdout: 10 243780 20.68 MB/sec execute 509 sec latency 3564.012 ms 2024-05-09T06:01:53.966 INFO:tasks.workunit.client.0.smithi039.stdout: 10 244095 20.66 MB/sec execute 510 sec latency 4564.081 ms 2024-05-09T06:01:54.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:01:53 smithi060 ceph-mon[34555]: pgmap v1105: 97 pgs: 97 active+clean; 655 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 5.1 MiB/s wr, 333 op/s 2024-05-09T06:01:54.103 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:01:53 smithi039 ceph-mon[30439]: pgmap v1105: 97 pgs: 97 active+clean; 655 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 5.1 MiB/s wr, 333 op/s 2024-05-09T06:01:54.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:01:53 smithi100 ceph-mon[34353]: pgmap v1105: 97 pgs: 97 active+clean; 655 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 5.1 MiB/s wr, 333 op/s 2024-05-09T06:01:54.966 INFO:tasks.workunit.client.0.smithi039.stdout: 10 244464 20.66 MB/sec execute 511 sec latency 4865.015 ms 2024-05-09T06:01:55.966 INFO:tasks.workunit.client.0.smithi039.stdout: 10 244913 20.68 MB/sec execute 512 sec latency 146.788 ms 2024-05-09T06:01:56.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:01:55 smithi060 ceph-mon[34555]: pgmap v1106: 97 pgs: 97 active+clean; 659 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 5.0 MiB/s wr, 325 op/s 2024-05-09T06:01:56.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:01:55 smithi060 ceph-mon[34555]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-09T06:01:56.103 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:01:55 smithi039 ceph-mon[30439]: pgmap v1106: 97 pgs: 97 active+clean; 659 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 5.0 MiB/s wr, 325 op/s 2024-05-09T06:01:56.103 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:01:55 smithi039 ceph-mon[30439]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-09T06:01:56.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:01:55 smithi100 ceph-mon[34353]: pgmap v1106: 97 pgs: 97 active+clean; 659 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 5.0 MiB/s wr, 325 op/s 2024-05-09T06:01:56.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:01:55 smithi100 ceph-mon[34353]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-09T06:01:56.966 INFO:tasks.workunit.client.0.smithi039.stdout: 10 245295 20.68 MB/sec execute 513 sec latency 215.915 ms 2024-05-09T06:01:57.966 INFO:tasks.workunit.client.0.smithi039.stdout: 10 245723 20.69 MB/sec execute 514 sec latency 88.362 ms 2024-05-09T06:01:58.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:01:57 smithi060 ceph-mon[34555]: pgmap v1107: 97 pgs: 97 active+clean; 664 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 6.0 MiB/s wr, 373 op/s 2024-05-09T06:01:58.103 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:01:57 smithi039 ceph-mon[30439]: pgmap v1107: 97 pgs: 97 active+clean; 664 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 6.0 MiB/s wr, 373 op/s 2024-05-09T06:01:58.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:01:57 smithi100 ceph-mon[34353]: pgmap v1107: 97 pgs: 97 active+clean; 664 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 6.0 MiB/s wr, 373 op/s 2024-05-09T06:01:58.966 INFO:tasks.workunit.client.0.smithi039.stdout: 10 246042 20.67 MB/sec execute 515 sec latency 79.876 ms 2024-05-09T06:01:59.966 INFO:tasks.workunit.client.0.smithi039.stdout: 10 246348 20.67 MB/sec execute 516 sec latency 96.340 ms 2024-05-09T06:02:00.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:01:59 smithi060 ceph-mon[34555]: pgmap v1108: 97 pgs: 97 active+clean; 663 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 5.3 MiB/s wr, 298 op/s 2024-05-09T06:02:00.103 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:01:59 smithi039 ceph-mon[30439]: pgmap v1108: 97 pgs: 97 active+clean; 663 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 5.3 MiB/s wr, 298 op/s 2024-05-09T06:02:00.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:01:59 smithi100 ceph-mon[34353]: pgmap v1108: 97 pgs: 97 active+clean; 663 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 5.3 MiB/s wr, 298 op/s 2024-05-09T06:02:00.966 INFO:tasks.workunit.client.0.smithi039.stdout: 10 246705 20.67 MB/sec execute 517 sec latency 88.913 ms 2024-05-09T06:02:01.966 INFO:tasks.workunit.client.0.smithi039.stdout: 10 247008 20.66 MB/sec execute 518 sec latency 264.652 ms 2024-05-09T06:02:02.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:02:01 smithi060 ceph-mon[34555]: pgmap v1109: 97 pgs: 97 active+clean; 667 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 5.6 MiB/s wr, 342 op/s 2024-05-09T06:02:02.102 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:02:01 smithi039 ceph-mon[30439]: pgmap v1109: 97 pgs: 97 active+clean; 667 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 5.6 MiB/s wr, 342 op/s 2024-05-09T06:02:02.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:02:01 smithi100 ceph-mon[34353]: pgmap v1109: 97 pgs: 97 active+clean; 667 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 5.6 MiB/s wr, 342 op/s 2024-05-09T06:02:02.967 INFO:tasks.workunit.client.0.smithi039.stdout: 10 247351 20.66 MB/sec execute 519 sec latency 273.732 ms 2024-05-09T06:02:03.966 INFO:tasks.workunit.client.0.smithi039.stdout: 10 247716 20.65 MB/sec execute 520 sec latency 65.310 ms 2024-05-09T06:02:04.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:02:03 smithi060 ceph-mon[34555]: pgmap v1110: 97 pgs: 97 active+clean; 667 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.5 MiB/s wr, 355 op/s 2024-05-09T06:02:04.102 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:02:03 smithi039 ceph-mon[30439]: pgmap v1110: 97 pgs: 97 active+clean; 667 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.5 MiB/s wr, 355 op/s 2024-05-09T06:02:04.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:02:03 smithi100 ceph-mon[34353]: pgmap v1110: 97 pgs: 97 active+clean; 667 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.5 MiB/s wr, 355 op/s 2024-05-09T06:02:04.966 INFO:tasks.workunit.client.0.smithi039.stdout: 10 248080 20.64 MB/sec execute 521 sec latency 104.739 ms 2024-05-09T06:02:05.966 INFO:tasks.workunit.client.0.smithi039.stdout: 10 248543 20.64 MB/sec execute 522 sec latency 106.951 ms 2024-05-09T06:02:06.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:02:05 smithi060 ceph-mon[34555]: pgmap v1111: 97 pgs: 97 active+clean; 655 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 5.3 MiB/s wr, 340 op/s 2024-05-09T06:02:06.102 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:02:05 smithi039 ceph-mon[30439]: pgmap v1111: 97 pgs: 97 active+clean; 655 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 5.3 MiB/s wr, 340 op/s 2024-05-09T06:02:06.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:02:05 smithi100 ceph-mon[34353]: pgmap v1111: 97 pgs: 97 active+clean; 655 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 5.3 MiB/s wr, 340 op/s 2024-05-09T06:02:06.966 INFO:tasks.workunit.client.0.smithi039.stdout: 10 248859 20.64 MB/sec execute 523 sec latency 285.035 ms 2024-05-09T06:02:07.967 INFO:tasks.workunit.client.0.smithi039.stdout: 10 249365 20.67 MB/sec execute 524 sec latency 71.000 ms 2024-05-09T06:02:08.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:02:07 smithi060 ceph-mon[34555]: pgmap v1112: 97 pgs: 97 active+clean; 651 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 6.1 MiB/s wr, 387 op/s 2024-05-09T06:02:08.103 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:02:07 smithi039 ceph-mon[30439]: pgmap v1112: 97 pgs: 97 active+clean; 651 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 6.1 MiB/s wr, 387 op/s 2024-05-09T06:02:08.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:02:07 smithi100 ceph-mon[34353]: pgmap v1112: 97 pgs: 97 active+clean; 651 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 6.1 MiB/s wr, 387 op/s 2024-05-09T06:02:08.967 INFO:tasks.workunit.client.0.smithi039.stdout: 10 249797 20.68 MB/sec execute 525 sec latency 69.600 ms 2024-05-09T06:02:09.967 INFO:tasks.workunit.client.0.smithi039.stdout: 10 250105 20.66 MB/sec execute 526 sec latency 97.611 ms 2024-05-09T06:02:09.967 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:02:09 smithi100 ceph-mon[34353]: pgmap v1113: 97 pgs: 97 active+clean; 652 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.4 MiB/s wr, 350 op/s 2024-05-09T06:02:10.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:02:09 smithi060 ceph-mon[34555]: pgmap v1113: 97 pgs: 97 active+clean; 652 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.4 MiB/s wr, 350 op/s 2024-05-09T06:02:10.102 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:02:09 smithi039 ceph-mon[30439]: pgmap v1113: 97 pgs: 97 active+clean; 652 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.4 MiB/s wr, 350 op/s 2024-05-09T06:02:10.967 INFO:tasks.workunit.client.0.smithi039.stdout: 10 250407 20.65 MB/sec execute 527 sec latency 88.517 ms 2024-05-09T06:02:11.967 INFO:tasks.workunit.client.0.smithi039.stdout: 10 250750 20.64 MB/sec execute 528 sec latency 216.580 ms 2024-05-09T06:02:12.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:02:11 smithi060 ceph-mon[34555]: pgmap v1114: 97 pgs: 97 active+clean; 652 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 5.3 MiB/s wr, 347 op/s 2024-05-09T06:02:12.102 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:02:11 smithi039 ceph-mon[30439]: pgmap v1114: 97 pgs: 97 active+clean; 652 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 5.3 MiB/s wr, 347 op/s 2024-05-09T06:02:12.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:02:11 smithi100 ceph-mon[34353]: pgmap v1114: 97 pgs: 97 active+clean; 652 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 5.3 MiB/s wr, 347 op/s 2024-05-09T06:02:12.967 INFO:tasks.workunit.client.0.smithi039.stdout: 10 251164 20.65 MB/sec execute 529 sec latency 231.677 ms 2024-05-09T06:02:13.967 INFO:tasks.workunit.client.0.smithi039.stdout: 10 251558 20.66 MB/sec execute 530 sec latency 63.424 ms 2024-05-09T06:02:14.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:02:13 smithi060 ceph-mon[34555]: pgmap v1115: 97 pgs: 97 active+clean; 655 MiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 5.1 MiB/s wr, 356 op/s 2024-05-09T06:02:14.103 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:02:13 smithi039 ceph-mon[30439]: pgmap v1115: 97 pgs: 97 active+clean; 655 MiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 5.1 MiB/s wr, 356 op/s 2024-05-09T06:02:14.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:02:13 smithi100 ceph-mon[34353]: pgmap v1115: 97 pgs: 97 active+clean; 655 MiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 5.1 MiB/s wr, 356 op/s 2024-05-09T06:02:14.967 INFO:tasks.workunit.client.0.smithi039.stdout: 10 251992 20.64 MB/sec execute 531 sec latency 65.141 ms 2024-05-09T06:02:15.967 INFO:tasks.workunit.client.0.smithi039.stdout: 10 252349 20.64 MB/sec execute 532 sec latency 103.095 ms 2024-05-09T06:02:16.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:02:15 smithi060 ceph-mon[34555]: pgmap v1116: 97 pgs: 97 active+clean; 658 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 5.4 MiB/s wr, 354 op/s 2024-05-09T06:02:16.102 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:02:15 smithi039 ceph-mon[30439]: pgmap v1116: 97 pgs: 97 active+clean; 658 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 5.4 MiB/s wr, 354 op/s 2024-05-09T06:02:16.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:02:15 smithi100 ceph-mon[34353]: pgmap v1116: 97 pgs: 97 active+clean; 658 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 5.4 MiB/s wr, 354 op/s 2024-05-09T06:02:16.967 INFO:tasks.workunit.client.0.smithi039.stdout: 10 252728 20.65 MB/sec execute 533 sec latency 161.924 ms 2024-05-09T06:02:17.967 INFO:tasks.workunit.client.0.smithi039.stdout: 10 253148 20.66 MB/sec execute 534 sec latency 157.138 ms 2024-05-09T06:02:18.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:02:17 smithi060 ceph-mon[34555]: pgmap v1117: 97 pgs: 97 active+clean; 657 MiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 5.6 MiB/s wr, 358 op/s 2024-05-09T06:02:18.102 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:02:17 smithi039 ceph-mon[30439]: pgmap v1117: 97 pgs: 97 active+clean; 657 MiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 5.6 MiB/s wr, 358 op/s 2024-05-09T06:02:18.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:02:17 smithi100 ceph-mon[34353]: pgmap v1117: 97 pgs: 97 active+clean; 657 MiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 5.6 MiB/s wr, 358 op/s 2024-05-09T06:02:18.967 INFO:tasks.workunit.client.0.smithi039.stdout: 10 253550 20.66 MB/sec execute 535 sec latency 87.535 ms 2024-05-09T06:02:19.967 INFO:tasks.workunit.client.0.smithi039.stdout: 10 253808 20.65 MB/sec execute 536 sec latency 103.441 ms 2024-05-09T06:02:20.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:02:19 smithi060 ceph-mon[34555]: pgmap v1118: 97 pgs: 97 active+clean; 667 MiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 5.7 MiB/s wr, 361 op/s 2024-05-09T06:02:20.102 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:02:19 smithi039 ceph-mon[30439]: pgmap v1118: 97 pgs: 97 active+clean; 667 MiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 5.7 MiB/s wr, 361 op/s 2024-05-09T06:02:20.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:02:19 smithi100 ceph-mon[34353]: pgmap v1118: 97 pgs: 97 active+clean; 667 MiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 5.7 MiB/s wr, 361 op/s 2024-05-09T06:02:20.967 INFO:tasks.workunit.client.0.smithi039.stdout: 10 254205 20.65 MB/sec execute 537 sec latency 99.118 ms 2024-05-09T06:02:21.967 INFO:tasks.workunit.client.0.smithi039.stdout: 10 254549 20.64 MB/sec execute 538 sec latency 228.897 ms 2024-05-09T06:02:22.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:02:21 smithi060 ceph-mon[34555]: pgmap v1119: 97 pgs: 97 active+clean; 675 MiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 6.4 MiB/s wr, 350 op/s 2024-05-09T06:02:22.103 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:02:21 smithi039 ceph-mon[30439]: pgmap v1119: 97 pgs: 97 active+clean; 675 MiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 6.4 MiB/s wr, 350 op/s 2024-05-09T06:02:22.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:02:21 smithi100 ceph-mon[34353]: pgmap v1119: 97 pgs: 97 active+clean; 675 MiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 6.4 MiB/s wr, 350 op/s 2024-05-09T06:02:22.967 INFO:tasks.workunit.client.0.smithi039.stdout: 10 254840 20.63 MB/sec execute 539 sec latency 231.749 ms 2024-05-09T06:02:23.967 INFO:tasks.workunit.client.0.smithi039.stdout: 10 255288 20.63 MB/sec execute 540 sec latency 47.564 ms 2024-05-09T06:02:24.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:02:23 smithi060 ceph-mon[34555]: pgmap v1120: 97 pgs: 97 active+clean; 682 MiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 6.8 MiB/s wr, 364 op/s 2024-05-09T06:02:24.102 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:02:23 smithi039 ceph-mon[30439]: pgmap v1120: 97 pgs: 97 active+clean; 682 MiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 6.8 MiB/s wr, 364 op/s 2024-05-09T06:02:24.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:02:23 smithi100 ceph-mon[34353]: pgmap v1120: 97 pgs: 97 active+clean; 682 MiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 6.8 MiB/s wr, 364 op/s 2024-05-09T06:02:24.967 INFO:tasks.workunit.client.0.smithi039.stdout: 10 255697 20.64 MB/sec execute 541 sec latency 62.763 ms 2024-05-09T06:02:25.967 INFO:tasks.workunit.client.0.smithi039.stdout: 10 256222 20.64 MB/sec execute 542 sec latency 104.582 ms 2024-05-09T06:02:26.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:02:25 smithi060 ceph-mon[34555]: pgmap v1121: 97 pgs: 97 active+clean; 687 MiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 6.5 MiB/s wr, 336 op/s 2024-05-09T06:02:26.102 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:02:25 smithi039 ceph-mon[30439]: pgmap v1121: 97 pgs: 97 active+clean; 687 MiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 6.5 MiB/s wr, 336 op/s 2024-05-09T06:02:26.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:02:25 smithi100 ceph-mon[34353]: pgmap v1121: 97 pgs: 97 active+clean; 687 MiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 6.5 MiB/s wr, 336 op/s 2024-05-09T06:02:26.967 INFO:tasks.workunit.client.0.smithi039.stdout: 10 256683 20.67 MB/sec execute 543 sec latency 119.327 ms 2024-05-09T06:02:27.967 INFO:tasks.workunit.client.0.smithi039.stdout: 10 256978 20.66 MB/sec execute 544 sec latency 232.782 ms 2024-05-09T06:02:28.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:02:27 smithi060 ceph-mon[34555]: pgmap v1122: 97 pgs: 97 active+clean; 687 MiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 6.4 MiB/s wr, 322 op/s 2024-05-09T06:02:28.102 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:02:27 smithi039 ceph-mon[30439]: pgmap v1122: 97 pgs: 97 active+clean; 687 MiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 6.4 MiB/s wr, 322 op/s 2024-05-09T06:02:28.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:02:27 smithi100 ceph-mon[34353]: pgmap v1122: 97 pgs: 97 active+clean; 687 MiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 6.4 MiB/s wr, 322 op/s 2024-05-09T06:02:28.967 INFO:tasks.workunit.client.0.smithi039.stdout: 10 257404 20.67 MB/sec execute 545 sec latency 66.011 ms 2024-05-09T06:02:29.967 INFO:tasks.workunit.client.0.smithi039.stdout: 10 257705 20.66 MB/sec execute 546 sec latency 83.074 ms 2024-05-09T06:02:30.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:02:29 smithi060 ceph-mon[34555]: pgmap v1123: 97 pgs: 97 active+clean; 684 MiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 7.0 MiB/s wr, 393 op/s 2024-05-09T06:02:30.102 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:02:29 smithi039 ceph-mon[30439]: pgmap v1123: 97 pgs: 97 active+clean; 684 MiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 7.0 MiB/s wr, 393 op/s 2024-05-09T06:02:30.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:02:29 smithi100 ceph-mon[34353]: pgmap v1123: 97 pgs: 97 active+clean; 684 MiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 7.0 MiB/s wr, 393 op/s 2024-05-09T06:02:30.967 INFO:tasks.workunit.client.0.smithi039.stdout: 10 258154 20.67 MB/sec execute 547 sec latency 68.203 ms 2024-05-09T06:02:31.967 INFO:tasks.workunit.client.0.smithi039.stdout: 10 258545 20.66 MB/sec execute 548 sec latency 94.438 ms 2024-05-09T06:02:32.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:02:31 smithi060 ceph-mon[34555]: pgmap v1124: 97 pgs: 97 active+clean; 675 MiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 6.1 MiB/s wr, 352 op/s 2024-05-09T06:02:32.103 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:02:31 smithi039 ceph-mon[30439]: pgmap v1124: 97 pgs: 97 active+clean; 675 MiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 6.1 MiB/s wr, 352 op/s 2024-05-09T06:02:32.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:02:31 smithi100 ceph-mon[34353]: pgmap v1124: 97 pgs: 97 active+clean; 675 MiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 6.1 MiB/s wr, 352 op/s 2024-05-09T06:02:32.967 INFO:tasks.workunit.client.0.smithi039.stdout: 10 258755 20.64 MB/sec execute 549 sec latency 267.319 ms 2024-05-09T06:02:33.968 INFO:tasks.workunit.client.0.smithi039.stdout: 10 259150 20.64 MB/sec execute 550 sec latency 73.982 ms 2024-05-09T06:02:34.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:02:33 smithi060 ceph-mon[34555]: pgmap v1125: 97 pgs: 97 active+clean; 672 MiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 5.6 MiB/s wr, 376 op/s 2024-05-09T06:02:34.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:02:33 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:02:34.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:02:33 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:02:34.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:02:33 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:02:34.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:02:33 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T06:02:34.102 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:02:33 smithi039 ceph-mon[30439]: pgmap v1125: 97 pgs: 97 active+clean; 672 MiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 5.6 MiB/s wr, 376 op/s 2024-05-09T06:02:34.103 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:02:33 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:02:34.103 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:02:33 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:02:34.103 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:02:33 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:02:34.103 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:02:33 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T06:02:34.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:02:33 smithi100 ceph-mon[34353]: pgmap v1125: 97 pgs: 97 active+clean; 672 MiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 5.6 MiB/s wr, 376 op/s 2024-05-09T06:02:34.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:02:33 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:02:34.167 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:02:33 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:02:34.167 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:02:33 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:02:34.167 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:02:33 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T06:02:34.968 INFO:tasks.workunit.client.0.smithi039.stdout: 10 259562 20.64 MB/sec execute 551 sec latency 92.102 ms 2024-05-09T06:02:35.967 INFO:tasks.workunit.client.0.smithi039.stdout: 10 260159 20.65 MB/sec execute 552 sec latency 60.109 ms 2024-05-09T06:02:36.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:02:35 smithi060 ceph-mon[34555]: pgmap v1126: 97 pgs: 97 active+clean; 678 MiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 5.6 MiB/s wr, 368 op/s 2024-05-09T06:02:36.103 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:02:35 smithi039 ceph-mon[30439]: pgmap v1126: 97 pgs: 97 active+clean; 678 MiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 5.6 MiB/s wr, 368 op/s 2024-05-09T06:02:36.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:02:35 smithi100 ceph-mon[34353]: pgmap v1126: 97 pgs: 97 active+clean; 678 MiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 5.6 MiB/s wr, 368 op/s 2024-05-09T06:02:36.968 INFO:tasks.workunit.client.0.smithi039.stdout: 10 260641 20.68 MB/sec execute 553 sec latency 58.682 ms 2024-05-09T06:02:37.968 INFO:tasks.workunit.client.0.smithi039.stdout: 10 260946 20.67 MB/sec execute 554 sec latency 261.179 ms 2024-05-09T06:02:38.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:02:37 smithi060 ceph-mon[34555]: pgmap v1127: 97 pgs: 97 active+clean; 681 MiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 5.9 MiB/s wr, 365 op/s 2024-05-09T06:02:38.102 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:02:37 smithi039 ceph-mon[30439]: pgmap v1127: 97 pgs: 97 active+clean; 681 MiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 5.9 MiB/s wr, 365 op/s 2024-05-09T06:02:38.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:02:37 smithi100 ceph-mon[34353]: pgmap v1127: 97 pgs: 97 active+clean; 681 MiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 5.9 MiB/s wr, 365 op/s 2024-05-09T06:02:38.968 INFO:tasks.workunit.client.0.smithi039.stdout: 10 261285 20.67 MB/sec execute 555 sec latency 160.470 ms 2024-05-09T06:02:39.968 INFO:tasks.workunit.client.0.smithi039.stdout: 10 261613 20.67 MB/sec execute 556 sec latency 69.058 ms 2024-05-09T06:02:40.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:02:39 smithi060 ceph-mon[34555]: pgmap v1128: 97 pgs: 97 active+clean; 685 MiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 6.2 MiB/s wr, 401 op/s 2024-05-09T06:02:40.102 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:02:39 smithi039 ceph-mon[30439]: pgmap v1128: 97 pgs: 97 active+clean; 685 MiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 6.2 MiB/s wr, 401 op/s 2024-05-09T06:02:40.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:02:39 smithi100 ceph-mon[34353]: pgmap v1128: 97 pgs: 97 active+clean; 685 MiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 6.2 MiB/s wr, 401 op/s 2024-05-09T06:02:40.968 INFO:tasks.workunit.client.0.smithi039.stdout: 10 262018 20.67 MB/sec execute 557 sec latency 91.440 ms 2024-05-09T06:02:41.968 INFO:tasks.workunit.client.0.smithi039.stdout: 10 262388 20.66 MB/sec execute 558 sec latency 94.397 ms 2024-05-09T06:02:42.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:02:41 smithi060 ceph-mon[34555]: pgmap v1129: 97 pgs: 97 active+clean; 685 MiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 5.7 MiB/s wr, 333 op/s 2024-05-09T06:02:42.102 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:02:41 smithi039 ceph-mon[30439]: pgmap v1129: 97 pgs: 97 active+clean; 685 MiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 5.7 MiB/s wr, 333 op/s 2024-05-09T06:02:42.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:02:41 smithi100 ceph-mon[34353]: pgmap v1129: 97 pgs: 97 active+clean; 685 MiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 5.7 MiB/s wr, 333 op/s 2024-05-09T06:02:42.968 INFO:tasks.workunit.client.0.smithi039.stdout: 10 262592 20.64 MB/sec execute 559 sec latency 310.457 ms 2024-05-09T06:02:43.968 INFO:tasks.workunit.client.0.smithi039.stdout: 10 262897 20.63 MB/sec execute 560 sec latency 111.483 ms 2024-05-09T06:02:44.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:02:43 smithi060 ceph-mon[34555]: pgmap v1130: 97 pgs: 97 active+clean; 691 MiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.8 MiB/s wr, 362 op/s 2024-05-09T06:02:44.102 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:02:43 smithi039 ceph-mon[30439]: pgmap v1130: 97 pgs: 97 active+clean; 691 MiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.8 MiB/s wr, 362 op/s 2024-05-09T06:02:44.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:02:43 smithi100 ceph-mon[34353]: pgmap v1130: 97 pgs: 97 active+clean; 691 MiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.8 MiB/s wr, 362 op/s 2024-05-09T06:02:44.968 INFO:tasks.workunit.client.0.smithi039.stdout: 10 263374 20.64 MB/sec execute 561 sec latency 53.148 ms 2024-05-09T06:02:45.968 INFO:tasks.workunit.client.0.smithi039.stdout: 10 264008 20.65 MB/sec execute 562 sec latency 50.946 ms 2024-05-09T06:02:46.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:02:45 smithi060 ceph-mon[34555]: pgmap v1131: 97 pgs: 97 active+clean; 691 MiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 5.4 MiB/s wr, 328 op/s 2024-05-09T06:02:46.102 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:02:45 smithi039 ceph-mon[30439]: pgmap v1131: 97 pgs: 97 active+clean; 691 MiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 5.4 MiB/s wr, 328 op/s 2024-05-09T06:02:46.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:02:45 smithi100 ceph-mon[34353]: pgmap v1131: 97 pgs: 97 active+clean; 691 MiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 5.4 MiB/s wr, 328 op/s 2024-05-09T06:02:46.968 INFO:tasks.workunit.client.0.smithi039.stdout: 10 264428 20.67 MB/sec execute 563 sec latency 91.011 ms 2024-05-09T06:02:47.968 INFO:tasks.workunit.client.0.smithi039.stdout: 10 264726 20.67 MB/sec execute 564 sec latency 324.879 ms 2024-05-09T06:02:48.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:02:47 smithi060 ceph-mon[34555]: pgmap v1132: 97 pgs: 97 active+clean; 696 MiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 5.5 MiB/s wr, 369 op/s 2024-05-09T06:02:48.102 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:02:47 smithi039 ceph-mon[30439]: pgmap v1132: 97 pgs: 97 active+clean; 696 MiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 5.5 MiB/s wr, 369 op/s 2024-05-09T06:02:48.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:02:47 smithi100 ceph-mon[34353]: pgmap v1132: 97 pgs: 97 active+clean; 696 MiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 5.5 MiB/s wr, 369 op/s 2024-05-09T06:02:48.968 INFO:tasks.workunit.client.0.smithi039.stdout: 10 265020 20.66 MB/sec execute 565 sec latency 164.376 ms 2024-05-09T06:02:49.968 INFO:tasks.workunit.client.0.smithi039.stdout: 10 265333 20.66 MB/sec execute 566 sec latency 86.851 ms 2024-05-09T06:02:50.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:02:49 smithi060 ceph-mon[34555]: pgmap v1133: 97 pgs: 97 active+clean; 700 MiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 5.6 MiB/s wr, 352 op/s 2024-05-09T06:02:50.102 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:02:49 smithi039 ceph-mon[30439]: pgmap v1133: 97 pgs: 97 active+clean; 700 MiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 5.6 MiB/s wr, 352 op/s 2024-05-09T06:02:50.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:02:49 smithi100 ceph-mon[34353]: pgmap v1133: 97 pgs: 97 active+clean; 700 MiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 5.6 MiB/s wr, 352 op/s 2024-05-09T06:02:50.968 INFO:tasks.workunit.client.0.smithi039.stdout: 10 265752 20.67 MB/sec execute 567 sec latency 106.469 ms 2024-05-09T06:02:51.968 INFO:tasks.workunit.client.0.smithi039.stdout: 10 266090 20.66 MB/sec execute 568 sec latency 77.137 ms 2024-05-09T06:02:52.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:02:51 smithi060 ceph-mon[34555]: pgmap v1134: 97 pgs: 97 active+clean; 704 MiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 5.8 MiB/s wr, 359 op/s 2024-05-09T06:02:52.102 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:02:51 smithi039 ceph-mon[30439]: pgmap v1134: 97 pgs: 97 active+clean; 704 MiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 5.8 MiB/s wr, 359 op/s 2024-05-09T06:02:52.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:02:51 smithi100 ceph-mon[34353]: pgmap v1134: 97 pgs: 97 active+clean; 704 MiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 5.8 MiB/s wr, 359 op/s 2024-05-09T06:02:52.968 INFO:tasks.workunit.client.0.smithi039.stdout: 10 266305 20.63 MB/sec execute 569 sec latency 273.236 ms 2024-05-09T06:02:53.968 INFO:tasks.workunit.client.0.smithi039.stdout: 10 266560 20.62 MB/sec execute 570 sec latency 127.532 ms 2024-05-09T06:02:54.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:02:53 smithi060 ceph-mon[34555]: pgmap v1135: 97 pgs: 97 active+clean; 704 MiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 5.7 MiB/s wr, 380 op/s 2024-05-09T06:02:54.102 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:02:53 smithi039 ceph-mon[30439]: pgmap v1135: 97 pgs: 97 active+clean; 704 MiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 5.7 MiB/s wr, 380 op/s 2024-05-09T06:02:54.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:02:53 smithi100 ceph-mon[34353]: pgmap v1135: 97 pgs: 97 active+clean; 704 MiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 5.7 MiB/s wr, 380 op/s 2024-05-09T06:02:54.968 INFO:tasks.workunit.client.0.smithi039.stdout: 10 266992 20.62 MB/sec execute 571 sec latency 67.412 ms 2024-05-09T06:02:55.968 INFO:tasks.workunit.client.0.smithi039.stdout: 10 267497 20.63 MB/sec execute 572 sec latency 58.072 ms 2024-05-09T06:02:56.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:02:55 smithi060 ceph-mon[34555]: pgmap v1136: 97 pgs: 97 active+clean; 690 MiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 5.2 MiB/s wr, 313 op/s 2024-05-09T06:02:56.102 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:02:55 smithi039 ceph-mon[30439]: pgmap v1136: 97 pgs: 97 active+clean; 690 MiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 5.2 MiB/s wr, 313 op/s 2024-05-09T06:02:56.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:02:55 smithi100 ceph-mon[34353]: pgmap v1136: 97 pgs: 97 active+clean; 690 MiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 5.2 MiB/s wr, 313 op/s 2024-05-09T06:02:56.968 INFO:tasks.workunit.client.0.smithi039.stdout: 10 268064 20.65 MB/sec execute 573 sec latency 73.550 ms 2024-05-09T06:02:57.968 INFO:tasks.workunit.client.0.smithi039.stdout: 10 268369 20.64 MB/sec execute 574 sec latency 281.726 ms 2024-05-09T06:02:58.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:02:57 smithi060 ceph-mon[34555]: pgmap v1137: 97 pgs: 97 active+clean; 683 MiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 5.7 MiB/s wr, 376 op/s 2024-05-09T06:02:58.102 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:02:57 smithi039 ceph-mon[30439]: pgmap v1137: 97 pgs: 97 active+clean; 683 MiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 5.7 MiB/s wr, 376 op/s 2024-05-09T06:02:58.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:02:57 smithi100 ceph-mon[34353]: pgmap v1137: 97 pgs: 97 active+clean; 683 MiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 5.7 MiB/s wr, 376 op/s 2024-05-09T06:02:58.968 INFO:tasks.workunit.client.0.smithi039.stdout: 10 268719 20.64 MB/sec execute 575 sec latency 138.295 ms 2024-05-09T06:02:59.968 INFO:tasks.workunit.client.0.smithi039.stdout: 10 269129 20.66 MB/sec execute 576 sec latency 118.501 ms 2024-05-09T06:03:00.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:02:59 smithi060 ceph-mon[34555]: pgmap v1138: 97 pgs: 97 active+clean; 684 MiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 5.3 MiB/s wr, 326 op/s 2024-05-09T06:03:00.102 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:02:59 smithi039 ceph-mon[30439]: pgmap v1138: 97 pgs: 97 active+clean; 684 MiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 5.3 MiB/s wr, 326 op/s 2024-05-09T06:03:00.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:02:59 smithi100 ceph-mon[34353]: pgmap v1138: 97 pgs: 97 active+clean; 684 MiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 5.3 MiB/s wr, 326 op/s 2024-05-09T06:03:00.968 INFO:tasks.workunit.client.0.smithi039.stdout: 10 269484 20.66 MB/sec execute 577 sec latency 126.591 ms 2024-05-09T06:03:01.968 INFO:tasks.workunit.client.0.smithi039.stdout: 10 269847 20.66 MB/sec execute 578 sec latency 86.630 ms 2024-05-09T06:03:02.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:03:01 smithi060 ceph-mon[34555]: pgmap v1139: 97 pgs: 97 active+clean; 687 MiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.1 MiB/s wr, 348 op/s 2024-05-09T06:03:02.103 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:03:01 smithi039 ceph-mon[30439]: pgmap v1139: 97 pgs: 97 active+clean; 687 MiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.1 MiB/s wr, 348 op/s 2024-05-09T06:03:02.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:03:01 smithi100 ceph-mon[34353]: pgmap v1139: 97 pgs: 97 active+clean; 687 MiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 5.1 MiB/s wr, 348 op/s 2024-05-09T06:03:02.968 INFO:tasks.workunit.client.0.smithi039.stdout: 10 270064 20.63 MB/sec execute 579 sec latency 278.497 ms 2024-05-09T06:03:03.968 INFO:tasks.workunit.client.0.smithi039.stdout: 10 270320 20.61 MB/sec execute 580 sec latency 306.271 ms 2024-05-09T06:03:04.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:03:03 smithi060 ceph-mon[34555]: pgmap v1140: 97 pgs: 97 active+clean; 691 MiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 5.3 MiB/s wr, 365 op/s 2024-05-09T06:03:04.102 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:03:03 smithi039 ceph-mon[30439]: pgmap v1140: 97 pgs: 97 active+clean; 691 MiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 5.3 MiB/s wr, 365 op/s 2024-05-09T06:03:04.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:03:03 smithi100 ceph-mon[34353]: pgmap v1140: 97 pgs: 97 active+clean; 691 MiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 5.3 MiB/s wr, 365 op/s 2024-05-09T06:03:04.969 INFO:tasks.workunit.client.0.smithi039.stdout: 10 270649 20.60 MB/sec execute 581 sec latency 93.514 ms 2024-05-09T06:03:05.968 INFO:tasks.workunit.client.0.smithi039.stdout: 10 271244 20.62 MB/sec execute 582 sec latency 55.916 ms 2024-05-09T06:03:06.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:03:05 smithi060 ceph-mon[34555]: pgmap v1141: 97 pgs: 97 active+clean; 689 MiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 5.0 MiB/s wr, 341 op/s 2024-05-09T06:03:06.102 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:03:05 smithi039 ceph-mon[30439]: pgmap v1141: 97 pgs: 97 active+clean; 689 MiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 5.0 MiB/s wr, 341 op/s 2024-05-09T06:03:06.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:03:05 smithi100 ceph-mon[34353]: pgmap v1141: 97 pgs: 97 active+clean; 689 MiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 5.0 MiB/s wr, 341 op/s 2024-05-09T06:03:06.969 INFO:tasks.workunit.client.0.smithi039.stdout: 10 271851 20.63 MB/sec execute 583 sec latency 56.447 ms 2024-05-09T06:03:07.969 INFO:tasks.workunit.client.0.smithi039.stdout: 10 272218 20.64 MB/sec execute 584 sec latency 153.184 ms 2024-05-09T06:03:08.042 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:03:07 smithi060 ceph-mon[34555]: pgmap v1142: 97 pgs: 97 active+clean; 694 MiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 5.7 MiB/s wr, 399 op/s 2024-05-09T06:03:08.102 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:03:07 smithi039 ceph-mon[30439]: pgmap v1142: 97 pgs: 97 active+clean; 694 MiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 5.7 MiB/s wr, 399 op/s 2024-05-09T06:03:08.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:03:07 smithi100 ceph-mon[34353]: pgmap v1142: 97 pgs: 97 active+clean; 694 MiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 5.7 MiB/s wr, 399 op/s 2024-05-09T06:03:08.969 INFO:tasks.workunit.client.0.smithi039.stdout: 10 272514 20.64 MB/sec execute 585 sec latency 271.110 ms 2024-05-09T06:03:09.969 INFO:tasks.workunit.client.0.smithi039.stdout: 10 272915 20.65 MB/sec execute 586 sec latency 78.036 ms 2024-05-09T06:03:10.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:03:09 smithi060 ceph-mon[34555]: pgmap v1143: 97 pgs: 97 active+clean; 701 MiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 6.1 MiB/s wr, 392 op/s 2024-05-09T06:03:10.102 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:03:09 smithi039 ceph-mon[30439]: pgmap v1143: 97 pgs: 97 active+clean; 701 MiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 6.1 MiB/s wr, 392 op/s 2024-05-09T06:03:10.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:03:09 smithi100 ceph-mon[34353]: pgmap v1143: 97 pgs: 97 active+clean; 701 MiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 6.1 MiB/s wr, 392 op/s 2024-05-09T06:03:10.969 INFO:tasks.workunit.client.0.smithi039.stdout: 10 273347 20.66 MB/sec execute 587 sec latency 57.007 ms 2024-05-09T06:03:11.969 INFO:tasks.workunit.client.0.smithi039.stdout: 10 273662 20.65 MB/sec execute 588 sec latency 88.773 ms 2024-05-09T06:03:12.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:03:11 smithi060 ceph-mon[34555]: pgmap v1144: 97 pgs: 97 active+clean; 701 MiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 6.2 MiB/s wr, 391 op/s 2024-05-09T06:03:12.102 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:03:11 smithi039 ceph-mon[30439]: pgmap v1144: 97 pgs: 97 active+clean; 701 MiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 6.2 MiB/s wr, 391 op/s 2024-05-09T06:03:12.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:03:11 smithi100 ceph-mon[34353]: pgmap v1144: 97 pgs: 97 active+clean; 701 MiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 6.2 MiB/s wr, 391 op/s 2024-05-09T06:03:12.969 INFO:tasks.workunit.client.0.smithi039.stdout: 10 273934 20.63 MB/sec execute 589 sec latency 103.308 ms 2024-05-09T06:03:13.969 INFO:tasks.workunit.client.0.smithi039.stdout: 10 274136 20.61 MB/sec execute 590 sec latency 227.656 ms 2024-05-09T06:03:14.038 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:03:13 smithi060 ceph-mon[34555]: pgmap v1145: 97 pgs: 97 active+clean; 702 MiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 6.1 MiB/s wr, 372 op/s 2024-05-09T06:03:14.102 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:03:13 smithi039 ceph-mon[30439]: pgmap v1145: 97 pgs: 97 active+clean; 702 MiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 6.1 MiB/s wr, 372 op/s 2024-05-09T06:03:14.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:03:13 smithi100 ceph-mon[34353]: pgmap v1145: 97 pgs: 97 active+clean; 702 MiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 6.1 MiB/s wr, 372 op/s 2024-05-09T06:03:14.969 INFO:tasks.workunit.client.0.smithi039.stdout: 10 274520 20.61 MB/sec execute 591 sec latency 69.950 ms 2024-05-09T06:03:15.970 INFO:tasks.workunit.client.0.smithi039.stdout: 10 275161 20.62 MB/sec execute 592 sec latency 59.428 ms 2024-05-09T06:03:16.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:03:15 smithi060 ceph-mon[34555]: pgmap v1146: 97 pgs: 97 active+clean; 698 MiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 5.3 MiB/s wr, 345 op/s 2024-05-09T06:03:16.102 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:03:15 smithi039 ceph-mon[30439]: pgmap v1146: 97 pgs: 97 active+clean; 698 MiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 5.3 MiB/s wr, 345 op/s 2024-05-09T06:03:16.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:03:15 smithi100 ceph-mon[34353]: pgmap v1146: 97 pgs: 97 active+clean; 698 MiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 5.3 MiB/s wr, 345 op/s 2024-05-09T06:03:16.969 INFO:tasks.workunit.client.0.smithi039.stdout: 10 275772 20.64 MB/sec execute 593 sec latency 68.058 ms 2024-05-09T06:03:17.969 INFO:tasks.workunit.client.0.smithi039.stdout: 10 276237 20.66 MB/sec execute 594 sec latency 62.578 ms 2024-05-09T06:03:18.038 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:03:17 smithi060 ceph-mon[34555]: pgmap v1147: 97 pgs: 97 active+clean; 688 MiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 6.1 MiB/s wr, 401 op/s 2024-05-09T06:03:18.102 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:03:17 smithi039 ceph-mon[30439]: pgmap v1147: 97 pgs: 97 active+clean; 688 MiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 6.1 MiB/s wr, 401 op/s 2024-05-09T06:03:18.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:03:17 smithi100 ceph-mon[34353]: pgmap v1147: 97 pgs: 97 active+clean; 688 MiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 6.1 MiB/s wr, 401 op/s 2024-05-09T06:03:18.969 INFO:tasks.workunit.client.0.smithi039.stdout: 10 276494 20.65 MB/sec execute 595 sec latency 365.651 ms 2024-05-09T06:03:19.969 INFO:tasks.workunit.client.0.smithi039.stdout: 10 276896 20.67 MB/sec execute 596 sec latency 97.659 ms 2024-05-09T06:03:20.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:03:19 smithi060 ceph-mon[34555]: pgmap v1148: 97 pgs: 97 active+clean; 687 MiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 5.7 MiB/s wr, 377 op/s 2024-05-09T06:03:20.102 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:03:19 smithi039 ceph-mon[30439]: pgmap v1148: 97 pgs: 97 active+clean; 687 MiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 5.7 MiB/s wr, 377 op/s 2024-05-09T06:03:20.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:03:19 smithi100 ceph-mon[34353]: pgmap v1148: 97 pgs: 97 active+clean; 687 MiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 5.7 MiB/s wr, 377 op/s 2024-05-09T06:03:20.969 INFO:tasks.workunit.client.0.smithi039.stdout: 10 277302 20.68 MB/sec execute 597 sec latency 78.576 ms 2024-05-09T06:03:21.969 INFO:tasks.workunit.client.0.smithi039.stdout: 10 277582 20.67 MB/sec execute 598 sec latency 76.709 ms 2024-05-09T06:03:22.038 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:03:21 smithi060 ceph-mon[34555]: pgmap v1149: 97 pgs: 97 active+clean; 687 MiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 5.1 MiB/s wr, 345 op/s 2024-05-09T06:03:22.102 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:03:21 smithi039 ceph-mon[30439]: pgmap v1149: 97 pgs: 97 active+clean; 687 MiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 5.1 MiB/s wr, 345 op/s 2024-05-09T06:03:22.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:03:21 smithi100 ceph-mon[34353]: pgmap v1149: 97 pgs: 97 active+clean; 687 MiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 5.1 MiB/s wr, 345 op/s 2024-05-09T06:03:22.969 INFO:tasks.workunit.client.0.smithi039.stdout: 10 277788 20.64 MB/sec execute 599 sec latency 142.601 ms 2024-05-09T06:03:23.969 INFO:tasks.workunit.client.0.smithi039.stdout: 10 cleanup 600 sec 2024-05-09T06:03:24.038 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:03:23 smithi060 ceph-mon[34555]: pgmap v1150: 97 pgs: 97 active+clean; 692 MiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.5 MiB/s wr, 400 op/s 2024-05-09T06:03:24.102 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:03:23 smithi039 ceph-mon[30439]: pgmap v1150: 97 pgs: 97 active+clean; 692 MiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.5 MiB/s wr, 400 op/s 2024-05-09T06:03:24.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:03:23 smithi100 ceph-mon[34353]: pgmap v1150: 97 pgs: 97 active+clean; 692 MiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 5.5 MiB/s wr, 400 op/s 2024-05-09T06:03:24.969 INFO:tasks.workunit.client.0.smithi039.stdout: 9 cleanup 601 sec 2024-05-09T06:03:25.781 INFO:tasks.workunit.client.0.smithi039.stdout: 0 cleanup 602 sec 2024-05-09T06:03:25.781 INFO:tasks.workunit.client.0.smithi039.stdout: 2024-05-09T06:03:25.781 INFO:tasks.workunit.client.0.smithi039.stdout: Operation Count AvgLat MaxLat 2024-05-09T06:03:25.781 INFO:tasks.workunit.client.0.smithi039.stdout: ---------------------------------------- 2024-05-09T06:03:25.781 INFO:tasks.workunit.client.0.smithi039.stdout: NTCreateX 396026 6.634 1078.131 2024-05-09T06:03:25.781 INFO:tasks.workunit.client.0.smithi039.stdout: Close 290720 0.003 0.114 2024-05-09T06:03:25.781 INFO:tasks.workunit.client.0.smithi039.stdout: Rename 16773 28.195 4865.003 2024-05-09T06:03:25.781 INFO:tasks.workunit.client.0.smithi039.stdout: Unlink 80147 9.878 319.755 2024-05-09T06:03:25.781 INFO:tasks.workunit.client.0.smithi039.stdout: Deltree 2 213.811 299.125 2024-05-09T06:03:25.781 INFO:tasks.workunit.client.0.smithi039.stdout: Mkdir 1 0.005 0.005 2024-05-09T06:03:25.782 INFO:tasks.workunit.client.0.smithi039.stdout: Qpathinfo 359102 4.569 323.202 2024-05-09T06:03:25.782 INFO:tasks.workunit.client.0.smithi039.stdout: Qfileinfo 62657 0.001 0.058 2024-05-09T06:03:25.782 INFO:tasks.workunit.client.0.smithi039.stdout: Qfsinfo 65889 0.247 220.162 2024-05-09T06:03:25.782 INFO:tasks.workunit.client.0.smithi039.stdout: Sfileinfo 32207 0.283 239.814 2024-05-09T06:03:25.782 INFO:tasks.workunit.client.0.smithi039.stdout: Find 138818 0.650 268.147 2024-05-09T06:03:25.782 INFO:tasks.workunit.client.0.smithi039.stdout: WriteX 195967 0.075 167.844 2024-05-09T06:03:25.782 INFO:tasks.workunit.client.0.smithi039.stdout: ReadX 621565 0.023 116.566 2024-05-09T06:03:25.782 INFO:tasks.workunit.client.0.smithi039.stdout: LockX 1294 10.031 155.694 2024-05-09T06:03:25.782 INFO:tasks.workunit.client.0.smithi039.stdout: UnlockX 1294 8.330 139.218 2024-05-09T06:03:25.782 INFO:tasks.workunit.client.0.smithi039.stdout: Flush 27765 10.527 301.284 2024-05-09T06:03:25.782 INFO:tasks.workunit.client.0.smithi039.stdout: 2024-05-09T06:03:25.782 INFO:tasks.workunit.client.0.smithi039.stdout:Throughput 20.6402 MB/sec 10 clients 10 procs max_latency=4865.015 ms 2024-05-09T06:03:25.783 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-05-09T06:03:25.783 DEBUG:teuthology.orchestra.run.smithi039:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-05-09T06:03:26.102 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:03:25 smithi039 ceph-mon[30439]: pgmap v1151: 97 pgs: 97 active+clean; 693 MiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 5.2 MiB/s wr, 393 op/s 2024-05-09T06:03:26.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:03:25 smithi100 ceph-mon[34353]: pgmap v1151: 97 pgs: 97 active+clean; 693 MiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 5.2 MiB/s wr, 393 op/s 2024-05-09T06:03:26.289 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:03:25 smithi060 ceph-mon[34555]: pgmap v1151: 97 pgs: 97 active+clean; 693 MiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 5.2 MiB/s wr, 393 op/s 2024-05-09T06:03:26.766 INFO:tasks.workunit:Stopping ['suites/dbench.sh'] on client.0... 2024-05-09T06:03:26.766 DEBUG:teuthology.orchestra.run.smithi039:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-05-09T06:03:27.080 DEBUG:teuthology.parallel:result is None 2024-05-09T06:03:27.081 DEBUG:teuthology.orchestra.run.smithi039:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-05-09T06:03:27.113 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-05-09T06:03:27.113 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-05-09T06:03:27.124 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T06:03:27.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.282+0000 7f0105c2b640 1 -- 172.21.15.39:0/1685838395 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0100103d30 msgr2=0x7f0100104140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:03:27.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.282+0000 7f0105c2b640 1 --2- 172.21.15.39:0/1685838395 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0100103d30 0x7f0100104140 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f00f4009900 tx=0x7f00f402a410 comp rx=0 tx=0).stop 2024-05-09T06:03:27.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.282+0000 7f0105c2b640 1 -- 172.21.15.39:0/1685838395 shutdown_connections 2024-05-09T06:03:27.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.282+0000 7f0105c2b640 1 --2- 172.21.15.39:0/1685838395 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0100108a30 0x7f010010ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:03:27.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.282+0000 7f0105c2b640 1 --2- 172.21.15.39:0/1685838395 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0100103d30 0x7f0100104140 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:03:27.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.282+0000 7f0105c2b640 1 --2- 172.21.15.39:0/1685838395 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0100102af0 0x7f01001037f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:03:27.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.282+0000 7f0105c2b640 1 -- 172.21.15.39:0/1685838395 >> 172.21.15.39:0/1685838395 conn(0x7f01000fdd00 msgr2=0x7f0100100190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:03:27.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.282+0000 7f0105c2b640 1 -- 172.21.15.39:0/1685838395 shutdown_connections 2024-05-09T06:03:27.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.282+0000 7f0105c2b640 1 -- 172.21.15.39:0/1685838395 wait complete. 2024-05-09T06:03:27.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.283+0000 7f0105c2b640 1 Processor -- start 2024-05-09T06:03:27.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.283+0000 7f0105c2b640 1 -- start start 2024-05-09T06:03:27.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.283+0000 7f0105c2b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0100102af0 0x7f010006aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:03:27.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.283+0000 7f0105c2b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0100103d30 0x7f010019f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:03:27.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.283+0000 7f0105c2b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0100108a30 0x7f01001a1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:03:27.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.283+0000 7f0105c2b640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f010010e620 con 0x7f0100102af0 2024-05-09T06:03:27.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.283+0000 7f0105c2b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f010010e4a0 con 0x7f0100103d30 2024-05-09T06:03:27.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.283+0000 7f0105c2b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f010010e7a0 con 0x7f0100108a30 2024-05-09T06:03:27.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.284+0000 7f00ff7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0100102af0 0x7f010006aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:03:27.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.284+0000 7f00ff7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0100102af0 0x7f010006aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55228/0 (socket says 172.21.15.39:55228) 2024-05-09T06:03:27.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.284+0000 7f00ff7fe640 1 -- 172.21.15.39:0/2911809006 learned_addr learned my addr 172.21.15.39:0/2911809006 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T06:03:27.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.284+0000 7f00fffff640 1 --2- 172.21.15.39:0/2911809006 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0100108a30 0x7f01001a1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:03:27.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.284+0000 7f00feffd640 1 --2- 172.21.15.39:0/2911809006 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0100103d30 0x7f010019f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:03:27.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.284+0000 7f00ff7fe640 1 -- 172.21.15.39:0/2911809006 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0100108a30 msgr2=0x7f01001a1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:03:27.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.284+0000 7f00ff7fe640 1 --2- 172.21.15.39:0/2911809006 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0100108a30 0x7f01001a1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:03:27.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.284+0000 7f00ff7fe640 1 -- 172.21.15.39:0/2911809006 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0100103d30 msgr2=0x7f010019f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:03:27.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.284+0000 7f00ff7fe640 1 --2- 172.21.15.39:0/2911809006 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0100103d30 0x7f010019f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:03:27.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.284+0000 7f00ff7fe640 1 -- 172.21.15.39:0/2911809006 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01001a1e50 con 0x7f0100102af0 2024-05-09T06:03:27.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.284+0000 7f00fffff640 1 --2- 172.21.15.39:0/2911809006 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0100108a30 0x7f01001a1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T06:03:27.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.284+0000 7f00ff7fe640 1 --2- 172.21.15.39:0/2911809006 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0100102af0 0x7f010006aa50 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f00f000eb90 tx=0x7f00f000c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:03:27.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.284+0000 7f00fcff9640 1 -- 172.21.15.39:0/2911809006 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00f0003b70 con 0x7f0100102af0 2024-05-09T06:03:27.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.284+0000 7f0105c2b640 1 -- 172.21.15.39:0/2911809006 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01001a2140 con 0x7f0100102af0 2024-05-09T06:03:27.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.284+0000 7f00fcff9640 1 -- 172.21.15.39:0/2911809006 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f00f000ee90 con 0x7f0100102af0 2024-05-09T06:03:27.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.284+0000 7f00fcff9640 1 -- 172.21.15.39:0/2911809006 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00f00197b0 con 0x7f0100102af0 2024-05-09T06:03:27.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.284+0000 7f0105c2b640 1 -- 172.21.15.39:0/2911809006 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01001a26e0 con 0x7f0100102af0 2024-05-09T06:03:27.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.285+0000 7f0105c2b640 1 -- 172.21.15.39:0/2911809006 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0100107840 con 0x7f0100102af0 2024-05-09T06:03:27.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.287+0000 7f00fcff9640 1 -- 172.21.15.39:0/2911809006 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f00f0004030 con 0x7f0100102af0 2024-05-09T06:03:27.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.288+0000 7f00fcff9640 1 --2- 172.21.15.39:0/2911809006 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f00e80b27f0 0x7f00e80b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:03:27.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.288+0000 7f00feffd640 1 --2- 172.21.15.39:0/2911809006 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f00e80b27f0 0x7f00e80b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:03:27.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.288+0000 7f00fcff9640 1 -- 172.21.15.39:0/2911809006 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f00f00e2be0 con 0x7f0100102af0 2024-05-09T06:03:27.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.288+0000 7f00feffd640 1 --2- 172.21.15.39:0/2911809006 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f00e80b27f0 0x7f00e80b4d00 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f00f4000c00 tx=0x7f00f4031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:03:27.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.292+0000 7f00fcff9640 1 -- 172.21.15.39:0/2911809006 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f00f00aa9a0 con 0x7f0100102af0 2024-05-09T06:03:27.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.487+0000 7f0105c2b640 1 -- 172.21.15.39:0/2911809006 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f010002dc30 con 0x7f0100102af0 2024-05-09T06:03:27.476 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.490+0000 7f00fcff9640 1 -- 172.21.15.39:0/2911809006 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+22602 (secure 0 0 0) 0x7f00f00aa2a0 con 0x7f0100102af0 2024-05-09T06:03:27.477 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-09T06:03:27.477 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":83,"fsid":"86d4cc60-0dc4-11ef-bc97-c7b262605968","created":"2024-05-09T05:26:33.514203+0000","modified":"2024-05-09T05:35:29.485823+0000","last_up_change":"2024-05-09T05:33:48.776015+0000","last_in_change":"2024-05-09T05:33:28.117875+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T05:29:56.122407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-09T05:34:49.964521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-09T05:34:52.915301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3491bbda-3a9b-40d2-8627-87d15660f864","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":1056276932},{"type":"v1","addr":"172.21.15.39:6803","nonce":1056276932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":1056276932},{"type":"v1","addr":"172.21.15.39:6805","nonce":1056276932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":1056276932},{"type":"v1","addr":"172.21.15.39:6809","nonce":1056276932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":1056276932},{"type":"v1","addr":"172.21.15.39:6807","nonce":1056276932}]},"public_addr":"172.21.15.39:6803/1056276932","cluster_addr":"172.21.15.39:6805/1056276932","heartbeat_back_addr":"172.21.15.39:6809/1056276932","heartbeat_front_addr":"172.21.15.39:6807/1056276932","state":["exists","up"]},{"osd":1,"uuid":"ec2bd2d0-2975-402c-9df8-3469dfd6070f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":4245630636},{"type":"v1","addr":"172.21.15.60:6801","nonce":4245630636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":4245630636},{"type":"v1","addr":"172.21.15.60:6803","nonce":4245630636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":4245630636},{"type":"v1","addr":"172.21.15.60:6807","nonce":4245630636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":4245630636},{"type":"v1","addr":"172.21.15.60:6805","nonce":4245630636}]},"public_addr":"172.21.15.60:6801/4245630636","cluster_addr":"172.21.15.60:6803/4245630636","heartbeat_back_addr":"172.21.15.60:6807/4245630636","heartbeat_front_addr":"172.21.15.60:6805/4245630636","state":["exists","up"]},{"osd":2,"uuid":"9efaf6dd-086e-4095-b92e-cbbecf738523","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":4141597693},{"type":"v1","addr":"172.21.15.100:6801","nonce":4141597693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":4141597693},{"type":"v1","addr":"172.21.15.100:6803","nonce":4141597693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":4141597693},{"type":"v1","addr":"172.21.15.100:6807","nonce":4141597693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":4141597693},{"type":"v1","addr":"172.21.15.100:6805","nonce":4141597693}]},"public_addr":"172.21.15.100:6801/4141597693","cluster_addr":"172.21.15.100:6803/4141597693","heartbeat_back_addr":"172.21.15.100:6807/4141597693","heartbeat_front_addr":"172.21.15.100:6805/4141597693","state":["exists","up"]},{"osd":3,"uuid":"1ebe1a25-541d-4b54-bed8-4f0ec51b2432","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":2254197543},{"type":"v1","addr":"172.21.15.39:6811","nonce":2254197543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":2254197543},{"type":"v1","addr":"172.21.15.39:6813","nonce":2254197543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2254197543},{"type":"v1","addr":"172.21.15.39:6817","nonce":2254197543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":2254197543},{"type":"v1","addr":"172.21.15.39:6815","nonce":2254197543}]},"public_addr":"172.21.15.39:6811/2254197543","cluster_addr":"172.21.15.39:6813/2254197543","heartbeat_back_addr":"172.21.15.39:6817/2254197543","heartbeat_front_addr":"172.21.15.39:6815/2254197543","state":["exists","up"]},{"osd":4,"uuid":"d52450a3-8a97-4746-a857-35aec69aac44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":649037162},{"type":"v1","addr":"172.21.15.60:6809","nonce":649037162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":649037162},{"type":"v1","addr":"172.21.15.60:6811","nonce":649037162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":649037162},{"type":"v1","addr":"172.21.15.60:6815","nonce":649037162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":649037162},{"type":"v1","addr":"172.21.15.60:6813","nonce":649037162}]},"public_addr":"172.21.15.60:6809/649037162","cluster_addr":"172.21.15.60:6811/649037162","heartbeat_back_addr":"172.21.15.60:6815/649037162","heartbeat_front_addr":"172.21.15.60:6813/649037162","state":["exists","up"]},{"osd":5,"uuid":"b35bf704-898d-40f7-b575-90267764a5b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":658409226},{"type":"v1","addr":"172.21.15.100:6809","nonce":658409226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":658409226},{"type":"v1","addr":"172.21.15.100:6811","nonce":658409226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":658409226},{"type":"v1","addr":"172.21.15.100:6815","nonce":658409226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":658409226},{"type":"v1","addr":"172.21.15.100:6813","nonce":658409226}]},"public_addr":"172.21.15.100:6809/658409226","cluster_addr":"172.21.15.100:6811/658409226","heartbeat_back_addr":"172.21.15.100:6815/658409226","heartbeat_front_addr":"172.21.15.100:6813/658409226","state":["exists","up"]},{"osd":6,"uuid":"49eae2f5-1dad-4c2c-89f4-efa1dd1faefb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":237628491},{"type":"v1","addr":"172.21.15.39:6819","nonce":237628491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":237628491},{"type":"v1","addr":"172.21.15.39:6821","nonce":237628491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":237628491},{"type":"v1","addr":"172.21.15.39:6825","nonce":237628491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":237628491},{"type":"v1","addr":"172.21.15.39:6823","nonce":237628491}]},"public_addr":"172.21.15.39:6819/237628491","cluster_addr":"172.21.15.39:6821/237628491","heartbeat_back_addr":"172.21.15.39:6825/237628491","heartbeat_front_addr":"172.21.15.39:6823/237628491","state":["exists","up"]},{"osd":7,"uuid":"60ccae54-535c-4a13-98d0-881c00b5e870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":2718201647},{"type":"v1","addr":"172.21.15.60:6817","nonce":2718201647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":2718201647},{"type":"v1","addr":"172.21.15.60:6819","nonce":2718201647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":2718201647},{"type":"v1","addr":"172.21.15.60:6823","nonce":2718201647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":2718201647},{"type":"v1","addr":"172.21.15.60:6821","nonce":2718201647}]},"public_addr":"172.21.15.60:6817/2718201647","cluster_addr":"172.21.15.60:6819/2718201647","heartbeat_back_addr":"172.21.15.60:6823/2718201647","heartbeat_front_addr":"172.21.15.60:6821/2718201647","state":["exists","up"]},{"osd":8,"uuid":"edd52a21-0066-429f-9e98-15d1a74c53b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":1757558317},{"type":"v1","addr":"172.21.15.100:6817","nonce":1757558317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":1757558317},{"type":"v1","addr":"172.21.15.100:6819","nonce":1757558317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":1757558317},{"type":"v1","addr":"172.21.15.100:6823","nonce":1757558317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":1757558317},{"type":"v1","addr":"172.21.15.100:6821","nonce":1757558317}]},"public_addr":"172.21.15.100:6817/1757558317","cluster_addr":"172.21.15.100:6819/1757558317","heartbeat_back_addr":"172.21.15.100:6823/1757558317","heartbeat_front_addr":"172.21.15.100:6821/1757558317","state":["exists","up"]},{"osd":9,"uuid":"03fb7543-3386-49a4-b165-1007f07d88d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":2944584368},{"type":"v1","addr":"172.21.15.39:6827","nonce":2944584368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":2944584368},{"type":"v1","addr":"172.21.15.39:6829","nonce":2944584368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":2944584368},{"type":"v1","addr":"172.21.15.39:6833","nonce":2944584368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":2944584368},{"type":"v1","addr":"172.21.15.39:6831","nonce":2944584368}]},"public_addr":"172.21.15.39:6827/2944584368","cluster_addr":"172.21.15.39:6829/2944584368","heartbeat_back_addr":"172.21.15.39:6833/2944584368","heartbeat_front_addr":"172.21.15.39:6831/2944584368","state":["exists","up"]},{"osd":10,"uuid":"c1cadd6c-fcc4-4d76-b07e-0f392066a8d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1940670367},{"type":"v1","addr":"172.21.15.60:6825","nonce":1940670367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":1940670367},{"type":"v1","addr":"172.21.15.60:6827","nonce":1940670367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":1940670367},{"type":"v1","addr":"172.21.15.60:6831","nonce":1940670367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":1940670367},{"type":"v1","addr":"172.21.15.60:6829","nonce":1940670367}]},"public_addr":"172.21.15.60:6825/1940670367","cluster_addr":"172.21.15.60:6827/1940670367","heartbeat_back_addr":"172.21.15.60:6831/1940670367","heartbeat_front_addr":"172.21.15.60:6829/1940670367","state":["exists","up"]},{"osd":11,"uuid":"56806877-9ce2-41e2-9506-ce67897fa09b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":3318561029},{"type":"v1","addr":"172.21.15.100:6825","nonce":3318561029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":3318561029},{"type":"v1","addr":"172.21.15.100:6827","nonce":3318561029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":3318561029},{"type":"v1","addr":"172.21.15.100:6831","nonce":3318561029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":3318561029},{"type":"v1","addr":"172.21.15.100:6829","nonce":3318561029}]},"public_addr":"172.21.15.100:6825/3318561029","cluster_addr":"172.21.15.100:6827/3318561029","heartbeat_back_addr":"172.21.15.100:6831/3318561029","heartbeat_front_addr":"172.21.15.100:6829/3318561029","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:29:03.565705+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:29:28.380764+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:29:53.300224+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:30:20.046517+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:30:45.557983+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:31:10.397933+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:31:37.644428+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:32:02.325329+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:32:27.699044+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:32:54.436305+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:33:20.691300+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:33:46.806146+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.39:6801/4091500272":"2024-05-10T05:27:28.034010+0000","172.21.15.39:6800/4091500272":"2024-05-10T05:27:28.034010+0000","172.21.15.39:0/782312916":"2024-05-10T05:27:28.034010+0000","172.21.15.39:0/1899316433":"2024-05-10T05:27:28.034010+0000","172.21.15.39:0/1613215795":"2024-05-10T05:27:00.650123+0000","172.21.15.39:0/2870431271":"2024-05-10T05:27:00.650123+0000","172.21.15.39:0/438945726":"2024-05-10T05:27:00.650123+0000","172.21.15.39:6800/499609328":"2024-05-10T05:27:00.650123+0000","172.21.15.39:6801/499609328":"2024-05-10T05:27:00.650123+0000","172.21.15.39:0/1698165886":"2024-05-10T05:27:28.034010+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T06:03:27.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.494+0000 7f0105c2b640 1 -- 172.21.15.39:0/2911809006 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f00e80b27f0 msgr2=0x7f00e80b4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:03:27.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.494+0000 7f0105c2b640 1 --2- 172.21.15.39:0/2911809006 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f00e80b27f0 0x7f00e80b4d00 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f00f4000c00 tx=0x7f00f4031400 comp rx=0 tx=0).stop 2024-05-09T06:03:27.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.494+0000 7f0105c2b640 1 -- 172.21.15.39:0/2911809006 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0100102af0 msgr2=0x7f010006aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:03:27.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.494+0000 7f0105c2b640 1 --2- 172.21.15.39:0/2911809006 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0100102af0 0x7f010006aa50 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f00f000eb90 tx=0x7f00f000c6a0 comp rx=0 tx=0).stop 2024-05-09T06:03:27.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.494+0000 7f0105c2b640 1 -- 172.21.15.39:0/2911809006 shutdown_connections 2024-05-09T06:03:27.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.494+0000 7f0105c2b640 1 --2- 172.21.15.39:0/2911809006 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f00e80b27f0 0x7f00e80b4d00 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:03:27.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.494+0000 7f0105c2b640 1 --2- 172.21.15.39:0/2911809006 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0100108a30 0x7f01001a1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:03:27.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.494+0000 7f0105c2b640 1 --2- 172.21.15.39:0/2911809006 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0100103d30 0x7f010019f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:03:27.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.494+0000 7f0105c2b640 1 --2- 172.21.15.39:0/2911809006 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0100102af0 0x7f010006aa50 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:03:27.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.494+0000 7f0105c2b640 1 -- 172.21.15.39:0/2911809006 >> 172.21.15.39:0/2911809006 conn(0x7f01000fdd00 msgr2=0x7f0100104a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:03:27.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.494+0000 7f0105c2b640 1 -- 172.21.15.39:0/2911809006 shutdown_connections 2024-05-09T06:03:27.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.494+0000 7f0105c2b640 1 -- 172.21.15.39:0/2911809006 wait complete. 2024-05-09T06:03:27.496 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-09T05:29:56.122407+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-09T05:34:49.964521+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-09T05:34:52.915301+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-09T06:03:27.497 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-09T06:03:27.617 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.630+0000 7fb1e4a3b640 1 -- 172.21.15.39:0/110649914 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb1e0102b20 msgr2=0x7fb1e0103820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:03:27.617 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.630+0000 7fb1e4a3b640 1 --2- 172.21.15.39:0/110649914 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb1e0102b20 0x7fb1e0103820 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fb1d0009900 tx=0x7fb1d002a410 comp rx=0 tx=0).stop 2024-05-09T06:03:27.617 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.630+0000 7fb1e4a3b640 1 -- 172.21.15.39:0/110649914 shutdown_connections 2024-05-09T06:03:27.617 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.630+0000 7fb1e4a3b640 1 --2- 172.21.15.39:0/110649914 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb1e0108a60 0x7fb1e010ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:03:27.617 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.630+0000 7fb1e4a3b640 1 --2- 172.21.15.39:0/110649914 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1e0103d60 0x7fb1e0104170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:03:27.617 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.630+0000 7fb1e4a3b640 1 --2- 172.21.15.39:0/110649914 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb1e0102b20 0x7fb1e0103820 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:03:27.617 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.630+0000 7fb1e4a3b640 1 -- 172.21.15.39:0/110649914 >> 172.21.15.39:0/110649914 conn(0x7fb1e00fdcf0 msgr2=0x7fb1e01001c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:03:27.618 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.631+0000 7fb1e4a3b640 1 -- 172.21.15.39:0/110649914 shutdown_connections 2024-05-09T06:03:27.618 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.631+0000 7fb1e4a3b640 1 -- 172.21.15.39:0/110649914 wait complete. 2024-05-09T06:03:27.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.631+0000 7fb1e4a3b640 1 Processor -- start 2024-05-09T06:03:27.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.631+0000 7fb1e4a3b640 1 -- start start 2024-05-09T06:03:27.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.632+0000 7fb1e4a3b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1e0102b20 0x7fb1e019a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:03:27.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.632+0000 7fb1e4a3b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb1e0103d60 0x7fb1e019a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:03:27.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.632+0000 7fb1e4a3b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb1e0108a60 0x7fb1e01a1870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:03:27.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.632+0000 7fb1e4a3b640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fb1e010e620 con 0x7fb1e0103d60 2024-05-09T06:03:27.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.632+0000 7fb1e4a3b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb1e010e4a0 con 0x7fb1e0102b20 2024-05-09T06:03:27.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.632+0000 7fb1e4a3b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb1e010e7a0 con 0x7fb1e0108a60 2024-05-09T06:03:27.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.632+0000 7fb1ddd9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb1e0103d60 0x7fb1e019a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:03:27.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.632+0000 7fb1ddd9b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb1e0103d60 0x7fb1e019a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55254/0 (socket says 172.21.15.39:55254) 2024-05-09T06:03:27.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.632+0000 7fb1ddd9b640 1 -- 172.21.15.39:0/827190920 learned_addr learned my addr 172.21.15.39:0/827190920 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T06:03:27.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.632+0000 7fb1de59c640 1 --2- 172.21.15.39:0/827190920 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1e0102b20 0x7fb1e019a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:03:27.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.632+0000 7fb1ded9d640 1 --2- 172.21.15.39:0/827190920 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb1e0108a60 0x7fb1e01a1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:03:27.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.632+0000 7fb1ddd9b640 1 -- 172.21.15.39:0/827190920 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb1e0108a60 msgr2=0x7fb1e01a1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:03:27.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.632+0000 7fb1ddd9b640 1 --2- 172.21.15.39:0/827190920 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb1e0108a60 0x7fb1e01a1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:03:27.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.632+0000 7fb1ddd9b640 1 -- 172.21.15.39:0/827190920 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1e0102b20 msgr2=0x7fb1e019a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:03:27.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.632+0000 7fb1ddd9b640 1 --2- 172.21.15.39:0/827190920 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1e0102b20 0x7fb1e019a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:03:27.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.632+0000 7fb1ddd9b640 1 -- 172.21.15.39:0/827190920 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1e01a1ee0 con 0x7fb1e0103d60 2024-05-09T06:03:27.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.632+0000 7fb1ddd9b640 1 --2- 172.21.15.39:0/827190920 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb1e0103d60 0x7fb1e019a8e0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fb1d400e9f0 tx=0x7fb1d400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:03:27.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.633+0000 7fb1cf7fe640 1 -- 172.21.15.39:0/827190920 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1d400cd80 con 0x7fb1e0103d60 2024-05-09T06:03:27.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.633+0000 7fb1cf7fe640 1 -- 172.21.15.39:0/827190920 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb1d40108e0 con 0x7fb1e0103d60 2024-05-09T06:03:27.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.633+0000 7fb1e4a3b640 1 -- 172.21.15.39:0/827190920 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1e01a21d0 con 0x7fb1e0103d60 2024-05-09T06:03:27.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.633+0000 7fb1cf7fe640 1 -- 172.21.15.39:0/827190920 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1d4018980 con 0x7fb1e0103d60 2024-05-09T06:03:27.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.633+0000 7fb1e4a3b640 1 -- 172.21.15.39:0/827190920 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1e01a2770 con 0x7fb1e0103d60 2024-05-09T06:03:27.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.634+0000 7fb1e4a3b640 1 -- 172.21.15.39:0/827190920 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1e01a29d0 con 0x7fb1e0103d60 2024-05-09T06:03:27.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.636+0000 7fb1cf7fe640 1 -- 172.21.15.39:0/827190920 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7fb1d4010430 con 0x7fb1e0103d60 2024-05-09T06:03:27.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.637+0000 7fb1cf7fe640 1 --2- 172.21.15.39:0/827190920 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fb1c80b2870 0x7fb1c80b4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:03:27.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.638+0000 7fb1de59c640 1 --2- 172.21.15.39:0/827190920 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fb1c80b2870 0x7fb1c80b4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:03:27.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.638+0000 7fb1cf7fe640 1 -- 172.21.15.39:0/827190920 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7fb1d40e2930 con 0x7fb1e0103d60 2024-05-09T06:03:27.624 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.638+0000 7fb1de59c640 1 --2- 172.21.15.39:0/827190920 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fb1c80b2870 0x7fb1c80b4d80 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb1d0005ab0 tx=0x7fb1d0031400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:03:27.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.640+0000 7fb1cf7fe640 1 -- 172.21.15.39:0/827190920 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fb1d40aa010 con 0x7fb1e0103d60 2024-05-09T06:03:27.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.834+0000 7fb1e4a3b640 1 -- 172.21.15.39:0/827190920 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fb1e01a2fe0 con 0x7fb1e0103d60 2024-05-09T06:03:27.820 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.834+0000 7fb1cf7fe640 1 -- 172.21.15.39:0/827190920 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v83) ==== 93+0+10 (secure 0 0 0) 0x7fb1d40ae310 con 0x7fb1e0103d60 2024-05-09T06:03:27.821 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 1 2024-05-09T06:03:27.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.836+0000 7fb1e4a3b640 1 -- 172.21.15.39:0/827190920 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fb1c80b2870 msgr2=0x7fb1c80b4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:03:27.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.836+0000 7fb1e4a3b640 1 --2- 172.21.15.39:0/827190920 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fb1c80b2870 0x7fb1c80b4d80 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb1d0005ab0 tx=0x7fb1d0031400 comp rx=0 tx=0).stop 2024-05-09T06:03:27.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.836+0000 7fb1e4a3b640 1 -- 172.21.15.39:0/827190920 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb1e0103d60 msgr2=0x7fb1e019a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:03:27.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.836+0000 7fb1e4a3b640 1 --2- 172.21.15.39:0/827190920 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb1e0103d60 0x7fb1e019a8e0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fb1d400e9f0 tx=0x7fb1d400eeb0 comp rx=0 tx=0).stop 2024-05-09T06:03:27.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.836+0000 7fb1e4a3b640 1 -- 172.21.15.39:0/827190920 shutdown_connections 2024-05-09T06:03:27.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.836+0000 7fb1e4a3b640 1 --2- 172.21.15.39:0/827190920 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fb1c80b2870 0x7fb1c80b4d80 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:03:27.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.836+0000 7fb1e4a3b640 1 --2- 172.21.15.39:0/827190920 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb1e0108a60 0x7fb1e01a1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:03:27.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.836+0000 7fb1e4a3b640 1 --2- 172.21.15.39:0/827190920 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb1e0103d60 0x7fb1e019a8e0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:03:27.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.836+0000 7fb1e4a3b640 1 --2- 172.21.15.39:0/827190920 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1e0102b20 0x7fb1e019a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:03:27.824 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.836+0000 7fb1e4a3b640 1 -- 172.21.15.39:0/827190920 >> 172.21.15.39:0/827190920 conn(0x7fb1e00fdcf0 msgr2=0x7fb1e0109fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:03:27.824 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.836+0000 7fb1e4a3b640 1 -- 172.21.15.39:0/827190920 shutdown_connections 2024-05-09T06:03:27.824 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.836+0000 7fb1e4a3b640 1 -- 172.21.15.39:0/827190920 wait complete. 2024-05-09T06:03:27.834 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-09T06:03:27.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.967+0000 7f3e11449640 1 -- 172.21.15.39:0/2412334165 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3e0c103d50 msgr2=0x7f3e0c104160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:03:27.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.967+0000 7f3e11449640 1 --2- 172.21.15.39:0/2412334165 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3e0c103d50 0x7f3e0c104160 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f3df4009900 tx=0x7f3df402a410 comp rx=0 tx=0).stop 2024-05-09T06:03:27.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.967+0000 7f3e11449640 1 -- 172.21.15.39:0/2412334165 shutdown_connections 2024-05-09T06:03:27.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.967+0000 7f3e11449640 1 --2- 172.21.15.39:0/2412334165 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e0c108a50 0x7f3e0c10ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:03:27.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.967+0000 7f3e11449640 1 --2- 172.21.15.39:0/2412334165 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3e0c103d50 0x7f3e0c104160 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:03:27.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.967+0000 7f3e11449640 1 --2- 172.21.15.39:0/2412334165 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e0c102b10 0x7f3e0c103810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:03:27.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.967+0000 7f3e11449640 1 -- 172.21.15.39:0/2412334165 >> 172.21.15.39:0/2412334165 conn(0x7f3e0c0fdd00 msgr2=0x7f3e0c1001b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:03:27.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.967+0000 7f3e11449640 1 -- 172.21.15.39:0/2412334165 shutdown_connections 2024-05-09T06:03:27.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.967+0000 7f3e11449640 1 -- 172.21.15.39:0/2412334165 wait complete. 2024-05-09T06:03:27.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.967+0000 7f3e11449640 1 Processor -- start 2024-05-09T06:03:27.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.968+0000 7f3e11449640 1 -- start start 2024-05-09T06:03:27.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.968+0000 7f3e11449640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e0c102b10 0x7f3e0c19a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:03:27.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.968+0000 7f3e11449640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3e0c103d50 0x7f3e0c19abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:03:27.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.968+0000 7f3e11449640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e0c108a50 0x7f3e0c1a1b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:03:27.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.968+0000 7f3e11449640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f3e0c10f740 con 0x7f3e0c103d50 2024-05-09T06:03:27.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.968+0000 7f3e11449640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f3e0c10f5c0 con 0x7f3e0c102b10 2024-05-09T06:03:27.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.968+0000 7f3e11449640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3e0c10f8c0 con 0x7f3e0c108a50 2024-05-09T06:03:27.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.968+0000 7f3e0a7fc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3e0c103d50 0x7f3e0c19abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:03:27.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.968+0000 7f3e0a7fc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3e0c103d50 0x7f3e0c19abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55264/0 (socket says 172.21.15.39:55264) 2024-05-09T06:03:27.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.968+0000 7f3e0a7fc640 1 -- 172.21.15.39:0/3597578218 learned_addr learned my addr 172.21.15.39:0/3597578218 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T06:03:27.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.968+0000 7f3e0b7fe640 1 --2- 172.21.15.39:0/3597578218 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e0c108a50 0x7f3e0c1a1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:03:27.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.968+0000 7f3e0affd640 1 --2- 172.21.15.39:0/3597578218 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e0c102b10 0x7f3e0c19a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:03:27.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.968+0000 7f3e0a7fc640 1 -- 172.21.15.39:0/3597578218 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e0c108a50 msgr2=0x7f3e0c1a1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:03:27.958 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.968+0000 7f3e0a7fc640 1 --2- 172.21.15.39:0/3597578218 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e0c108a50 0x7f3e0c1a1b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:03:27.958 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.968+0000 7f3e0a7fc640 1 -- 172.21.15.39:0/3597578218 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e0c102b10 msgr2=0x7f3e0c19a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:03:27.958 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.968+0000 7f3e0a7fc640 1 --2- 172.21.15.39:0/3597578218 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e0c102b10 0x7f3e0c19a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:03:27.958 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.968+0000 7f3e0a7fc640 1 -- 172.21.15.39:0/3597578218 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e0c1a21f0 con 0x7f3e0c103d50 2024-05-09T06:03:27.958 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.968+0000 7f3e0b7fe640 1 --2- 172.21.15.39:0/3597578218 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e0c108a50 0x7f3e0c1a1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T06:03:27.958 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.968+0000 7f3e0affd640 1 --2- 172.21.15.39:0/3597578218 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e0c102b10 0x7f3e0c19a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T06:03:27.958 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.968+0000 7f3e0a7fc640 1 --2- 172.21.15.39:0/3597578218 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3e0c103d50 0x7f3e0c19abf0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f3df4006010 tx=0x7f3df4031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:03:27.958 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.969+0000 7f3e03fff640 1 -- 172.21.15.39:0/3597578218 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df403f030 con 0x7f3e0c103d50 2024-05-09T06:03:27.958 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.969+0000 7f3e03fff640 1 -- 172.21.15.39:0/3597578218 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3df4003aa0 con 0x7f3e0c103d50 2024-05-09T06:03:27.958 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.969+0000 7f3e11449640 1 -- 172.21.15.39:0/3597578218 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e0c1a2480 con 0x7f3e0c103d50 2024-05-09T06:03:27.958 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.969+0000 7f3e03fff640 1 -- 172.21.15.39:0/3597578218 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df4035070 con 0x7f3e0c103d50 2024-05-09T06:03:27.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.969+0000 7f3e11449640 1 -- 172.21.15.39:0/3597578218 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e0c1a2970 con 0x7f3e0c103d50 2024-05-09T06:03:27.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.970+0000 7f3e11449640 1 -- 172.21.15.39:0/3597578218 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e0c107860 con 0x7f3e0c103d50 2024-05-09T06:03:27.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.972+0000 7f3e03fff640 1 -- 172.21.15.39:0/3597578218 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f3df4042030 con 0x7f3e0c103d50 2024-05-09T06:03:27.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.973+0000 7f3e03fff640 1 --2- 172.21.15.39:0/3597578218 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f3df80b27f0 0x7f3df80b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:03:27.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.973+0000 7f3e0affd640 1 --2- 172.21.15.39:0/3597578218 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f3df80b27f0 0x7f3df80b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:03:27.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.973+0000 7f3e03fff640 1 -- 172.21.15.39:0/3597578218 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f3df4102e80 con 0x7f3e0c103d50 2024-05-09T06:03:27.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.973+0000 7f3e0affd640 1 --2- 172.21.15.39:0/3597578218 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f3df80b27f0 0x7f3df80b4d00 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c103710 tx=0x7f3dfc009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:03:27.962 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:27.976+0000 7f3e03fff640 1 -- 172.21.15.39:0/3597578218 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f3df40cabb0 con 0x7f3e0c103d50 2024-05-09T06:03:28.102 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:03:27 smithi039 ceph-mon[30439]: pgmap v1152: 97 pgs: 97 active+clean; 682 MiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 5.3 MiB/s wr, 374 op/s 2024-05-09T06:03:28.102 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:03:27 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/2911809006' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T06:03:28.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.169+0000 7f3e11449640 1 -- 172.21.15.39:0/3597578218 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f3e0c02dd30 con 0x7f3e0c103d50 2024-05-09T06:03:28.156 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.170+0000 7f3e03fff640 1 -- 172.21.15.39:0/3597578218 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v83) ==== 104+0+11 (secure 0 0 0) 0x7f3df40ca4b0 con 0x7f3e0c103d50 2024-05-09T06:03:28.156 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 32 2024-05-09T06:03:28.158 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.172+0000 7f3e11449640 1 -- 172.21.15.39:0/3597578218 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f3df80b27f0 msgr2=0x7f3df80b4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:03:28.158 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.172+0000 7f3e11449640 1 --2- 172.21.15.39:0/3597578218 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f3df80b27f0 0x7f3df80b4d00 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c103710 tx=0x7f3dfc009500 comp rx=0 tx=0).stop 2024-05-09T06:03:28.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.172+0000 7f3e11449640 1 -- 172.21.15.39:0/3597578218 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3e0c103d50 msgr2=0x7f3e0c19abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:03:28.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.172+0000 7f3e11449640 1 --2- 172.21.15.39:0/3597578218 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3e0c103d50 0x7f3e0c19abf0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f3df4006010 tx=0x7f3df4031a50 comp rx=0 tx=0).stop 2024-05-09T06:03:28.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.172+0000 7f3e11449640 1 -- 172.21.15.39:0/3597578218 shutdown_connections 2024-05-09T06:03:28.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.172+0000 7f3e11449640 1 --2- 172.21.15.39:0/3597578218 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f3df80b27f0 0x7f3df80b4d00 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:03:28.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.172+0000 7f3e11449640 1 --2- 172.21.15.39:0/3597578218 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e0c108a50 0x7f3e0c1a1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:03:28.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.172+0000 7f3e11449640 1 --2- 172.21.15.39:0/3597578218 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3e0c103d50 0x7f3e0c19abf0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:03:28.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.172+0000 7f3e11449640 1 --2- 172.21.15.39:0/3597578218 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e0c102b10 0x7f3e0c19a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:03:28.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.172+0000 7f3e11449640 1 -- 172.21.15.39:0/3597578218 >> 172.21.15.39:0/3597578218 conn(0x7f3e0c0fdd00 msgr2=0x7f3e0c104a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:03:28.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.172+0000 7f3e11449640 1 -- 172.21.15.39:0/3597578218 shutdown_connections 2024-05-09T06:03:28.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.172+0000 7f3e11449640 1 -- 172.21.15.39:0/3597578218 wait complete. 2024-05-09T06:03:28.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:03:27 smithi100 ceph-mon[34353]: pgmap v1152: 97 pgs: 97 active+clean; 682 MiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 5.3 MiB/s wr, 374 op/s 2024-05-09T06:03:28.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:03:27 smithi100 ceph-mon[34353]: from='client.? 172.21.15.39:0/2911809006' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T06:03:28.170 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-09T06:03:28.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.302+0000 7f391331c640 1 -- 172.21.15.39:0/1464524861 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f390c103d50 msgr2=0x7f390c104160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:03:28.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.302+0000 7f391331c640 1 --2- 172.21.15.39:0/1464524861 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f390c103d50 0x7f390c104160 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f3900009900 tx=0x7f390002a410 comp rx=0 tx=0).stop 2024-05-09T06:03:28.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.302+0000 7f391331c640 1 -- 172.21.15.39:0/1464524861 shutdown_connections 2024-05-09T06:03:28.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.302+0000 7f391331c640 1 --2- 172.21.15.39:0/1464524861 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f390c108a50 0x7f390c10ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:03:28.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.302+0000 7f391331c640 1 --2- 172.21.15.39:0/1464524861 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f390c103d50 0x7f390c104160 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:03:28.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.302+0000 7f391331c640 1 --2- 172.21.15.39:0/1464524861 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f390c102b10 0x7f390c103810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:03:28.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.302+0000 7f391331c640 1 -- 172.21.15.39:0/1464524861 >> 172.21.15.39:0/1464524861 conn(0x7f390c0fdd00 msgr2=0x7f390c1001b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:03:28.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.302+0000 7f391331c640 1 -- 172.21.15.39:0/1464524861 shutdown_connections 2024-05-09T06:03:28.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.302+0000 7f391331c640 1 -- 172.21.15.39:0/1464524861 wait complete. 2024-05-09T06:03:28.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.303+0000 7f391331c640 1 Processor -- start 2024-05-09T06:03:28.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.303+0000 7f391331c640 1 -- start start 2024-05-09T06:03:28.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.303+0000 7f391331c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f390c102b10 0x7f390c199590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:03:28.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.303+0000 7f391331c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f390c103d50 0x7f390c199ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:03:28.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.303+0000 7f391331c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f390c108a50 0x7f390c1a0a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:03:28.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.303+0000 7f391331c640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f390c10e630 con 0x7f390c102b10 2024-05-09T06:03:28.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.303+0000 7f391331c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f390c10e4b0 con 0x7f390c108a50 2024-05-09T06:03:28.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.303+0000 7f391331c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f390c10e7b0 con 0x7f390c103d50 2024-05-09T06:03:28.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.303+0000 7f39110b8640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f390c102b10 0x7f390c199590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:03:28.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.303+0000 7f39110b8640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f390c102b10 0x7f390c199590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55288/0 (socket says 172.21.15.39:55288) 2024-05-09T06:03:28.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.303+0000 7f39110b8640 1 -- 172.21.15.39:0/267278863 learned_addr learned my addr 172.21.15.39:0/267278863 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T06:03:28.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.303+0000 7f39108b7640 1 --2- 172.21.15.39:0/267278863 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f390c103d50 0x7f390c199ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:03:28.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.303+0000 7f39118b9640 1 --2- 172.21.15.39:0/267278863 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f390c108a50 0x7f390c1a0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:03:28.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.303+0000 7f39110b8640 1 -- 172.21.15.39:0/267278863 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f390c103d50 msgr2=0x7f390c199ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:03:28.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.303+0000 7f39110b8640 1 --2- 172.21.15.39:0/267278863 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f390c103d50 0x7f390c199ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:03:28.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.303+0000 7f39110b8640 1 -- 172.21.15.39:0/267278863 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f390c108a50 msgr2=0x7f390c1a0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:03:28.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.303+0000 7f39110b8640 1 --2- 172.21.15.39:0/267278863 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f390c108a50 0x7f390c1a0a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:03:28.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.303+0000 7f39110b8640 1 -- 172.21.15.39:0/267278863 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f390c1a10d0 con 0x7f390c102b10 2024-05-09T06:03:28.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.303+0000 7f39108b7640 1 --2- 172.21.15.39:0/267278863 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f390c103d50 0x7f390c199ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T06:03:28.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.304+0000 7f39110b8640 1 --2- 172.21.15.39:0/267278863 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f390c102b10 0x7f390c199590 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f3908005d00 tx=0x7f390800dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:03:28.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.304+0000 7f38fe7fc640 1 -- 172.21.15.39:0/267278863 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3908017070 con 0x7f390c102b10 2024-05-09T06:03:28.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.304+0000 7f38fe7fc640 1 -- 172.21.15.39:0/267278863 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3908009c30 con 0x7f390c102b10 2024-05-09T06:03:28.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.304+0000 7f391331c640 1 -- 172.21.15.39:0/267278863 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f390c1a13c0 con 0x7f390c102b10 2024-05-09T06:03:28.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.304+0000 7f38fe7fc640 1 -- 172.21.15.39:0/267278863 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f390800f620 con 0x7f390c102b10 2024-05-09T06:03:28.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.304+0000 7f391331c640 1 -- 172.21.15.39:0/267278863 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f390c1a18c0 con 0x7f390c102b10 2024-05-09T06:03:28.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.305+0000 7f391331c640 1 -- 172.21.15.39:0/267278863 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f390c107860 con 0x7f390c102b10 2024-05-09T06:03:28.294 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:03:27 smithi060 ceph-mon[34555]: pgmap v1152: 97 pgs: 97 active+clean; 682 MiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 5.3 MiB/s wr, 374 op/s 2024-05-09T06:03:28.294 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:03:27 smithi060 ceph-mon[34555]: from='client.? 172.21.15.39:0/2911809006' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T06:03:28.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.306+0000 7f38fe7fc640 1 -- 172.21.15.39:0/267278863 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f390801a070 con 0x7f390c102b10 2024-05-09T06:03:28.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.307+0000 7f38fe7fc640 1 --2- 172.21.15.39:0/267278863 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f38f80b27f0 0x7f38f80b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:03:28.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.308+0000 7f39108b7640 1 --2- 172.21.15.39:0/267278863 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f38f80b27f0 0x7f38f80b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:03:28.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.308+0000 7f38fe7fc640 1 -- 172.21.15.39:0/267278863 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f39080e1d30 con 0x7f390c102b10 2024-05-09T06:03:28.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.308+0000 7f39108b7640 1 --2- 172.21.15.39:0/267278863 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f38f80b27f0 0x7f38f80b4d00 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f3900000c00 tx=0x7f3900005d50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:03:28.297 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.311+0000 7f38fe7fc640 1 -- 172.21.15.39:0/267278863 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f3908009de0 con 0x7f390c102b10 2024-05-09T06:03:28.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.598+0000 7f391331c640 1 -- 172.21.15.39:0/267278863 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f390c02de30 con 0x7f390c102b10 2024-05-09T06:03:28.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.599+0000 7f38fe7fc640 1 -- 172.21.15.39:0/267278863 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v83) ==== 100+0+11 (secure 0 0 0) 0x7f39080a9a60 con 0x7f390c102b10 2024-05-09T06:03:28.585 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 64 2024-05-09T06:03:28.587 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.601+0000 7f391331c640 1 -- 172.21.15.39:0/267278863 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f38f80b27f0 msgr2=0x7f38f80b4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:03:28.587 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.601+0000 7f391331c640 1 --2- 172.21.15.39:0/267278863 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f38f80b27f0 0x7f38f80b4d00 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f3900000c00 tx=0x7f3900005d50 comp rx=0 tx=0).stop 2024-05-09T06:03:28.587 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.601+0000 7f391331c640 1 -- 172.21.15.39:0/267278863 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f390c102b10 msgr2=0x7f390c199590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:03:28.587 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.601+0000 7f391331c640 1 --2- 172.21.15.39:0/267278863 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f390c102b10 0x7f390c199590 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f3908005d00 tx=0x7f390800dde0 comp rx=0 tx=0).stop 2024-05-09T06:03:28.587 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.601+0000 7f391331c640 1 -- 172.21.15.39:0/267278863 shutdown_connections 2024-05-09T06:03:28.587 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.601+0000 7f391331c640 1 --2- 172.21.15.39:0/267278863 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f38f80b27f0 0x7f38f80b4d00 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:03:28.587 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.601+0000 7f391331c640 1 --2- 172.21.15.39:0/267278863 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f390c108a50 0x7f390c1a0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:03:28.588 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.601+0000 7f391331c640 1 --2- 172.21.15.39:0/267278863 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f390c103d50 0x7f390c199ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:03:28.588 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.601+0000 7f391331c640 1 --2- 172.21.15.39:0/267278863 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f390c102b10 0x7f390c199590 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:03:28.588 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.601+0000 7f391331c640 1 -- 172.21.15.39:0/267278863 >> 172.21.15.39:0/267278863 conn(0x7f390c0fdd00 msgr2=0x7f390c104a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:03:28.588 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.601+0000 7f391331c640 1 -- 172.21.15.39:0/267278863 shutdown_connections 2024-05-09T06:03:28.588 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.601+0000 7f391331c640 1 -- 172.21.15.39:0/267278863 wait complete. 2024-05-09T06:03:28.599 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-05-09T06:03:28.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.730+0000 7fa4a0300640 1 -- 172.21.15.39:0/1438712002 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa498108a30 msgr2=0x7fa49810ae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:03:28.719 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.730+0000 7fa4a0300640 1 --2- 172.21.15.39:0/1438712002 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa498108a30 0x7fa49810ae50 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fa488009ca0 tx=0x7fa48802a8c0 comp rx=0 tx=0).stop 2024-05-09T06:03:28.719 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.730+0000 7fa4a0300640 1 -- 172.21.15.39:0/1438712002 shutdown_connections 2024-05-09T06:03:28.719 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.730+0000 7fa4a0300640 1 --2- 172.21.15.39:0/1438712002 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa498108a30 0x7fa49810ae50 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:03:28.719 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.730+0000 7fa4a0300640 1 --2- 172.21.15.39:0/1438712002 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa498103d30 0x7fa498104140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:03:28.719 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.730+0000 7fa4a0300640 1 --2- 172.21.15.39:0/1438712002 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa498102af0 0x7fa4981037f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:03:28.719 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.730+0000 7fa4a0300640 1 -- 172.21.15.39:0/1438712002 >> 172.21.15.39:0/1438712002 conn(0x7fa4980fdd00 msgr2=0x7fa498100190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:03:28.719 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.730+0000 7fa4a0300640 1 -- 172.21.15.39:0/1438712002 shutdown_connections 2024-05-09T06:03:28.719 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.730+0000 7fa4a0300640 1 -- 172.21.15.39:0/1438712002 wait complete. 2024-05-09T06:03:28.719 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.730+0000 7fa4a0300640 1 Processor -- start 2024-05-09T06:03:28.719 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.731+0000 7fa4a0300640 1 -- start start 2024-05-09T06:03:28.719 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.731+0000 7fa4a0300640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa498102af0 0x7fa49806aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:03:28.719 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.731+0000 7fa4a0300640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa498103d30 0x7fa49819f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:03:28.720 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.731+0000 7fa4a0300640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa498108a30 0x7fa4981a1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:03:28.720 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.731+0000 7fa4a0300640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fa49810e620 con 0x7fa498103d30 2024-05-09T06:03:28.720 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.731+0000 7fa4a0300640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa49810e4a0 con 0x7fa498102af0 2024-05-09T06:03:28.720 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.731+0000 7fa4a0300640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa49810e7a0 con 0x7fa498108a30 2024-05-09T06:03:28.720 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.731+0000 7fa49d89b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa498103d30 0x7fa49819f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:03:28.720 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.731+0000 7fa49e09c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa498102af0 0x7fa49806aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:03:28.720 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.731+0000 7fa49d89b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa498103d30 0x7fa49819f050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:55308/0 (socket says 172.21.15.39:55308) 2024-05-09T06:03:28.720 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.731+0000 7fa49d89b640 1 -- 172.21.15.39:0/1442543806 learned_addr learned my addr 172.21.15.39:0/1442543806 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T06:03:28.720 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.731+0000 7fa49e89d640 1 --2- 172.21.15.39:0/1442543806 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa498108a30 0x7fa4981a1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:03:28.720 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.731+0000 7fa49d89b640 1 -- 172.21.15.39:0/1442543806 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa498108a30 msgr2=0x7fa4981a1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:03:28.720 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.731+0000 7fa49d89b640 1 --2- 172.21.15.39:0/1442543806 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa498108a30 0x7fa4981a1600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:03:28.720 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.731+0000 7fa49d89b640 1 -- 172.21.15.39:0/1442543806 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa498102af0 msgr2=0x7fa49806aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:03:28.720 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.731+0000 7fa49d89b640 1 --2- 172.21.15.39:0/1442543806 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa498102af0 0x7fa49806aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:03:28.721 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.731+0000 7fa49d89b640 1 -- 172.21.15.39:0/1442543806 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4981a1e20 con 0x7fa498103d30 2024-05-09T06:03:28.721 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.731+0000 7fa49d89b640 1 --2- 172.21.15.39:0/1442543806 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa498103d30 0x7fa49819f050 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fa48c00d770 tx=0x7fa48c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:03:28.721 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.732+0000 7fa4977fe640 1 -- 172.21.15.39:0/1442543806 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa48c017070 con 0x7fa498103d30 2024-05-09T06:03:28.721 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.732+0000 7fa4977fe640 1 -- 172.21.15.39:0/1442543806 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa48c0054d0 con 0x7fa498103d30 2024-05-09T06:03:28.721 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.732+0000 7fa4a0300640 1 -- 172.21.15.39:0/1442543806 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4981a2110 con 0x7fa498103d30 2024-05-09T06:03:28.721 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.732+0000 7fa4977fe640 1 -- 172.21.15.39:0/1442543806 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa48c004c30 con 0x7fa498103d30 2024-05-09T06:03:28.721 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.732+0000 7fa4a0300640 1 -- 172.21.15.39:0/1442543806 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4981a2610 con 0x7fa498103d30 2024-05-09T06:03:28.722 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.733+0000 7fa4a0300640 1 -- 172.21.15.39:0/1442543806 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa498107840 con 0x7fa498103d30 2024-05-09T06:03:28.722 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.735+0000 7fa4977fe640 1 -- 172.21.15.39:0/1442543806 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7fa48c004dd0 con 0x7fa498103d30 2024-05-09T06:03:28.722 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.736+0000 7fa4977fe640 1 --2- 172.21.15.39:0/1442543806 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fa4800b27f0 0x7fa4800b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:03:28.722 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.736+0000 7fa49e09c640 1 --2- 172.21.15.39:0/1442543806 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fa4800b27f0 0x7fa4800b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:03:28.722 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.736+0000 7fa4977fe640 1 -- 172.21.15.39:0/1442543806 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7fa48c0e1fa0 con 0x7fa498103d30 2024-05-09T06:03:28.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.736+0000 7fa49e09c640 1 --2- 172.21.15.39:0/1442543806 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fa4800b27f0 0x7fa4800b4d00 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fa490005fd0 tx=0x7fa49000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:03:28.726 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.740+0000 7fa4977fe640 1 -- 172.21.15.39:0/1442543806 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fa48c0a9680 con 0x7fa498103d30 2024-05-09T06:03:28.852 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:03:28 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/827190920' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-09T06:03:28.852 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:03:28 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/3597578218' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-09T06:03:28.853 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:03:28 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/267278863' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-09T06:03:28.978 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:28.992+0000 7fa4a0300640 1 -- 172.21.15.39:0/1442543806 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7fa4980638d0 con 0x7fa498103d30 2024-05-09T06:03:28.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:29.001+0000 7fa4977fe640 1 -- 172.21.15.39:0/1442543806 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v20) ==== 81+0+815642 (secure 0 0 0) 0x7fa48c0ad980 con 0x7fa498103d30 2024-05-09T06:03:28.998 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-09T06:03:28.999 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-05-09T06:03:28.999 INFO:teuthology.orchestra.run.smithi039.stdout: "epoch": 20, 2024-05-09T06:03:28.999 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:28.999 INFO:teuthology.orchestra.run.smithi039.stdout: "active_gid": 14152, 2024-05-09T06:03:28.999 INFO:teuthology.orchestra.run.smithi039.stdout: "active_name": "x", 2024-05-09T06:03:28.999 INFO:teuthology.orchestra.run.smithi039.stdout: "active_addrs": { 2024-05-09T06:03:28.999 INFO:teuthology.orchestra.run.smithi039.stdout: "addrvec": [ 2024-05-09T06:03:28.999 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:28.999 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "v2", 2024-05-09T06:03:28.999 INFO:teuthology.orchestra.run.smithi039.stdout: "addr": "172.21.15.39:6800", 2024-05-09T06:03:28.999 INFO:teuthology.orchestra.run.smithi039.stdout: "nonce": 3184189003 2024-05-09T06:03:28.999 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:28.999 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:28.999 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "v1", 2024-05-09T06:03:29.000 INFO:teuthology.orchestra.run.smithi039.stdout: "addr": "172.21.15.39:6801", 2024-05-09T06:03:29.000 INFO:teuthology.orchestra.run.smithi039.stdout: "nonce": 3184189003 2024-05-09T06:03:29.000 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.000 INFO:teuthology.orchestra.run.smithi039.stdout: ] 2024-05-09T06:03:29.000 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.000 INFO:teuthology.orchestra.run.smithi039.stdout: "active_addr": "172.21.15.39:6801/3184189003", 2024-05-09T06:03:29.000 INFO:teuthology.orchestra.run.smithi039.stdout: "active_change": "2024-05-09T05:27:28.034198+0000", 2024-05-09T06:03:29.000 INFO:teuthology.orchestra.run.smithi039.stdout: "active_mgr_features": 4540701547738038271, 2024-05-09T06:03:29.000 INFO:teuthology.orchestra.run.smithi039.stdout: "available": true, 2024-05-09T06:03:29.000 INFO:teuthology.orchestra.run.smithi039.stdout: "standbys": [ 2024-05-09T06:03:29.000 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:29.000 INFO:teuthology.orchestra.run.smithi039.stdout: "gid": 24109, 2024-05-09T06:03:29.000 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "z", 2024-05-09T06:03:29.000 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr_features": 4540701547738038271, 2024-05-09T06:03:29.001 INFO:teuthology.orchestra.run.smithi039.stdout: "available_modules": [ 2024-05-09T06:03:29.001 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:29.001 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "alerts", 2024-05-09T06:03:29.001 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-05-09T06:03:29.001 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-05-09T06:03:29.001 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:29.001 INFO:teuthology.orchestra.run.smithi039.stdout: "interval": { 2024-05-09T06:03:29.001 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "interval", 2024-05-09T06:03:29.001 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-05-09T06:03:29.001 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.001 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.001 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "60", 2024-05-09T06:03:29.001 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.001 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.002 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.002 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "How frequently to reexamine health status", 2024-05-09T06:03:29.002 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.002 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.002 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.002 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.002 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:29.002 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:29.002 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.002 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.002 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.002 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.002 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.003 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.003 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.003 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.003 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.003 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.003 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.003 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.003 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.003 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.003 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.003 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.003 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.003 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.003 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.004 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:29.004 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:29.004 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.004 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.004 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.004 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.004 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.004 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.004 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.004 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.004 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.005 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.005 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.005 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.005 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:29.005 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:29.005 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.005 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.005 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.005 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:29.005 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.005 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.005 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.005 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.005 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.005 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.006 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.006 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.006 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.006 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.006 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.006 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.006 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.006 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.006 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.006 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:29.006 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:29.006 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.006 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.006 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.007 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.007 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.007 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.007 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.007 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.007 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.007 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.007 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.007 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.007 INFO:teuthology.orchestra.run.smithi039.stdout: "smtp_destination": { 2024-05-09T06:03:29.007 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "smtp_destination", 2024-05-09T06:03:29.007 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.007 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.007 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.008 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.008 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.008 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.008 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.008 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Email address to send alerts to", 2024-05-09T06:03:29.008 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.008 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.008 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.008 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.008 INFO:teuthology.orchestra.run.smithi039.stdout: "smtp_from_name": { 2024-05-09T06:03:29.008 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "smtp_from_name", 2024-05-09T06:03:29.008 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.008 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.008 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.009 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "Ceph", 2024-05-09T06:03:29.009 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.009 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.009 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.009 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Email From: name", 2024-05-09T06:03:29.009 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.009 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.009 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.009 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.009 INFO:teuthology.orchestra.run.smithi039.stdout: "smtp_host": { 2024-05-09T06:03:29.009 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "smtp_host", 2024-05-09T06:03:29.009 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.009 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.009 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.009 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.010 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.010 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.010 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.010 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "SMTP server", 2024-05-09T06:03:29.010 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.010 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.010 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.010 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.010 INFO:teuthology.orchestra.run.smithi039.stdout: "smtp_password": { 2024-05-09T06:03:29.010 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "smtp_password", 2024-05-09T06:03:29.010 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.010 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.010 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.010 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.011 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.011 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.011 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.011 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Password to authenticate with", 2024-05-09T06:03:29.011 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.011 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.011 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.011 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.011 INFO:teuthology.orchestra.run.smithi039.stdout: "smtp_port": { 2024-05-09T06:03:29.011 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "smtp_port", 2024-05-09T06:03:29.011 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.011 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.011 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.011 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "465", 2024-05-09T06:03:29.011 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.012 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.012 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.012 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "SMTP port", 2024-05-09T06:03:29.012 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.012 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.012 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.012 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.012 INFO:teuthology.orchestra.run.smithi039.stdout: "smtp_sender": { 2024-05-09T06:03:29.012 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "smtp_sender", 2024-05-09T06:03:29.012 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.012 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.012 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.012 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.012 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.012 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.012 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.013 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "SMTP envelope sender", 2024-05-09T06:03:29.013 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.013 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.013 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.013 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.013 INFO:teuthology.orchestra.run.smithi039.stdout: "smtp_ssl": { 2024-05-09T06:03:29.013 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "smtp_ssl", 2024-05-09T06:03:29.013 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.013 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.013 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.013 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:29.013 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.014 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.014 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.014 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Use SSL to connect to SMTP server", 2024-05-09T06:03:29.014 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.014 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.014 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.014 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.014 INFO:teuthology.orchestra.run.smithi039.stdout: "smtp_user": { 2024-05-09T06:03:29.014 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "smtp_user", 2024-05-09T06:03:29.014 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.014 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.014 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.014 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.015 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.015 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.015 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.015 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "User to authenticate as", 2024-05-09T06:03:29.015 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.015 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.015 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.015 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.015 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:29.015 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:29.015 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.015 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:29.015 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.015 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:29.016 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.016 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.016 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.016 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.016 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.016 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.016 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.016 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.016 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.016 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.016 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:29.016 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "balancer", 2024-05-09T06:03:29.016 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-05-09T06:03:29.016 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-05-09T06:03:29.016 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:29.017 INFO:teuthology.orchestra.run.smithi039.stdout: "active": { 2024-05-09T06:03:29.017 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "active", 2024-05-09T06:03:29.017 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.017 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.017 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.017 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:29.017 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.017 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.017 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.017 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "automatically balance PGs across cluster", 2024-05-09T06:03:29.017 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.017 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.017 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.018 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.018 INFO:teuthology.orchestra.run.smithi039.stdout: "begin_time": { 2024-05-09T06:03:29.018 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "begin_time", 2024-05-09T06:03:29.018 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.018 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.018 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.018 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0000", 2024-05-09T06:03:29.018 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.018 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.018 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.018 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "beginning time of day to automatically balance", 2024-05-09T06:03:29.018 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-09T06:03:29.018 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.018 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.019 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.019 INFO:teuthology.orchestra.run.smithi039.stdout: "begin_weekday": { 2024-05-09T06:03:29.019 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "begin_weekday", 2024-05-09T06:03:29.019 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "uint", 2024-05-09T06:03:29.019 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.019 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.019 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:29.019 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "0", 2024-05-09T06:03:29.019 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "6", 2024-05-09T06:03:29.019 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.019 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-05-09T06:03:29.019 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-09T06:03:29.019 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.019 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.019 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.020 INFO:teuthology.orchestra.run.smithi039.stdout: "crush_compat_max_iterations": { 2024-05-09T06:03:29.020 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "crush_compat_max_iterations", 2024-05-09T06:03:29.020 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "uint", 2024-05-09T06:03:29.020 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.020 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.020 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "25", 2024-05-09T06:03:29.020 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "1", 2024-05-09T06:03:29.020 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "250", 2024-05-09T06:03:29.020 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.020 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-05-09T06:03:29.020 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.020 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.020 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.020 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.021 INFO:teuthology.orchestra.run.smithi039.stdout: "crush_compat_metrics": { 2024-05-09T06:03:29.021 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "crush_compat_metrics", 2024-05-09T06:03:29.021 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.021 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.021 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.021 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "pgs,objects,bytes", 2024-05-09T06:03:29.021 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.021 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.021 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.021 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-05-09T06:03:29.021 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-05-09T06:03:29.021 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.021 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.021 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.021 INFO:teuthology.orchestra.run.smithi039.stdout: "crush_compat_step": { 2024-05-09T06:03:29.022 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "crush_compat_step", 2024-05-09T06:03:29.022 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "float", 2024-05-09T06:03:29.022 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.022 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.022 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0.5", 2024-05-09T06:03:29.022 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "0.001", 2024-05-09T06:03:29.022 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "0.999", 2024-05-09T06:03:29.022 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.022 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "aggressiveness of optimization", 2024-05-09T06:03:29.022 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-05-09T06:03:29.022 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.022 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.022 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.022 INFO:teuthology.orchestra.run.smithi039.stdout: "end_time": { 2024-05-09T06:03:29.023 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "end_time", 2024-05-09T06:03:29.023 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.023 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.023 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.023 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "2359", 2024-05-09T06:03:29.023 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.023 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.023 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.023 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "ending time of day to automatically balance", 2024-05-09T06:03:29.023 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-09T06:03:29.025 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.025 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.025 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.025 INFO:teuthology.orchestra.run.smithi039.stdout: "end_weekday": { 2024-05-09T06:03:29.025 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "end_weekday", 2024-05-09T06:03:29.025 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "uint", 2024-05-09T06:03:29.025 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.025 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.025 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:29.025 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "0", 2024-05-09T06:03:29.026 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "6", 2024-05-09T06:03:29.026 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.026 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-05-09T06:03:29.026 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-09T06:03:29.026 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.026 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.026 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.026 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:29.026 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:29.026 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.026 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.026 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.026 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.026 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.027 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.027 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.027 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.027 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.027 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.027 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.027 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.027 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.027 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.027 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.027 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.027 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.027 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.027 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.027 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:29.028 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:29.028 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.028 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.028 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.028 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.028 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.028 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.028 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.028 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.028 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.028 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.028 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.028 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.028 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:29.028 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:29.029 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.029 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.029 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.029 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:29.029 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.029 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.029 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.029 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.029 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.029 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.029 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.029 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.029 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.029 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.030 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.030 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.030 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.030 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.030 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.030 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:29.030 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:29.030 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.030 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.030 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.030 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.030 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.030 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.030 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.031 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.031 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.031 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.031 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.031 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.031 INFO:teuthology.orchestra.run.smithi039.stdout: "min_score": { 2024-05-09T06:03:29.031 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "min_score", 2024-05-09T06:03:29.031 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "float", 2024-05-09T06:03:29.031 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.031 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.031 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:29.031 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.031 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.031 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.032 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-05-09T06:03:29.032 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.032 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.032 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.032 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.032 INFO:teuthology.orchestra.run.smithi039.stdout: "mode": { 2024-05-09T06:03:29.032 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "mode", 2024-05-09T06:03:29.032 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.032 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.032 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.032 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "upmap", 2024-05-09T06:03:29.032 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.032 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.032 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.033 INFO:teuthology.orchestra.run.smithi039.stdout: "crush-compat", 2024-05-09T06:03:29.033 INFO:teuthology.orchestra.run.smithi039.stdout: "none", 2024-05-09T06:03:29.033 INFO:teuthology.orchestra.run.smithi039.stdout: "read", 2024-05-09T06:03:29.033 INFO:teuthology.orchestra.run.smithi039.stdout: "upmap", 2024-05-09T06:03:29.033 INFO:teuthology.orchestra.run.smithi039.stdout: "upmap-read" 2024-05-09T06:03:29.033 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.033 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Balancer mode", 2024-05-09T06:03:29.033 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.033 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.033 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.033 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.033 INFO:teuthology.orchestra.run.smithi039.stdout: "pool_ids": { 2024-05-09T06:03:29.033 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "pool_ids", 2024-05-09T06:03:29.033 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.034 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.034 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.034 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.034 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.034 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.034 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.034 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-05-09T06:03:29.034 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.034 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.034 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.034 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.034 INFO:teuthology.orchestra.run.smithi039.stdout: "sleep_interval": { 2024-05-09T06:03:29.034 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sleep_interval", 2024-05-09T06:03:29.034 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-05-09T06:03:29.035 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.035 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.035 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "60", 2024-05-09T06:03:29.035 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.035 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.035 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.035 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-05-09T06:03:29.035 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.035 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.035 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.035 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.035 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:29.035 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:29.035 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.036 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:29.036 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.036 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:29.036 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.036 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.036 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.036 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.036 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.036 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.036 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.036 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.036 INFO:teuthology.orchestra.run.smithi039.stdout: "upmap_max_deviation": { 2024-05-09T06:03:29.036 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "upmap_max_deviation", 2024-05-09T06:03:29.037 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.037 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.037 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.037 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "5", 2024-05-09T06:03:29.037 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "1", 2024-05-09T06:03:29.037 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.037 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.037 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "deviation below which no optimization is attempted", 2024-05-09T06:03:29.037 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-05-09T06:03:29.037 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.037 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.037 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.037 INFO:teuthology.orchestra.run.smithi039.stdout: "upmap_max_optimizations": { 2024-05-09T06:03:29.037 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "upmap_max_optimizations", 2024-05-09T06:03:29.037 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "uint", 2024-05-09T06:03:29.038 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.038 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.038 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10", 2024-05-09T06:03:29.038 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.038 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.038 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.038 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-05-09T06:03:29.038 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.038 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.038 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.038 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.038 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.038 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.038 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:29.039 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "cephadm", 2024-05-09T06:03:29.039 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-05-09T06:03:29.039 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-05-09T06:03:29.039 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:29.039 INFO:teuthology.orchestra.run.smithi039.stdout: "agent_down_multiplier": { 2024-05-09T06:03:29.039 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "agent_down_multiplier", 2024-05-09T06:03:29.039 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "float", 2024-05-09T06:03:29.039 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.039 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.039 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "3.0", 2024-05-09T06:03:29.039 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.039 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.039 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.039 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-05-09T06:03:29.039 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.040 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.040 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.040 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.040 INFO:teuthology.orchestra.run.smithi039.stdout: "agent_refresh_rate": { 2024-05-09T06:03:29.040 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "agent_refresh_rate", 2024-05-09T06:03:29.040 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-05-09T06:03:29.040 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.040 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.040 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "20", 2024-05-09T06:03:29.040 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.040 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.040 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.040 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-05-09T06:03:29.041 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.041 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.041 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.041 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.041 INFO:teuthology.orchestra.run.smithi039.stdout: "agent_starting_port": { 2024-05-09T06:03:29.041 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "agent_starting_port", 2024-05-09T06:03:29.041 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.041 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.041 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.041 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "4721", 2024-05-09T06:03:29.041 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.041 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.041 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.041 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-05-09T06:03:29.042 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.042 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.042 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.042 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.042 INFO:teuthology.orchestra.run.smithi039.stdout: "allow_ptrace": { 2024-05-09T06:03:29.042 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "allow_ptrace", 2024-05-09T06:03:29.042 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.042 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.042 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.042 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.042 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.042 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.042 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.042 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-05-09T06:03:29.043 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-05-09T06:03:29.043 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.043 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.043 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.043 INFO:teuthology.orchestra.run.smithi039.stdout: "autotune_interval": { 2024-05-09T06:03:29.043 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "autotune_interval", 2024-05-09T06:03:29.043 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-05-09T06:03:29.043 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.043 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.043 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "600", 2024-05-09T06:03:29.043 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.043 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.043 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.043 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "how frequently to autotune daemon memory", 2024-05-09T06:03:29.044 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.044 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.044 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.044 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.044 INFO:teuthology.orchestra.run.smithi039.stdout: "autotune_memory_target_ratio": { 2024-05-09T06:03:29.044 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "autotune_memory_target_ratio", 2024-05-09T06:03:29.044 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "float", 2024-05-09T06:03:29.044 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.044 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.044 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0.7", 2024-05-09T06:03:29.044 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.044 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.044 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.044 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-05-09T06:03:29.044 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.045 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.045 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.045 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.045 INFO:teuthology.orchestra.run.smithi039.stdout: "cephadm_log_destination": { 2024-05-09T06:03:29.045 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "cephadm_log_destination", 2024-05-09T06:03:29.045 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.045 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.045 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.045 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.045 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.045 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.045 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.045 INFO:teuthology.orchestra.run.smithi039.stdout: "file", 2024-05-09T06:03:29.045 INFO:teuthology.orchestra.run.smithi039.stdout: "file,syslog", 2024-05-09T06:03:29.046 INFO:teuthology.orchestra.run.smithi039.stdout: "syslog" 2024-05-09T06:03:29.046 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.046 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-05-09T06:03:29.046 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.046 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.046 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.046 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.046 INFO:teuthology.orchestra.run.smithi039.stdout: "cgroups_split": { 2024-05-09T06:03:29.046 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "cgroups_split", 2024-05-09T06:03:29.046 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.046 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.046 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.046 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:29.047 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.047 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.047 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.047 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-05-09T06:03:29.047 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.047 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.047 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.047 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.047 INFO:teuthology.orchestra.run.smithi039.stdout: "config_checks_enabled": { 2024-05-09T06:03:29.047 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "config_checks_enabled", 2024-05-09T06:03:29.047 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.047 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.047 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.047 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.047 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.047 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.048 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.048 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-05-09T06:03:29.048 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.048 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.048 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.048 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.048 INFO:teuthology.orchestra.run.smithi039.stdout: "config_dashboard": { 2024-05-09T06:03:29.048 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "config_dashboard", 2024-05-09T06:03:29.048 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.048 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.048 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.048 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:29.048 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.049 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.049 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.049 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-05-09T06:03:29.049 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.049 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.049 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.049 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.049 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_alertmanager": { 2024-05-09T06:03:29.049 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_alertmanager", 2024-05-09T06:03:29.049 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.049 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.049 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.049 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-05-09T06:03:29.049 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.049 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.050 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.050 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Prometheus container image", 2024-05-09T06:03:29.050 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.050 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.050 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.050 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.050 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_base": { 2024-05-09T06:03:29.050 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_base", 2024-05-09T06:03:29.050 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.050 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.050 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.051 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/ceph/ceph", 2024-05-09T06:03:29.051 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.051 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.051 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.051 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Container image name, without the tag", 2024-05-09T06:03:29.051 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.051 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.051 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.051 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.051 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_elasticsearch": { 2024-05-09T06:03:29.051 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_elasticsearch", 2024-05-09T06:03:29.051 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.051 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.052 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.052 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-05-09T06:03:29.052 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.052 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.052 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.052 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "elasticsearch container image", 2024-05-09T06:03:29.052 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.052 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.052 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.052 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.052 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_grafana": { 2024-05-09T06:03:29.052 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_grafana", 2024-05-09T06:03:29.053 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.053 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.053 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.053 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-05-09T06:03:29.053 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.053 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.053 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.053 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Prometheus container image", 2024-05-09T06:03:29.053 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.053 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.053 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.053 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.053 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_haproxy": { 2024-05-09T06:03:29.053 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_haproxy", 2024-05-09T06:03:29.054 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.054 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.054 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.054 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-05-09T06:03:29.054 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.054 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.054 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.054 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "HAproxy container image", 2024-05-09T06:03:29.054 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.054 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.054 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.054 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.054 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_jaeger_agent": { 2024-05-09T06:03:29.055 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_jaeger_agent", 2024-05-09T06:03:29.055 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.055 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.055 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.055 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-05-09T06:03:29.055 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.055 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.055 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.055 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Jaeger agent container image", 2024-05-09T06:03:29.055 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.055 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.055 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.056 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.056 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_jaeger_collector": { 2024-05-09T06:03:29.056 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_jaeger_collector", 2024-05-09T06:03:29.056 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.056 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.056 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.056 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-05-09T06:03:29.056 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.056 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.056 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.056 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Jaeger collector container image", 2024-05-09T06:03:29.056 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.056 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.056 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.057 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.057 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_jaeger_query": { 2024-05-09T06:03:29.057 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_jaeger_query", 2024-05-09T06:03:29.057 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.057 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.057 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.057 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-05-09T06:03:29.057 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.057 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.057 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.057 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Jaeger query container image", 2024-05-09T06:03:29.057 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.057 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.057 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.058 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.058 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_keepalived": { 2024-05-09T06:03:29.058 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_keepalived", 2024-05-09T06:03:29.058 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.058 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.058 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.058 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-05-09T06:03:29.058 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.058 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.058 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.058 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Keepalived container image", 2024-05-09T06:03:29.058 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.058 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.059 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.059 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.059 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_loki": { 2024-05-09T06:03:29.059 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_loki", 2024-05-09T06:03:29.059 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.059 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.059 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.059 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-05-09T06:03:29.059 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.059 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.059 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.059 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Loki container image", 2024-05-09T06:03:29.059 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.059 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.059 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.060 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.060 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_node_exporter": { 2024-05-09T06:03:29.060 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_node_exporter", 2024-05-09T06:03:29.060 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.060 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.060 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.060 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-05-09T06:03:29.060 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.060 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.060 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.060 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Prometheus container image", 2024-05-09T06:03:29.060 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.060 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.060 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.060 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.061 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_nvmeof": { 2024-05-09T06:03:29.061 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_nvmeof", 2024-05-09T06:03:29.061 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.061 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.061 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.061 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.1", 2024-05-09T06:03:29.061 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.061 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.061 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.061 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Nvme-of container image", 2024-05-09T06:03:29.061 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.061 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.061 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.061 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.061 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_prometheus": { 2024-05-09T06:03:29.061 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_prometheus", 2024-05-09T06:03:29.062 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.062 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.062 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.062 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-05-09T06:03:29.062 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.062 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.062 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.062 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Prometheus container image", 2024-05-09T06:03:29.062 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.062 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.062 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.062 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.062 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_promtail": { 2024-05-09T06:03:29.062 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_promtail", 2024-05-09T06:03:29.062 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.063 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.063 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.063 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-05-09T06:03:29.063 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.063 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.063 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.063 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Promtail container image", 2024-05-09T06:03:29.063 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.063 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.063 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.063 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.063 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_samba": { 2024-05-09T06:03:29.063 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_samba", 2024-05-09T06:03:29.063 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.063 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.064 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.064 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-05-09T06:03:29.064 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.064 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.064 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.064 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Samba/SMB container image", 2024-05-09T06:03:29.064 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.064 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.064 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.064 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.064 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_snmp_gateway": { 2024-05-09T06:03:29.064 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_snmp_gateway", 2024-05-09T06:03:29.064 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.064 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.065 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.065 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-05-09T06:03:29.065 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.065 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.065 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.065 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "SNMP Gateway container image", 2024-05-09T06:03:29.065 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.065 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.065 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.065 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.065 INFO:teuthology.orchestra.run.smithi039.stdout: "container_init": { 2024-05-09T06:03:29.065 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_init", 2024-05-09T06:03:29.066 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.066 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.066 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.066 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:29.066 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.066 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.066 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.066 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Run podman/docker with `--init`", 2024-05-09T06:03:29.066 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.066 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.066 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.066 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.066 INFO:teuthology.orchestra.run.smithi039.stdout: "daemon_cache_timeout": { 2024-05-09T06:03:29.066 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "daemon_cache_timeout", 2024-05-09T06:03:29.067 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-05-09T06:03:29.067 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.067 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.067 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "600", 2024-05-09T06:03:29.067 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.067 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.067 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.067 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-05-09T06:03:29.067 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.067 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.067 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.067 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.067 INFO:teuthology.orchestra.run.smithi039.stdout: "default_cephadm_command_timeout": { 2024-05-09T06:03:29.067 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "default_cephadm_command_timeout", 2024-05-09T06:03:29.068 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.068 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.068 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.068 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "900", 2024-05-09T06:03:29.068 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.068 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.068 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.068 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-05-09T06:03:29.068 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.068 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.068 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.068 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.068 INFO:teuthology.orchestra.run.smithi039.stdout: "default_registry": { 2024-05-09T06:03:29.068 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "default_registry", 2024-05-09T06:03:29.069 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.069 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.069 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.069 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "docker.io", 2024-05-09T06:03:29.069 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.069 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.069 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.069 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-05-09T06:03:29.069 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.069 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.069 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.069 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.069 INFO:teuthology.orchestra.run.smithi039.stdout: "device_cache_timeout": { 2024-05-09T06:03:29.069 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "device_cache_timeout", 2024-05-09T06:03:29.069 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-05-09T06:03:29.070 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.070 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.070 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "1800", 2024-05-09T06:03:29.070 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.070 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.070 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.070 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "seconds to cache device inventory", 2024-05-09T06:03:29.070 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.070 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.070 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.070 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.070 INFO:teuthology.orchestra.run.smithi039.stdout: "device_enhanced_scan": { 2024-05-09T06:03:29.070 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "device_enhanced_scan", 2024-05-09T06:03:29.070 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.071 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.071 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.071 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.071 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.071 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.071 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.071 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Use libstoragemgmt during device scans", 2024-05-09T06:03:29.071 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.071 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.071 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.071 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.071 INFO:teuthology.orchestra.run.smithi039.stdout: "facts_cache_timeout": { 2024-05-09T06:03:29.071 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "facts_cache_timeout", 2024-05-09T06:03:29.071 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-05-09T06:03:29.071 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.072 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.072 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "60", 2024-05-09T06:03:29.072 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.072 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.072 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.072 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "seconds to cache host facts data", 2024-05-09T06:03:29.072 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.072 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.072 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.072 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.072 INFO:teuthology.orchestra.run.smithi039.stdout: "grafana_dashboards_path": { 2024-05-09T06:03:29.072 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "grafana_dashboards_path", 2024-05-09T06:03:29.072 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.072 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.073 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.073 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-05-09T06:03:29.073 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.073 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.073 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.073 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-05-09T06:03:29.073 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.073 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.073 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.073 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.073 INFO:teuthology.orchestra.run.smithi039.stdout: "host_check_interval": { 2024-05-09T06:03:29.073 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "host_check_interval", 2024-05-09T06:03:29.073 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-05-09T06:03:29.073 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.073 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.074 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "600", 2024-05-09T06:03:29.074 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.074 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.074 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.074 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "how frequently to perform a host check", 2024-05-09T06:03:29.074 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.074 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.074 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.074 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.074 INFO:teuthology.orchestra.run.smithi039.stdout: "hw_monitoring": { 2024-05-09T06:03:29.074 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "hw_monitoring", 2024-05-09T06:03:29.074 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.074 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.074 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.075 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.075 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.075 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.075 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.075 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-05-09T06:03:29.075 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.075 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.075 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.075 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.075 INFO:teuthology.orchestra.run.smithi039.stdout: "inventory_list_all": { 2024-05-09T06:03:29.075 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "inventory_list_all", 2024-05-09T06:03:29.075 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.075 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.075 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.075 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.075 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.076 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.076 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.076 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-05-09T06:03:29.076 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.076 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.076 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.076 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.076 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:29.076 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:29.076 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.076 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.076 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.076 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.076 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.077 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.077 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.077 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.077 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.077 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.077 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.077 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.077 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.077 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.077 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.077 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.077 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.077 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.077 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.077 INFO:teuthology.orchestra.run.smithi039.stdout: "log_refresh_metadata": { 2024-05-09T06:03:29.077 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_refresh_metadata", 2024-05-09T06:03:29.078 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.078 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.078 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.078 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.078 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.078 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.078 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.078 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-05-09T06:03:29.078 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.078 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.078 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.078 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.078 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:29.079 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:29.079 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.079 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.079 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.079 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:29.079 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.079 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.079 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.079 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-05-09T06:03:29.079 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.079 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.079 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.079 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.079 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:29.079 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:29.079 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.080 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.080 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.080 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:29.080 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.080 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.080 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.080 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.080 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.080 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.080 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.080 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.080 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.080 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.080 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.080 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.080 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.081 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.081 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.081 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:29.081 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:29.081 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.081 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.081 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.081 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.081 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.081 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.081 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.081 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.081 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.081 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.081 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.082 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.082 INFO:teuthology.orchestra.run.smithi039.stdout: "manage_etc_ceph_ceph_conf": { 2024-05-09T06:03:29.082 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-05-09T06:03:29.082 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.082 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.082 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.082 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.082 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.082 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.082 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.082 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-05-09T06:03:29.082 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.082 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.083 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.083 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.083 INFO:teuthology.orchestra.run.smithi039.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-05-09T06:03:29.083 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-05-09T06:03:29.083 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.083 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.083 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.083 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "*", 2024-05-09T06:03:29.083 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.083 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.083 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.083 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-05-09T06:03:29.083 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.083 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.083 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.083 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.084 INFO:teuthology.orchestra.run.smithi039.stdout: "max_count_per_host": { 2024-05-09T06:03:29.084 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "max_count_per_host", 2024-05-09T06:03:29.084 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.084 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.084 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.084 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10", 2024-05-09T06:03:29.084 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.084 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.084 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.084 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "max number of daemons per service per host", 2024-05-09T06:03:29.084 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.084 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.084 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.084 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.084 INFO:teuthology.orchestra.run.smithi039.stdout: "max_osd_draining_count": { 2024-05-09T06:03:29.084 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "max_osd_draining_count", 2024-05-09T06:03:29.085 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.085 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.085 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.085 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10", 2024-05-09T06:03:29.085 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.085 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.085 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.085 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-05-09T06:03:29.085 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.085 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.085 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.085 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.085 INFO:teuthology.orchestra.run.smithi039.stdout: "migration_current": { 2024-05-09T06:03:29.085 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "migration_current", 2024-05-09T06:03:29.085 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.086 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.086 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.086 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.086 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.086 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.086 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.086 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "internal - do not modify", 2024-05-09T06:03:29.086 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.086 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.086 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.086 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.086 INFO:teuthology.orchestra.run.smithi039.stdout: "mode": { 2024-05-09T06:03:29.086 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "mode", 2024-05-09T06:03:29.086 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.087 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.087 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.087 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "root", 2024-05-09T06:03:29.087 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.087 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.087 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.087 INFO:teuthology.orchestra.run.smithi039.stdout: "cephadm-package", 2024-05-09T06:03:29.087 INFO:teuthology.orchestra.run.smithi039.stdout: "root" 2024-05-09T06:03:29.087 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.087 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "mode for remote execution of cephadm", 2024-05-09T06:03:29.087 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.087 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.087 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.087 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.087 INFO:teuthology.orchestra.run.smithi039.stdout: "oob_default_addr": { 2024-05-09T06:03:29.088 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "oob_default_addr", 2024-05-09T06:03:29.088 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.088 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.088 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.088 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "169.254.1.1", 2024-05-09T06:03:29.088 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.088 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.088 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.088 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Default address for RedFish API (oob management).", 2024-05-09T06:03:29.088 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.088 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.088 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.088 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.088 INFO:teuthology.orchestra.run.smithi039.stdout: "prometheus_alerts_path": { 2024-05-09T06:03:29.089 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "prometheus_alerts_path", 2024-05-09T06:03:29.089 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.089 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.089 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.089 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-05-09T06:03:29.089 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.089 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.089 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.089 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-05-09T06:03:29.089 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.089 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.089 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.089 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.089 INFO:teuthology.orchestra.run.smithi039.stdout: "registry_insecure": { 2024-05-09T06:03:29.089 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "registry_insecure", 2024-05-09T06:03:29.089 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.090 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.090 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.090 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.090 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.090 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.090 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.090 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-05-09T06:03:29.090 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.090 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.090 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.090 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.090 INFO:teuthology.orchestra.run.smithi039.stdout: "registry_password": { 2024-05-09T06:03:29.090 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "registry_password", 2024-05-09T06:03:29.090 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.090 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.090 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.091 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.091 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.091 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.091 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.091 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-05-09T06:03:29.091 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.091 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.091 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.091 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.091 INFO:teuthology.orchestra.run.smithi039.stdout: "registry_url": { 2024-05-09T06:03:29.091 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "registry_url", 2024-05-09T06:03:29.091 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.091 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.091 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.091 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.092 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.092 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.092 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.092 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-05-09T06:03:29.092 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.092 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.092 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.092 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.092 INFO:teuthology.orchestra.run.smithi039.stdout: "registry_username": { 2024-05-09T06:03:29.092 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "registry_username", 2024-05-09T06:03:29.092 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.092 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.092 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.092 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.093 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.093 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.093 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.093 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-05-09T06:03:29.093 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.093 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.093 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.093 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.093 INFO:teuthology.orchestra.run.smithi039.stdout: "secure_monitoring_stack": { 2024-05-09T06:03:29.093 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "secure_monitoring_stack", 2024-05-09T06:03:29.093 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.093 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.093 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.093 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.094 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.094 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.094 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.094 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-05-09T06:03:29.094 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.094 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.094 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.094 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.094 INFO:teuthology.orchestra.run.smithi039.stdout: "service_discovery_port": { 2024-05-09T06:03:29.094 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "service_discovery_port", 2024-05-09T06:03:29.094 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.094 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.094 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.094 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "8765", 2024-05-09T06:03:29.095 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.095 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.095 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.095 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "cephadm service discovery port", 2024-05-09T06:03:29.095 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.095 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.095 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.095 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.095 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:29.095 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:29.095 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.095 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:29.095 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.095 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:29.096 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.096 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.096 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.096 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.096 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.096 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.096 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.096 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.096 INFO:teuthology.orchestra.run.smithi039.stdout: "ssh_config_file": { 2024-05-09T06:03:29.096 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ssh_config_file", 2024-05-09T06:03:29.096 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.096 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.096 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.097 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.097 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.097 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.097 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.097 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-05-09T06:03:29.097 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.097 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.097 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.097 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.097 INFO:teuthology.orchestra.run.smithi039.stdout: "use_agent": { 2024-05-09T06:03:29.097 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "use_agent", 2024-05-09T06:03:29.097 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.097 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.097 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.098 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.098 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.098 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.098 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.098 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-05-09T06:03:29.098 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.098 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.098 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.098 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.098 INFO:teuthology.orchestra.run.smithi039.stdout: "use_repo_digest": { 2024-05-09T06:03:29.098 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "use_repo_digest", 2024-05-09T06:03:29.098 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.098 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.099 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.099 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:29.099 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.099 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.099 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.099 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-05-09T06:03:29.099 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.099 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.099 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.099 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.099 INFO:teuthology.orchestra.run.smithi039.stdout: "warn_on_failed_host_check": { 2024-05-09T06:03:29.099 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "warn_on_failed_host_check", 2024-05-09T06:03:29.099 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.099 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.099 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.100 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:29.100 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.100 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.100 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.100 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "raise a health warning if the host check fails", 2024-05-09T06:03:29.100 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.100 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.100 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.100 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.100 INFO:teuthology.orchestra.run.smithi039.stdout: "warn_on_stray_daemons": { 2024-05-09T06:03:29.100 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "warn_on_stray_daemons", 2024-05-09T06:03:29.100 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.100 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.101 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.101 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:29.101 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.101 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.101 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.101 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-05-09T06:03:29.101 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.101 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.101 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.101 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.101 INFO:teuthology.orchestra.run.smithi039.stdout: "warn_on_stray_hosts": { 2024-05-09T06:03:29.101 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "warn_on_stray_hosts", 2024-05-09T06:03:29.101 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.102 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.102 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.102 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:29.102 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.102 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.102 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.102 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-05-09T06:03:29.102 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.102 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.102 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.102 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.102 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.102 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.103 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:29.103 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "crash", 2024-05-09T06:03:29.103 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-05-09T06:03:29.103 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-05-09T06:03:29.103 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:29.103 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:29.103 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:29.103 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.103 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.103 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.103 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.103 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.103 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.103 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.104 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.104 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.104 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.104 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.104 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.104 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.104 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.104 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.104 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.104 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.104 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.105 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.105 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:29.105 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:29.105 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.105 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.105 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.105 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.105 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.105 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.105 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.105 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.105 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.105 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.105 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.105 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.105 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:29.106 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:29.106 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.106 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.106 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.106 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:29.106 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.106 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.106 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.106 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.106 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.106 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.106 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.106 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.107 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.107 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.107 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.107 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.107 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.107 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.107 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.107 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:29.107 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:29.107 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.107 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.107 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.107 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.107 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.108 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.108 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.108 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.108 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.108 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.108 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.108 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.108 INFO:teuthology.orchestra.run.smithi039.stdout: "retain_interval": { 2024-05-09T06:03:29.108 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "retain_interval", 2024-05-09T06:03:29.108 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-05-09T06:03:29.108 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.108 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.108 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "31536000", 2024-05-09T06:03:29.108 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.109 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.109 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.109 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "how long to retain crashes before pruning them", 2024-05-09T06:03:29.109 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.109 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.109 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.109 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.109 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:29.109 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:29.109 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.109 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:29.109 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.109 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:29.109 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.109 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.109 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.110 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.110 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.110 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.110 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.110 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.110 INFO:teuthology.orchestra.run.smithi039.stdout: "warn_recent_interval": { 2024-05-09T06:03:29.110 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "warn_recent_interval", 2024-05-09T06:03:29.110 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-05-09T06:03:29.110 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.110 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.110 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "1209600", 2024-05-09T06:03:29.110 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.110 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.110 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.111 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "time interval in which to warn about recent crashes", 2024-05-09T06:03:29.111 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.111 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.111 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.111 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.111 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.111 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.111 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:29.111 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "dashboard", 2024-05-09T06:03:29.111 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-05-09T06:03:29.111 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-05-09T06:03:29.111 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:29.111 INFO:teuthology.orchestra.run.smithi039.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-05-09T06:03:29.111 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-05-09T06:03:29.111 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.112 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.112 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.112 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10", 2024-05-09T06:03:29.112 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.112 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.112 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.112 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.112 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.112 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.112 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.112 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.112 INFO:teuthology.orchestra.run.smithi039.stdout: "ALERTMANAGER_API_HOST": { 2024-05-09T06:03:29.112 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ALERTMANAGER_API_HOST", 2024-05-09T06:03:29.112 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.112 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.113 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.113 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.113 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.113 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.113 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.113 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.113 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.113 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.113 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.113 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.113 INFO:teuthology.orchestra.run.smithi039.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-05-09T06:03:29.113 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-05-09T06:03:29.113 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.113 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.114 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.114 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:29.114 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.114 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.114 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.114 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.114 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.114 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.114 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.114 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.114 INFO:teuthology.orchestra.run.smithi039.stdout: "AUDIT_API_ENABLED": { 2024-05-09T06:03:29.114 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "AUDIT_API_ENABLED", 2024-05-09T06:03:29.114 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.115 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.115 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.115 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.115 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.115 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.115 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.115 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.115 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.115 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.115 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.115 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.115 INFO:teuthology.orchestra.run.smithi039.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-05-09T06:03:29.115 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-05-09T06:03:29.115 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.115 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.115 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.115 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:29.116 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.116 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.116 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.116 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.116 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.116 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.116 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.116 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.116 INFO:teuthology.orchestra.run.smithi039.stdout: "ENABLE_BROWSABLE_API": { 2024-05-09T06:03:29.116 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ENABLE_BROWSABLE_API", 2024-05-09T06:03:29.116 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.116 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.116 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.116 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:29.117 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.117 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.117 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.117 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.117 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.117 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.117 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.117 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.117 INFO:teuthology.orchestra.run.smithi039.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-05-09T06:03:29.117 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-05-09T06:03:29.117 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.117 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.117 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.117 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:29.118 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.118 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.118 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.118 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.118 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.118 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.118 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.118 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.118 INFO:teuthology.orchestra.run.smithi039.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-05-09T06:03:29.118 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-05-09T06:03:29.118 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.118 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.118 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.119 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:29.119 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.119 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.119 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.119 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.119 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.119 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.119 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.119 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.119 INFO:teuthology.orchestra.run.smithi039.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-05-09T06:03:29.119 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-05-09T06:03:29.119 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.119 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.119 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.119 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:29.120 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.120 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.120 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.120 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.120 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.120 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.120 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.120 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.120 INFO:teuthology.orchestra.run.smithi039.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-05-09T06:03:29.120 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-05-09T06:03:29.120 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.120 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.120 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.120 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:29.121 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.121 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.121 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.121 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.121 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.121 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.121 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.121 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.121 INFO:teuthology.orchestra.run.smithi039.stdout: "FEATURE_TOGGLE_NFS": { 2024-05-09T06:03:29.121 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-05-09T06:03:29.121 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.121 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.121 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.121 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:29.122 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.122 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.122 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.122 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.122 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.122 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.122 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.122 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.122 INFO:teuthology.orchestra.run.smithi039.stdout: "FEATURE_TOGGLE_RBD": { 2024-05-09T06:03:29.122 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-05-09T06:03:29.122 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.122 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.122 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.122 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:29.123 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.123 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.123 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.123 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.123 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.123 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.123 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.123 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.123 INFO:teuthology.orchestra.run.smithi039.stdout: "FEATURE_TOGGLE_RGW": { 2024-05-09T06:03:29.123 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-05-09T06:03:29.123 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.123 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.123 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.123 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:29.123 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.124 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.124 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.124 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.124 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.124 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.124 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.124 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.124 INFO:teuthology.orchestra.run.smithi039.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-05-09T06:03:29.124 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-05-09T06:03:29.124 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.124 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.124 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.124 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.124 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.124 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.124 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.125 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.125 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.125 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.125 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.125 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.125 INFO:teuthology.orchestra.run.smithi039.stdout: "GRAFANA_API_PASSWORD": { 2024-05-09T06:03:29.125 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "GRAFANA_API_PASSWORD", 2024-05-09T06:03:29.125 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.125 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.125 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.125 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "admin", 2024-05-09T06:03:29.125 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.125 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.125 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.125 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.125 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.125 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.126 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.126 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.126 INFO:teuthology.orchestra.run.smithi039.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-05-09T06:03:29.126 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-05-09T06:03:29.126 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.126 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.126 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.126 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:29.126 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.126 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.126 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.126 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.126 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.126 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.127 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.127 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.127 INFO:teuthology.orchestra.run.smithi039.stdout: "GRAFANA_API_URL": { 2024-05-09T06:03:29.127 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "GRAFANA_API_URL", 2024-05-09T06:03:29.127 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.127 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.127 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.127 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.127 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.127 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.127 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.127 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.127 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.127 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.128 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.128 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.128 INFO:teuthology.orchestra.run.smithi039.stdout: "GRAFANA_API_USERNAME": { 2024-05-09T06:03:29.128 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "GRAFANA_API_USERNAME", 2024-05-09T06:03:29.128 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.128 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.128 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.128 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "admin", 2024-05-09T06:03:29.128 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.128 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.128 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.128 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.128 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.128 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.129 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.129 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.129 INFO:teuthology.orchestra.run.smithi039.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-05-09T06:03:29.129 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-05-09T06:03:29.129 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.129 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.129 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.129 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.129 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.129 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.129 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.129 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.129 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.129 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.130 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.130 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.130 INFO:teuthology.orchestra.run.smithi039.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-05-09T06:03:29.130 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-05-09T06:03:29.130 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.130 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.130 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.130 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.130 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.130 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.130 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.130 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.130 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.130 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.130 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.131 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.131 INFO:teuthology.orchestra.run.smithi039.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-05-09T06:03:29.131 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-05-09T06:03:29.131 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.131 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.131 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.131 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:29.131 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.131 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.131 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.131 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.131 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.131 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.131 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.131 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.131 INFO:teuthology.orchestra.run.smithi039.stdout: "ISSUE_TRACKER_API_KEY": { 2024-05-09T06:03:29.132 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-05-09T06:03:29.132 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.132 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.132 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.132 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.132 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.132 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.132 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.132 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.132 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.132 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.132 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.132 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.132 INFO:teuthology.orchestra.run.smithi039.stdout: "MANAGED_BY_CLUSTERS": { 2024-05-09T06:03:29.132 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-05-09T06:03:29.133 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.133 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.133 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.133 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "[]", 2024-05-09T06:03:29.133 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.133 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.133 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.133 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.133 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.133 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.133 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.133 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.133 INFO:teuthology.orchestra.run.smithi039.stdout: "MULTICLUSTER_CONFIG": { 2024-05-09T06:03:29.133 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "MULTICLUSTER_CONFIG", 2024-05-09T06:03:29.134 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.134 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.134 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.134 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "{}", 2024-05-09T06:03:29.134 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.134 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.134 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.134 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.134 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.134 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.134 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.134 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.134 INFO:teuthology.orchestra.run.smithi039.stdout: "PROMETHEUS_API_HOST": { 2024-05-09T06:03:29.134 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PROMETHEUS_API_HOST", 2024-05-09T06:03:29.135 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.135 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.135 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.135 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.135 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.135 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.135 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.135 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.135 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.135 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.135 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.135 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.135 INFO:teuthology.orchestra.run.smithi039.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-05-09T06:03:29.135 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-05-09T06:03:29.135 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.136 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.136 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.136 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:29.136 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.136 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.136 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.136 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.136 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.136 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.136 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.136 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.136 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-05-09T06:03:29.136 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-05-09T06:03:29.136 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.137 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.137 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.137 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.137 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.137 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.137 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.137 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.137 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.137 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.137 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.137 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.137 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-05-09T06:03:29.137 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-05-09T06:03:29.137 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.137 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.138 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.138 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.138 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.138 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.138 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.138 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.138 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.138 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.138 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.138 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.138 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-05-09T06:03:29.138 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-05-09T06:03:29.138 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.138 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.139 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.139 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:29.139 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.139 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.139 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.139 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.139 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.139 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.139 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.139 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.139 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-05-09T06:03:29.139 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-05-09T06:03:29.139 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.139 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.140 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.140 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:29.140 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.140 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.140 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.140 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.140 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.140 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.140 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.140 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.140 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-05-09T06:03:29.140 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-05-09T06:03:29.140 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.140 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.140 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.141 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.141 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.141 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.141 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.141 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.141 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.141 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.141 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.141 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.141 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-05-09T06:03:29.141 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-05-09T06:03:29.141 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.141 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.141 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.141 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.142 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.142 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.142 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.142 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.142 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.142 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.142 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.142 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.142 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-05-09T06:03:29.142 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-05-09T06:03:29.142 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.142 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.142 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.143 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.143 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.143 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.143 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.143 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.143 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.143 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.143 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.143 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.143 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_ENABLED": { 2024-05-09T06:03:29.143 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_ENABLED", 2024-05-09T06:03:29.143 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.143 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.143 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.143 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:29.144 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.144 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.144 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.144 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.144 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.144 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.144 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.144 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.144 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-05-09T06:03:29.144 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-05-09T06:03:29.144 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.144 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.144 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.144 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-05-09T06:03:29.144 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.144 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.145 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.145 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.145 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.145 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.145 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.145 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.145 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-05-09T06:03:29.145 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-05-09T06:03:29.145 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.145 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.145 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.145 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10", 2024-05-09T06:03:29.145 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.146 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.146 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.146 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.146 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.146 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.146 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.146 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.146 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-05-09T06:03:29.146 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-05-09T06:03:29.146 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.146 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.146 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.146 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "8", 2024-05-09T06:03:29.146 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.147 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.147 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.147 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.147 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.147 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.147 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.147 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.147 INFO:teuthology.orchestra.run.smithi039.stdout: "REST_REQUESTS_TIMEOUT": { 2024-05-09T06:03:29.147 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-05-09T06:03:29.147 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.147 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.147 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.148 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "45", 2024-05-09T06:03:29.148 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.148 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.148 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.148 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.148 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.148 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.148 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.148 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.148 INFO:teuthology.orchestra.run.smithi039.stdout: "RGW_API_ACCESS_KEY": { 2024-05-09T06:03:29.148 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "RGW_API_ACCESS_KEY", 2024-05-09T06:03:29.148 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.148 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.148 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.148 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.149 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.149 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.149 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.149 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.149 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.149 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.149 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.149 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.149 INFO:teuthology.orchestra.run.smithi039.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-05-09T06:03:29.149 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-05-09T06:03:29.149 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.149 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.149 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.149 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "admin", 2024-05-09T06:03:29.149 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.149 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.150 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.150 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.150 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.150 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.150 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.150 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.150 INFO:teuthology.orchestra.run.smithi039.stdout: "RGW_API_SECRET_KEY": { 2024-05-09T06:03:29.150 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "RGW_API_SECRET_KEY", 2024-05-09T06:03:29.150 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.150 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.150 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.150 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.150 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.150 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.151 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.151 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.151 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.151 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.151 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.151 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.151 INFO:teuthology.orchestra.run.smithi039.stdout: "RGW_API_SSL_VERIFY": { 2024-05-09T06:03:29.151 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "RGW_API_SSL_VERIFY", 2024-05-09T06:03:29.151 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.151 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.151 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.151 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:29.151 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.151 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.151 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.152 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.152 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.152 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.152 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.152 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.152 INFO:teuthology.orchestra.run.smithi039.stdout: "UNSAFE_TLS_v1_2": { 2024-05-09T06:03:29.152 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "UNSAFE_TLS_v1_2", 2024-05-09T06:03:29.152 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.152 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.152 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.152 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.152 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.152 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.152 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.152 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.152 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.153 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.153 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.153 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.153 INFO:teuthology.orchestra.run.smithi039.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-05-09T06:03:29.153 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-05-09T06:03:29.153 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.153 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.153 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.153 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:29.153 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.153 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.153 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.153 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.153 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.153 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.154 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.154 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.154 INFO:teuthology.orchestra.run.smithi039.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-05-09T06:03:29.154 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-05-09T06:03:29.154 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.154 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.154 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.154 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10", 2024-05-09T06:03:29.154 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.154 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.154 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.154 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.154 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.155 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.155 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.155 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.155 INFO:teuthology.orchestra.run.smithi039.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-05-09T06:03:29.155 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-05-09T06:03:29.155 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.155 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.155 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.155 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "5", 2024-05-09T06:03:29.155 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.155 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.155 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.155 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.155 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.155 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.156 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.156 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.156 INFO:teuthology.orchestra.run.smithi039.stdout: "cross_origin_url": { 2024-05-09T06:03:29.156 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "cross_origin_url", 2024-05-09T06:03:29.156 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.156 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.156 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.156 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.156 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.156 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.156 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.156 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.156 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.156 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.156 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.156 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.157 INFO:teuthology.orchestra.run.smithi039.stdout: "crt_file": { 2024-05-09T06:03:29.157 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "crt_file", 2024-05-09T06:03:29.157 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.157 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.157 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.157 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.157 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.157 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.157 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.157 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.157 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.157 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.157 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.157 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.158 INFO:teuthology.orchestra.run.smithi039.stdout: "debug": { 2024-05-09T06:03:29.158 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "debug", 2024-05-09T06:03:29.158 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.158 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.158 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.158 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.158 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.158 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.158 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.158 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Enable/disable debug options", 2024-05-09T06:03:29.158 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.158 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.158 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.158 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.158 INFO:teuthology.orchestra.run.smithi039.stdout: "jwt_token_ttl": { 2024-05-09T06:03:29.159 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "jwt_token_ttl", 2024-05-09T06:03:29.159 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.159 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.159 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.159 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "28800", 2024-05-09T06:03:29.159 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.159 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.159 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.159 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.159 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.159 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.159 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.159 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.159 INFO:teuthology.orchestra.run.smithi039.stdout: "key_file": { 2024-05-09T06:03:29.160 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "key_file", 2024-05-09T06:03:29.160 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.160 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.160 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.160 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.160 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.160 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.160 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.160 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.160 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.160 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.160 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.160 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.160 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:29.160 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:29.161 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.161 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.161 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.161 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.161 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.161 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.161 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.161 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.161 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.161 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.161 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.161 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.161 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.161 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.161 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.162 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.162 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.162 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.162 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.162 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:29.162 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:29.162 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.162 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.162 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.162 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.162 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.162 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.162 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.162 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.162 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.163 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.163 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.163 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.163 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:29.163 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:29.163 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.163 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.163 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.163 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:29.163 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.163 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.163 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.163 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.163 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.163 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.164 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.164 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.164 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.164 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.164 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.164 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.164 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.164 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.164 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.164 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:29.164 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:29.164 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.164 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.164 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.165 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.165 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.165 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.165 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.165 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.165 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.165 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.165 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.165 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.165 INFO:teuthology.orchestra.run.smithi039.stdout: "motd": { 2024-05-09T06:03:29.165 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "motd", 2024-05-09T06:03:29.165 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.165 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.165 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.165 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.166 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.166 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.166 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.166 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "The message of the day", 2024-05-09T06:03:29.166 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.166 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.166 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.166 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.166 INFO:teuthology.orchestra.run.smithi039.stdout: "redirect_resolve_ip_addr": { 2024-05-09T06:03:29.166 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "redirect_resolve_ip_addr", 2024-05-09T06:03:29.166 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.166 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.166 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.166 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.167 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.167 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.167 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.167 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.167 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.167 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.167 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.167 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.167 INFO:teuthology.orchestra.run.smithi039.stdout: "server_addr": { 2024-05-09T06:03:29.167 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "server_addr", 2024-05-09T06:03:29.167 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.167 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.167 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.168 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "::", 2024-05-09T06:03:29.168 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.168 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.168 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.168 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.168 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.168 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.168 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.168 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.168 INFO:teuthology.orchestra.run.smithi039.stdout: "server_port": { 2024-05-09T06:03:29.168 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "server_port", 2024-05-09T06:03:29.168 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.168 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.168 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.169 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "8080", 2024-05-09T06:03:29.169 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.169 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.169 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.169 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.169 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.169 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.169 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.169 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.169 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:29.169 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:29.170 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.170 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:29.170 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.170 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:29.170 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.170 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.170 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.170 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.170 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.170 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.170 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.170 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.170 INFO:teuthology.orchestra.run.smithi039.stdout: "ssl": { 2024-05-09T06:03:29.171 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ssl", 2024-05-09T06:03:29.171 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.171 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.171 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.171 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:29.171 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.171 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.171 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.171 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.171 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.171 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.171 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.171 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.171 INFO:teuthology.orchestra.run.smithi039.stdout: "ssl_server_port": { 2024-05-09T06:03:29.171 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ssl_server_port", 2024-05-09T06:03:29.172 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.172 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.172 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.172 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "8443", 2024-05-09T06:03:29.172 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.172 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.172 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.172 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.172 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.172 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.172 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.172 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.172 INFO:teuthology.orchestra.run.smithi039.stdout: "standby_behaviour": { 2024-05-09T06:03:29.172 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "standby_behaviour", 2024-05-09T06:03:29.172 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.173 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.173 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.173 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "redirect", 2024-05-09T06:03:29.173 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.173 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.173 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.173 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.173 INFO:teuthology.orchestra.run.smithi039.stdout: "redirect" 2024-05-09T06:03:29.173 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.173 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.173 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.173 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.173 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.173 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.174 INFO:teuthology.orchestra.run.smithi039.stdout: "standby_error_status_code": { 2024-05-09T06:03:29.174 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "standby_error_status_code", 2024-05-09T06:03:29.174 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.174 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.174 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.174 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "500", 2024-05-09T06:03:29.174 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "400", 2024-05-09T06:03:29.174 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "599", 2024-05-09T06:03:29.174 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.174 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.174 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.174 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.174 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.175 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.175 INFO:teuthology.orchestra.run.smithi039.stdout: "url_prefix": { 2024-05-09T06:03:29.175 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "url_prefix", 2024-05-09T06:03:29.175 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.175 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.175 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.175 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.175 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.175 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.175 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.175 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.175 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.175 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.176 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.176 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.176 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.176 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.176 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:29.176 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "devicehealth", 2024-05-09T06:03:29.176 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-05-09T06:03:29.176 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-05-09T06:03:29.176 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:29.176 INFO:teuthology.orchestra.run.smithi039.stdout: "enable_monitoring": { 2024-05-09T06:03:29.176 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "enable_monitoring", 2024-05-09T06:03:29.176 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.176 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.176 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.177 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:29.177 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.177 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.177 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.177 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "monitor device health metrics", 2024-05-09T06:03:29.177 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.177 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.177 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.177 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.177 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:29.177 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:29.177 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.177 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.177 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.178 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.178 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.178 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.178 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.178 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.178 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.178 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.178 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.178 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.178 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.178 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.178 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.179 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.179 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.179 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.179 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.179 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:29.179 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:29.179 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.179 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.179 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.179 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.179 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.179 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.179 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.180 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.180 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.180 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.180 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.180 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.180 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:29.180 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:29.180 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.180 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.180 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.180 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:29.180 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.180 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.181 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.181 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.181 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.181 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.181 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.181 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.181 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.181 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.181 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.181 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.181 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.181 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.181 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.181 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:29.182 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:29.182 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.182 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.182 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.182 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.182 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.182 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.182 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.182 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.182 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.182 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.182 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.182 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.182 INFO:teuthology.orchestra.run.smithi039.stdout: "mark_out_threshold": { 2024-05-09T06:03:29.183 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "mark_out_threshold", 2024-05-09T06:03:29.183 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-05-09T06:03:29.183 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.183 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.183 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "2419200", 2024-05-09T06:03:29.183 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.183 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.183 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.183 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-05-09T06:03:29.183 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.183 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.183 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.183 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.183 INFO:teuthology.orchestra.run.smithi039.stdout: "pool_name": { 2024-05-09T06:03:29.184 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "pool_name", 2024-05-09T06:03:29.184 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.184 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.184 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.184 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "device_health_metrics", 2024-05-09T06:03:29.184 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.184 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.184 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.184 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "name of pool in which to store device health metrics", 2024-05-09T06:03:29.184 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.184 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.184 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.184 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.184 INFO:teuthology.orchestra.run.smithi039.stdout: "retention_period": { 2024-05-09T06:03:29.184 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "retention_period", 2024-05-09T06:03:29.185 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-05-09T06:03:29.185 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.185 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.185 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "15552000", 2024-05-09T06:03:29.185 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.185 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.185 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.185 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "how long to retain device health metrics", 2024-05-09T06:03:29.185 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.185 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.186 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.186 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.186 INFO:teuthology.orchestra.run.smithi039.stdout: "scrape_frequency": { 2024-05-09T06:03:29.186 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "scrape_frequency", 2024-05-09T06:03:29.186 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-05-09T06:03:29.186 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.186 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.186 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "86400", 2024-05-09T06:03:29.186 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.186 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.186 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.186 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "how frequently to scrape device health metrics", 2024-05-09T06:03:29.186 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.186 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.187 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.187 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.187 INFO:teuthology.orchestra.run.smithi039.stdout: "self_heal": { 2024-05-09T06:03:29.187 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "self_heal", 2024-05-09T06:03:29.187 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.187 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.187 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.187 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:29.187 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.187 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.187 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.187 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-05-09T06:03:29.187 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.187 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.188 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.188 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.188 INFO:teuthology.orchestra.run.smithi039.stdout: "sleep_interval": { 2024-05-09T06:03:29.188 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sleep_interval", 2024-05-09T06:03:29.188 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-05-09T06:03:29.188 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.188 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.188 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "600", 2024-05-09T06:03:29.188 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.188 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.188 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.188 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "how frequently to wake up and check device health", 2024-05-09T06:03:29.188 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.189 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.189 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.189 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.189 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:29.189 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:29.189 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.189 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:29.189 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.189 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:29.189 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.189 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.189 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.189 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.189 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.190 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.190 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.190 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.190 INFO:teuthology.orchestra.run.smithi039.stdout: "warn_threshold": { 2024-05-09T06:03:29.190 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "warn_threshold", 2024-05-09T06:03:29.190 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-05-09T06:03:29.190 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.190 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.190 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "7257600", 2024-05-09T06:03:29.190 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.190 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.190 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.190 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-05-09T06:03:29.191 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.191 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.191 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.191 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.191 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.191 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.191 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:29.191 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "diskprediction_local", 2024-05-09T06:03:29.191 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-05-09T06:03:29.191 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-05-09T06:03:29.191 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:29.192 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:29.192 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:29.192 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.192 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.192 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.192 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.192 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.192 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.192 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.192 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.192 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.192 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.193 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.193 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.193 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.193 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.193 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.193 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.193 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.193 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.193 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.193 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:29.193 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:29.193 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.193 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.193 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.194 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.194 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.194 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.194 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.194 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.194 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.194 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.194 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.194 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.194 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:29.194 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:29.194 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.195 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.195 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.195 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:29.195 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.195 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.195 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.195 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.195 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.195 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.195 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.195 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.195 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.195 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.196 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.196 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.196 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.196 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.196 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.196 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:29.196 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:29.196 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.196 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.196 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.196 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.196 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.196 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.197 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.197 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.197 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.197 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.197 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.197 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.197 INFO:teuthology.orchestra.run.smithi039.stdout: "predict_interval": { 2024-05-09T06:03:29.197 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "predict_interval", 2024-05-09T06:03:29.197 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.197 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.197 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.197 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "86400", 2024-05-09T06:03:29.197 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.198 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.198 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.198 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.198 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.198 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.198 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.198 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.198 INFO:teuthology.orchestra.run.smithi039.stdout: "predictor_model": { 2024-05-09T06:03:29.198 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "predictor_model", 2024-05-09T06:03:29.198 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.198 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.198 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.199 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "prophetstor", 2024-05-09T06:03:29.199 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.199 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.199 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.199 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.199 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.199 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.199 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.199 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.199 INFO:teuthology.orchestra.run.smithi039.stdout: "sleep_interval": { 2024-05-09T06:03:29.199 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sleep_interval", 2024-05-09T06:03:29.199 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.199 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.199 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.200 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "600", 2024-05-09T06:03:29.200 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.200 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.200 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.200 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.200 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.200 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.200 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.200 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.200 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:29.200 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:29.200 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.200 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:29.200 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.201 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:29.201 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.201 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.201 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.201 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.201 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.201 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.201 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.201 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.201 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.201 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.201 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:29.201 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "influx", 2024-05-09T06:03:29.201 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": false, 2024-05-09T06:03:29.202 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "influxdb python module not found", 2024-05-09T06:03:29.202 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:29.202 INFO:teuthology.orchestra.run.smithi039.stdout: "batch_size": { 2024-05-09T06:03:29.202 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "batch_size", 2024-05-09T06:03:29.202 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.202 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.202 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.202 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "5000", 2024-05-09T06:03:29.202 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.202 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.202 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.202 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-05-09T06:03:29.202 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.202 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.202 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.203 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.203 INFO:teuthology.orchestra.run.smithi039.stdout: "database": { 2024-05-09T06:03:29.203 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "database", 2024-05-09T06:03:29.203 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.203 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.203 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.203 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "ceph", 2024-05-09T06:03:29.203 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.203 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.203 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.203 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-05-09T06:03:29.203 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.203 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.203 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.204 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.204 INFO:teuthology.orchestra.run.smithi039.stdout: "hostname": { 2024-05-09T06:03:29.204 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "hostname", 2024-05-09T06:03:29.204 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.204 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.204 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.204 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.204 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.204 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.204 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.204 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "InfluxDB server hostname", 2024-05-09T06:03:29.204 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.204 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.204 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.205 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.205 INFO:teuthology.orchestra.run.smithi039.stdout: "interval": { 2024-05-09T06:03:29.205 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "interval", 2024-05-09T06:03:29.205 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-05-09T06:03:29.205 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.205 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.205 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "30", 2024-05-09T06:03:29.205 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "5", 2024-05-09T06:03:29.205 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.205 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.205 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-05-09T06:03:29.205 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.205 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.205 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.206 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.206 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:29.206 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:29.206 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.206 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.206 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.206 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.206 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.206 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.206 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.206 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.206 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.206 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.207 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.207 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.207 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.207 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.207 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.207 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.207 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.207 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.207 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.207 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:29.207 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:29.207 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.207 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.208 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.208 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.208 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.208 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.208 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.208 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.208 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.208 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.208 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.208 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.208 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:29.208 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:29.208 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.208 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.209 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.209 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:29.209 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.209 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.209 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.209 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.209 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.209 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.209 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.209 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.209 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.209 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.209 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.210 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.210 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.210 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.210 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.210 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:29.210 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:29.210 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.210 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.210 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.210 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.210 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.210 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.210 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.211 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.211 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.211 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.211 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.211 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.211 INFO:teuthology.orchestra.run.smithi039.stdout: "password": { 2024-05-09T06:03:29.211 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "password", 2024-05-09T06:03:29.211 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.211 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.211 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.211 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.212 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.212 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.212 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.212 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "password of InfluxDB server user", 2024-05-09T06:03:29.212 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.212 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.212 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.212 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.212 INFO:teuthology.orchestra.run.smithi039.stdout: "port": { 2024-05-09T06:03:29.212 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "port", 2024-05-09T06:03:29.212 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.212 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.212 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.212 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "8086", 2024-05-09T06:03:29.213 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.213 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.213 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.213 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "InfluxDB server port", 2024-05-09T06:03:29.213 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.213 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.213 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.213 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.213 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:29.213 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:29.213 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.213 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:29.213 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.213 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:29.213 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.214 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.214 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.214 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.214 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.214 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.214 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.214 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.214 INFO:teuthology.orchestra.run.smithi039.stdout: "ssl": { 2024-05-09T06:03:29.214 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ssl", 2024-05-09T06:03:29.214 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.214 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.214 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.214 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "false", 2024-05-09T06:03:29.214 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.215 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.215 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.215 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-05-09T06:03:29.215 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.215 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.215 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.215 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.215 INFO:teuthology.orchestra.run.smithi039.stdout: "threads": { 2024-05-09T06:03:29.215 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "threads", 2024-05-09T06:03:29.215 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.215 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.215 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.215 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "5", 2024-05-09T06:03:29.215 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "1", 2024-05-09T06:03:29.216 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "32", 2024-05-09T06:03:29.216 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.216 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-05-09T06:03:29.216 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.216 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.216 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.216 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.216 INFO:teuthology.orchestra.run.smithi039.stdout: "username": { 2024-05-09T06:03:29.216 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "username", 2024-05-09T06:03:29.216 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.216 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.216 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.216 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.216 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.217 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.217 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.217 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "username of InfluxDB server user", 2024-05-09T06:03:29.217 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.217 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.217 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.217 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.217 INFO:teuthology.orchestra.run.smithi039.stdout: "verify_ssl": { 2024-05-09T06:03:29.217 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "verify_ssl", 2024-05-09T06:03:29.217 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.217 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.217 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.217 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "true", 2024-05-09T06:03:29.217 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.218 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.218 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.218 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-05-09T06:03:29.218 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.218 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.218 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.218 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.218 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.218 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.218 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:29.218 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "insights", 2024-05-09T06:03:29.218 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-05-09T06:03:29.218 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-05-09T06:03:29.219 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:29.219 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:29.219 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:29.219 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.219 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.219 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.219 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.219 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.219 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.219 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.219 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.219 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.219 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.219 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.219 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.220 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.220 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.220 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.220 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.220 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.220 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.220 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.220 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:29.220 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:29.220 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.220 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.220 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.220 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.221 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.221 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.221 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.221 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.221 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.221 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.221 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.221 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.221 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:29.221 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:29.221 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.221 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.221 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.221 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:29.221 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.222 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.222 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.222 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.222 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.222 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.222 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.222 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.222 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.222 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.222 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.222 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.222 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.222 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.223 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.223 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:29.223 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:29.223 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.223 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.223 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.223 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.223 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.223 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.223 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.223 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.223 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.223 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.224 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.224 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.224 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:29.224 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:29.224 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.224 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:29.224 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.224 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:29.224 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.224 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.224 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.224 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.224 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.224 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.225 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.225 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.225 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.225 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.225 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:29.225 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "iostat", 2024-05-09T06:03:29.225 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-05-09T06:03:29.225 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-05-09T06:03:29.225 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:29.225 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:29.225 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:29.225 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.225 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.225 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.226 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.226 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.226 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.226 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.226 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.226 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.226 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.226 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.226 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.226 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.226 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.226 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.226 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.226 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.227 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.227 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.227 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:29.227 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:29.227 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.227 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.227 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.227 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.227 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.229 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.229 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.229 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.229 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.229 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.229 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.229 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.229 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:29.230 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:29.230 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.230 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.230 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.230 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:29.230 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.230 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.230 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.230 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.230 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.230 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.230 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.230 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.231 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.231 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.231 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.231 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.231 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.231 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.231 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.231 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:29.231 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:29.231 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.231 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.231 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.231 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.232 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.232 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.232 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.232 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.232 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.232 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.232 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.232 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.232 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:29.232 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:29.232 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.232 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:29.232 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.232 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:29.233 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.233 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.233 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.233 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.233 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.233 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.233 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.233 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.233 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.233 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.233 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:29.233 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "k8sevents", 2024-05-09T06:03:29.234 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-05-09T06:03:29.234 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-05-09T06:03:29.234 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:29.234 INFO:teuthology.orchestra.run.smithi039.stdout: "ceph_event_retention_days": { 2024-05-09T06:03:29.234 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ceph_event_retention_days", 2024-05-09T06:03:29.234 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.234 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.234 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.234 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "7", 2024-05-09T06:03:29.234 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.234 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.235 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.235 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Days to hold ceph event information within local cache", 2024-05-09T06:03:29.235 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.235 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.235 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.235 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.235 INFO:teuthology.orchestra.run.smithi039.stdout: "config_check_secs": { 2024-05-09T06:03:29.235 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "config_check_secs", 2024-05-09T06:03:29.235 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.235 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.235 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.235 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10", 2024-05-09T06:03:29.235 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "10", 2024-05-09T06:03:29.235 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.235 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.236 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-05-09T06:03:29.236 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.236 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.236 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.236 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.236 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:29.236 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:29.236 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.236 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.236 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.236 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.236 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.237 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.237 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.237 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.237 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.237 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.237 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.237 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.237 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.237 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.237 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.237 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.237 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.238 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.238 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.238 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:29.238 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:29.238 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.238 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.238 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.238 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.238 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.238 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.238 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.238 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.238 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.239 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.239 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.239 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.239 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:29.239 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:29.239 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.239 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.239 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.239 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:29.239 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.239 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.239 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.239 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.240 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.240 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.240 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.240 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.240 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.240 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.240 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.240 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.240 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.240 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.240 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.240 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:29.240 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:29.240 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.240 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.241 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.241 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.241 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.241 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.241 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.241 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.241 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.241 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.241 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.241 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.241 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:29.241 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:29.241 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.242 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:29.242 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.242 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:29.242 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.242 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.242 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.242 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.242 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.242 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.242 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.242 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.242 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.242 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.243 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:29.243 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "localpool", 2024-05-09T06:03:29.243 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-05-09T06:03:29.243 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-05-09T06:03:29.243 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:29.243 INFO:teuthology.orchestra.run.smithi039.stdout: "failure_domain": { 2024-05-09T06:03:29.243 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "failure_domain", 2024-05-09T06:03:29.243 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.243 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.243 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.243 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "host", 2024-05-09T06:03:29.243 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.243 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.244 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.244 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "failure domain for any created local pool", 2024-05-09T06:03:29.244 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-05-09T06:03:29.244 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.244 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.244 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.244 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:29.244 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:29.244 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.244 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.244 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.244 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.244 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.245 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.245 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.245 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.245 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.245 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.245 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.245 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.245 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.245 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.245 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.245 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.245 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.245 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.245 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.245 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:29.246 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:29.246 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.246 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.246 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.246 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.246 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.246 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.246 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.246 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.246 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.246 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.246 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.246 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.246 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:29.247 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:29.247 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.247 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.247 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.247 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:29.247 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.247 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.247 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.247 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.247 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.247 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.247 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.248 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.248 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.248 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.248 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.248 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.248 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.248 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.248 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.248 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:29.248 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:29.248 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.248 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.248 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.248 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.248 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.249 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.249 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.249 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.249 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.249 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.249 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.249 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.249 INFO:teuthology.orchestra.run.smithi039.stdout: "min_size": { 2024-05-09T06:03:29.249 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "min_size", 2024-05-09T06:03:29.249 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.249 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.249 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.249 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.250 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.250 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.250 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.250 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "default min_size for any created local pool", 2024-05-09T06:03:29.250 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-05-09T06:03:29.250 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.250 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.250 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.250 INFO:teuthology.orchestra.run.smithi039.stdout: "num_rep": { 2024-05-09T06:03:29.250 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "num_rep", 2024-05-09T06:03:29.250 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.250 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.251 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.251 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "3", 2024-05-09T06:03:29.251 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.251 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.251 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.251 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "default replica count for any created local pool", 2024-05-09T06:03:29.251 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.251 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.251 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.251 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.251 INFO:teuthology.orchestra.run.smithi039.stdout: "pg_num": { 2024-05-09T06:03:29.251 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "pg_num", 2024-05-09T06:03:29.251 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.251 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.252 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.252 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "128", 2024-05-09T06:03:29.252 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.252 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.252 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.252 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "default pg_num for any created local pool", 2024-05-09T06:03:29.252 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.252 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.252 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.252 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.252 INFO:teuthology.orchestra.run.smithi039.stdout: "prefix": { 2024-05-09T06:03:29.252 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "prefix", 2024-05-09T06:03:29.252 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.252 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.253 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.253 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.253 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.253 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.253 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.253 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "name prefix for any created local pool", 2024-05-09T06:03:29.253 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.253 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.253 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.253 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.253 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:29.253 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:29.253 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.253 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:29.254 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.254 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:29.254 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.254 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.254 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.254 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.254 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.254 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.254 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.254 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.254 INFO:teuthology.orchestra.run.smithi039.stdout: "subtree": { 2024-05-09T06:03:29.254 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "subtree", 2024-05-09T06:03:29.254 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.255 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.255 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.255 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "rack", 2024-05-09T06:03:29.255 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.255 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.255 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.255 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "CRUSH level for which to create a local pool", 2024-05-09T06:03:29.255 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-05-09T06:03:29.255 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.255 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.255 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.255 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.255 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.255 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:29.255 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "mds_autoscaler", 2024-05-09T06:03:29.256 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-05-09T06:03:29.256 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-05-09T06:03:29.256 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:29.256 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:29.256 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:29.256 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.256 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.256 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.256 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.256 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.256 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.256 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.256 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.257 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.257 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.257 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.257 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.257 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.257 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.257 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.257 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.257 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.257 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.257 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.257 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:29.257 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:29.257 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.258 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.258 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.258 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.258 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.258 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.258 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.258 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.258 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.258 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.258 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.258 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.258 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:29.258 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:29.259 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.259 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.259 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.259 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:29.259 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.259 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.259 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.259 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.259 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.259 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.259 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.259 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.259 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.259 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.259 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.260 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.260 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.260 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.260 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.260 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:29.260 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:29.260 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.260 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.260 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.260 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.260 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.260 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.260 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.260 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.261 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.261 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.261 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.261 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.261 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:29.261 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:29.261 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.261 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:29.261 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.261 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:29.261 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.261 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.261 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.261 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.261 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.261 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.262 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.262 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.262 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.262 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.262 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:29.262 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "mirroring", 2024-05-09T06:03:29.262 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-05-09T06:03:29.262 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-05-09T06:03:29.262 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:29.262 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:29.262 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:29.262 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.262 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.262 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.263 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.263 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.263 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.263 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.263 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.263 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.263 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.263 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.263 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.263 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.263 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.263 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.263 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.263 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.263 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.264 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.264 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:29.264 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:29.264 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.264 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.264 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.264 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.264 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.264 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.264 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.264 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.264 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.264 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.264 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.265 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.265 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:29.265 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:29.265 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.265 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.265 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.265 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:29.265 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.265 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.265 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.265 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.265 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.265 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.265 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.266 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.266 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.266 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.266 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.266 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.266 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.266 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.266 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.266 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:29.266 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:29.266 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.266 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.266 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.266 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.266 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.267 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.267 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.267 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.267 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.267 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.267 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.267 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.267 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:29.267 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:29.267 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.267 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:29.267 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.267 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:29.267 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.268 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.268 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.268 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.268 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.268 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.268 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.268 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.268 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.268 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.268 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:29.268 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "nfs", 2024-05-09T06:03:29.268 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-05-09T06:03:29.268 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-05-09T06:03:29.268 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:29.268 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:29.269 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:29.269 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.269 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.269 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.269 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.269 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.269 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.269 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.269 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.269 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.269 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.269 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.269 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.269 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.269 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.270 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.270 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.270 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.270 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.270 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.270 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:29.270 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:29.270 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.270 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.270 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.270 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.270 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.270 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.270 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.271 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.271 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.271 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.271 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.271 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.271 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:29.271 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:29.271 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.271 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.271 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.271 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:29.271 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.271 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.271 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.272 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.272 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.272 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.272 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.272 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.272 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.272 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.272 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.272 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.272 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.272 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.272 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.272 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:29.272 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:29.272 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.273 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.273 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.273 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.273 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.273 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.273 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.273 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.273 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.273 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.273 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.273 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.273 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:29.273 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:29.273 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.273 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:29.273 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.274 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:29.274 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.274 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.274 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.274 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.274 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.274 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.274 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.274 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.274 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.274 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.274 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:29.274 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "orchestrator", 2024-05-09T06:03:29.275 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-05-09T06:03:29.275 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-05-09T06:03:29.275 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:29.275 INFO:teuthology.orchestra.run.smithi039.stdout: "fail_fs": { 2024-05-09T06:03:29.275 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "fail_fs", 2024-05-09T06:03:29.275 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.275 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.275 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.275 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.275 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.275 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.275 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.275 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-05-09T06:03:29.275 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.275 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.275 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.276 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.276 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:29.276 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:29.276 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.276 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.276 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.276 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.276 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.276 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.276 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.276 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.276 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.276 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.276 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.276 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.277 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.277 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.277 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.277 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.277 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.277 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.277 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.277 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:29.277 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:29.277 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.277 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.277 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.277 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.277 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.278 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.278 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.278 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.278 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.278 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.278 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.278 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.278 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:29.278 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:29.278 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.278 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.278 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.279 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:29.279 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.279 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.279 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.279 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.279 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.279 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.279 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.279 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.279 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.279 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.279 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.279 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.279 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.280 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.280 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.280 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:29.280 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:29.280 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.280 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.280 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.280 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.280 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.280 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.280 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.280 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.280 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.280 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.280 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.280 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.281 INFO:teuthology.orchestra.run.smithi039.stdout: "orchestrator": { 2024-05-09T06:03:29.281 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "orchestrator", 2024-05-09T06:03:29.281 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.281 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.281 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.281 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.281 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.281 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.281 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.281 INFO:teuthology.orchestra.run.smithi039.stdout: "cephadm", 2024-05-09T06:03:29.281 INFO:teuthology.orchestra.run.smithi039.stdout: "rook", 2024-05-09T06:03:29.281 INFO:teuthology.orchestra.run.smithi039.stdout: "test_orchestrator" 2024-05-09T06:03:29.281 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.281 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Orchestrator backend", 2024-05-09T06:03:29.281 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.282 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.282 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.282 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.282 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:29.282 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:29.282 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.282 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:29.282 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.282 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:29.282 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.282 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.282 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.282 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.282 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.283 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.283 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.283 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.283 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.283 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.283 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:29.283 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "osd_perf_query", 2024-05-09T06:03:29.283 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-05-09T06:03:29.283 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-05-09T06:03:29.283 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:29.283 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:29.283 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:29.283 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.283 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.283 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.283 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.284 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.284 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.284 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.284 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.284 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.284 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.284 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.284 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.284 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.284 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.284 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.284 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.284 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.284 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.284 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.284 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:29.285 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:29.285 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.285 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.285 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.285 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.285 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.285 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.285 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.285 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.285 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.285 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.285 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.285 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.285 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:29.285 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:29.286 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.286 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.286 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.286 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:29.286 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.286 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.286 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.286 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.286 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.286 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.286 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.286 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.286 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.286 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.287 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.287 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.287 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.287 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.287 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.287 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:29.287 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:29.287 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.287 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.287 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.287 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.287 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.287 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.287 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.287 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.287 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.288 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.288 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.288 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.288 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:29.288 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:29.288 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.288 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:29.288 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.288 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:29.288 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.288 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.288 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.288 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.288 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.289 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.289 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.289 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.289 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.289 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.289 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:29.289 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "osd_support", 2024-05-09T06:03:29.289 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-05-09T06:03:29.289 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-05-09T06:03:29.289 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:29.289 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:29.289 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:29.289 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.289 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.290 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.290 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.290 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.290 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.290 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.290 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.290 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.290 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.290 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.290 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.290 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.290 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.290 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.290 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.290 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.291 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.291 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.291 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:29.291 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:29.291 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.291 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.291 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.291 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.291 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.291 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.291 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.291 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.291 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.291 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.292 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.292 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.292 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:29.292 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:29.292 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.292 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.292 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.292 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:29.292 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.292 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.292 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.292 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.292 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.292 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.292 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.293 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.293 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.293 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.293 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.293 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.293 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.293 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.293 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.293 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:29.293 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:29.293 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.293 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.293 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.293 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.293 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.293 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.294 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.294 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.294 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.294 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.294 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.294 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.294 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:29.294 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:29.294 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.294 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:29.294 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.294 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:29.294 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.294 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.294 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.294 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.295 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.295 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.295 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.295 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.295 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.295 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.295 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:29.295 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "pg_autoscaler", 2024-05-09T06:03:29.295 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-05-09T06:03:29.295 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-05-09T06:03:29.295 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:29.295 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:29.295 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:29.295 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.295 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.295 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.296 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.296 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.296 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.296 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.296 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.296 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.296 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.296 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.296 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.296 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.296 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.296 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.296 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.296 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.296 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.297 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.297 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:29.297 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:29.297 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.297 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.297 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.297 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.297 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.297 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.297 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.297 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.297 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.297 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.298 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.298 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.298 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:29.298 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:29.298 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.298 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.298 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.298 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:29.298 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.298 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.299 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.299 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.299 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.299 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.299 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.299 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.299 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.299 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.299 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.299 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.299 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.299 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.299 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.299 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:29.299 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:29.299 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.300 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.300 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.300 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.300 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.300 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.300 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.300 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.300 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.300 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.300 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.300 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.300 INFO:teuthology.orchestra.run.smithi039.stdout: "sleep_interval": { 2024-05-09T06:03:29.300 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sleep_interval", 2024-05-09T06:03:29.300 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-05-09T06:03:29.300 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.301 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.301 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "60", 2024-05-09T06:03:29.301 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.301 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.301 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.301 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.301 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.301 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.301 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.301 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.301 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:29.301 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:29.301 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.301 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:29.301 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.302 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:29.302 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.302 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.302 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.302 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.302 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.302 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.302 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.302 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.302 INFO:teuthology.orchestra.run.smithi039.stdout: "threshold": { 2024-05-09T06:03:29.302 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "threshold", 2024-05-09T06:03:29.302 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "float", 2024-05-09T06:03:29.302 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.302 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.302 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "3.0", 2024-05-09T06:03:29.303 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "1.0", 2024-05-09T06:03:29.303 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.303 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.303 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "scaling threshold", 2024-05-09T06:03:29.303 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-05-09T06:03:29.303 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.303 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.303 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.303 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.303 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.303 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:29.303 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "progress", 2024-05-09T06:03:29.303 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-05-09T06:03:29.303 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-05-09T06:03:29.303 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:29.303 INFO:teuthology.orchestra.run.smithi039.stdout: "allow_pg_recovery_event": { 2024-05-09T06:03:29.304 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "allow_pg_recovery_event", 2024-05-09T06:03:29.304 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.304 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.304 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.304 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.304 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.304 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.304 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.304 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "allow the module to show pg recovery progress", 2024-05-09T06:03:29.304 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.304 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.304 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.304 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.304 INFO:teuthology.orchestra.run.smithi039.stdout: "enabled": { 2024-05-09T06:03:29.305 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "enabled", 2024-05-09T06:03:29.305 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.305 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.305 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.305 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:29.305 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.305 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.305 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.305 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.305 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.305 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.305 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.305 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.305 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:29.305 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:29.306 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.306 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.306 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.306 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.306 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.306 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.306 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.306 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.306 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.306 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.306 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.306 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.306 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.306 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.306 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.307 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.307 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.307 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.307 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.307 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:29.307 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:29.307 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.307 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.307 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.307 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.307 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.307 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.307 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.308 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.308 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.308 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.308 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.308 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.308 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:29.308 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:29.308 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.308 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.308 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.308 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:29.308 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.308 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.308 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.309 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.309 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.309 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.309 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.309 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.309 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.309 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.309 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.309 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.309 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.309 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.309 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.309 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:29.310 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:29.310 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.310 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.310 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.310 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.310 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.310 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.310 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.310 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.310 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.310 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.310 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.310 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.311 INFO:teuthology.orchestra.run.smithi039.stdout: "max_completed_events": { 2024-05-09T06:03:29.311 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "max_completed_events", 2024-05-09T06:03:29.311 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.311 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.311 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.311 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "50", 2024-05-09T06:03:29.311 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.311 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.311 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.311 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "number of past completed events to remember", 2024-05-09T06:03:29.311 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.311 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.311 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.311 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.312 INFO:teuthology.orchestra.run.smithi039.stdout: "sleep_interval": { 2024-05-09T06:03:29.312 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sleep_interval", 2024-05-09T06:03:29.312 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-05-09T06:03:29.312 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.312 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.312 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "5", 2024-05-09T06:03:29.312 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.312 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.312 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.312 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "how long the module is going to sleep", 2024-05-09T06:03:29.312 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.312 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.312 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.312 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.312 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:29.313 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:29.313 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.313 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:29.313 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.313 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:29.313 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.313 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.313 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.313 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.313 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.313 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.313 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.313 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.313 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.313 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.314 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:29.314 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "prometheus", 2024-05-09T06:03:29.314 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-05-09T06:03:29.314 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-05-09T06:03:29.314 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:29.314 INFO:teuthology.orchestra.run.smithi039.stdout: "cache": { 2024-05-09T06:03:29.314 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "cache", 2024-05-09T06:03:29.314 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.314 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.314 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.314 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:29.314 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.314 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.314 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.315 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.315 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.315 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.315 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.315 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.315 INFO:teuthology.orchestra.run.smithi039.stdout: "exclude_perf_counters": { 2024-05-09T06:03:29.315 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "exclude_perf_counters", 2024-05-09T06:03:29.315 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.315 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.315 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.315 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:29.315 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.315 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.315 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.315 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-05-09T06:03:29.315 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-05-09T06:03:29.316 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.316 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.316 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.316 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:29.316 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:29.316 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.316 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.316 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.316 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.316 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.316 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.316 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.316 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.317 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.317 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.317 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.317 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.317 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.317 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.317 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.317 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.317 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.318 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.318 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.318 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:29.318 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:29.318 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.318 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.318 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.318 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.318 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.318 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.318 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.318 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.318 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.319 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.319 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.319 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.319 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:29.319 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:29.319 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.319 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.319 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.319 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:29.319 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.319 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.319 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.319 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.319 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.319 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.319 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.320 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.320 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.320 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.320 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.320 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.320 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.320 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.320 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.320 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:29.320 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:29.320 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.320 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.320 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.320 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.321 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.321 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.321 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.321 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.321 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.321 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.321 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.321 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.321 INFO:teuthology.orchestra.run.smithi039.stdout: "rbd_stats_pools": { 2024-05-09T06:03:29.321 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rbd_stats_pools", 2024-05-09T06:03:29.321 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.321 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.321 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.321 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.321 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.322 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.322 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.322 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.322 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.322 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.322 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.322 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.322 INFO:teuthology.orchestra.run.smithi039.stdout: "rbd_stats_pools_refresh_interval": { 2024-05-09T06:03:29.322 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-05-09T06:03:29.322 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.322 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.322 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.322 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "300", 2024-05-09T06:03:29.322 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.323 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.323 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.323 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.323 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.323 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.323 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.323 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.323 INFO:teuthology.orchestra.run.smithi039.stdout: "scrape_interval": { 2024-05-09T06:03:29.323 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "scrape_interval", 2024-05-09T06:03:29.323 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "float", 2024-05-09T06:03:29.323 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.323 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.323 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "15.0", 2024-05-09T06:03:29.323 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.323 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.324 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.324 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.324 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.324 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.324 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.324 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.324 INFO:teuthology.orchestra.run.smithi039.stdout: "server_addr": { 2024-05-09T06:03:29.324 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "server_addr", 2024-05-09T06:03:29.324 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.324 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.324 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.324 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "::", 2024-05-09T06:03:29.324 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.324 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.324 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.325 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-05-09T06:03:29.325 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.325 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.325 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.325 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.325 INFO:teuthology.orchestra.run.smithi039.stdout: "server_port": { 2024-05-09T06:03:29.325 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "server_port", 2024-05-09T06:03:29.325 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.325 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.325 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.325 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "9283", 2024-05-09T06:03:29.325 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.325 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.325 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.326 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-05-09T06:03:29.326 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.326 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.326 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.326 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.326 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:29.326 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:29.326 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.326 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:29.326 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.326 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:29.326 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.326 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.326 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.326 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.326 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.327 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.327 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.327 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.327 INFO:teuthology.orchestra.run.smithi039.stdout: "stale_cache_strategy": { 2024-05-09T06:03:29.327 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "stale_cache_strategy", 2024-05-09T06:03:29.327 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.327 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.327 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.327 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "log", 2024-05-09T06:03:29.327 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.327 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.327 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.327 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.327 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.327 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.327 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.327 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.328 INFO:teuthology.orchestra.run.smithi039.stdout: "standby_behaviour": { 2024-05-09T06:03:29.328 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "standby_behaviour", 2024-05-09T06:03:29.328 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.328 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.328 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.328 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "default", 2024-05-09T06:03:29.328 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.328 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.328 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.328 INFO:teuthology.orchestra.run.smithi039.stdout: "default", 2024-05-09T06:03:29.328 INFO:teuthology.orchestra.run.smithi039.stdout: "error" 2024-05-09T06:03:29.328 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.328 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.328 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.329 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.329 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.329 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.329 INFO:teuthology.orchestra.run.smithi039.stdout: "standby_error_status_code": { 2024-05-09T06:03:29.329 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "standby_error_status_code", 2024-05-09T06:03:29.329 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.329 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.329 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.329 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "500", 2024-05-09T06:03:29.329 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "400", 2024-05-09T06:03:29.329 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "599", 2024-05-09T06:03:29.329 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.329 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.329 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.330 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.330 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.330 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.330 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.330 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.330 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:29.330 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rbd_support", 2024-05-09T06:03:29.330 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-05-09T06:03:29.330 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-05-09T06:03:29.330 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:29.330 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:29.330 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:29.330 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.331 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.331 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.331 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.331 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.331 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.331 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.331 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.331 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.331 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.331 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.331 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.331 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.331 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.331 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.331 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.332 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.332 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.332 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.332 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:29.332 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:29.332 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.332 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.332 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.332 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.332 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.332 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.332 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.332 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.332 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.333 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.333 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.333 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.333 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:29.333 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:29.333 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.333 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.333 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.333 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:29.333 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.333 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.333 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.333 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.334 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.334 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.334 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.334 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.334 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.334 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.334 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.334 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.334 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.334 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.334 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.334 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:29.334 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:29.335 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.335 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.335 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.335 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.335 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.335 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.335 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.335 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.335 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.335 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.335 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.335 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.335 INFO:teuthology.orchestra.run.smithi039.stdout: "max_concurrent_snap_create": { 2024-05-09T06:03:29.335 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "max_concurrent_snap_create", 2024-05-09T06:03:29.336 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.336 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.336 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.336 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10", 2024-05-09T06:03:29.336 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.336 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.336 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.336 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.336 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.336 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.336 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.336 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.336 INFO:teuthology.orchestra.run.smithi039.stdout: "mirror_snapshot_schedule": { 2024-05-09T06:03:29.336 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "mirror_snapshot_schedule", 2024-05-09T06:03:29.337 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.337 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.337 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.337 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.337 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.337 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.337 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.337 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.337 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.337 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.337 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.337 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.337 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:29.337 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:29.338 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.338 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:29.338 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.338 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:29.338 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.338 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.338 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.338 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.338 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.338 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.338 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.338 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.338 INFO:teuthology.orchestra.run.smithi039.stdout: "trash_purge_schedule": { 2024-05-09T06:03:29.338 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "trash_purge_schedule", 2024-05-09T06:03:29.338 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.339 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.339 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.339 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.339 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.339 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.339 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.339 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.339 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.339 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.339 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.339 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.339 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.339 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.340 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:29.340 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "restful", 2024-05-09T06:03:29.340 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-05-09T06:03:29.340 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-05-09T06:03:29.340 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:29.340 INFO:teuthology.orchestra.run.smithi039.stdout: "enable_auth": { 2024-05-09T06:03:29.340 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "enable_auth", 2024-05-09T06:03:29.340 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.340 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.340 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.340 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:29.340 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.340 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.340 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.341 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.341 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.341 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.341 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.341 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.341 INFO:teuthology.orchestra.run.smithi039.stdout: "key_file": { 2024-05-09T06:03:29.341 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "key_file", 2024-05-09T06:03:29.341 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.341 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.341 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.341 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.341 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.341 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.341 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.342 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.342 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.342 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.342 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.342 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.342 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:29.342 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:29.342 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.342 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.342 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.342 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.342 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.342 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.342 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.343 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.343 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.343 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.343 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.343 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.343 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.343 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.343 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.343 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.343 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.343 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.343 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.343 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:29.343 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:29.343 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.343 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.344 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.344 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.344 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.344 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.344 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.344 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.344 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.344 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.344 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.344 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.344 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:29.344 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:29.344 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.344 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.345 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.345 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:29.345 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.345 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.345 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.345 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.345 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.345 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.345 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.345 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.345 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.345 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.345 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.346 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.346 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.346 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.346 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.346 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:29.346 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:29.346 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.346 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.346 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.346 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.346 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.347 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.347 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.347 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.347 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.347 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.347 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.347 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.347 INFO:teuthology.orchestra.run.smithi039.stdout: "server_addr": { 2024-05-09T06:03:29.347 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "server_addr", 2024-05-09T06:03:29.347 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.347 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.347 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.347 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.347 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.348 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.348 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.348 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.348 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.348 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.348 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.348 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.348 INFO:teuthology.orchestra.run.smithi039.stdout: "server_port": { 2024-05-09T06:03:29.348 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "server_port", 2024-05-09T06:03:29.348 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.348 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.348 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.348 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.349 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.349 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.349 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.349 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.349 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.349 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.349 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.349 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.349 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:29.349 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:29.349 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.349 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:29.349 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.350 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:29.350 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.350 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.350 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.350 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.350 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.350 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.350 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.350 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.350 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.350 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.350 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:29.351 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rgw", 2024-05-09T06:03:29.351 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-05-09T06:03:29.351 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-05-09T06:03:29.351 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:29.351 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:29.351 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:29.351 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.351 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.351 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.351 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.351 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.351 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.351 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.351 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.352 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.352 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.352 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.352 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.352 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.352 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.352 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.352 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.352 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.352 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.352 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.352 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:29.352 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:29.352 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.352 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.353 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.353 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.353 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.353 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.353 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.353 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.353 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.353 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.353 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.353 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.353 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:29.353 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:29.353 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.353 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.353 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.354 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:29.354 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.354 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.354 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.354 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.354 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.354 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.354 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.354 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.354 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.354 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.354 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.354 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.354 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.355 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.355 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.355 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:29.355 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:29.355 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.355 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.355 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.355 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.355 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.355 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.355 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.355 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.355 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.355 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.355 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.356 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.356 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:29.356 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:29.356 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.356 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:29.356 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.356 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:29.356 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.356 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.356 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.356 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.356 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.356 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.356 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.356 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.357 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.357 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.357 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:29.357 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rook", 2024-05-09T06:03:29.357 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-05-09T06:03:29.357 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-05-09T06:03:29.357 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:29.357 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:29.357 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:29.357 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.357 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.357 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.357 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.357 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.358 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.358 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.358 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.358 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.358 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.358 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.358 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.358 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.358 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.358 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.358 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.358 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.359 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.359 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.359 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:29.359 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:29.359 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.359 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.359 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.359 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.359 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.359 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.359 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.359 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.359 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.359 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.360 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.360 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.360 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:29.360 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:29.360 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.360 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.360 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.360 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:29.360 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.360 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.360 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.360 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.360 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.360 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.361 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.361 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.361 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.361 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.361 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.361 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.361 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.361 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.361 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.361 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:29.361 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:29.361 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.361 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.361 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.362 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.362 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.362 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.362 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.362 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.362 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.362 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.362 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.362 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.362 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:29.362 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:29.362 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.362 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:29.362 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.363 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:29.363 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.363 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.363 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.363 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.363 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.363 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.363 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.363 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.363 INFO:teuthology.orchestra.run.smithi039.stdout: "storage_class": { 2024-05-09T06:03:29.363 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "storage_class", 2024-05-09T06:03:29.363 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.363 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.363 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.364 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "local", 2024-05-09T06:03:29.364 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.364 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.364 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.364 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-05-09T06:03:29.364 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.364 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.364 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.364 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.364 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.364 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.364 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:29.364 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "selftest", 2024-05-09T06:03:29.364 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-05-09T06:03:29.365 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-05-09T06:03:29.365 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:29.365 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:29.365 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:29.365 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.365 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.365 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.365 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.365 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.365 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.365 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.365 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.365 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.365 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.366 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.366 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.366 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.366 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.366 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.366 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.366 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.366 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.366 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.366 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:29.366 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:29.366 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.367 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.367 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.367 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.367 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.367 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.367 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.367 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.367 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.367 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.367 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.367 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.367 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:29.367 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:29.367 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.368 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.368 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.368 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:29.368 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.368 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.368 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.368 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.368 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.368 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.368 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.368 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.368 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.368 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.368 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.369 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.369 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.369 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.369 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.369 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:29.369 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:29.369 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.369 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.369 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.369 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.369 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.369 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.369 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.369 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.370 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.370 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.370 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.370 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.370 INFO:teuthology.orchestra.run.smithi039.stdout: "roption1": { 2024-05-09T06:03:29.370 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "roption1", 2024-05-09T06:03:29.370 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.370 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.370 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.370 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.370 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.370 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.370 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.370 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.371 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.371 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.371 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.371 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.371 INFO:teuthology.orchestra.run.smithi039.stdout: "roption2": { 2024-05-09T06:03:29.371 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "roption2", 2024-05-09T06:03:29.371 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.371 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.371 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.371 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "xyz", 2024-05-09T06:03:29.371 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.371 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.371 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.371 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.371 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.372 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.372 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.372 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.372 INFO:teuthology.orchestra.run.smithi039.stdout: "rwoption1": { 2024-05-09T06:03:29.372 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rwoption1", 2024-05-09T06:03:29.372 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.372 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.372 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.372 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.372 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.372 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.373 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.373 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.373 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.373 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.373 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.373 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.373 INFO:teuthology.orchestra.run.smithi039.stdout: "rwoption2": { 2024-05-09T06:03:29.373 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rwoption2", 2024-05-09T06:03:29.373 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.373 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.373 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.373 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.373 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.373 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.374 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.374 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.374 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.374 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.374 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.374 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.374 INFO:teuthology.orchestra.run.smithi039.stdout: "rwoption3": { 2024-05-09T06:03:29.374 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rwoption3", 2024-05-09T06:03:29.374 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "float", 2024-05-09T06:03:29.374 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.374 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.374 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.374 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.375 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.375 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.375 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.375 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.375 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.375 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.375 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.375 INFO:teuthology.orchestra.run.smithi039.stdout: "rwoption4": { 2024-05-09T06:03:29.375 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rwoption4", 2024-05-09T06:03:29.375 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.375 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.375 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.376 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.376 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.376 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.376 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.376 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.376 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.376 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.376 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.376 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.376 INFO:teuthology.orchestra.run.smithi039.stdout: "rwoption5": { 2024-05-09T06:03:29.376 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rwoption5", 2024-05-09T06:03:29.376 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.376 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.376 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.376 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.377 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.377 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.377 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.377 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.377 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.377 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.377 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.377 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.377 INFO:teuthology.orchestra.run.smithi039.stdout: "rwoption6": { 2024-05-09T06:03:29.377 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rwoption6", 2024-05-09T06:03:29.377 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.377 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.377 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.378 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:29.378 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.378 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.378 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.378 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.378 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.378 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.378 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.378 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.378 INFO:teuthology.orchestra.run.smithi039.stdout: "rwoption7": { 2024-05-09T06:03:29.378 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rwoption7", 2024-05-09T06:03:29.378 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.378 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.379 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.379 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.379 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "1", 2024-05-09T06:03:29.379 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "42", 2024-05-09T06:03:29.379 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.379 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.379 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.379 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.379 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.379 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.379 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:29.379 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:29.379 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.379 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:29.380 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.380 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:29.380 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.380 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.380 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.380 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.380 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.380 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.380 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.380 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.380 INFO:teuthology.orchestra.run.smithi039.stdout: "testkey": { 2024-05-09T06:03:29.380 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "testkey", 2024-05-09T06:03:29.380 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.381 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.381 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.381 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.381 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.381 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.381 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.381 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.381 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.381 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.381 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.381 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.381 INFO:teuthology.orchestra.run.smithi039.stdout: "testlkey": { 2024-05-09T06:03:29.381 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "testlkey", 2024-05-09T06:03:29.381 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.381 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.382 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.382 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.382 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.382 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.382 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.382 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.382 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.382 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.382 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.382 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.382 INFO:teuthology.orchestra.run.smithi039.stdout: "testnewline": { 2024-05-09T06:03:29.382 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "testnewline", 2024-05-09T06:03:29.382 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.382 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.383 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.383 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.383 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.383 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.383 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.383 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.383 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.383 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.383 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.383 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.383 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.383 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.383 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:29.383 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "smb", 2024-05-09T06:03:29.383 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-05-09T06:03:29.384 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-05-09T06:03:29.384 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:29.384 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:29.384 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:29.384 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.384 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.384 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.384 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.384 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.384 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.384 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.384 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.384 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.384 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.385 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.385 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.385 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.385 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.385 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.385 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.385 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.385 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.385 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.385 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:29.385 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:29.385 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.385 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.385 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.386 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.386 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.386 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.386 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.386 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.386 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.386 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.386 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.386 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.386 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:29.386 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:29.386 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.386 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.386 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.387 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:29.387 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.387 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.387 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.387 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.387 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.387 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.387 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.387 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.387 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.387 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.387 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.387 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.388 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.388 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.388 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.388 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:29.388 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:29.388 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.388 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.388 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.388 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.388 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.388 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.388 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.388 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.389 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.389 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.389 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.389 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.389 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:29.389 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:29.389 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.389 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:29.389 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.389 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:29.389 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.389 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.389 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.389 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.389 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.390 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.390 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.390 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.390 INFO:teuthology.orchestra.run.smithi039.stdout: "update_orchestration": { 2024-05-09T06:03:29.390 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "update_orchestration", 2024-05-09T06:03:29.390 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.390 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.390 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.390 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:29.390 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.390 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.390 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.390 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-05-09T06:03:29.390 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.391 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.391 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.391 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.391 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.391 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.391 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:29.391 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "snap_schedule", 2024-05-09T06:03:29.391 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-05-09T06:03:29.391 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-05-09T06:03:29.391 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:29.391 INFO:teuthology.orchestra.run.smithi039.stdout: "allow_m_granularity": { 2024-05-09T06:03:29.391 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "allow_m_granularity", 2024-05-09T06:03:29.391 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.391 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.392 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.392 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.392 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.392 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.392 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.392 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "allow minute scheduled snapshots", 2024-05-09T06:03:29.392 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.392 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.392 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.392 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.392 INFO:teuthology.orchestra.run.smithi039.stdout: "dump_on_update": { 2024-05-09T06:03:29.392 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "dump_on_update", 2024-05-09T06:03:29.392 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.392 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.393 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.393 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.393 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.393 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.393 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.393 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "dump database to debug log on update", 2024-05-09T06:03:29.393 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.393 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.393 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.393 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.393 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:29.393 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:29.393 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.393 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.393 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.394 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.394 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.394 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.394 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.394 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.394 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.394 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.394 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.394 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.394 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.394 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.394 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.394 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.394 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.395 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.395 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.395 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:29.395 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:29.395 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.395 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.395 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.395 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.395 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.395 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.395 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.395 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.395 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.395 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.396 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.396 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.396 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:29.396 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:29.396 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.396 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.396 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.396 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:29.396 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.396 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.396 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.396 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.396 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.396 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.396 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.397 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.397 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.397 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.397 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.397 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.397 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.397 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.397 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.397 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:29.397 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:29.397 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.397 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.397 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.397 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.397 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.398 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.398 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.398 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.398 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.398 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.398 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.398 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.398 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:29.398 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:29.398 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.398 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:29.398 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.398 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:29.399 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.399 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.399 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.399 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.399 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.399 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.399 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.399 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.399 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.399 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.399 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:29.399 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "stats", 2024-05-09T06:03:29.399 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-05-09T06:03:29.399 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-05-09T06:03:29.400 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:29.400 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:29.400 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:29.400 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.400 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.400 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.400 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.400 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.400 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.400 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.400 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.400 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.400 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.401 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.401 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.401 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.401 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.401 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.401 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.401 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.401 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.401 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.401 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:29.401 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:29.401 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.401 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.401 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.402 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.402 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.402 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.402 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.402 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.402 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.402 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.402 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.402 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.402 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:29.402 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:29.402 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.402 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.403 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.403 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:29.403 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.403 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.403 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.403 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.403 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.403 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.403 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.403 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.403 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.403 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.403 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.403 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.404 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.404 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.404 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.404 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:29.404 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:29.404 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.404 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.404 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.404 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.404 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.404 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.404 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.404 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.405 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.405 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.405 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.405 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.405 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:29.405 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:29.405 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.405 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:29.405 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.405 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:29.405 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.405 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.405 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.405 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.406 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.406 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.406 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.406 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.406 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.406 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.406 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:29.406 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "status", 2024-05-09T06:03:29.406 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-05-09T06:03:29.406 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-05-09T06:03:29.406 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:29.406 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:29.406 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:29.406 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.407 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.407 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.407 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.407 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.407 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.407 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.407 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.407 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.407 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.407 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.407 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.407 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.407 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.408 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.408 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.408 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.408 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.408 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.408 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:29.408 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:29.408 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.408 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.408 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.408 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.408 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.408 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.408 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.409 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.409 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.409 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.409 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.409 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.409 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:29.409 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:29.409 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.409 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.409 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.409 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:29.409 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.409 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.409 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.410 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.410 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.410 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.410 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.410 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.410 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.410 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.410 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.410 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.410 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.410 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.410 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.410 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:29.410 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:29.411 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.411 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.411 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.411 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.411 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.411 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.411 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.411 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.411 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.411 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.411 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.411 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.411 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:29.411 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:29.412 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.412 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:29.412 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.412 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:29.412 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.412 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.412 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.412 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.412 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.412 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.412 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.412 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.412 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.412 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.412 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:29.413 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "telegraf", 2024-05-09T06:03:29.413 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-05-09T06:03:29.413 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-05-09T06:03:29.413 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:29.413 INFO:teuthology.orchestra.run.smithi039.stdout: "address": { 2024-05-09T06:03:29.413 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "address", 2024-05-09T06:03:29.413 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.413 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.413 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.413 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-05-09T06:03:29.413 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.413 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.413 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.413 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.414 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.414 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.414 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.414 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.414 INFO:teuthology.orchestra.run.smithi039.stdout: "interval": { 2024-05-09T06:03:29.414 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "interval", 2024-05-09T06:03:29.414 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-05-09T06:03:29.414 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.414 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.414 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "15", 2024-05-09T06:03:29.414 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.414 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.414 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.414 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.415 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.415 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.415 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.415 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.415 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:29.415 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:29.415 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.415 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.415 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.415 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.415 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.415 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.415 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.415 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.416 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.416 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.416 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.416 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.416 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.416 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.416 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.416 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.416 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.416 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.416 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.416 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:29.416 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:29.416 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.416 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.417 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.417 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.417 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.417 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.417 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.417 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.417 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.417 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.417 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.417 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.417 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:29.417 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:29.417 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.417 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.418 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.418 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:29.418 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.418 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.418 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.418 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.418 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.418 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.418 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.418 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.418 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.418 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.418 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.419 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.419 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.419 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.419 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.419 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:29.419 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:29.419 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.419 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.419 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.419 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.419 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.419 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.419 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.419 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.420 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.420 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.420 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.420 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.420 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:29.420 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:29.420 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.420 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:29.420 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.420 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:29.420 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.420 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.420 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.420 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.421 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.421 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.421 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.421 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.421 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.421 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.421 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:29.421 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "telemetry", 2024-05-09T06:03:29.421 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-05-09T06:03:29.421 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-05-09T06:03:29.421 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:29.421 INFO:teuthology.orchestra.run.smithi039.stdout: "channel_basic": { 2024-05-09T06:03:29.421 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "channel_basic", 2024-05-09T06:03:29.421 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.422 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.422 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.422 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:29.422 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.422 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.422 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.422 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Share basic cluster information (size, version)", 2024-05-09T06:03:29.422 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.422 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.422 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.422 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.422 INFO:teuthology.orchestra.run.smithi039.stdout: "channel_crash": { 2024-05-09T06:03:29.422 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "channel_crash", 2024-05-09T06:03:29.422 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.423 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.423 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.423 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:29.423 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.423 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.423 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.423 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-05-09T06:03:29.423 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.423 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.423 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.423 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.423 INFO:teuthology.orchestra.run.smithi039.stdout: "channel_device": { 2024-05-09T06:03:29.423 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "channel_device", 2024-05-09T06:03:29.423 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.424 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.424 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.424 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:29.424 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.424 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.424 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.424 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-05-09T06:03:29.424 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.424 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.424 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.424 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.424 INFO:teuthology.orchestra.run.smithi039.stdout: "channel_ident": { 2024-05-09T06:03:29.424 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "channel_ident", 2024-05-09T06:03:29.424 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.425 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.425 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.425 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.425 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.425 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.425 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.425 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-05-09T06:03:29.425 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.425 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.425 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.425 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.425 INFO:teuthology.orchestra.run.smithi039.stdout: "channel_perf": { 2024-05-09T06:03:29.425 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "channel_perf", 2024-05-09T06:03:29.425 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.425 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.426 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.426 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.426 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.426 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.426 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.426 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Share various performance metrics of a cluster", 2024-05-09T06:03:29.426 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.426 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.426 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.426 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.426 INFO:teuthology.orchestra.run.smithi039.stdout: "contact": { 2024-05-09T06:03:29.426 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "contact", 2024-05-09T06:03:29.426 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.426 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.427 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.427 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.427 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.427 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.427 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.427 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.427 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.427 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.427 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.427 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.427 INFO:teuthology.orchestra.run.smithi039.stdout: "description": { 2024-05-09T06:03:29.427 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "description", 2024-05-09T06:03:29.427 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.427 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.427 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.428 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.428 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.428 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.428 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.428 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.428 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.428 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.428 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.428 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.428 INFO:teuthology.orchestra.run.smithi039.stdout: "device_url": { 2024-05-09T06:03:29.428 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "device_url", 2024-05-09T06:03:29.428 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.428 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.429 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.429 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-05-09T06:03:29.429 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.429 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.429 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.429 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.429 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.429 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.429 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.429 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.429 INFO:teuthology.orchestra.run.smithi039.stdout: "enabled": { 2024-05-09T06:03:29.429 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "enabled", 2024-05-09T06:03:29.429 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.429 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.430 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.430 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.430 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.430 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.430 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.430 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.430 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.430 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.430 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.430 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.430 INFO:teuthology.orchestra.run.smithi039.stdout: "interval": { 2024-05-09T06:03:29.430 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "interval", 2024-05-09T06:03:29.430 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.430 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.431 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.431 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "24", 2024-05-09T06:03:29.431 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "8", 2024-05-09T06:03:29.431 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.431 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.431 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.431 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.431 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.431 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.431 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.433 INFO:teuthology.orchestra.run.smithi039.stdout: "last_opt_revision": { 2024-05-09T06:03:29.433 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "last_opt_revision", 2024-05-09T06:03:29.433 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.433 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.433 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.433 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "1", 2024-05-09T06:03:29.433 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.433 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.433 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.433 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.434 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.434 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.434 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.434 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.434 INFO:teuthology.orchestra.run.smithi039.stdout: "leaderboard": { 2024-05-09T06:03:29.434 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "leaderboard", 2024-05-09T06:03:29.434 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.434 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.434 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.434 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.434 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.434 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.434 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.435 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.435 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.435 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.435 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.435 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.435 INFO:teuthology.orchestra.run.smithi039.stdout: "leaderboard_description": { 2024-05-09T06:03:29.435 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "leaderboard_description", 2024-05-09T06:03:29.435 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.435 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.435 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.435 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.435 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.435 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.435 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.436 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.436 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.436 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.436 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.436 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.436 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:29.436 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:29.436 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.436 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.436 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.436 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.436 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.436 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.437 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.437 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.437 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.437 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.437 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.437 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.437 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.437 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.437 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.437 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.437 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.437 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.437 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.437 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:29.438 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:29.438 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.438 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.438 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.438 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.438 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.438 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.438 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.438 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.438 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.438 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.438 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.438 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.439 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:29.439 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:29.439 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.439 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.439 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.439 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:29.439 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.439 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.439 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.439 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.439 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.439 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.439 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.439 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.440 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.440 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.440 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.440 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.440 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.440 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.440 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.440 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:29.440 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:29.440 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.440 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.440 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.440 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.441 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.441 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.441 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.441 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.441 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.441 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.441 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.441 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.441 INFO:teuthology.orchestra.run.smithi039.stdout: "organization": { 2024-05-09T06:03:29.441 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "organization", 2024-05-09T06:03:29.441 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.441 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.441 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.441 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.442 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.442 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.442 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.442 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.442 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.442 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.442 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.442 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.442 INFO:teuthology.orchestra.run.smithi039.stdout: "proxy": { 2024-05-09T06:03:29.442 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "proxy", 2024-05-09T06:03:29.442 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.442 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.442 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.443 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.443 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.443 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.443 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.443 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.443 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.443 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.443 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.443 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.443 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:29.443 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:29.443 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.443 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:29.443 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.444 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:29.444 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.444 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.444 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.444 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.444 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.444 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.444 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.444 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.444 INFO:teuthology.orchestra.run.smithi039.stdout: "url": { 2024-05-09T06:03:29.444 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "url", 2024-05-09T06:03:29.444 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.444 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.444 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.445 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-05-09T06:03:29.445 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.445 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.445 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.445 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.445 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.445 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.445 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.445 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.445 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.445 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.445 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:29.445 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "test_orchestrator", 2024-05-09T06:03:29.445 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-05-09T06:03:29.445 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-05-09T06:03:29.446 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:29.446 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:29.446 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:29.446 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.446 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.446 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.446 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.446 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.446 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.446 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.446 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.446 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.446 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.446 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.447 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.447 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.447 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.447 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.447 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.447 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.447 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.447 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.447 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:29.447 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:29.447 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.447 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.447 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.447 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.448 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.448 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.448 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.448 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.448 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.448 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.448 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.448 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.448 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:29.448 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:29.448 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.448 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.448 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.448 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:29.449 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.449 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.449 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.449 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.449 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.449 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.449 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.449 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.449 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.449 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.449 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.449 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.449 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.449 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.449 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.450 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:29.450 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:29.450 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.450 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.450 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.450 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.450 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.450 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.450 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.450 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.450 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.450 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.451 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.451 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.451 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:29.451 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:29.451 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.451 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:29.451 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.451 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:29.451 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.451 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.451 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.451 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.451 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.451 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.451 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.452 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.452 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.452 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.452 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:29.452 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "volumes", 2024-05-09T06:03:29.452 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-05-09T06:03:29.452 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-05-09T06:03:29.452 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:29.452 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:29.452 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:29.452 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.452 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.452 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.452 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.452 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.453 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.453 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.453 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.453 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.453 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.453 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.453 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.453 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.453 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.453 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.453 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.453 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.453 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.453 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.454 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:29.454 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:29.454 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.454 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.454 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.454 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.454 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.454 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.454 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.454 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.454 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.454 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.454 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.455 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.455 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:29.455 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:29.455 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.455 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.455 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.455 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:29.455 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.455 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.455 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.455 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.455 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.455 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.456 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.456 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.456 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.456 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.456 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.456 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.456 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.456 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.456 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.456 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:29.456 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:29.456 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.456 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.456 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.457 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.457 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.457 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.457 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.457 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.457 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.457 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.457 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.457 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.457 INFO:teuthology.orchestra.run.smithi039.stdout: "max_concurrent_clones": { 2024-05-09T06:03:29.457 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "max_concurrent_clones", 2024-05-09T06:03:29.457 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.457 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.457 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.458 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "4", 2024-05-09T06:03:29.458 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.458 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.458 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.458 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Number of asynchronous cloner threads", 2024-05-09T06:03:29.458 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.458 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.458 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.458 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.458 INFO:teuthology.orchestra.run.smithi039.stdout: "periodic_async_work": { 2024-05-09T06:03:29.458 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "periodic_async_work", 2024-05-09T06:03:29.458 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.458 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.459 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.459 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.459 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.459 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.459 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.459 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Periodically check for async work", 2024-05-09T06:03:29.459 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.459 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.459 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.459 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.459 INFO:teuthology.orchestra.run.smithi039.stdout: "snapshot_clone_delay": { 2024-05-09T06:03:29.459 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "snapshot_clone_delay", 2024-05-09T06:03:29.459 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.459 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.459 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.460 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:29.460 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.460 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.460 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.460 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-05-09T06:03:29.460 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.460 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.460 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.460 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.460 INFO:teuthology.orchestra.run.smithi039.stdout: "snapshot_clone_no_wait": { 2024-05-09T06:03:29.460 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "snapshot_clone_no_wait", 2024-05-09T06:03:29.460 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.460 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.460 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.461 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:29.461 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.461 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.461 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.461 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-05-09T06:03:29.461 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.461 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.461 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.461 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.461 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:29.461 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:29.461 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.461 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:29.461 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.462 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:29.462 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.462 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.462 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.462 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.462 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.462 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.462 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.462 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.462 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.462 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.462 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:29.462 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "zabbix", 2024-05-09T06:03:29.463 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-05-09T06:03:29.463 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-05-09T06:03:29.463 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:29.463 INFO:teuthology.orchestra.run.smithi039.stdout: "discovery_interval": { 2024-05-09T06:03:29.463 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "discovery_interval", 2024-05-09T06:03:29.463 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "uint", 2024-05-09T06:03:29.463 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.463 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.463 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "100", 2024-05-09T06:03:29.463 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.463 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.463 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.463 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.463 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.464 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.464 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.464 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.464 INFO:teuthology.orchestra.run.smithi039.stdout: "identifier": { 2024-05-09T06:03:29.464 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "identifier", 2024-05-09T06:03:29.464 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.464 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.464 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.464 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.464 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.464 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.464 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.464 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.464 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.464 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.464 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.465 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.465 INFO:teuthology.orchestra.run.smithi039.stdout: "interval": { 2024-05-09T06:03:29.465 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "interval", 2024-05-09T06:03:29.465 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-05-09T06:03:29.465 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.465 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.465 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "60", 2024-05-09T06:03:29.465 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.465 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.465 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.465 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.465 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.465 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.465 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.465 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.465 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:29.466 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:29.466 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.466 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.466 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.466 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.466 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.466 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.466 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.466 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.466 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.466 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.466 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.467 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.467 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.467 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.467 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.467 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.467 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.467 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.467 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.467 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:29.467 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:29.467 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.467 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.467 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.467 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.467 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.467 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.468 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.468 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.468 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.468 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.468 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.468 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.468 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:29.468 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:29.468 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.468 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.468 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.468 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:29.468 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.469 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.469 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.469 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.469 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.469 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.469 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.469 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.469 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.469 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.469 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.469 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.469 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.469 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.469 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.469 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:29.470 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:29.470 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.470 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.470 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.470 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.470 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.470 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.470 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.470 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.470 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.470 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.470 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.470 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.470 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:29.471 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:29.471 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.471 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:29.471 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.471 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:29.471 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.471 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.471 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.471 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.471 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.471 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.471 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.471 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.471 INFO:teuthology.orchestra.run.smithi039.stdout: "zabbix_host": { 2024-05-09T06:03:29.472 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "zabbix_host", 2024-05-09T06:03:29.472 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.472 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.472 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.472 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.472 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.472 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.472 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.472 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.472 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.472 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.472 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.472 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.472 INFO:teuthology.orchestra.run.smithi039.stdout: "zabbix_port": { 2024-05-09T06:03:29.473 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "zabbix_port", 2024-05-09T06:03:29.473 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.473 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.473 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.473 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10051", 2024-05-09T06:03:29.473 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.473 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.473 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.473 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.473 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.473 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.473 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.473 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.473 INFO:teuthology.orchestra.run.smithi039.stdout: "zabbix_sender": { 2024-05-09T06:03:29.474 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "zabbix_sender", 2024-05-09T06:03:29.474 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.474 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.474 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.474 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-05-09T06:03:29.474 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.474 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.474 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.474 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.474 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.474 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.474 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.474 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.474 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.475 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.475 INFO:teuthology.orchestra.run.smithi039.stdout: ] 2024-05-09T06:03:29.475 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.475 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:29.475 INFO:teuthology.orchestra.run.smithi039.stdout: "gid": 24122, 2024-05-09T06:03:29.475 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "y", 2024-05-09T06:03:29.475 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr_features": 4540701547738038271, 2024-05-09T06:03:29.475 INFO:teuthology.orchestra.run.smithi039.stdout: "available_modules": [ 2024-05-09T06:03:29.475 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:29.475 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "alerts", 2024-05-09T06:03:29.475 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-05-09T06:03:29.475 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-05-09T06:03:29.475 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:29.475 INFO:teuthology.orchestra.run.smithi039.stdout: "interval": { 2024-05-09T06:03:29.476 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "interval", 2024-05-09T06:03:29.476 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-05-09T06:03:29.476 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.476 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.476 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "60", 2024-05-09T06:03:29.476 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.476 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.476 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.476 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "How frequently to reexamine health status", 2024-05-09T06:03:29.476 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.476 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.476 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.476 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.476 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:29.476 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:29.477 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.477 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.477 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.477 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.477 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.477 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.477 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.477 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.477 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.477 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.477 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.477 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.477 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.478 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.478 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.478 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.478 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.478 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.478 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.478 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:29.478 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:29.478 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.478 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.478 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.478 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.478 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.478 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.479 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.479 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.479 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.479 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.479 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.479 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.479 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:29.479 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:29.479 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.479 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.479 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.479 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:29.479 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.479 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.479 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.480 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.480 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.480 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.480 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.480 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.480 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.480 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.480 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.480 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.480 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.480 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.480 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.480 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:29.480 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:29.480 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.481 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.481 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.481 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.481 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.481 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.481 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.481 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.481 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.481 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.481 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.481 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.481 INFO:teuthology.orchestra.run.smithi039.stdout: "smtp_destination": { 2024-05-09T06:03:29.481 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "smtp_destination", 2024-05-09T06:03:29.481 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.481 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.482 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.482 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.482 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.482 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.482 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.482 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Email address to send alerts to", 2024-05-09T06:03:29.482 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.482 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.482 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.482 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.482 INFO:teuthology.orchestra.run.smithi039.stdout: "smtp_from_name": { 2024-05-09T06:03:29.482 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "smtp_from_name", 2024-05-09T06:03:29.482 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.483 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.483 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.483 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "Ceph", 2024-05-09T06:03:29.483 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.483 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.483 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.483 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Email From: name", 2024-05-09T06:03:29.483 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.483 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.483 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.483 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.483 INFO:teuthology.orchestra.run.smithi039.stdout: "smtp_host": { 2024-05-09T06:03:29.483 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "smtp_host", 2024-05-09T06:03:29.483 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.483 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.483 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.484 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.484 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.484 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.484 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.484 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "SMTP server", 2024-05-09T06:03:29.484 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.484 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.484 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.484 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.484 INFO:teuthology.orchestra.run.smithi039.stdout: "smtp_password": { 2024-05-09T06:03:29.484 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "smtp_password", 2024-05-09T06:03:29.484 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.485 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.485 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.485 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.485 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.485 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.485 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.485 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Password to authenticate with", 2024-05-09T06:03:29.485 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.485 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.485 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.485 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.485 INFO:teuthology.orchestra.run.smithi039.stdout: "smtp_port": { 2024-05-09T06:03:29.485 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "smtp_port", 2024-05-09T06:03:29.485 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.485 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.486 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.486 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "465", 2024-05-09T06:03:29.486 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.486 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.486 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.486 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "SMTP port", 2024-05-09T06:03:29.486 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.486 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.486 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.486 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.486 INFO:teuthology.orchestra.run.smithi039.stdout: "smtp_sender": { 2024-05-09T06:03:29.486 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "smtp_sender", 2024-05-09T06:03:29.486 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.486 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.487 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.487 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.487 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.487 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.487 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.487 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "SMTP envelope sender", 2024-05-09T06:03:29.487 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.487 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.487 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.487 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.487 INFO:teuthology.orchestra.run.smithi039.stdout: "smtp_ssl": { 2024-05-09T06:03:29.487 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "smtp_ssl", 2024-05-09T06:03:29.487 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.488 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.488 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.488 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:29.488 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.488 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.488 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.488 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Use SSL to connect to SMTP server", 2024-05-09T06:03:29.488 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.488 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.488 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.488 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.488 INFO:teuthology.orchestra.run.smithi039.stdout: "smtp_user": { 2024-05-09T06:03:29.488 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "smtp_user", 2024-05-09T06:03:29.488 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.489 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.489 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.489 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.489 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.489 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.489 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.489 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "User to authenticate as", 2024-05-09T06:03:29.489 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.489 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.489 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.489 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.489 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:29.489 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:29.490 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.490 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:29.490 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.490 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:29.490 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.490 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.490 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.490 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.490 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.490 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.490 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.490 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.490 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.490 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.491 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:29.491 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "balancer", 2024-05-09T06:03:29.491 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-05-09T06:03:29.491 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-05-09T06:03:29.491 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:29.491 INFO:teuthology.orchestra.run.smithi039.stdout: "active": { 2024-05-09T06:03:29.491 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "active", 2024-05-09T06:03:29.491 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.491 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.491 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.491 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:29.491 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.491 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.491 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.492 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "automatically balance PGs across cluster", 2024-05-09T06:03:29.492 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.492 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.492 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.492 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.492 INFO:teuthology.orchestra.run.smithi039.stdout: "begin_time": { 2024-05-09T06:03:29.492 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "begin_time", 2024-05-09T06:03:29.492 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.492 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.492 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.492 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0000", 2024-05-09T06:03:29.492 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.492 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.492 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.492 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "beginning time of day to automatically balance", 2024-05-09T06:03:29.492 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-09T06:03:29.493 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.493 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.493 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.493 INFO:teuthology.orchestra.run.smithi039.stdout: "begin_weekday": { 2024-05-09T06:03:29.493 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "begin_weekday", 2024-05-09T06:03:29.493 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "uint", 2024-05-09T06:03:29.493 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.493 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.493 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:29.493 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "0", 2024-05-09T06:03:29.493 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "6", 2024-05-09T06:03:29.493 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.493 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-05-09T06:03:29.493 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-09T06:03:29.493 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.494 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.494 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.494 INFO:teuthology.orchestra.run.smithi039.stdout: "crush_compat_max_iterations": { 2024-05-09T06:03:29.494 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "crush_compat_max_iterations", 2024-05-09T06:03:29.494 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "uint", 2024-05-09T06:03:29.494 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.494 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.494 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "25", 2024-05-09T06:03:29.494 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "1", 2024-05-09T06:03:29.494 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "250", 2024-05-09T06:03:29.494 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.494 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-05-09T06:03:29.494 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.495 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.495 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.495 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.495 INFO:teuthology.orchestra.run.smithi039.stdout: "crush_compat_metrics": { 2024-05-09T06:03:29.495 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "crush_compat_metrics", 2024-05-09T06:03:29.495 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.495 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.495 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.495 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "pgs,objects,bytes", 2024-05-09T06:03:29.495 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.495 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.495 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.495 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-05-09T06:03:29.495 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-05-09T06:03:29.495 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.495 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.496 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.496 INFO:teuthology.orchestra.run.smithi039.stdout: "crush_compat_step": { 2024-05-09T06:03:29.496 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "crush_compat_step", 2024-05-09T06:03:29.496 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "float", 2024-05-09T06:03:29.496 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.496 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.496 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0.5", 2024-05-09T06:03:29.496 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "0.001", 2024-05-09T06:03:29.496 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "0.999", 2024-05-09T06:03:29.496 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.496 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "aggressiveness of optimization", 2024-05-09T06:03:29.496 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-05-09T06:03:29.496 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.496 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.496 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.497 INFO:teuthology.orchestra.run.smithi039.stdout: "end_time": { 2024-05-09T06:03:29.497 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "end_time", 2024-05-09T06:03:29.497 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.497 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.497 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.497 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "2359", 2024-05-09T06:03:29.497 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.497 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.497 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.497 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "ending time of day to automatically balance", 2024-05-09T06:03:29.497 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-09T06:03:29.497 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.497 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.497 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.498 INFO:teuthology.orchestra.run.smithi039.stdout: "end_weekday": { 2024-05-09T06:03:29.498 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "end_weekday", 2024-05-09T06:03:29.498 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "uint", 2024-05-09T06:03:29.498 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.498 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.498 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:29.498 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "0", 2024-05-09T06:03:29.498 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "6", 2024-05-09T06:03:29.498 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.498 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-05-09T06:03:29.498 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-09T06:03:29.498 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.498 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.498 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.499 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:29.499 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:29.499 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.499 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.499 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.499 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.499 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.499 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.499 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.499 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.499 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.499 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.499 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.499 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.499 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.500 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.500 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.500 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.500 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.500 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.500 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.500 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:29.500 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:29.500 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.500 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.500 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.500 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.500 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.500 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.501 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.501 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.501 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.501 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.501 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.501 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.501 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:29.501 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:29.501 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.501 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.501 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.501 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:29.501 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.501 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.501 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.502 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.502 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.502 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.502 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.502 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.502 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.502 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.502 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.502 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.502 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.502 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.502 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.502 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:29.502 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:29.503 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.503 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.503 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.503 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.503 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.503 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.503 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.503 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.503 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.503 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.503 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.503 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.503 INFO:teuthology.orchestra.run.smithi039.stdout: "min_score": { 2024-05-09T06:03:29.503 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "min_score", 2024-05-09T06:03:29.503 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "float", 2024-05-09T06:03:29.504 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.504 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.504 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:29.504 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.504 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.504 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.504 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-05-09T06:03:29.504 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.504 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.504 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.504 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.504 INFO:teuthology.orchestra.run.smithi039.stdout: "mode": { 2024-05-09T06:03:29.504 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "mode", 2024-05-09T06:03:29.504 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.504 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.505 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.505 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "upmap", 2024-05-09T06:03:29.505 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.505 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.505 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.505 INFO:teuthology.orchestra.run.smithi039.stdout: "crush-compat", 2024-05-09T06:03:29.505 INFO:teuthology.orchestra.run.smithi039.stdout: "none", 2024-05-09T06:03:29.505 INFO:teuthology.orchestra.run.smithi039.stdout: "read", 2024-05-09T06:03:29.505 INFO:teuthology.orchestra.run.smithi039.stdout: "upmap", 2024-05-09T06:03:29.505 INFO:teuthology.orchestra.run.smithi039.stdout: "upmap-read" 2024-05-09T06:03:29.505 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.505 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Balancer mode", 2024-05-09T06:03:29.505 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.505 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.506 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.506 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.506 INFO:teuthology.orchestra.run.smithi039.stdout: "pool_ids": { 2024-05-09T06:03:29.506 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "pool_ids", 2024-05-09T06:03:29.506 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.506 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.506 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.506 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.506 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.506 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.506 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.506 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-05-09T06:03:29.506 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.506 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.506 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.507 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.507 INFO:teuthology.orchestra.run.smithi039.stdout: "sleep_interval": { 2024-05-09T06:03:29.507 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sleep_interval", 2024-05-09T06:03:29.507 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-05-09T06:03:29.507 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.507 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.507 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "60", 2024-05-09T06:03:29.507 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.507 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.507 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.507 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-05-09T06:03:29.507 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.507 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.507 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.508 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.508 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:29.508 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:29.508 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.508 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:29.508 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.508 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:29.508 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.508 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.508 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.508 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.508 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.508 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.508 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.509 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.509 INFO:teuthology.orchestra.run.smithi039.stdout: "upmap_max_deviation": { 2024-05-09T06:03:29.509 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "upmap_max_deviation", 2024-05-09T06:03:29.509 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.509 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.509 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.509 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "5", 2024-05-09T06:03:29.509 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "1", 2024-05-09T06:03:29.509 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.509 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.509 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "deviation below which no optimization is attempted", 2024-05-09T06:03:29.509 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-05-09T06:03:29.509 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.509 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.509 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.510 INFO:teuthology.orchestra.run.smithi039.stdout: "upmap_max_optimizations": { 2024-05-09T06:03:29.510 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "upmap_max_optimizations", 2024-05-09T06:03:29.510 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "uint", 2024-05-09T06:03:29.510 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.510 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.510 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10", 2024-05-09T06:03:29.510 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.510 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.510 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.510 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-05-09T06:03:29.510 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.510 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.510 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.510 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.511 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.511 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.511 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:29.511 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "cephadm", 2024-05-09T06:03:29.511 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-05-09T06:03:29.511 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-05-09T06:03:29.511 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:29.511 INFO:teuthology.orchestra.run.smithi039.stdout: "agent_down_multiplier": { 2024-05-09T06:03:29.511 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "agent_down_multiplier", 2024-05-09T06:03:29.511 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "float", 2024-05-09T06:03:29.511 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.511 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.511 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "3.0", 2024-05-09T06:03:29.511 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.512 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.512 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.512 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-05-09T06:03:29.512 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.512 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.512 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.512 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.512 INFO:teuthology.orchestra.run.smithi039.stdout: "agent_refresh_rate": { 2024-05-09T06:03:29.512 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "agent_refresh_rate", 2024-05-09T06:03:29.512 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-05-09T06:03:29.512 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.512 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.512 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "20", 2024-05-09T06:03:29.512 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.513 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.513 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.513 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-05-09T06:03:29.513 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.513 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.513 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.513 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.513 INFO:teuthology.orchestra.run.smithi039.stdout: "agent_starting_port": { 2024-05-09T06:03:29.513 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "agent_starting_port", 2024-05-09T06:03:29.513 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.513 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.513 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.513 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "4721", 2024-05-09T06:03:29.513 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.514 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.514 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.514 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-05-09T06:03:29.514 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.514 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.514 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.514 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.514 INFO:teuthology.orchestra.run.smithi039.stdout: "allow_ptrace": { 2024-05-09T06:03:29.514 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "allow_ptrace", 2024-05-09T06:03:29.514 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.514 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.514 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.514 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.515 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.515 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.515 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.515 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-05-09T06:03:29.515 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-05-09T06:03:29.515 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.515 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.515 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.515 INFO:teuthology.orchestra.run.smithi039.stdout: "autotune_interval": { 2024-05-09T06:03:29.515 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "autotune_interval", 2024-05-09T06:03:29.515 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-05-09T06:03:29.515 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.515 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.515 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "600", 2024-05-09T06:03:29.515 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.516 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.516 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.516 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "how frequently to autotune daemon memory", 2024-05-09T06:03:29.516 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.516 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.516 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.516 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.516 INFO:teuthology.orchestra.run.smithi039.stdout: "autotune_memory_target_ratio": { 2024-05-09T06:03:29.516 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "autotune_memory_target_ratio", 2024-05-09T06:03:29.516 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "float", 2024-05-09T06:03:29.516 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.516 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.516 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0.7", 2024-05-09T06:03:29.516 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.517 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.517 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.517 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-05-09T06:03:29.517 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.517 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.517 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.517 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.517 INFO:teuthology.orchestra.run.smithi039.stdout: "cephadm_log_destination": { 2024-05-09T06:03:29.517 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "cephadm_log_destination", 2024-05-09T06:03:29.517 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.517 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.517 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.517 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.517 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.518 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.518 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.518 INFO:teuthology.orchestra.run.smithi039.stdout: "file", 2024-05-09T06:03:29.518 INFO:teuthology.orchestra.run.smithi039.stdout: "file,syslog", 2024-05-09T06:03:29.518 INFO:teuthology.orchestra.run.smithi039.stdout: "syslog" 2024-05-09T06:03:29.518 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.518 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-05-09T06:03:29.518 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.518 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.518 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.518 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.518 INFO:teuthology.orchestra.run.smithi039.stdout: "cgroups_split": { 2024-05-09T06:03:29.518 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "cgroups_split", 2024-05-09T06:03:29.518 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.519 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.519 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.519 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:29.519 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.519 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.519 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.519 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-05-09T06:03:29.519 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.519 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.519 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.519 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.519 INFO:teuthology.orchestra.run.smithi039.stdout: "config_checks_enabled": { 2024-05-09T06:03:29.519 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "config_checks_enabled", 2024-05-09T06:03:29.519 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.519 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.520 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.520 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.520 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.520 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.520 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.520 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-05-09T06:03:29.520 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.520 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.520 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.520 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.520 INFO:teuthology.orchestra.run.smithi039.stdout: "config_dashboard": { 2024-05-09T06:03:29.520 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "config_dashboard", 2024-05-09T06:03:29.520 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.520 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.520 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.521 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:29.521 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.521 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.521 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.521 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-05-09T06:03:29.521 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.521 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.521 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.521 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.521 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_alertmanager": { 2024-05-09T06:03:29.521 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_alertmanager", 2024-05-09T06:03:29.521 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.521 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.521 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.521 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-05-09T06:03:29.522 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.522 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.522 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.522 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Prometheus container image", 2024-05-09T06:03:29.522 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.522 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.522 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.522 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.522 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_base": { 2024-05-09T06:03:29.522 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_base", 2024-05-09T06:03:29.522 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.522 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.522 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.522 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/ceph/ceph", 2024-05-09T06:03:29.523 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.523 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.523 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.523 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Container image name, without the tag", 2024-05-09T06:03:29.523 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.523 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.523 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.523 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.523 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_elasticsearch": { 2024-05-09T06:03:29.523 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_elasticsearch", 2024-05-09T06:03:29.523 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.523 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.523 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.523 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-05-09T06:03:29.523 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.524 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.524 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.524 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "elasticsearch container image", 2024-05-09T06:03:29.524 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.524 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.524 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.524 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.524 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_grafana": { 2024-05-09T06:03:29.524 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_grafana", 2024-05-09T06:03:29.524 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.524 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.524 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.524 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-05-09T06:03:29.524 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.525 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.525 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.525 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Prometheus container image", 2024-05-09T06:03:29.525 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.525 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.525 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.525 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.525 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_haproxy": { 2024-05-09T06:03:29.525 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_haproxy", 2024-05-09T06:03:29.525 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.525 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.525 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.525 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-05-09T06:03:29.525 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.525 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.526 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.526 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "HAproxy container image", 2024-05-09T06:03:29.526 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.526 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.526 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.526 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.526 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_jaeger_agent": { 2024-05-09T06:03:29.526 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_jaeger_agent", 2024-05-09T06:03:29.526 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.526 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.526 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.526 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-05-09T06:03:29.526 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.526 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.527 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.527 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Jaeger agent container image", 2024-05-09T06:03:29.527 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.527 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.527 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.527 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.527 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_jaeger_collector": { 2024-05-09T06:03:29.527 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_jaeger_collector", 2024-05-09T06:03:29.527 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.527 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.527 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.527 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-05-09T06:03:29.527 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.527 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.527 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.528 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Jaeger collector container image", 2024-05-09T06:03:29.528 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.528 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.528 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.528 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.528 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_jaeger_query": { 2024-05-09T06:03:29.528 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_jaeger_query", 2024-05-09T06:03:29.528 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.528 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.528 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.528 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-05-09T06:03:29.528 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.528 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.528 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.529 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Jaeger query container image", 2024-05-09T06:03:29.529 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.529 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.529 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.529 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.529 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_keepalived": { 2024-05-09T06:03:29.529 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_keepalived", 2024-05-09T06:03:29.529 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.529 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.529 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.529 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-05-09T06:03:29.529 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.529 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.529 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.529 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Keepalived container image", 2024-05-09T06:03:29.530 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.530 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.530 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.530 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.530 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_loki": { 2024-05-09T06:03:29.530 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_loki", 2024-05-09T06:03:29.530 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.530 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.530 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.530 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-05-09T06:03:29.530 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.530 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.530 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.530 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Loki container image", 2024-05-09T06:03:29.531 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.531 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.531 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.531 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.531 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_node_exporter": { 2024-05-09T06:03:29.531 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_node_exporter", 2024-05-09T06:03:29.531 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.531 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.531 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.531 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-05-09T06:03:29.531 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.531 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.531 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.531 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Prometheus container image", 2024-05-09T06:03:29.531 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.532 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.532 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.532 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.532 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_nvmeof": { 2024-05-09T06:03:29.532 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_nvmeof", 2024-05-09T06:03:29.532 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.532 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.532 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.532 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.1", 2024-05-09T06:03:29.532 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.532 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.532 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.532 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Nvme-of container image", 2024-05-09T06:03:29.532 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.532 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.533 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.533 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.533 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_prometheus": { 2024-05-09T06:03:29.533 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_prometheus", 2024-05-09T06:03:29.533 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.533 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.533 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.533 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-05-09T06:03:29.533 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.533 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.533 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.533 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Prometheus container image", 2024-05-09T06:03:29.533 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.534 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.534 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.534 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.534 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_promtail": { 2024-05-09T06:03:29.534 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_promtail", 2024-05-09T06:03:29.534 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.534 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.534 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.534 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-05-09T06:03:29.534 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.534 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.534 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.534 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Promtail container image", 2024-05-09T06:03:29.535 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.535 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.535 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.535 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.535 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_samba": { 2024-05-09T06:03:29.535 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_samba", 2024-05-09T06:03:29.535 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.535 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.535 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.535 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-05-09T06:03:29.535 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.535 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.535 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.535 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Samba/SMB container image", 2024-05-09T06:03:29.536 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.536 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.536 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.536 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.536 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_snmp_gateway": { 2024-05-09T06:03:29.536 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_snmp_gateway", 2024-05-09T06:03:29.536 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.536 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.536 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.536 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-05-09T06:03:29.536 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.536 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.536 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.536 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "SNMP Gateway container image", 2024-05-09T06:03:29.537 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.537 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.537 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.537 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.537 INFO:teuthology.orchestra.run.smithi039.stdout: "container_init": { 2024-05-09T06:03:29.537 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_init", 2024-05-09T06:03:29.537 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.537 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.537 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.537 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:29.537 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.537 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.537 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.537 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Run podman/docker with `--init`", 2024-05-09T06:03:29.538 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.538 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.538 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.538 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.538 INFO:teuthology.orchestra.run.smithi039.stdout: "daemon_cache_timeout": { 2024-05-09T06:03:29.538 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "daemon_cache_timeout", 2024-05-09T06:03:29.538 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-05-09T06:03:29.538 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.538 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.538 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "600", 2024-05-09T06:03:29.538 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.538 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.538 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.539 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-05-09T06:03:29.539 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.539 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.539 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.539 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.539 INFO:teuthology.orchestra.run.smithi039.stdout: "default_cephadm_command_timeout": { 2024-05-09T06:03:29.539 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "default_cephadm_command_timeout", 2024-05-09T06:03:29.539 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.539 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.539 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.539 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "900", 2024-05-09T06:03:29.539 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.539 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.539 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.539 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-05-09T06:03:29.539 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.540 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.540 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.540 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.540 INFO:teuthology.orchestra.run.smithi039.stdout: "default_registry": { 2024-05-09T06:03:29.540 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "default_registry", 2024-05-09T06:03:29.540 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.540 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.540 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.540 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "docker.io", 2024-05-09T06:03:29.540 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.540 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.540 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.540 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-05-09T06:03:29.540 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.541 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.541 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.541 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.541 INFO:teuthology.orchestra.run.smithi039.stdout: "device_cache_timeout": { 2024-05-09T06:03:29.541 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "device_cache_timeout", 2024-05-09T06:03:29.541 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-05-09T06:03:29.541 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.541 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.541 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "1800", 2024-05-09T06:03:29.541 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.541 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.541 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.541 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "seconds to cache device inventory", 2024-05-09T06:03:29.541 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.541 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.541 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.542 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.542 INFO:teuthology.orchestra.run.smithi039.stdout: "device_enhanced_scan": { 2024-05-09T06:03:29.542 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "device_enhanced_scan", 2024-05-09T06:03:29.542 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.542 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.542 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.542 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.542 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.542 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.542 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.542 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Use libstoragemgmt during device scans", 2024-05-09T06:03:29.542 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.542 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.542 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.543 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.543 INFO:teuthology.orchestra.run.smithi039.stdout: "facts_cache_timeout": { 2024-05-09T06:03:29.543 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "facts_cache_timeout", 2024-05-09T06:03:29.543 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-05-09T06:03:29.543 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.543 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.543 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "60", 2024-05-09T06:03:29.543 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.543 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.543 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.543 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "seconds to cache host facts data", 2024-05-09T06:03:29.543 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.543 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.543 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.543 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.544 INFO:teuthology.orchestra.run.smithi039.stdout: "grafana_dashboards_path": { 2024-05-09T06:03:29.544 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "grafana_dashboards_path", 2024-05-09T06:03:29.544 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.544 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.544 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.544 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-05-09T06:03:29.544 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.544 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.544 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.544 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-05-09T06:03:29.544 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.544 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.544 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.544 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.545 INFO:teuthology.orchestra.run.smithi039.stdout: "host_check_interval": { 2024-05-09T06:03:29.545 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "host_check_interval", 2024-05-09T06:03:29.545 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-05-09T06:03:29.545 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.545 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.545 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "600", 2024-05-09T06:03:29.545 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.545 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.545 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.545 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "how frequently to perform a host check", 2024-05-09T06:03:29.545 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.545 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.545 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.546 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.546 INFO:teuthology.orchestra.run.smithi039.stdout: "hw_monitoring": { 2024-05-09T06:03:29.546 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "hw_monitoring", 2024-05-09T06:03:29.546 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.546 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.546 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.546 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.546 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.546 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.546 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.546 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-05-09T06:03:29.546 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.546 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.546 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.547 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.547 INFO:teuthology.orchestra.run.smithi039.stdout: "inventory_list_all": { 2024-05-09T06:03:29.547 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "inventory_list_all", 2024-05-09T06:03:29.547 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.547 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.547 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.547 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.547 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.547 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.547 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.547 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-05-09T06:03:29.547 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.547 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.547 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.548 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.548 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:29.548 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:29.548 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.548 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.548 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.548 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.548 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.548 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.548 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.548 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.548 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.548 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.548 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.549 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.549 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.549 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.549 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.549 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.549 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.549 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.549 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.549 INFO:teuthology.orchestra.run.smithi039.stdout: "log_refresh_metadata": { 2024-05-09T06:03:29.549 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_refresh_metadata", 2024-05-09T06:03:29.549 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.549 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.549 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.549 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.549 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.550 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.550 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.550 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-05-09T06:03:29.550 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.550 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.550 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.550 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.550 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:29.550 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:29.550 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.550 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.550 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.550 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:29.551 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.551 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.551 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.551 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-05-09T06:03:29.551 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.551 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.551 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.551 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.551 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:29.551 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:29.551 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.551 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.551 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.551 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:29.552 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.552 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.552 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.552 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.552 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.552 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.552 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.552 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.552 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.552 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.552 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.552 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.552 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.552 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.552 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.553 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:29.553 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:29.553 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.553 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.553 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.553 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.553 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.553 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.553 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.553 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.553 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.553 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.553 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.553 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.553 INFO:teuthology.orchestra.run.smithi039.stdout: "manage_etc_ceph_ceph_conf": { 2024-05-09T06:03:29.554 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-05-09T06:03:29.554 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.554 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.554 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.554 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.554 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.554 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.554 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.554 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-05-09T06:03:29.554 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.554 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.554 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.554 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.554 INFO:teuthology.orchestra.run.smithi039.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-05-09T06:03:29.555 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-05-09T06:03:29.555 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.555 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.555 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.555 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "*", 2024-05-09T06:03:29.555 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.555 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.555 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.555 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-05-09T06:03:29.555 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.555 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.555 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.555 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.555 INFO:teuthology.orchestra.run.smithi039.stdout: "max_count_per_host": { 2024-05-09T06:03:29.555 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "max_count_per_host", 2024-05-09T06:03:29.556 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.556 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.556 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.556 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10", 2024-05-09T06:03:29.556 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.556 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.556 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.556 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "max number of daemons per service per host", 2024-05-09T06:03:29.556 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.556 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.556 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.556 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.556 INFO:teuthology.orchestra.run.smithi039.stdout: "max_osd_draining_count": { 2024-05-09T06:03:29.556 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "max_osd_draining_count", 2024-05-09T06:03:29.556 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.556 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.557 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.557 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10", 2024-05-09T06:03:29.557 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.557 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.557 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.557 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-05-09T06:03:29.557 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.557 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.557 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.557 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.557 INFO:teuthology.orchestra.run.smithi039.stdout: "migration_current": { 2024-05-09T06:03:29.557 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "migration_current", 2024-05-09T06:03:29.557 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.557 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.558 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.558 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.558 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.558 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.558 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.558 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "internal - do not modify", 2024-05-09T06:03:29.558 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.558 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.558 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.558 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.558 INFO:teuthology.orchestra.run.smithi039.stdout: "mode": { 2024-05-09T06:03:29.558 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "mode", 2024-05-09T06:03:29.558 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.558 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.559 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.559 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "root", 2024-05-09T06:03:29.559 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.559 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.559 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.559 INFO:teuthology.orchestra.run.smithi039.stdout: "cephadm-package", 2024-05-09T06:03:29.559 INFO:teuthology.orchestra.run.smithi039.stdout: "root" 2024-05-09T06:03:29.559 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.559 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "mode for remote execution of cephadm", 2024-05-09T06:03:29.559 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.559 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.559 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.559 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.559 INFO:teuthology.orchestra.run.smithi039.stdout: "oob_default_addr": { 2024-05-09T06:03:29.559 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "oob_default_addr", 2024-05-09T06:03:29.560 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.560 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.560 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.560 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "169.254.1.1", 2024-05-09T06:03:29.560 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.560 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.560 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.560 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Default address for RedFish API (oob management).", 2024-05-09T06:03:29.560 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.560 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.560 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.560 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.560 INFO:teuthology.orchestra.run.smithi039.stdout: "prometheus_alerts_path": { 2024-05-09T06:03:29.561 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "prometheus_alerts_path", 2024-05-09T06:03:29.561 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.561 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.561 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.561 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-05-09T06:03:29.561 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.561 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.561 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.561 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-05-09T06:03:29.561 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.561 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.561 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.561 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.561 INFO:teuthology.orchestra.run.smithi039.stdout: "registry_insecure": { 2024-05-09T06:03:29.562 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "registry_insecure", 2024-05-09T06:03:29.562 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.562 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.562 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.562 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.562 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.562 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.562 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.562 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-05-09T06:03:29.562 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.562 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.562 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.562 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.562 INFO:teuthology.orchestra.run.smithi039.stdout: "registry_password": { 2024-05-09T06:03:29.563 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "registry_password", 2024-05-09T06:03:29.563 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.563 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.563 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.563 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.563 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.563 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.563 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.563 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-05-09T06:03:29.563 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.563 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.563 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.563 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.563 INFO:teuthology.orchestra.run.smithi039.stdout: "registry_url": { 2024-05-09T06:03:29.563 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "registry_url", 2024-05-09T06:03:29.564 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.564 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.564 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.564 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.564 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.564 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.564 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.564 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-05-09T06:03:29.564 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.564 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.564 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.564 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.564 INFO:teuthology.orchestra.run.smithi039.stdout: "registry_username": { 2024-05-09T06:03:29.564 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "registry_username", 2024-05-09T06:03:29.565 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.565 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.565 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.565 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.565 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.565 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.565 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.565 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-05-09T06:03:29.565 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.565 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.565 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.565 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.565 INFO:teuthology.orchestra.run.smithi039.stdout: "secure_monitoring_stack": { 2024-05-09T06:03:29.565 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "secure_monitoring_stack", 2024-05-09T06:03:29.565 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.566 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.566 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.566 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.566 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.566 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.566 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.566 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-05-09T06:03:29.566 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.566 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.566 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.566 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.566 INFO:teuthology.orchestra.run.smithi039.stdout: "service_discovery_port": { 2024-05-09T06:03:29.566 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "service_discovery_port", 2024-05-09T06:03:29.567 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.567 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.567 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.567 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "8765", 2024-05-09T06:03:29.567 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.567 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.567 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.567 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "cephadm service discovery port", 2024-05-09T06:03:29.567 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.567 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.567 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.567 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.567 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:29.567 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:29.567 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.568 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:29.568 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.568 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:29.568 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.568 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.568 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.568 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.568 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.568 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.568 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.568 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.568 INFO:teuthology.orchestra.run.smithi039.stdout: "ssh_config_file": { 2024-05-09T06:03:29.568 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ssh_config_file", 2024-05-09T06:03:29.568 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.569 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.569 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.569 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.569 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.569 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.569 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.569 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-05-09T06:03:29.569 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.569 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.569 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.569 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.569 INFO:teuthology.orchestra.run.smithi039.stdout: "use_agent": { 2024-05-09T06:03:29.569 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "use_agent", 2024-05-09T06:03:29.569 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.570 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.570 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.570 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.570 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.570 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.570 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.570 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-05-09T06:03:29.570 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.570 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.570 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.570 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.571 INFO:teuthology.orchestra.run.smithi039.stdout: "use_repo_digest": { 2024-05-09T06:03:29.571 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "use_repo_digest", 2024-05-09T06:03:29.571 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.571 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.571 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.571 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:29.571 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.571 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.571 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.571 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-05-09T06:03:29.571 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.571 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.571 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.571 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.571 INFO:teuthology.orchestra.run.smithi039.stdout: "warn_on_failed_host_check": { 2024-05-09T06:03:29.572 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "warn_on_failed_host_check", 2024-05-09T06:03:29.572 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.572 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.572 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.572 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:29.572 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.572 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.572 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.572 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "raise a health warning if the host check fails", 2024-05-09T06:03:29.572 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.572 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.572 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.572 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.573 INFO:teuthology.orchestra.run.smithi039.stdout: "warn_on_stray_daemons": { 2024-05-09T06:03:29.573 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "warn_on_stray_daemons", 2024-05-09T06:03:29.573 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.573 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.573 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.573 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:29.573 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.573 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.573 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.573 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-05-09T06:03:29.573 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.573 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.573 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.573 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.574 INFO:teuthology.orchestra.run.smithi039.stdout: "warn_on_stray_hosts": { 2024-05-09T06:03:29.574 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "warn_on_stray_hosts", 2024-05-09T06:03:29.574 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.574 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.574 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.574 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:29.574 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.574 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.574 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.574 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-05-09T06:03:29.574 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.574 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.574 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.575 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.575 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.575 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.575 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:29.575 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "crash", 2024-05-09T06:03:29.575 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-05-09T06:03:29.575 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-05-09T06:03:29.575 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:29.575 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:29.575 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:29.575 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.575 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.575 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.575 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.576 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.576 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.576 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.576 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.576 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.576 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.576 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.576 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.576 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.576 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.576 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.576 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.576 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.576 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.576 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.577 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:29.577 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:29.577 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.577 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.577 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.577 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.577 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.577 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.577 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.577 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.577 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.577 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.577 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.577 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.578 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:29.578 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:29.578 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.578 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.578 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.578 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:29.578 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.578 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.578 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.578 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.578 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.578 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.578 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.578 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.578 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.579 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.579 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.579 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.579 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.579 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.579 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.579 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:29.579 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:29.579 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.579 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.579 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.579 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.579 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.580 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.580 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.580 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.580 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.580 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.580 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.580 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.580 INFO:teuthology.orchestra.run.smithi039.stdout: "retain_interval": { 2024-05-09T06:03:29.580 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "retain_interval", 2024-05-09T06:03:29.580 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-05-09T06:03:29.580 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.580 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.580 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "31536000", 2024-05-09T06:03:29.580 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.580 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.581 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.581 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "how long to retain crashes before pruning them", 2024-05-09T06:03:29.581 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.581 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.581 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.581 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.581 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:29.581 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:29.581 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.581 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:29.581 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.581 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:29.581 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.581 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.582 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.582 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.582 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.582 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.582 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.582 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.582 INFO:teuthology.orchestra.run.smithi039.stdout: "warn_recent_interval": { 2024-05-09T06:03:29.582 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "warn_recent_interval", 2024-05-09T06:03:29.582 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-05-09T06:03:29.582 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.582 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.582 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "1209600", 2024-05-09T06:03:29.582 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.582 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.583 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.583 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "time interval in which to warn about recent crashes", 2024-05-09T06:03:29.583 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.583 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.583 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.583 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.583 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.583 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.583 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:29.583 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "dashboard", 2024-05-09T06:03:29.583 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-05-09T06:03:29.583 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-05-09T06:03:29.583 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:29.583 INFO:teuthology.orchestra.run.smithi039.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-05-09T06:03:29.584 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-05-09T06:03:29.584 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.584 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.584 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.584 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10", 2024-05-09T06:03:29.584 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.584 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.584 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.584 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.584 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.584 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.584 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.584 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.584 INFO:teuthology.orchestra.run.smithi039.stdout: "ALERTMANAGER_API_HOST": { 2024-05-09T06:03:29.584 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ALERTMANAGER_API_HOST", 2024-05-09T06:03:29.585 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.585 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.585 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.585 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.585 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.585 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.585 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.585 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.585 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.585 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.585 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.585 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.585 INFO:teuthology.orchestra.run.smithi039.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-05-09T06:03:29.585 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-05-09T06:03:29.586 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.586 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.586 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.586 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:29.586 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.586 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.586 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.586 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.586 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.586 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.586 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.586 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.586 INFO:teuthology.orchestra.run.smithi039.stdout: "AUDIT_API_ENABLED": { 2024-05-09T06:03:29.586 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "AUDIT_API_ENABLED", 2024-05-09T06:03:29.587 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.587 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.587 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.587 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.587 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.587 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.587 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.587 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.587 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.587 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.587 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.587 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.587 INFO:teuthology.orchestra.run.smithi039.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-05-09T06:03:29.587 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-05-09T06:03:29.587 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.588 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.588 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.588 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:29.588 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.588 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.588 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.588 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.588 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.588 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.588 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.588 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.588 INFO:teuthology.orchestra.run.smithi039.stdout: "ENABLE_BROWSABLE_API": { 2024-05-09T06:03:29.588 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ENABLE_BROWSABLE_API", 2024-05-09T06:03:29.588 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.589 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.589 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.589 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:29.589 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.589 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.589 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.589 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.589 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.589 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.589 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.589 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.589 INFO:teuthology.orchestra.run.smithi039.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-05-09T06:03:29.589 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-05-09T06:03:29.589 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.589 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.590 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.590 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:29.590 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.590 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.590 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.590 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.590 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.590 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.590 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.590 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.590 INFO:teuthology.orchestra.run.smithi039.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-05-09T06:03:29.590 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-05-09T06:03:29.590 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.590 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.591 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.591 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:29.591 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.591 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.591 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.591 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.591 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.591 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.591 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.591 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.591 INFO:teuthology.orchestra.run.smithi039.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-05-09T06:03:29.591 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-05-09T06:03:29.591 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.591 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.591 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.592 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:29.592 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.592 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.592 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.592 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.592 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.592 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.592 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.592 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.592 INFO:teuthology.orchestra.run.smithi039.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-05-09T06:03:29.592 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-05-09T06:03:29.592 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.592 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.592 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.592 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:29.593 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.593 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.593 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.593 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.593 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.593 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.593 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.593 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.593 INFO:teuthology.orchestra.run.smithi039.stdout: "FEATURE_TOGGLE_NFS": { 2024-05-09T06:03:29.593 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-05-09T06:03:29.593 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.593 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.593 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.593 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:29.594 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.594 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.594 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.594 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.594 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.594 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.594 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.594 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.594 INFO:teuthology.orchestra.run.smithi039.stdout: "FEATURE_TOGGLE_RBD": { 2024-05-09T06:03:29.594 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-05-09T06:03:29.594 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.594 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.594 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.594 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:29.595 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.595 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.595 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.595 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.595 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.595 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.595 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.595 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.595 INFO:teuthology.orchestra.run.smithi039.stdout: "FEATURE_TOGGLE_RGW": { 2024-05-09T06:03:29.595 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-05-09T06:03:29.595 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.595 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.595 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.595 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:29.595 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.596 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.596 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.596 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.596 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.596 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.596 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.596 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.596 INFO:teuthology.orchestra.run.smithi039.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-05-09T06:03:29.596 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-05-09T06:03:29.596 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.596 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.596 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.596 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.597 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.597 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.597 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.597 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.597 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.597 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.597 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.597 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.597 INFO:teuthology.orchestra.run.smithi039.stdout: "GRAFANA_API_PASSWORD": { 2024-05-09T06:03:29.597 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "GRAFANA_API_PASSWORD", 2024-05-09T06:03:29.597 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.597 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.597 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.597 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "admin", 2024-05-09T06:03:29.598 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.598 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.598 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.598 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.598 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.598 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.598 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.598 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.598 INFO:teuthology.orchestra.run.smithi039.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-05-09T06:03:29.598 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-05-09T06:03:29.598 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.598 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.598 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.598 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:29.599 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.599 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.599 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.599 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.599 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.599 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.599 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.599 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.599 INFO:teuthology.orchestra.run.smithi039.stdout: "GRAFANA_API_URL": { 2024-05-09T06:03:29.599 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "GRAFANA_API_URL", 2024-05-09T06:03:29.599 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.599 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.599 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.600 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.600 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.600 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.600 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.600 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.600 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.600 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.600 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.600 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.600 INFO:teuthology.orchestra.run.smithi039.stdout: "GRAFANA_API_USERNAME": { 2024-05-09T06:03:29.600 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "GRAFANA_API_USERNAME", 2024-05-09T06:03:29.600 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.600 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.600 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.601 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "admin", 2024-05-09T06:03:29.601 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.601 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.601 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.601 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.601 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.601 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.601 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.601 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.601 INFO:teuthology.orchestra.run.smithi039.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-05-09T06:03:29.601 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-05-09T06:03:29.601 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.601 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.601 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.602 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.602 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.602 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.602 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.602 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.602 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.602 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.602 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.602 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.602 INFO:teuthology.orchestra.run.smithi039.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-05-09T06:03:29.602 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-05-09T06:03:29.602 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.602 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.602 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.603 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.603 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.603 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.603 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.603 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.603 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.603 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.603 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.603 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.603 INFO:teuthology.orchestra.run.smithi039.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-05-09T06:03:29.603 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-05-09T06:03:29.603 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.603 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.603 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.603 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:29.604 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.604 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.604 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.604 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.604 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.604 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.604 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.604 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.604 INFO:teuthology.orchestra.run.smithi039.stdout: "ISSUE_TRACKER_API_KEY": { 2024-05-09T06:03:29.604 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-05-09T06:03:29.604 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.604 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.604 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.604 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.605 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.605 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.605 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.605 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.605 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.605 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.605 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.605 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.605 INFO:teuthology.orchestra.run.smithi039.stdout: "MANAGED_BY_CLUSTERS": { 2024-05-09T06:03:29.605 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-05-09T06:03:29.605 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.605 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.605 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.606 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "[]", 2024-05-09T06:03:29.606 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.606 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.606 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.606 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.606 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.606 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.606 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.606 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.606 INFO:teuthology.orchestra.run.smithi039.stdout: "MULTICLUSTER_CONFIG": { 2024-05-09T06:03:29.606 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "MULTICLUSTER_CONFIG", 2024-05-09T06:03:29.606 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.606 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.606 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.607 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "{}", 2024-05-09T06:03:29.607 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.607 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.607 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.607 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.607 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.607 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.607 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.607 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.607 INFO:teuthology.orchestra.run.smithi039.stdout: "PROMETHEUS_API_HOST": { 2024-05-09T06:03:29.607 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PROMETHEUS_API_HOST", 2024-05-09T06:03:29.607 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.607 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.608 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.608 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.608 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.608 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.608 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.608 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.608 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.608 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.608 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.608 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.608 INFO:teuthology.orchestra.run.smithi039.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-05-09T06:03:29.608 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-05-09T06:03:29.608 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.608 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.609 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.609 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:29.609 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.609 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.609 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.609 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.609 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.609 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.609 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.609 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.609 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-05-09T06:03:29.609 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-05-09T06:03:29.609 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.609 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.610 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.610 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.610 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.610 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.610 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.610 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.610 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.610 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.610 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.610 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.610 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-05-09T06:03:29.610 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-05-09T06:03:29.610 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.610 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.611 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.611 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.611 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.611 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.611 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.611 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.611 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.611 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.611 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.611 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.611 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-05-09T06:03:29.611 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-05-09T06:03:29.611 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.611 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.612 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.612 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:29.612 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.612 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.612 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.612 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.612 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.612 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.612 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.612 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.612 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-05-09T06:03:29.612 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-05-09T06:03:29.613 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.613 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.613 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.613 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:29.613 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.613 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.613 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.613 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.613 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.613 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.613 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.613 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.613 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-05-09T06:03:29.613 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-05-09T06:03:29.613 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.614 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.614 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.614 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.614 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.614 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.614 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.614 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.614 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.614 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.614 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.614 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.614 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-05-09T06:03:29.614 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-05-09T06:03:29.615 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.615 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.615 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.615 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.615 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.615 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.615 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.615 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.615 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.615 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.615 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.615 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.615 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-05-09T06:03:29.615 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-05-09T06:03:29.615 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.616 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.616 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.616 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.616 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.616 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.616 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.616 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.616 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.616 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.616 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.616 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.616 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_ENABLED": { 2024-05-09T06:03:29.616 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_ENABLED", 2024-05-09T06:03:29.616 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.617 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.617 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.617 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:29.617 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.617 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.617 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.617 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.617 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.617 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.617 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.617 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.617 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-05-09T06:03:29.617 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-05-09T06:03:29.617 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.618 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.618 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.618 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-05-09T06:03:29.618 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.618 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.618 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.618 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.618 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.618 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.618 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.618 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.618 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-05-09T06:03:29.618 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-05-09T06:03:29.619 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.619 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.619 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.619 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10", 2024-05-09T06:03:29.619 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.619 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.619 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.619 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.619 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.619 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.619 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.619 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.619 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-05-09T06:03:29.620 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-05-09T06:03:29.620 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.620 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.620 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.620 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "8", 2024-05-09T06:03:29.620 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.620 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.620 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.620 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.620 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.620 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.620 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.620 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.620 INFO:teuthology.orchestra.run.smithi039.stdout: "REST_REQUESTS_TIMEOUT": { 2024-05-09T06:03:29.620 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-05-09T06:03:29.621 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.621 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.621 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.621 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "45", 2024-05-09T06:03:29.621 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.621 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.621 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.621 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.621 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.621 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.621 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.621 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.621 INFO:teuthology.orchestra.run.smithi039.stdout: "RGW_API_ACCESS_KEY": { 2024-05-09T06:03:29.621 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "RGW_API_ACCESS_KEY", 2024-05-09T06:03:29.621 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.621 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.622 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.622 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.622 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.622 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.622 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.622 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.622 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.622 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.622 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.622 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.622 INFO:teuthology.orchestra.run.smithi039.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-05-09T06:03:29.622 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-05-09T06:03:29.622 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.623 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.623 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.623 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "admin", 2024-05-09T06:03:29.623 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.623 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.623 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.623 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.623 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.623 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.623 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.623 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.623 INFO:teuthology.orchestra.run.smithi039.stdout: "RGW_API_SECRET_KEY": { 2024-05-09T06:03:29.623 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "RGW_API_SECRET_KEY", 2024-05-09T06:03:29.623 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.623 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.623 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.624 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.624 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.624 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.624 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.624 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.624 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.624 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.624 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.624 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.624 INFO:teuthology.orchestra.run.smithi039.stdout: "RGW_API_SSL_VERIFY": { 2024-05-09T06:03:29.624 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "RGW_API_SSL_VERIFY", 2024-05-09T06:03:29.624 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.624 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.624 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.624 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:29.624 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.625 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.625 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.625 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.625 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.625 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.625 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.625 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.625 INFO:teuthology.orchestra.run.smithi039.stdout: "UNSAFE_TLS_v1_2": { 2024-05-09T06:03:29.625 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "UNSAFE_TLS_v1_2", 2024-05-09T06:03:29.625 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.625 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.625 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.625 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.626 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.626 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.626 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.626 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.626 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.626 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.626 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.626 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.626 INFO:teuthology.orchestra.run.smithi039.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-05-09T06:03:29.626 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-05-09T06:03:29.626 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.626 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.626 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.626 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:29.627 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.627 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.627 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.627 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.627 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.627 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.627 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.627 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.627 INFO:teuthology.orchestra.run.smithi039.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-05-09T06:03:29.627 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-05-09T06:03:29.627 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.627 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.627 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.628 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10", 2024-05-09T06:03:29.628 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.628 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.628 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.628 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.628 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.628 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.628 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.628 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.628 INFO:teuthology.orchestra.run.smithi039.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-05-09T06:03:29.628 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-05-09T06:03:29.628 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.628 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.628 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.629 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "5", 2024-05-09T06:03:29.629 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.629 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.629 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.629 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.629 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.629 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.629 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.629 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.629 INFO:teuthology.orchestra.run.smithi039.stdout: "cross_origin_url": { 2024-05-09T06:03:29.629 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "cross_origin_url", 2024-05-09T06:03:29.629 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.629 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.629 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.630 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.630 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.630 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.630 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.630 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.630 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.630 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.630 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.630 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.630 INFO:teuthology.orchestra.run.smithi039.stdout: "crt_file": { 2024-05-09T06:03:29.630 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "crt_file", 2024-05-09T06:03:29.630 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.630 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.631 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.631 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.631 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.631 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.631 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.631 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.631 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.631 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.631 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.631 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.631 INFO:teuthology.orchestra.run.smithi039.stdout: "debug": { 2024-05-09T06:03:29.631 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "debug", 2024-05-09T06:03:29.631 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.631 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.631 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.632 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.632 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.632 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.632 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.632 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Enable/disable debug options", 2024-05-09T06:03:29.632 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.632 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.632 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.632 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.632 INFO:teuthology.orchestra.run.smithi039.stdout: "jwt_token_ttl": { 2024-05-09T06:03:29.632 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "jwt_token_ttl", 2024-05-09T06:03:29.632 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.632 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.632 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.633 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "28800", 2024-05-09T06:03:29.633 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.633 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.633 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.633 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.633 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.633 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.633 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.633 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.633 INFO:teuthology.orchestra.run.smithi039.stdout: "key_file": { 2024-05-09T06:03:29.633 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "key_file", 2024-05-09T06:03:29.633 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.633 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.634 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.634 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.634 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.634 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.634 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.634 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.634 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.634 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.634 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.634 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.634 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:29.634 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:29.634 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.634 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.635 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.635 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.635 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.635 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.635 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.635 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.635 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.635 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.635 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.635 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.635 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.635 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.635 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.636 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.636 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.636 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.636 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.636 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:29.636 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:29.636 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.636 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.636 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.636 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.636 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.636 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.636 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.636 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.637 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.637 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.637 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.637 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.637 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:29.637 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:29.637 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.637 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.637 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.637 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:29.637 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.637 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.637 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.637 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.638 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.638 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.638 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.638 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.638 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.638 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.638 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.638 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.638 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.638 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.638 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.638 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:29.638 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:29.638 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.639 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.639 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.639 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.639 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.639 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.639 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.639 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.639 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.639 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.639 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.639 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.639 INFO:teuthology.orchestra.run.smithi039.stdout: "motd": { 2024-05-09T06:03:29.639 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "motd", 2024-05-09T06:03:29.639 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.639 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.640 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.640 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.640 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.640 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.640 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.640 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "The message of the day", 2024-05-09T06:03:29.640 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.640 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.640 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.640 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.640 INFO:teuthology.orchestra.run.smithi039.stdout: "redirect_resolve_ip_addr": { 2024-05-09T06:03:29.640 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "redirect_resolve_ip_addr", 2024-05-09T06:03:29.640 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.640 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.641 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.641 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.641 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.641 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.641 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.641 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.641 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.641 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.641 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.641 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.641 INFO:teuthology.orchestra.run.smithi039.stdout: "server_addr": { 2024-05-09T06:03:29.641 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "server_addr", 2024-05-09T06:03:29.641 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.641 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.642 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.642 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "::", 2024-05-09T06:03:29.642 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.642 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.642 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.642 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.642 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.642 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.642 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.642 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.642 INFO:teuthology.orchestra.run.smithi039.stdout: "server_port": { 2024-05-09T06:03:29.642 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "server_port", 2024-05-09T06:03:29.642 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.642 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.643 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.643 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "8080", 2024-05-09T06:03:29.643 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.643 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.643 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.643 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.643 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.643 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.643 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.643 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.643 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:29.643 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:29.643 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.644 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:29.644 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.644 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:29.644 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.644 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.644 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.644 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.644 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.644 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.644 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.644 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.644 INFO:teuthology.orchestra.run.smithi039.stdout: "ssl": { 2024-05-09T06:03:29.644 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ssl", 2024-05-09T06:03:29.644 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.645 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.645 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.645 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:29.645 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.645 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.645 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.645 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.645 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.645 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.645 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.645 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.645 INFO:teuthology.orchestra.run.smithi039.stdout: "ssl_server_port": { 2024-05-09T06:03:29.645 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ssl_server_port", 2024-05-09T06:03:29.645 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.646 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.646 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.646 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "8443", 2024-05-09T06:03:29.646 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.646 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.646 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.646 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.646 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.646 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.646 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.646 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.646 INFO:teuthology.orchestra.run.smithi039.stdout: "standby_behaviour": { 2024-05-09T06:03:29.646 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "standby_behaviour", 2024-05-09T06:03:29.647 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.647 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.647 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.647 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "redirect", 2024-05-09T06:03:29.647 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.647 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.647 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.647 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.647 INFO:teuthology.orchestra.run.smithi039.stdout: "redirect" 2024-05-09T06:03:29.647 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.647 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.647 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.647 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.647 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.648 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.648 INFO:teuthology.orchestra.run.smithi039.stdout: "standby_error_status_code": { 2024-05-09T06:03:29.648 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "standby_error_status_code", 2024-05-09T06:03:29.648 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.648 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.648 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.648 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "500", 2024-05-09T06:03:29.648 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "400", 2024-05-09T06:03:29.648 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "599", 2024-05-09T06:03:29.648 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.648 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.648 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.648 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.649 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.649 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.649 INFO:teuthology.orchestra.run.smithi039.stdout: "url_prefix": { 2024-05-09T06:03:29.649 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "url_prefix", 2024-05-09T06:03:29.649 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.649 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.649 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.649 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.649 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.649 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.649 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.649 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.649 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.649 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.650 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.650 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.650 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.650 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.650 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:29.650 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "devicehealth", 2024-05-09T06:03:29.650 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-05-09T06:03:29.650 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-05-09T06:03:29.650 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:29.650 INFO:teuthology.orchestra.run.smithi039.stdout: "enable_monitoring": { 2024-05-09T06:03:29.650 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "enable_monitoring", 2024-05-09T06:03:29.650 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.650 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.651 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.651 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:29.651 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.651 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.651 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.651 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "monitor device health metrics", 2024-05-09T06:03:29.651 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.651 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.651 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.651 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.651 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:29.651 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:29.651 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.652 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.652 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.652 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.652 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.652 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.652 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.652 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.652 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.652 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.652 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.652 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.652 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.652 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.652 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.653 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.653 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.653 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.653 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.653 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:29.653 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:29.653 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.653 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.653 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.653 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.653 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.653 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.653 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.653 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.653 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.654 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.654 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.654 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.654 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:29.654 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:29.654 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.654 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.654 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.654 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:29.654 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.654 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.654 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.654 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.655 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.655 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.655 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.655 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.655 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.655 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.655 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.655 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.655 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.655 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.655 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.655 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:29.655 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:29.655 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.655 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.655 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.656 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.656 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.656 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.656 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.656 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.656 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.656 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.656 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.656 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.656 INFO:teuthology.orchestra.run.smithi039.stdout: "mark_out_threshold": { 2024-05-09T06:03:29.656 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "mark_out_threshold", 2024-05-09T06:03:29.656 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-05-09T06:03:29.656 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.656 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.657 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "2419200", 2024-05-09T06:03:29.657 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.657 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.657 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.657 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-05-09T06:03:29.657 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.657 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.657 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.657 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.657 INFO:teuthology.orchestra.run.smithi039.stdout: "pool_name": { 2024-05-09T06:03:29.657 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "pool_name", 2024-05-09T06:03:29.657 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.657 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.657 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.657 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "device_health_metrics", 2024-05-09T06:03:29.658 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.658 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.658 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.658 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "name of pool in which to store device health metrics", 2024-05-09T06:03:29.658 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.658 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.658 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.658 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.658 INFO:teuthology.orchestra.run.smithi039.stdout: "retention_period": { 2024-05-09T06:03:29.658 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "retention_period", 2024-05-09T06:03:29.658 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-05-09T06:03:29.658 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.658 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.659 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "15552000", 2024-05-09T06:03:29.659 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.659 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.659 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.659 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "how long to retain device health metrics", 2024-05-09T06:03:29.659 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.659 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.659 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.659 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.659 INFO:teuthology.orchestra.run.smithi039.stdout: "scrape_frequency": { 2024-05-09T06:03:29.659 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "scrape_frequency", 2024-05-09T06:03:29.659 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-05-09T06:03:29.659 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.659 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.659 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "86400", 2024-05-09T06:03:29.660 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.660 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.660 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.660 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "how frequently to scrape device health metrics", 2024-05-09T06:03:29.660 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.660 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.660 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.660 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.660 INFO:teuthology.orchestra.run.smithi039.stdout: "self_heal": { 2024-05-09T06:03:29.660 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "self_heal", 2024-05-09T06:03:29.660 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.660 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.660 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.660 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:29.660 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.660 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.661 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.661 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-05-09T06:03:29.661 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.661 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.661 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.661 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.661 INFO:teuthology.orchestra.run.smithi039.stdout: "sleep_interval": { 2024-05-09T06:03:29.661 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sleep_interval", 2024-05-09T06:03:29.661 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-05-09T06:03:29.661 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.661 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.661 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "600", 2024-05-09T06:03:29.661 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.661 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.661 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.661 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "how frequently to wake up and check device health", 2024-05-09T06:03:29.662 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.662 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.662 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.662 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.662 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:29.662 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:29.662 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.662 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:29.662 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.662 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:29.663 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.663 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.663 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.663 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.663 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.663 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.663 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.663 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.663 INFO:teuthology.orchestra.run.smithi039.stdout: "warn_threshold": { 2024-05-09T06:03:29.663 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "warn_threshold", 2024-05-09T06:03:29.663 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-05-09T06:03:29.663 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.663 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.663 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "7257600", 2024-05-09T06:03:29.664 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.664 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.664 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.664 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-05-09T06:03:29.664 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.664 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.664 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.664 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.664 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.664 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.664 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:29.664 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "diskprediction_local", 2024-05-09T06:03:29.664 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-05-09T06:03:29.665 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-05-09T06:03:29.665 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:29.665 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:29.665 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:29.665 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.665 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.665 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.665 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.665 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.665 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.665 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.665 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.665 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.665 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.665 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.666 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.666 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.666 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.666 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.666 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.666 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.666 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.666 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.666 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:29.666 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:29.666 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.666 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.666 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.666 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.667 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.667 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.667 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.667 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.667 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.667 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.667 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.667 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.667 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:29.667 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:29.667 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.667 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.667 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.667 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:29.667 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.667 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.668 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.668 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.668 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.668 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.668 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.668 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.668 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.668 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.668 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.668 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.668 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.668 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.668 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.668 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:29.669 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:29.669 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.669 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.669 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.669 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.669 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.669 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.669 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.669 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.669 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.669 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.669 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.669 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.669 INFO:teuthology.orchestra.run.smithi039.stdout: "predict_interval": { 2024-05-09T06:03:29.670 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "predict_interval", 2024-05-09T06:03:29.670 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.670 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.670 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.670 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "86400", 2024-05-09T06:03:29.670 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.670 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.670 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.670 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.670 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.670 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.670 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.670 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.670 INFO:teuthology.orchestra.run.smithi039.stdout: "predictor_model": { 2024-05-09T06:03:29.671 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "predictor_model", 2024-05-09T06:03:29.671 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.671 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.671 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.671 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "prophetstor", 2024-05-09T06:03:29.671 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.671 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.671 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.671 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.671 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.671 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.671 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.671 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.672 INFO:teuthology.orchestra.run.smithi039.stdout: "sleep_interval": { 2024-05-09T06:03:29.672 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sleep_interval", 2024-05-09T06:03:29.672 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.672 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.672 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.672 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "600", 2024-05-09T06:03:29.672 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.672 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.672 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.672 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.672 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.672 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.673 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.673 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.673 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:29.673 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:29.673 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.673 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:29.673 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.673 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:29.673 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.673 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.673 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.673 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.673 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.673 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.674 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.674 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.674 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.674 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.674 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:29.674 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "influx", 2024-05-09T06:03:29.674 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": false, 2024-05-09T06:03:29.674 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "influxdb python module not found", 2024-05-09T06:03:29.674 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:29.674 INFO:teuthology.orchestra.run.smithi039.stdout: "batch_size": { 2024-05-09T06:03:29.674 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "batch_size", 2024-05-09T06:03:29.674 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.674 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.674 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.675 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "5000", 2024-05-09T06:03:29.675 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.675 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.675 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.675 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-05-09T06:03:29.675 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.675 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.675 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.675 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.675 INFO:teuthology.orchestra.run.smithi039.stdout: "database": { 2024-05-09T06:03:29.675 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "database", 2024-05-09T06:03:29.675 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.675 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.675 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.676 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "ceph", 2024-05-09T06:03:29.676 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.676 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.676 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.676 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-05-09T06:03:29.676 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.676 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.676 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.676 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.676 INFO:teuthology.orchestra.run.smithi039.stdout: "hostname": { 2024-05-09T06:03:29.676 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "hostname", 2024-05-09T06:03:29.676 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.676 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.677 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.677 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.677 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.677 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.677 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.677 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "InfluxDB server hostname", 2024-05-09T06:03:29.677 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.677 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.677 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.677 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.677 INFO:teuthology.orchestra.run.smithi039.stdout: "interval": { 2024-05-09T06:03:29.677 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "interval", 2024-05-09T06:03:29.677 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-05-09T06:03:29.677 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.678 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.678 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "30", 2024-05-09T06:03:29.678 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "5", 2024-05-09T06:03:29.678 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.678 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.678 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-05-09T06:03:29.678 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.678 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.678 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.678 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.678 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:29.678 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:29.678 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.679 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.679 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.679 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.679 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.679 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.679 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.679 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.679 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.679 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.679 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.679 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.679 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.679 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.679 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.680 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.680 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.680 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.680 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.680 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:29.680 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:29.680 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.680 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.680 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.680 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.680 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.680 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.680 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.680 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.680 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.681 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.681 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.681 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.681 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:29.681 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:29.681 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.681 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.681 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.681 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:29.681 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.681 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.681 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.681 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.682 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.682 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.682 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.682 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.682 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.682 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.682 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.682 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.682 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.682 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.682 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.682 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:29.683 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:29.683 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.683 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.683 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.683 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.683 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.683 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.683 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.683 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.683 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.683 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.683 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.683 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.683 INFO:teuthology.orchestra.run.smithi039.stdout: "password": { 2024-05-09T06:03:29.684 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "password", 2024-05-09T06:03:29.684 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.684 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.684 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.684 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.684 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.684 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.684 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.684 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "password of InfluxDB server user", 2024-05-09T06:03:29.684 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.684 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.684 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.684 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.684 INFO:teuthology.orchestra.run.smithi039.stdout: "port": { 2024-05-09T06:03:29.685 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "port", 2024-05-09T06:03:29.685 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.685 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.685 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.685 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "8086", 2024-05-09T06:03:29.685 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.685 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.685 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.685 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "InfluxDB server port", 2024-05-09T06:03:29.685 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.685 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.685 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.685 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.685 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:29.685 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:29.686 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.686 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:29.686 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.686 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:29.686 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.686 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.686 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.686 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.686 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.686 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.686 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.686 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.686 INFO:teuthology.orchestra.run.smithi039.stdout: "ssl": { 2024-05-09T06:03:29.686 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ssl", 2024-05-09T06:03:29.687 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.687 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.687 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.687 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "false", 2024-05-09T06:03:29.687 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.687 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.687 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.687 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-05-09T06:03:29.687 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.687 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.687 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.687 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.687 INFO:teuthology.orchestra.run.smithi039.stdout: "threads": { 2024-05-09T06:03:29.687 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "threads", 2024-05-09T06:03:29.688 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.688 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.688 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.688 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "5", 2024-05-09T06:03:29.688 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "1", 2024-05-09T06:03:29.688 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "32", 2024-05-09T06:03:29.688 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.688 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-05-09T06:03:29.688 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.688 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.688 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.688 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.688 INFO:teuthology.orchestra.run.smithi039.stdout: "username": { 2024-05-09T06:03:29.688 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "username", 2024-05-09T06:03:29.689 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.689 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.689 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.689 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.689 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.689 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.689 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.689 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "username of InfluxDB server user", 2024-05-09T06:03:29.689 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.689 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.689 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.689 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.689 INFO:teuthology.orchestra.run.smithi039.stdout: "verify_ssl": { 2024-05-09T06:03:29.689 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "verify_ssl", 2024-05-09T06:03:29.690 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.690 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.690 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.690 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "true", 2024-05-09T06:03:29.690 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.690 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.690 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.690 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-05-09T06:03:29.690 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.690 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.690 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.690 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.690 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.690 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.691 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:29.691 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "insights", 2024-05-09T06:03:29.691 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-05-09T06:03:29.691 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-05-09T06:03:29.691 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:29.691 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:29.691 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:29.691 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.691 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.691 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.691 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.691 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.691 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.692 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.692 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.692 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.692 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.692 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.692 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.692 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.692 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.692 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.692 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.692 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.692 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.692 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.693 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:29.693 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:29.693 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.693 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.693 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.693 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.693 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.693 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.693 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.693 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.693 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.693 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.693 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.693 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.694 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:29.694 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:29.694 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.694 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.694 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.694 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:29.694 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.694 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.694 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.694 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.694 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.694 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.695 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.695 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.695 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.695 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.695 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.695 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.695 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.695 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.695 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.695 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:29.695 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:29.695 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.695 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.696 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.696 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.696 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.696 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.696 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.696 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.696 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.696 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.696 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.696 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.696 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:29.696 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:29.696 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.696 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:29.697 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.697 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:29.697 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.697 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.697 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.697 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.697 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.697 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.697 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.697 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.697 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.697 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.697 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:29.697 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "iostat", 2024-05-09T06:03:29.698 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-05-09T06:03:29.698 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-05-09T06:03:29.698 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:29.698 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:29.698 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:29.698 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.698 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.698 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.698 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.698 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.698 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.699 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.699 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.699 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.699 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.699 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.699 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.699 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.699 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.699 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.699 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.699 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.699 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.699 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.700 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:29.700 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:29.700 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.700 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.700 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.700 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.700 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.700 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.700 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.700 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.700 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.700 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.700 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.700 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.700 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:29.701 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:29.701 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.701 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.701 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.701 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:29.701 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.701 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.701 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.701 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.701 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.701 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.701 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.701 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.701 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.701 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.702 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.702 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.702 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.702 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.702 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.702 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:29.702 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:29.702 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.702 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.702 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.702 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.702 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.702 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.702 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.703 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.703 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.703 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.703 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.703 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.703 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:29.703 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:29.703 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.703 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:29.703 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.703 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:29.703 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.703 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.703 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.703 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.703 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.704 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.704 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.704 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.704 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.704 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.704 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:29.704 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "k8sevents", 2024-05-09T06:03:29.704 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-05-09T06:03:29.704 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-05-09T06:03:29.704 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:29.704 INFO:teuthology.orchestra.run.smithi039.stdout: "ceph_event_retention_days": { 2024-05-09T06:03:29.704 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ceph_event_retention_days", 2024-05-09T06:03:29.704 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.704 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.705 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.705 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "7", 2024-05-09T06:03:29.705 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.705 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.705 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.705 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Days to hold ceph event information within local cache", 2024-05-09T06:03:29.705 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.705 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.705 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.705 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.705 INFO:teuthology.orchestra.run.smithi039.stdout: "config_check_secs": { 2024-05-09T06:03:29.705 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "config_check_secs", 2024-05-09T06:03:29.705 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.705 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.705 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.706 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10", 2024-05-09T06:03:29.706 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "10", 2024-05-09T06:03:29.706 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.706 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.706 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-05-09T06:03:29.706 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.706 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.706 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.706 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.706 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:29.706 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:29.706 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.706 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.707 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.707 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.707 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.707 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.707 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.707 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.707 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.707 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.707 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.707 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.707 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.707 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.707 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.707 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.707 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.708 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.708 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.708 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:29.708 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:29.708 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.708 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.708 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.708 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.708 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.708 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.708 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.708 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.708 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.708 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.708 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.709 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.709 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:29.709 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:29.709 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.709 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.709 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.709 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:29.709 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.709 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.709 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.709 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.709 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.709 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.709 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.709 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.710 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.710 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.710 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.710 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.710 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.710 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.710 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.710 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:29.710 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:29.710 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.710 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.710 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.710 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.711 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.711 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.711 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.711 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.711 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.711 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.711 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.711 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.711 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:29.711 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:29.711 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.711 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:29.711 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.711 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:29.712 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.712 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.712 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.712 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.712 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.712 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.712 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.712 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.712 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.712 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.712 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:29.712 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "localpool", 2024-05-09T06:03:29.712 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-05-09T06:03:29.712 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-05-09T06:03:29.712 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:29.712 INFO:teuthology.orchestra.run.smithi039.stdout: "failure_domain": { 2024-05-09T06:03:29.713 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "failure_domain", 2024-05-09T06:03:29.713 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.713 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.713 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.713 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "host", 2024-05-09T06:03:29.713 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.713 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.713 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.713 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "failure domain for any created local pool", 2024-05-09T06:03:29.713 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-05-09T06:03:29.713 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.713 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.714 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.714 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:29.714 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:29.714 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.714 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.714 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.714 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.714 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.714 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.714 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.714 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.714 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.714 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.714 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.715 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.715 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.715 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.715 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.715 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.715 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.715 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.715 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.715 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:29.715 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:29.715 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.715 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.715 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.715 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.715 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.716 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.716 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.716 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.716 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.716 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.716 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.716 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.716 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:29.716 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:29.716 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.716 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.716 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.716 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:29.716 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.716 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.716 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.717 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.717 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.717 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.717 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.717 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.717 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.717 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.717 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.717 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.717 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.717 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.717 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.717 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:29.718 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:29.718 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.718 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.718 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.718 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.718 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.718 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.718 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.718 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.718 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.718 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.718 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.719 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.719 INFO:teuthology.orchestra.run.smithi039.stdout: "min_size": { 2024-05-09T06:03:29.719 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "min_size", 2024-05-09T06:03:29.719 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.719 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.719 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.719 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.719 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.719 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.719 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.719 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "default min_size for any created local pool", 2024-05-09T06:03:29.719 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-05-09T06:03:29.719 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.720 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.720 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.720 INFO:teuthology.orchestra.run.smithi039.stdout: "num_rep": { 2024-05-09T06:03:29.720 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "num_rep", 2024-05-09T06:03:29.720 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.720 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.720 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.720 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "3", 2024-05-09T06:03:29.720 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.720 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.720 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.720 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "default replica count for any created local pool", 2024-05-09T06:03:29.720 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.720 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.720 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.720 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.721 INFO:teuthology.orchestra.run.smithi039.stdout: "pg_num": { 2024-05-09T06:03:29.721 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "pg_num", 2024-05-09T06:03:29.721 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.721 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.721 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.721 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "128", 2024-05-09T06:03:29.721 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.721 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.721 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.721 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "default pg_num for any created local pool", 2024-05-09T06:03:29.721 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.721 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.721 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.721 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.721 INFO:teuthology.orchestra.run.smithi039.stdout: "prefix": { 2024-05-09T06:03:29.721 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "prefix", 2024-05-09T06:03:29.721 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.722 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.722 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.722 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.722 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.722 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.722 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.722 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "name prefix for any created local pool", 2024-05-09T06:03:29.722 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.722 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.722 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.722 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.722 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:29.722 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:29.723 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.723 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:29.723 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.723 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:29.723 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.723 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.723 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.723 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.723 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.723 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.723 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.723 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.723 INFO:teuthology.orchestra.run.smithi039.stdout: "subtree": { 2024-05-09T06:03:29.723 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "subtree", 2024-05-09T06:03:29.723 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.724 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.724 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.724 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "rack", 2024-05-09T06:03:29.724 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.724 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.724 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.724 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "CRUSH level for which to create a local pool", 2024-05-09T06:03:29.724 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-05-09T06:03:29.724 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.724 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.724 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.724 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.724 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.724 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:29.724 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "mds_autoscaler", 2024-05-09T06:03:29.725 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-05-09T06:03:29.725 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-05-09T06:03:29.725 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:29.725 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:29.725 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:29.725 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.725 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.725 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.725 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.725 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.725 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.725 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.725 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.725 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.725 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.725 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.726 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.726 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.726 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.726 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.726 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.726 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.726 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.726 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.726 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:29.726 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:29.726 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.726 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.726 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.726 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.727 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.727 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.727 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.727 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.727 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.727 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.727 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.727 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.727 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:29.727 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:29.727 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.727 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.727 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.728 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:29.728 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.728 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.728 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.728 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.728 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.728 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.728 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.728 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.728 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.728 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.728 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.728 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.728 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.728 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.729 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.729 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:29.729 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:29.729 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.729 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.729 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.729 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.729 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.729 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.729 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.729 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.729 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.729 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.729 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.729 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.729 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:29.730 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:29.730 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.730 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:29.730 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.730 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:29.730 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.730 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.730 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.730 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.730 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.730 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.730 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.730 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.730 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.731 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.731 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:29.731 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "mirroring", 2024-05-09T06:03:29.731 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-05-09T06:03:29.731 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-05-09T06:03:29.731 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:29.731 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:29.731 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:29.731 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.731 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.731 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.731 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.731 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.731 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.731 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.732 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.732 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.732 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.732 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.732 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.732 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.732 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.732 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.732 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.732 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.732 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.732 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.732 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:29.732 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:29.732 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.732 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.733 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.733 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.733 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.733 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.733 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.733 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.733 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.733 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.733 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.733 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.733 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:29.733 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:29.733 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.733 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.733 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.733 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:29.734 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.734 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.734 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.734 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.734 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.734 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.734 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.734 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.734 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.734 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.734 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.734 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.734 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.734 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.735 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.735 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:29.735 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:29.735 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.735 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.735 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.735 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.735 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.735 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.735 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.735 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.735 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.735 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.735 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.735 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.735 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:29.736 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:29.736 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.736 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:29.736 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.736 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:29.736 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.736 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.736 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.736 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.736 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.736 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.736 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.736 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.736 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.736 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.737 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:29.737 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "nfs", 2024-05-09T06:03:29.737 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-05-09T06:03:29.737 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-05-09T06:03:29.737 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:29.737 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:29.737 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:29.737 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.737 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.737 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.737 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.737 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.737 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.737 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.737 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.738 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.738 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.738 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.738 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.738 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.738 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.738 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.738 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.738 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.738 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.738 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.738 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:29.738 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:29.738 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.739 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.739 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.739 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.739 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.739 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.739 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.739 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.739 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.739 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.739 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.739 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.739 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:29.739 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:29.739 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.739 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.740 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.740 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:29.740 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.740 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.740 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.740 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.740 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.740 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.740 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.740 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.740 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.740 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.740 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.740 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.740 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.741 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.741 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.741 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:29.741 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:29.741 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.741 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.741 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.741 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.741 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.741 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.741 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.742 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.742 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.742 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.742 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.742 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.742 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:29.742 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:29.742 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.742 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:29.742 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.742 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:29.742 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.742 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.742 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.743 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.743 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.743 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.743 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.743 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.743 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.743 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.743 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:29.743 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "orchestrator", 2024-05-09T06:03:29.743 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-05-09T06:03:29.743 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-05-09T06:03:29.743 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:29.743 INFO:teuthology.orchestra.run.smithi039.stdout: "fail_fs": { 2024-05-09T06:03:29.743 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "fail_fs", 2024-05-09T06:03:29.744 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.744 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.744 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.744 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.744 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.744 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.744 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.744 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-05-09T06:03:29.744 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.744 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.744 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.744 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.744 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:29.744 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:29.745 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.745 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.745 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.745 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.745 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.745 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.745 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.745 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.745 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.745 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.745 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.745 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.745 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.746 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.746 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.746 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.746 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.746 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.746 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.746 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:29.746 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:29.746 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.746 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.746 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.746 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.747 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.747 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.747 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.747 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.747 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.747 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.747 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.747 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.747 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:29.747 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:29.747 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.747 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.747 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.747 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:29.748 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.748 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.748 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.748 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.748 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.748 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.748 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.748 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.748 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.748 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.748 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.748 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.748 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.748 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.749 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.749 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:29.749 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:29.749 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.749 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.749 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.749 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.749 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.749 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.749 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.749 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.749 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.749 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.749 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.749 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.750 INFO:teuthology.orchestra.run.smithi039.stdout: "orchestrator": { 2024-05-09T06:03:29.750 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "orchestrator", 2024-05-09T06:03:29.750 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.750 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.750 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.750 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.750 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.750 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.750 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.750 INFO:teuthology.orchestra.run.smithi039.stdout: "cephadm", 2024-05-09T06:03:29.750 INFO:teuthology.orchestra.run.smithi039.stdout: "rook", 2024-05-09T06:03:29.750 INFO:teuthology.orchestra.run.smithi039.stdout: "test_orchestrator" 2024-05-09T06:03:29.750 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.751 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Orchestrator backend", 2024-05-09T06:03:29.751 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.751 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.751 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.751 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.751 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:29.751 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:29.751 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.751 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:29.751 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.751 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:29.751 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.751 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.751 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.751 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.751 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.752 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.752 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.752 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.752 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.752 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.752 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:29.752 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "osd_perf_query", 2024-05-09T06:03:29.752 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-05-09T06:03:29.752 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-05-09T06:03:29.752 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:29.752 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:29.752 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:29.752 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.752 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.752 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.752 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.753 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.753 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.753 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.753 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.753 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.753 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.753 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.753 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.753 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.753 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.753 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.753 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.753 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.753 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.753 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.753 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:29.753 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:29.754 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.754 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.754 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.754 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.754 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.754 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.754 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.754 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.754 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.754 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.754 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.754 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.754 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:29.754 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:29.754 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.755 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.755 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.755 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:29.755 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.755 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.755 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.755 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.755 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.755 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.755 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.755 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.755 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.755 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.755 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.755 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.755 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.756 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.756 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.756 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:29.756 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:29.756 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.756 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.756 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.756 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.756 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.756 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.756 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.756 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.756 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.756 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.756 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.756 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.756 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:29.757 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:29.757 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.757 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:29.757 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.757 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:29.757 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.757 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.757 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.757 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.757 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.757 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.757 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.757 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.758 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.758 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.758 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:29.758 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "osd_support", 2024-05-09T06:03:29.758 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-05-09T06:03:29.758 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-05-09T06:03:29.758 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:29.758 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:29.758 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:29.758 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.758 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.758 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.758 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.759 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.759 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.759 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.759 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.759 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.759 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.759 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.759 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.759 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.759 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.759 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.759 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.759 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.759 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.759 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.760 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:29.760 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:29.760 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.760 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.760 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.760 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.760 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.760 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.760 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.760 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.760 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.760 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.760 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.760 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.760 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:29.760 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:29.761 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.761 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.761 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.761 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:29.761 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.761 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.761 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.761 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.761 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.761 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.761 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.761 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.761 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.761 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.762 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.762 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.762 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.762 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.762 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.762 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:29.762 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:29.762 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.762 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.762 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.762 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.762 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.762 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.762 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.762 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.763 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.763 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.763 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.763 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.763 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:29.763 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:29.763 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.763 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:29.763 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.763 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:29.763 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.763 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.763 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.763 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.763 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.763 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.764 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.764 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.764 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.764 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.764 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:29.764 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "pg_autoscaler", 2024-05-09T06:03:29.764 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-05-09T06:03:29.764 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-05-09T06:03:29.764 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:29.764 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:29.764 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:29.764 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.764 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.764 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.764 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.765 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.765 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.765 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.765 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.765 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.765 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.765 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.765 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.765 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.765 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.765 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.765 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.765 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.765 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.765 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.765 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:29.766 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:29.766 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.766 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.766 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.766 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.766 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.766 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.766 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.766 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.766 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.766 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.766 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.766 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.766 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:29.767 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:29.767 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.767 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.767 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.767 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:29.767 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.767 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.767 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.767 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.767 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.767 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.767 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.767 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.767 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.768 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.768 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.768 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.768 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.768 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.768 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.768 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:29.768 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:29.768 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.768 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.768 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.768 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.769 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.769 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.769 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.769 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.769 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.769 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.769 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.769 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.769 INFO:teuthology.orchestra.run.smithi039.stdout: "sleep_interval": { 2024-05-09T06:03:29.769 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sleep_interval", 2024-05-09T06:03:29.769 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-05-09T06:03:29.769 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.769 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.770 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "60", 2024-05-09T06:03:29.770 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.770 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.770 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.770 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.770 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.770 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.770 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.770 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.770 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:29.770 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:29.770 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.770 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:29.771 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.771 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:29.771 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.771 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.771 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.771 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.771 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.771 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.771 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.771 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.771 INFO:teuthology.orchestra.run.smithi039.stdout: "threshold": { 2024-05-09T06:03:29.771 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "threshold", 2024-05-09T06:03:29.771 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "float", 2024-05-09T06:03:29.772 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.772 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.772 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "3.0", 2024-05-09T06:03:29.772 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "1.0", 2024-05-09T06:03:29.772 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.772 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.772 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "scaling threshold", 2024-05-09T06:03:29.772 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-05-09T06:03:29.772 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.772 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.772 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.772 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.772 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.772 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:29.773 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "progress", 2024-05-09T06:03:29.773 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-05-09T06:03:29.773 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-05-09T06:03:29.773 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:29.773 INFO:teuthology.orchestra.run.smithi039.stdout: "allow_pg_recovery_event": { 2024-05-09T06:03:29.773 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "allow_pg_recovery_event", 2024-05-09T06:03:29.773 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.773 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.773 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.773 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.773 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.773 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.774 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.774 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "allow the module to show pg recovery progress", 2024-05-09T06:03:29.774 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.774 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.774 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.774 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.774 INFO:teuthology.orchestra.run.smithi039.stdout: "enabled": { 2024-05-09T06:03:29.774 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "enabled", 2024-05-09T06:03:29.774 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.774 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.774 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.774 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:29.775 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.775 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.775 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.775 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.775 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.775 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.775 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.775 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.775 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:29.775 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:29.775 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.775 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.775 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.775 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.775 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.776 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.776 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.776 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.776 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.776 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.776 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.776 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.776 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.776 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.776 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.776 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.776 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.776 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.776 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.776 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:29.777 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:29.777 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.777 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.777 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.777 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.777 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.777 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.777 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.777 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.777 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.777 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.777 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.777 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.778 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:29.778 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:29.778 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.778 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.778 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.778 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:29.778 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.778 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.778 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.778 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.778 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.778 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.778 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.779 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.779 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.779 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.779 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.779 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.779 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.779 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.779 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.779 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:29.779 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:29.779 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.779 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.779 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.779 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.779 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.780 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.780 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.780 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.780 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.780 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.780 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.780 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.780 INFO:teuthology.orchestra.run.smithi039.stdout: "max_completed_events": { 2024-05-09T06:03:29.780 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "max_completed_events", 2024-05-09T06:03:29.780 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.780 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.780 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.780 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "50", 2024-05-09T06:03:29.780 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.781 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.781 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.781 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "number of past completed events to remember", 2024-05-09T06:03:29.781 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.781 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.781 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.781 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.781 INFO:teuthology.orchestra.run.smithi039.stdout: "sleep_interval": { 2024-05-09T06:03:29.781 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sleep_interval", 2024-05-09T06:03:29.781 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-05-09T06:03:29.781 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.781 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.781 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "5", 2024-05-09T06:03:29.781 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.781 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.782 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.782 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "how long the module is going to sleep", 2024-05-09T06:03:29.782 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.782 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.782 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.782 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.782 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:29.782 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:29.782 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.782 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:29.782 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.782 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:29.783 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.783 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.783 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.783 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.783 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.783 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.783 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.783 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.783 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.783 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.783 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:29.783 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "prometheus", 2024-05-09T06:03:29.783 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-05-09T06:03:29.784 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-05-09T06:03:29.784 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:29.784 INFO:teuthology.orchestra.run.smithi039.stdout: "cache": { 2024-05-09T06:03:29.784 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "cache", 2024-05-09T06:03:29.784 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.784 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.784 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.784 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:29.784 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.784 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.784 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.784 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.784 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.784 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.785 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.785 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.785 INFO:teuthology.orchestra.run.smithi039.stdout: "exclude_perf_counters": { 2024-05-09T06:03:29.785 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "exclude_perf_counters", 2024-05-09T06:03:29.785 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.785 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.785 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.785 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:29.785 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.785 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.785 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.785 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-05-09T06:03:29.785 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-05-09T06:03:29.786 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.786 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.786 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.786 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:29.786 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:29.786 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.786 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.786 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.786 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.786 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.786 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.786 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.786 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.786 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.786 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.787 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.787 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.787 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.787 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.787 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.787 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.787 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.787 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.787 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.787 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:29.787 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:29.787 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.788 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.788 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.788 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.788 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.788 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.788 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.788 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.788 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.788 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.788 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.788 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.788 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:29.788 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:29.788 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.789 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.789 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.789 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:29.789 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.789 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.789 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.789 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.789 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.789 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.789 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.789 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.789 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.789 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.789 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.789 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.790 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.790 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.790 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.790 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:29.790 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:29.790 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.790 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.790 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.790 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.790 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.790 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.790 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.790 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.790 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.791 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.791 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.791 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.791 INFO:teuthology.orchestra.run.smithi039.stdout: "rbd_stats_pools": { 2024-05-09T06:03:29.791 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rbd_stats_pools", 2024-05-09T06:03:29.791 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.791 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.791 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.791 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.791 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.791 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.791 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.791 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.792 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.792 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.792 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.792 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.792 INFO:teuthology.orchestra.run.smithi039.stdout: "rbd_stats_pools_refresh_interval": { 2024-05-09T06:03:29.792 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-05-09T06:03:29.792 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.792 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.792 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.792 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "300", 2024-05-09T06:03:29.792 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.792 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.792 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.792 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.793 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.793 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.793 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.793 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.793 INFO:teuthology.orchestra.run.smithi039.stdout: "scrape_interval": { 2024-05-09T06:03:29.793 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "scrape_interval", 2024-05-09T06:03:29.793 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "float", 2024-05-09T06:03:29.793 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.793 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.793 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "15.0", 2024-05-09T06:03:29.793 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.793 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.794 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.794 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.794 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.794 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.794 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.794 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.794 INFO:teuthology.orchestra.run.smithi039.stdout: "server_addr": { 2024-05-09T06:03:29.794 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "server_addr", 2024-05-09T06:03:29.794 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.794 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.794 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.794 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "::", 2024-05-09T06:03:29.794 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.794 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.795 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.795 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-05-09T06:03:29.795 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.795 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.795 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.795 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.795 INFO:teuthology.orchestra.run.smithi039.stdout: "server_port": { 2024-05-09T06:03:29.795 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "server_port", 2024-05-09T06:03:29.795 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.795 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.795 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.795 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "9283", 2024-05-09T06:03:29.795 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.795 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.796 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.796 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-05-09T06:03:29.796 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.796 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.796 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.796 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.796 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:29.796 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:29.796 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.796 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:29.796 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.796 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:29.796 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.797 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.797 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.797 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.797 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.797 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.797 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.797 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.797 INFO:teuthology.orchestra.run.smithi039.stdout: "stale_cache_strategy": { 2024-05-09T06:03:29.797 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "stale_cache_strategy", 2024-05-09T06:03:29.797 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.797 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.797 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.798 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "log", 2024-05-09T06:03:29.798 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.798 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.798 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.798 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.798 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.798 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.798 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.798 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.798 INFO:teuthology.orchestra.run.smithi039.stdout: "standby_behaviour": { 2024-05-09T06:03:29.798 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "standby_behaviour", 2024-05-09T06:03:29.798 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.799 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.799 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.799 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "default", 2024-05-09T06:03:29.799 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.799 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.799 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.799 INFO:teuthology.orchestra.run.smithi039.stdout: "default", 2024-05-09T06:03:29.799 INFO:teuthology.orchestra.run.smithi039.stdout: "error" 2024-05-09T06:03:29.799 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.799 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.799 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.799 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.799 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.799 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.800 INFO:teuthology.orchestra.run.smithi039.stdout: "standby_error_status_code": { 2024-05-09T06:03:29.800 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "standby_error_status_code", 2024-05-09T06:03:29.800 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.800 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.800 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.800 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "500", 2024-05-09T06:03:29.800 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "400", 2024-05-09T06:03:29.800 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "599", 2024-05-09T06:03:29.800 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.800 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.800 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.800 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.800 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.800 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.801 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.801 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.801 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:29.801 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rbd_support", 2024-05-09T06:03:29.801 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-05-09T06:03:29.801 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-05-09T06:03:29.801 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:29.801 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:29.801 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:29.801 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.801 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.801 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.801 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.802 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.802 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.802 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.802 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.802 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.802 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.802 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.802 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.802 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.802 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.802 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.802 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.802 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.803 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.803 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.803 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:29.803 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:29.803 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.803 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.803 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.803 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.803 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.803 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.803 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.803 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.804 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.804 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.804 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.804 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.804 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:29.804 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:29.804 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.804 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.804 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.804 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:29.804 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.804 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.804 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.805 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.805 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.805 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.805 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.805 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.805 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.805 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.805 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.805 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.805 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.805 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.805 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.805 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:29.805 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:29.806 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.806 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.806 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.806 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.806 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.806 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.806 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.806 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.806 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.806 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.806 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.806 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.806 INFO:teuthology.orchestra.run.smithi039.stdout: "max_concurrent_snap_create": { 2024-05-09T06:03:29.806 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "max_concurrent_snap_create", 2024-05-09T06:03:29.807 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.807 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.807 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.807 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10", 2024-05-09T06:03:29.807 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.807 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.807 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.807 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.807 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.807 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.807 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.807 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.807 INFO:teuthology.orchestra.run.smithi039.stdout: "mirror_snapshot_schedule": { 2024-05-09T06:03:29.807 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "mirror_snapshot_schedule", 2024-05-09T06:03:29.807 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.808 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.808 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.808 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.808 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.808 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.808 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.808 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.808 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.808 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.808 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.808 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.808 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:29.808 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:29.808 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.809 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:29.809 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.809 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:29.809 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.809 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.809 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.809 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.809 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.809 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.809 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.809 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.809 INFO:teuthology.orchestra.run.smithi039.stdout: "trash_purge_schedule": { 2024-05-09T06:03:29.809 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "trash_purge_schedule", 2024-05-09T06:03:29.809 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.810 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.810 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.810 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.810 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.810 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.810 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.810 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.810 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.810 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.810 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.810 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.810 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.810 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.810 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:29.811 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "restful", 2024-05-09T06:03:29.811 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-05-09T06:03:29.811 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-05-09T06:03:29.811 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:29.811 INFO:teuthology.orchestra.run.smithi039.stdout: "enable_auth": { 2024-05-09T06:03:29.811 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "enable_auth", 2024-05-09T06:03:29.811 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.811 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.811 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.811 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:29.811 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.811 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.811 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.811 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.811 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.811 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.812 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.812 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.812 INFO:teuthology.orchestra.run.smithi039.stdout: "key_file": { 2024-05-09T06:03:29.812 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "key_file", 2024-05-09T06:03:29.812 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.812 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.812 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.812 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.812 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.812 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.812 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.812 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.812 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.812 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.813 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.813 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.813 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:29.813 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:29.813 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.813 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.813 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.813 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.813 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.813 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.813 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.813 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.813 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.813 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.813 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.814 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.814 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.814 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.814 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.814 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.814 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.814 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.814 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.814 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:29.814 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:29.814 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.814 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.814 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.814 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.815 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.815 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.815 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.815 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.815 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.815 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.815 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.815 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.815 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:29.815 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:29.815 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.815 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.815 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.815 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:29.815 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.816 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.816 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.816 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.816 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.816 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.816 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.816 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.816 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.816 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.816 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.816 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.816 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.816 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.816 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.816 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:29.816 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:29.817 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.817 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.817 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.817 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.817 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.817 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.817 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.817 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.817 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.817 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.817 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.817 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.817 INFO:teuthology.orchestra.run.smithi039.stdout: "server_addr": { 2024-05-09T06:03:29.818 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "server_addr", 2024-05-09T06:03:29.818 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.818 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.818 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.818 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.818 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.818 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.818 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.818 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.818 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.818 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.818 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.818 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.818 INFO:teuthology.orchestra.run.smithi039.stdout: "server_port": { 2024-05-09T06:03:29.819 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "server_port", 2024-05-09T06:03:29.819 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.819 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.819 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.819 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.819 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.819 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.819 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.819 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.819 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.819 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.819 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.819 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.819 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:29.820 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:29.820 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.820 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:29.820 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.820 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:29.820 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.820 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.820 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.820 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.820 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.820 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.820 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.820 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.820 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.820 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.821 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:29.821 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rgw", 2024-05-09T06:03:29.821 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-05-09T06:03:29.821 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-05-09T06:03:29.821 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:29.821 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:29.821 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:29.821 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.821 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.821 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.821 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.821 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.821 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.821 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.821 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.821 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.822 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.822 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.822 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.822 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.822 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.822 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.822 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.822 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.822 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.822 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.822 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:29.823 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:29.823 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.823 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.823 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.823 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.823 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.823 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.823 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.823 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.823 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.823 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.823 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.823 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.823 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:29.824 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:29.824 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.824 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.824 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.824 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:29.824 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.824 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.824 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.824 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.824 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.824 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.824 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.824 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.824 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.824 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.825 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.825 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.825 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.825 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.825 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.825 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:29.825 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:29.825 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.825 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.825 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.825 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.825 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.825 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.825 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.826 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.826 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.826 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.826 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.826 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.826 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:29.826 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:29.826 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.826 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:29.826 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.826 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:29.826 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.826 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.827 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.827 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.827 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.827 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.827 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.827 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.827 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.827 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.827 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:29.827 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rook", 2024-05-09T06:03:29.827 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-05-09T06:03:29.827 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-05-09T06:03:29.827 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:29.827 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:29.828 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:29.828 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.828 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.828 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.828 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.828 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.828 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.828 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.828 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.828 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.828 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.828 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.828 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.828 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.828 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.829 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.829 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.829 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.829 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.829 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.829 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:29.829 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:29.829 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.829 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.829 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.829 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.829 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.829 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.829 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.830 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.830 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.830 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.830 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.830 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.830 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:29.830 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:29.830 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.830 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.830 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.830 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:29.830 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.830 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.830 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.831 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.831 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.831 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.831 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.831 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.831 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.831 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.831 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.831 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.831 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.831 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.831 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.831 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:29.831 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:29.832 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.832 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.832 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.832 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.832 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.832 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.832 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.832 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.832 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.832 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.832 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.832 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.832 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:29.832 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:29.833 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.833 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:29.833 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.833 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:29.833 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.833 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.833 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.833 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.833 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.833 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.833 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.833 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.833 INFO:teuthology.orchestra.run.smithi039.stdout: "storage_class": { 2024-05-09T06:03:29.833 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "storage_class", 2024-05-09T06:03:29.833 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.834 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.834 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.834 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "local", 2024-05-09T06:03:29.834 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.834 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.834 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.834 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-05-09T06:03:29.834 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.834 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.834 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.834 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.834 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.834 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.834 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:29.835 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "selftest", 2024-05-09T06:03:29.835 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-05-09T06:03:29.835 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-05-09T06:03:29.835 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:29.835 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:29.835 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:29.835 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.835 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.835 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.835 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.835 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.835 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.835 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.835 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.836 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.836 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.836 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.836 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.836 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.836 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.837 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.837 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.837 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.837 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.837 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.837 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:29.837 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:29.837 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.837 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.837 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.837 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.837 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.837 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.837 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.838 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.838 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.838 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.838 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.838 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.838 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:29.838 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:29.838 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.838 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.838 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.838 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:29.838 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.838 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.839 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.839 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.839 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.839 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.839 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.839 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.839 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.839 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.839 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.839 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.839 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.839 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.839 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.839 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:29.840 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:29.840 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.840 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.840 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.840 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.840 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.840 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.840 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.840 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.840 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.840 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.840 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.840 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.840 INFO:teuthology.orchestra.run.smithi039.stdout: "roption1": { 2024-05-09T06:03:29.841 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "roption1", 2024-05-09T06:03:29.841 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.841 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.841 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.841 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.841 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.841 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.841 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.841 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.841 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.841 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.841 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.841 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.842 INFO:teuthology.orchestra.run.smithi039.stdout: "roption2": { 2024-05-09T06:03:29.842 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "roption2", 2024-05-09T06:03:29.842 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.842 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.842 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.842 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "xyz", 2024-05-09T06:03:29.842 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.842 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.842 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.842 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.842 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.842 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.842 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.842 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.843 INFO:teuthology.orchestra.run.smithi039.stdout: "rwoption1": { 2024-05-09T06:03:29.843 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rwoption1", 2024-05-09T06:03:29.843 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.843 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.843 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.843 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.843 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.843 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.843 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.843 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.843 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.843 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.843 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.843 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.844 INFO:teuthology.orchestra.run.smithi039.stdout: "rwoption2": { 2024-05-09T06:03:29.844 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rwoption2", 2024-05-09T06:03:29.844 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.844 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.844 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.844 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.844 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.844 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.844 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.845 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.845 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.845 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.845 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.845 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.845 INFO:teuthology.orchestra.run.smithi039.stdout: "rwoption3": { 2024-05-09T06:03:29.845 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rwoption3", 2024-05-09T06:03:29.846 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "float", 2024-05-09T06:03:29.846 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.846 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.846 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.846 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.846 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.846 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.846 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.846 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.846 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.846 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.846 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.846 INFO:teuthology.orchestra.run.smithi039.stdout: "rwoption4": { 2024-05-09T06:03:29.846 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rwoption4", 2024-05-09T06:03:29.847 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.847 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.847 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.847 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.847 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.847 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.847 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.847 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.847 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.847 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.847 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.847 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.847 INFO:teuthology.orchestra.run.smithi039.stdout: "rwoption5": { 2024-05-09T06:03:29.848 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rwoption5", 2024-05-09T06:03:29.848 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.848 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.848 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.848 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.848 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.848 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.848 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.848 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.848 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.848 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.848 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.848 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.848 INFO:teuthology.orchestra.run.smithi039.stdout: "rwoption6": { 2024-05-09T06:03:29.848 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rwoption6", 2024-05-09T06:03:29.849 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.849 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.849 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.849 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:29.849 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.849 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.849 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.849 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.849 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.849 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.849 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.849 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.849 INFO:teuthology.orchestra.run.smithi039.stdout: "rwoption7": { 2024-05-09T06:03:29.849 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rwoption7", 2024-05-09T06:03:29.850 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.850 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.850 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.850 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.850 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "1", 2024-05-09T06:03:29.850 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "42", 2024-05-09T06:03:29.850 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.850 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.850 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.850 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.850 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.850 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.850 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:29.850 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:29.851 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.851 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:29.851 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.851 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:29.851 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.851 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.851 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.851 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.851 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.851 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.851 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.851 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.851 INFO:teuthology.orchestra.run.smithi039.stdout: "testkey": { 2024-05-09T06:03:29.851 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "testkey", 2024-05-09T06:03:29.852 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.852 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.852 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.852 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.852 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.852 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.852 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.852 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.852 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.852 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.852 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.852 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.852 INFO:teuthology.orchestra.run.smithi039.stdout: "testlkey": { 2024-05-09T06:03:29.852 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "testlkey", 2024-05-09T06:03:29.853 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.853 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.853 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.853 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.853 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.853 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.853 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.853 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.853 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.853 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.853 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.853 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.853 INFO:teuthology.orchestra.run.smithi039.stdout: "testnewline": { 2024-05-09T06:03:29.853 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "testnewline", 2024-05-09T06:03:29.854 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.854 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.854 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.854 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.854 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.854 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.854 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.854 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.854 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.854 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.854 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.854 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.854 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.854 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.855 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:29.855 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "smb", 2024-05-09T06:03:29.855 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-05-09T06:03:29.855 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-05-09T06:03:29.855 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:29.855 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:29.855 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:29.855 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.855 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.855 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.855 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.855 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.855 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.855 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.856 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.856 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.856 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.856 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.856 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.856 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.856 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.856 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.856 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.856 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.856 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.856 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.856 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:29.856 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:29.856 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.857 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.857 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.857 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.857 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.857 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.857 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.857 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.857 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.857 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.857 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.857 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.857 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:29.857 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:29.857 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.858 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.858 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.858 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:29.858 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.858 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.858 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.858 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.858 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.858 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.858 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.858 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.858 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.858 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.858 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.859 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.859 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.859 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.859 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.859 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:29.859 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:29.859 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.859 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.859 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.859 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.859 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.859 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.859 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.859 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.860 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.860 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.860 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.860 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.860 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:29.860 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:29.860 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.860 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:29.860 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.860 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:29.860 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.860 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.860 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.860 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.861 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.861 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.861 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.861 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.861 INFO:teuthology.orchestra.run.smithi039.stdout: "update_orchestration": { 2024-05-09T06:03:29.861 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "update_orchestration", 2024-05-09T06:03:29.861 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.861 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.861 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.861 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:29.861 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.861 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.861 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.861 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-05-09T06:03:29.862 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.862 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.862 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.862 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.862 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.862 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.862 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:29.862 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "snap_schedule", 2024-05-09T06:03:29.862 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-05-09T06:03:29.862 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-05-09T06:03:29.862 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:29.862 INFO:teuthology.orchestra.run.smithi039.stdout: "allow_m_granularity": { 2024-05-09T06:03:29.862 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "allow_m_granularity", 2024-05-09T06:03:29.862 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.863 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.863 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.863 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.863 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.863 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.863 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.863 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "allow minute scheduled snapshots", 2024-05-09T06:03:29.863 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.863 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.863 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.863 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.863 INFO:teuthology.orchestra.run.smithi039.stdout: "dump_on_update": { 2024-05-09T06:03:29.863 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "dump_on_update", 2024-05-09T06:03:29.863 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.863 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.864 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.864 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.864 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.864 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.864 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.864 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "dump database to debug log on update", 2024-05-09T06:03:29.864 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.864 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.864 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.864 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.864 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:29.864 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:29.864 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.864 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.865 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.865 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.865 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.865 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.865 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.865 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.865 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.865 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.865 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.865 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.865 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.865 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.865 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.865 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.866 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.866 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.866 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.866 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:29.866 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:29.866 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.866 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.866 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.866 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.866 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.866 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.866 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.866 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.866 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.867 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.867 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.867 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.867 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:29.867 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:29.867 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.867 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.867 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.867 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:29.867 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.867 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.867 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.867 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.867 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.867 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.868 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.868 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.868 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.868 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.868 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.868 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.868 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.868 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.868 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.868 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:29.868 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:29.868 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.868 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.868 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.869 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.869 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.869 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.869 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.869 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.869 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.869 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.869 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.869 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.869 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:29.869 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:29.869 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.869 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:29.869 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.870 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:29.870 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.870 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.870 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.870 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.870 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.870 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.870 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.870 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.870 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.870 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.870 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:29.870 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "stats", 2024-05-09T06:03:29.870 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-05-09T06:03:29.871 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-05-09T06:03:29.871 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:29.871 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:29.871 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:29.871 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.871 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.871 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.871 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.871 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.871 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.871 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.871 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.871 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.871 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.871 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.872 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.872 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.872 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.872 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.872 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.872 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.872 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.872 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.872 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:29.872 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:29.872 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.872 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.872 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.873 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.873 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.873 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.873 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.873 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.873 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.873 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.873 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.873 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.873 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:29.873 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:29.873 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.873 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.873 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.873 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:29.874 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.874 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.874 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.874 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.874 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.874 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.874 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.874 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.874 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.874 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.874 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.874 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.874 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.874 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.875 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.875 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:29.875 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:29.875 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.875 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.875 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.875 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.875 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.875 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.875 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.875 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.875 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.875 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.876 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.876 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.876 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:29.876 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:29.876 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.876 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:29.876 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.876 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:29.876 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.876 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.876 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.876 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.876 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.876 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.876 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.877 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.877 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.877 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.877 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:29.877 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "status", 2024-05-09T06:03:29.877 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-05-09T06:03:29.877 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-05-09T06:03:29.877 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:29.877 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:29.877 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:29.877 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.877 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.877 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.877 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.878 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.878 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.878 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.878 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.878 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.878 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.878 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.878 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.878 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.878 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.878 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.878 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.878 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.878 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.879 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.879 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:29.879 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:29.879 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.879 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.879 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.879 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.879 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.879 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.879 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.879 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.879 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.879 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.879 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.880 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.880 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:29.880 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:29.880 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.880 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.880 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.880 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:29.880 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.880 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.880 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.880 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.880 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.880 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.880 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.881 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.881 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.881 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.881 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.881 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.881 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.881 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.881 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.881 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:29.881 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:29.881 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.881 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.881 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.882 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.882 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.882 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.882 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.882 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.882 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.882 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.882 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.882 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.882 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:29.882 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:29.882 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.882 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:29.883 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.883 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:29.883 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.883 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.883 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.883 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.883 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.883 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.883 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.883 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.883 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.883 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.883 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:29.883 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "telegraf", 2024-05-09T06:03:29.884 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-05-09T06:03:29.884 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-05-09T06:03:29.884 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:29.884 INFO:teuthology.orchestra.run.smithi039.stdout: "address": { 2024-05-09T06:03:29.884 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "address", 2024-05-09T06:03:29.884 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.884 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.884 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.884 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-05-09T06:03:29.884 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.884 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.884 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.884 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.884 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.884 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.884 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.885 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.885 INFO:teuthology.orchestra.run.smithi039.stdout: "interval": { 2024-05-09T06:03:29.885 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "interval", 2024-05-09T06:03:29.885 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-05-09T06:03:29.885 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.885 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.885 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "15", 2024-05-09T06:03:29.885 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.885 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.885 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.885 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.885 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.885 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.886 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.886 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.886 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:29.886 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:29.886 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.886 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.886 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.886 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.886 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.886 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.886 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.886 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.886 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.886 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.887 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.887 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.887 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.887 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.887 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.887 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.887 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.887 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.887 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.887 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:29.887 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:29.887 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.887 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.887 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.888 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.888 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.888 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.888 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.888 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.888 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.888 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.888 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.888 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.888 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:29.888 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:29.888 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.888 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.888 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.889 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:29.889 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.889 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.889 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.889 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.889 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.889 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.889 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.889 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.889 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.889 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.889 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.889 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.889 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.890 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.890 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.890 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:29.890 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:29.890 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.890 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.890 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.890 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.890 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.890 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.890 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.890 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.890 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.890 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.891 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.891 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.891 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:29.891 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:29.891 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.891 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:29.891 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.891 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:29.891 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.891 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.891 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.891 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.891 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.891 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.892 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.892 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.892 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.892 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.892 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:29.892 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "telemetry", 2024-05-09T06:03:29.892 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-05-09T06:03:29.892 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-05-09T06:03:29.892 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:29.892 INFO:teuthology.orchestra.run.smithi039.stdout: "channel_basic": { 2024-05-09T06:03:29.892 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "channel_basic", 2024-05-09T06:03:29.892 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.892 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.892 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.892 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:29.893 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.893 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.893 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.893 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Share basic cluster information (size, version)", 2024-05-09T06:03:29.893 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.893 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.893 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.893 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.893 INFO:teuthology.orchestra.run.smithi039.stdout: "channel_crash": { 2024-05-09T06:03:29.893 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "channel_crash", 2024-05-09T06:03:29.893 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.893 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.893 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.893 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:29.894 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.894 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.894 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.894 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-05-09T06:03:29.894 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.894 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.894 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.894 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.894 INFO:teuthology.orchestra.run.smithi039.stdout: "channel_device": { 2024-05-09T06:03:29.894 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "channel_device", 2024-05-09T06:03:29.894 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.894 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.894 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.894 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:29.894 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.895 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.895 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.895 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-05-09T06:03:29.895 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.895 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.895 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.895 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.895 INFO:teuthology.orchestra.run.smithi039.stdout: "channel_ident": { 2024-05-09T06:03:29.895 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "channel_ident", 2024-05-09T06:03:29.895 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.895 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.895 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.895 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.895 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.896 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.896 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.896 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-05-09T06:03:29.896 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.896 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.896 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.896 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.896 INFO:teuthology.orchestra.run.smithi039.stdout: "channel_perf": { 2024-05-09T06:03:29.896 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "channel_perf", 2024-05-09T06:03:29.896 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.896 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.896 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.896 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.896 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.896 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.897 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.897 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Share various performance metrics of a cluster", 2024-05-09T06:03:29.897 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.897 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.897 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.897 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.897 INFO:teuthology.orchestra.run.smithi039.stdout: "contact": { 2024-05-09T06:03:29.897 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "contact", 2024-05-09T06:03:29.897 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.897 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.897 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.897 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.897 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.897 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.898 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.898 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.898 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.898 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.898 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.898 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.898 INFO:teuthology.orchestra.run.smithi039.stdout: "description": { 2024-05-09T06:03:29.898 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "description", 2024-05-09T06:03:29.898 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.898 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.898 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.898 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.898 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.898 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.898 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.899 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.899 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.899 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.899 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.899 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.899 INFO:teuthology.orchestra.run.smithi039.stdout: "device_url": { 2024-05-09T06:03:29.899 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "device_url", 2024-05-09T06:03:29.899 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.899 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.899 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.899 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-05-09T06:03:29.899 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.899 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.900 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.900 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.900 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.900 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.900 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.900 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.900 INFO:teuthology.orchestra.run.smithi039.stdout: "enabled": { 2024-05-09T06:03:29.900 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "enabled", 2024-05-09T06:03:29.900 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.900 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.900 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.900 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.900 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.900 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.900 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.901 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.901 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.901 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.901 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.901 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.901 INFO:teuthology.orchestra.run.smithi039.stdout: "interval": { 2024-05-09T06:03:29.901 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "interval", 2024-05-09T06:03:29.901 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.901 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.901 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.901 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "24", 2024-05-09T06:03:29.901 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "8", 2024-05-09T06:03:29.901 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.901 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.901 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.902 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.902 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.902 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.902 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.902 INFO:teuthology.orchestra.run.smithi039.stdout: "last_opt_revision": { 2024-05-09T06:03:29.902 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "last_opt_revision", 2024-05-09T06:03:29.902 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.902 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.902 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.902 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "1", 2024-05-09T06:03:29.902 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.902 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.902 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.903 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.903 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.903 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.903 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.903 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.903 INFO:teuthology.orchestra.run.smithi039.stdout: "leaderboard": { 2024-05-09T06:03:29.903 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "leaderboard", 2024-05-09T06:03:29.903 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.903 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.903 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.903 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.903 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.903 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.903 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.904 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.904 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.904 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.904 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.904 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.904 INFO:teuthology.orchestra.run.smithi039.stdout: "leaderboard_description": { 2024-05-09T06:03:29.904 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "leaderboard_description", 2024-05-09T06:03:29.904 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.904 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.904 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.904 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.904 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.904 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.904 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.904 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.905 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.905 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.905 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.905 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.905 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:29.905 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:29.905 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.905 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.905 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.905 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.905 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.905 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.905 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.905 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.906 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.906 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.906 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.906 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.906 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.906 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.906 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.906 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.906 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.906 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.906 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.906 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:29.906 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:29.906 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.907 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.907 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.907 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.907 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.907 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.907 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.907 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.907 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.907 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.907 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.907 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.907 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:29.907 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:29.907 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.908 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.908 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.908 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:29.908 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.908 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.908 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.908 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.908 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.908 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.908 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.908 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.908 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.908 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.908 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.908 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.909 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.909 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.909 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.909 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:29.909 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:29.909 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.909 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.909 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.909 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.909 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.909 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.909 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.909 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.910 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.910 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.910 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.910 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.910 INFO:teuthology.orchestra.run.smithi039.stdout: "organization": { 2024-05-09T06:03:29.910 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "organization", 2024-05-09T06:03:29.910 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.910 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.910 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.910 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.910 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.910 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.910 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.910 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.910 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.911 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.911 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.911 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.911 INFO:teuthology.orchestra.run.smithi039.stdout: "proxy": { 2024-05-09T06:03:29.911 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "proxy", 2024-05-09T06:03:29.911 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.911 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.911 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.911 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.911 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.911 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.911 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.911 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.911 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.912 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.912 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.912 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.912 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:29.912 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:29.912 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.912 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:29.912 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.912 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:29.912 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.912 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.912 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.912 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.912 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.912 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.913 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.913 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.913 INFO:teuthology.orchestra.run.smithi039.stdout: "url": { 2024-05-09T06:03:29.913 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "url", 2024-05-09T06:03:29.913 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.913 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.913 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.913 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-05-09T06:03:29.913 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.913 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.913 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.913 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.913 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.913 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.914 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.914 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.914 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.914 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.914 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:29.914 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "test_orchestrator", 2024-05-09T06:03:29.914 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-05-09T06:03:29.914 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-05-09T06:03:29.914 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:29.914 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:29.914 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:29.914 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.914 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.915 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.915 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.915 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.915 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.915 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.915 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.915 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.915 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.915 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.915 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.915 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.915 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.915 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.915 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.915 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.916 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.916 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.916 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:29.916 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:29.916 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.916 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.916 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.916 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.916 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.916 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.916 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.916 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.916 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.916 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.917 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.917 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.917 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:29.917 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:29.917 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.917 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.917 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.917 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:29.917 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.917 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.917 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.917 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.917 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.917 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.918 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.918 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.918 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.918 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.918 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.918 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.918 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.918 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.918 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.918 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:29.918 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:29.918 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.918 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.918 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.919 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.919 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.919 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.919 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.919 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.919 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.919 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.919 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.919 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.919 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:29.919 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:29.919 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.919 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:29.919 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.920 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:29.920 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.920 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.920 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.920 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.920 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.920 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.920 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.920 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.920 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.920 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.920 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:29.920 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "volumes", 2024-05-09T06:03:29.920 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-05-09T06:03:29.921 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-05-09T06:03:29.921 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:29.921 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:29.921 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:29.921 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.921 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.921 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.921 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.921 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.921 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.921 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.921 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.921 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.921 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.922 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.922 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.922 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.922 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.922 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.922 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.922 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.922 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.922 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.922 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:29.922 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:29.922 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.922 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.922 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.923 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.923 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.923 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.923 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.923 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.923 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.923 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.923 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.923 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.923 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:29.923 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:29.923 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.923 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.923 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.924 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:29.924 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.924 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.924 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.924 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.924 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.924 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.924 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.924 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.924 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.924 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.924 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.924 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.924 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.925 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.925 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.925 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:29.925 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:29.925 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.925 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.925 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.925 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.925 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.925 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.925 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.925 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.925 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.925 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.925 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.926 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.926 INFO:teuthology.orchestra.run.smithi039.stdout: "max_concurrent_clones": { 2024-05-09T06:03:29.926 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "max_concurrent_clones", 2024-05-09T06:03:29.926 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.926 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.926 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.926 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "4", 2024-05-09T06:03:29.926 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.926 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.926 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.926 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Number of asynchronous cloner threads", 2024-05-09T06:03:29.926 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.926 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.927 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.927 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.927 INFO:teuthology.orchestra.run.smithi039.stdout: "periodic_async_work": { 2024-05-09T06:03:29.927 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "periodic_async_work", 2024-05-09T06:03:29.927 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.927 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.927 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.927 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.927 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.927 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.927 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.927 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Periodically check for async work", 2024-05-09T06:03:29.927 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.927 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.928 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.928 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.928 INFO:teuthology.orchestra.run.smithi039.stdout: "snapshot_clone_delay": { 2024-05-09T06:03:29.928 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "snapshot_clone_delay", 2024-05-09T06:03:29.928 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.928 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.928 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.928 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:29.928 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.928 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.928 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.928 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-05-09T06:03:29.928 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.928 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.929 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.929 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.929 INFO:teuthology.orchestra.run.smithi039.stdout: "snapshot_clone_no_wait": { 2024-05-09T06:03:29.929 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "snapshot_clone_no_wait", 2024-05-09T06:03:29.929 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.929 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.929 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.929 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:29.929 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.929 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.929 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.929 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-05-09T06:03:29.929 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.929 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.930 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.930 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.930 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:29.930 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:29.930 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.930 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:29.930 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.930 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:29.930 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.930 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.930 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.930 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.930 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.930 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.931 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.931 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.931 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.931 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.931 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:29.931 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "zabbix", 2024-05-09T06:03:29.931 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-05-09T06:03:29.931 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-05-09T06:03:29.931 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:29.931 INFO:teuthology.orchestra.run.smithi039.stdout: "discovery_interval": { 2024-05-09T06:03:29.931 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "discovery_interval", 2024-05-09T06:03:29.931 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "uint", 2024-05-09T06:03:29.931 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.931 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.932 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "100", 2024-05-09T06:03:29.932 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.932 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.932 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.932 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.932 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.932 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.932 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.932 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.932 INFO:teuthology.orchestra.run.smithi039.stdout: "identifier": { 2024-05-09T06:03:29.932 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "identifier", 2024-05-09T06:03:29.932 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.932 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.933 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.933 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.933 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.933 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.933 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.933 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.933 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.933 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.933 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.933 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.933 INFO:teuthology.orchestra.run.smithi039.stdout: "interval": { 2024-05-09T06:03:29.933 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "interval", 2024-05-09T06:03:29.933 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-05-09T06:03:29.933 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.933 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.934 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "60", 2024-05-09T06:03:29.934 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.934 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.934 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.934 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.934 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.934 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.934 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.934 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.934 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:29.934 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:29.934 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.934 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.935 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.935 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.935 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.935 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.935 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.935 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.935 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.935 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.935 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.935 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.935 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.935 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.935 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.935 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.935 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.935 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.936 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.936 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:29.936 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:29.936 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.936 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.936 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.936 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.936 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.936 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.936 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.936 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.936 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.936 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.936 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.936 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.937 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:29.937 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:29.937 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.937 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.937 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.937 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:29.937 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.937 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.937 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.937 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.937 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.937 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.937 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.937 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.938 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.938 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.938 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.938 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.938 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.938 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.938 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.938 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:29.938 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:29.938 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.938 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.938 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.938 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.938 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.939 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.939 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.939 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.939 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.939 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.939 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.939 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.939 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:29.939 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:29.939 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.939 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:29.939 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.939 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:29.939 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.940 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.940 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.940 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.940 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.940 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.940 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.940 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.940 INFO:teuthology.orchestra.run.smithi039.stdout: "zabbix_host": { 2024-05-09T06:03:29.940 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "zabbix_host", 2024-05-09T06:03:29.940 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.940 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.940 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.940 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.940 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.941 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.941 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.941 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.941 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.941 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.941 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.941 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.941 INFO:teuthology.orchestra.run.smithi039.stdout: "zabbix_port": { 2024-05-09T06:03:29.941 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "zabbix_port", 2024-05-09T06:03:29.941 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.941 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.941 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.941 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10051", 2024-05-09T06:03:29.941 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.942 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.942 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.942 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.942 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.942 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.942 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.942 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.942 INFO:teuthology.orchestra.run.smithi039.stdout: "zabbix_sender": { 2024-05-09T06:03:29.942 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "zabbix_sender", 2024-05-09T06:03:29.942 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.942 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.942 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.942 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-05-09T06:03:29.942 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.943 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.943 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.943 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.943 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.943 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.943 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.943 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.943 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.943 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.943 INFO:teuthology.orchestra.run.smithi039.stdout: ] 2024-05-09T06:03:29.943 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.943 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.943 INFO:teuthology.orchestra.run.smithi039.stdout: "modules": [ 2024-05-09T06:03:29.943 INFO:teuthology.orchestra.run.smithi039.stdout: "cephadm", 2024-05-09T06:03:29.944 INFO:teuthology.orchestra.run.smithi039.stdout: "dashboard", 2024-05-09T06:03:29.944 INFO:teuthology.orchestra.run.smithi039.stdout: "iostat", 2024-05-09T06:03:29.944 INFO:teuthology.orchestra.run.smithi039.stdout: "nfs", 2024-05-09T06:03:29.944 INFO:teuthology.orchestra.run.smithi039.stdout: "restful" 2024-05-09T06:03:29.944 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.944 INFO:teuthology.orchestra.run.smithi039.stdout: "available_modules": [ 2024-05-09T06:03:29.944 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:29.944 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "alerts", 2024-05-09T06:03:29.944 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-05-09T06:03:29.944 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-05-09T06:03:29.944 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:29.944 INFO:teuthology.orchestra.run.smithi039.stdout: "interval": { 2024-05-09T06:03:29.944 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "interval", 2024-05-09T06:03:29.944 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-05-09T06:03:29.945 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.945 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.945 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "60", 2024-05-09T06:03:29.945 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.945 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.945 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.945 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "How frequently to reexamine health status", 2024-05-09T06:03:29.945 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.945 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.945 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.945 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.945 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:29.945 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:29.945 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.946 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.946 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.946 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.946 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.946 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.946 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.946 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.946 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.946 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.946 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.946 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.946 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.946 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.946 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.947 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.947 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.947 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.947 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.947 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:29.947 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:29.947 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.947 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.947 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.947 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.947 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.947 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.947 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.947 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.948 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.948 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.948 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.948 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.948 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:29.948 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:29.948 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.948 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.948 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.948 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:29.948 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.948 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.948 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.948 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.949 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.949 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.949 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.949 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.949 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.949 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.949 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.949 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.949 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.949 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.949 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.949 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:29.949 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:29.949 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.950 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.950 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.950 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.950 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.950 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.950 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.950 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.950 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.950 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.950 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.950 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.950 INFO:teuthology.orchestra.run.smithi039.stdout: "smtp_destination": { 2024-05-09T06:03:29.950 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "smtp_destination", 2024-05-09T06:03:29.950 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.951 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.951 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.951 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.951 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.951 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.951 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.951 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Email address to send alerts to", 2024-05-09T06:03:29.951 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.951 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.951 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.951 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.951 INFO:teuthology.orchestra.run.smithi039.stdout: "smtp_from_name": { 2024-05-09T06:03:29.951 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "smtp_from_name", 2024-05-09T06:03:29.951 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.951 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.951 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.952 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "Ceph", 2024-05-09T06:03:29.952 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.952 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.952 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.952 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Email From: name", 2024-05-09T06:03:29.952 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.952 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.952 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.952 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.952 INFO:teuthology.orchestra.run.smithi039.stdout: "smtp_host": { 2024-05-09T06:03:29.952 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "smtp_host", 2024-05-09T06:03:29.952 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.952 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.953 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.953 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.953 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.953 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.953 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.953 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "SMTP server", 2024-05-09T06:03:29.953 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.953 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.953 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.953 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.953 INFO:teuthology.orchestra.run.smithi039.stdout: "smtp_password": { 2024-05-09T06:03:29.953 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "smtp_password", 2024-05-09T06:03:29.953 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.953 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.954 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.954 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.954 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.954 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.954 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.954 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Password to authenticate with", 2024-05-09T06:03:29.954 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.954 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.954 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.954 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.954 INFO:teuthology.orchestra.run.smithi039.stdout: "smtp_port": { 2024-05-09T06:03:29.954 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "smtp_port", 2024-05-09T06:03:29.954 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.955 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.955 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.955 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "465", 2024-05-09T06:03:29.955 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.955 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.955 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.955 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "SMTP port", 2024-05-09T06:03:29.955 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.955 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.955 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.955 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.955 INFO:teuthology.orchestra.run.smithi039.stdout: "smtp_sender": { 2024-05-09T06:03:29.955 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "smtp_sender", 2024-05-09T06:03:29.955 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.956 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.956 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.956 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.956 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.956 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.956 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.956 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "SMTP envelope sender", 2024-05-09T06:03:29.956 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.956 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.956 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.956 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.956 INFO:teuthology.orchestra.run.smithi039.stdout: "smtp_ssl": { 2024-05-09T06:03:29.956 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "smtp_ssl", 2024-05-09T06:03:29.957 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.957 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.957 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.957 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:29.957 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.957 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.957 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.957 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Use SSL to connect to SMTP server", 2024-05-09T06:03:29.957 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.957 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.957 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.957 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.957 INFO:teuthology.orchestra.run.smithi039.stdout: "smtp_user": { 2024-05-09T06:03:29.957 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "smtp_user", 2024-05-09T06:03:29.958 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.958 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.958 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.958 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.958 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.958 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.958 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.958 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "User to authenticate as", 2024-05-09T06:03:29.958 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.958 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.958 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.958 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.958 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:29.958 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:29.959 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.959 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:29.959 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.959 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:29.959 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.959 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.959 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.959 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.959 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.959 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.959 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.959 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.959 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.959 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.960 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:29.960 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "balancer", 2024-05-09T06:03:29.960 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-05-09T06:03:29.960 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-05-09T06:03:29.960 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:29.960 INFO:teuthology.orchestra.run.smithi039.stdout: "active": { 2024-05-09T06:03:29.960 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "active", 2024-05-09T06:03:29.960 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.960 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.960 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.960 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:29.960 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.960 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.960 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.961 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "automatically balance PGs across cluster", 2024-05-09T06:03:29.961 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.961 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.961 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.961 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.961 INFO:teuthology.orchestra.run.smithi039.stdout: "begin_time": { 2024-05-09T06:03:29.961 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "begin_time", 2024-05-09T06:03:29.961 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.961 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.961 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.961 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0000", 2024-05-09T06:03:29.961 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.961 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.961 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.962 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "beginning time of day to automatically balance", 2024-05-09T06:03:29.962 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-09T06:03:29.962 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.962 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.962 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.962 INFO:teuthology.orchestra.run.smithi039.stdout: "begin_weekday": { 2024-05-09T06:03:29.962 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "begin_weekday", 2024-05-09T06:03:29.962 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "uint", 2024-05-09T06:03:29.962 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.962 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.962 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:29.962 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "0", 2024-05-09T06:03:29.962 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "6", 2024-05-09T06:03:29.962 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.963 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-05-09T06:03:29.963 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-09T06:03:29.963 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.963 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.963 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.963 INFO:teuthology.orchestra.run.smithi039.stdout: "crush_compat_max_iterations": { 2024-05-09T06:03:29.963 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "crush_compat_max_iterations", 2024-05-09T06:03:29.963 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "uint", 2024-05-09T06:03:29.963 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.963 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.963 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "25", 2024-05-09T06:03:29.963 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "1", 2024-05-09T06:03:29.963 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "250", 2024-05-09T06:03:29.963 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.964 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-05-09T06:03:29.964 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.964 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.964 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.964 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.964 INFO:teuthology.orchestra.run.smithi039.stdout: "crush_compat_metrics": { 2024-05-09T06:03:29.964 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "crush_compat_metrics", 2024-05-09T06:03:29.964 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.964 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.964 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.964 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "pgs,objects,bytes", 2024-05-09T06:03:29.964 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.964 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.964 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.965 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-05-09T06:03:29.965 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-05-09T06:03:29.965 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.965 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.965 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.965 INFO:teuthology.orchestra.run.smithi039.stdout: "crush_compat_step": { 2024-05-09T06:03:29.965 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "crush_compat_step", 2024-05-09T06:03:29.965 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "float", 2024-05-09T06:03:29.965 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.965 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.965 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0.5", 2024-05-09T06:03:29.965 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "0.001", 2024-05-09T06:03:29.965 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "0.999", 2024-05-09T06:03:29.965 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.965 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "aggressiveness of optimization", 2024-05-09T06:03:29.966 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-05-09T06:03:29.966 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.966 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.966 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.966 INFO:teuthology.orchestra.run.smithi039.stdout: "end_time": { 2024-05-09T06:03:29.966 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "end_time", 2024-05-09T06:03:29.966 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.966 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.966 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.966 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "2359", 2024-05-09T06:03:29.966 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.966 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.966 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.966 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "ending time of day to automatically balance", 2024-05-09T06:03:29.966 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-09T06:03:29.967 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.967 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.967 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.967 INFO:teuthology.orchestra.run.smithi039.stdout: "end_weekday": { 2024-05-09T06:03:29.967 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "end_weekday", 2024-05-09T06:03:29.967 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "uint", 2024-05-09T06:03:29.967 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.967 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.967 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:29.967 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "0", 2024-05-09T06:03:29.967 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "6", 2024-05-09T06:03:29.967 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.967 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-05-09T06:03:29.967 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-09T06:03:29.967 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.967 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.968 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.968 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:29.968 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:29.968 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.968 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.968 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.968 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.968 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.968 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.968 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.968 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.968 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.968 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.968 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.968 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.968 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.969 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.969 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.969 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.969 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.969 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.969 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.969 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:29.969 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:29.969 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.969 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.969 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.969 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.969 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.969 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.969 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.969 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.970 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.970 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.970 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.970 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.970 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:29.970 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:29.970 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.970 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.970 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.970 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:29.970 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.970 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.970 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.970 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:29.971 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:29.971 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:29.971 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:29.971 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:29.971 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:29.971 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.971 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.971 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.971 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.971 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.971 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.971 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:29.971 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:29.971 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.971 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.972 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.972 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.972 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.972 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.972 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.972 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.972 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.972 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.972 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.972 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.972 INFO:teuthology.orchestra.run.smithi039.stdout: "min_score": { 2024-05-09T06:03:29.972 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "min_score", 2024-05-09T06:03:29.972 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "float", 2024-05-09T06:03:29.972 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.973 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.973 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:29.973 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.973 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.973 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.973 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-05-09T06:03:29.973 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.973 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.973 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.973 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.973 INFO:teuthology.orchestra.run.smithi039.stdout: "mode": { 2024-05-09T06:03:29.973 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "mode", 2024-05-09T06:03:29.973 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.973 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.973 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.974 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "upmap", 2024-05-09T06:03:29.974 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.974 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.974 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.974 INFO:teuthology.orchestra.run.smithi039.stdout: "crush-compat", 2024-05-09T06:03:29.974 INFO:teuthology.orchestra.run.smithi039.stdout: "none", 2024-05-09T06:03:29.974 INFO:teuthology.orchestra.run.smithi039.stdout: "read", 2024-05-09T06:03:29.974 INFO:teuthology.orchestra.run.smithi039.stdout: "upmap", 2024-05-09T06:03:29.974 INFO:teuthology.orchestra.run.smithi039.stdout: "upmap-read" 2024-05-09T06:03:29.974 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.974 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Balancer mode", 2024-05-09T06:03:29.974 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.974 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.975 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.975 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.975 INFO:teuthology.orchestra.run.smithi039.stdout: "pool_ids": { 2024-05-09T06:03:29.975 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "pool_ids", 2024-05-09T06:03:29.975 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.975 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.975 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.975 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.975 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.975 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.975 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.975 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-05-09T06:03:29.975 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.975 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.975 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.976 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.976 INFO:teuthology.orchestra.run.smithi039.stdout: "sleep_interval": { 2024-05-09T06:03:29.976 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sleep_interval", 2024-05-09T06:03:29.976 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-05-09T06:03:29.976 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.976 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.976 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "60", 2024-05-09T06:03:29.976 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.976 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.976 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.976 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-05-09T06:03:29.976 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.976 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.976 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.976 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.977 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:29.977 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:29.977 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.977 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:29.977 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.977 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:29.977 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.977 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.977 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.977 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:29.977 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.977 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.977 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.977 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.978 INFO:teuthology.orchestra.run.smithi039.stdout: "upmap_max_deviation": { 2024-05-09T06:03:29.978 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "upmap_max_deviation", 2024-05-09T06:03:29.978 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.978 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.978 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.978 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "5", 2024-05-09T06:03:29.978 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "1", 2024-05-09T06:03:29.978 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.978 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.978 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "deviation below which no optimization is attempted", 2024-05-09T06:03:29.978 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-05-09T06:03:29.978 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.978 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.979 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.979 INFO:teuthology.orchestra.run.smithi039.stdout: "upmap_max_optimizations": { 2024-05-09T06:03:29.979 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "upmap_max_optimizations", 2024-05-09T06:03:29.979 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "uint", 2024-05-09T06:03:29.979 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.979 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.979 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10", 2024-05-09T06:03:29.979 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.979 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.979 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.979 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-05-09T06:03:29.979 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.979 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.979 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.979 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.980 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:29.980 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.980 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:29.980 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "cephadm", 2024-05-09T06:03:29.980 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-05-09T06:03:29.980 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-05-09T06:03:29.980 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:29.980 INFO:teuthology.orchestra.run.smithi039.stdout: "agent_down_multiplier": { 2024-05-09T06:03:29.980 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "agent_down_multiplier", 2024-05-09T06:03:29.980 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "float", 2024-05-09T06:03:29.980 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.980 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.980 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "3.0", 2024-05-09T06:03:29.980 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.981 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.981 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.981 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-05-09T06:03:29.981 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.981 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.981 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.981 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.981 INFO:teuthology.orchestra.run.smithi039.stdout: "agent_refresh_rate": { 2024-05-09T06:03:29.981 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "agent_refresh_rate", 2024-05-09T06:03:29.981 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-05-09T06:03:29.981 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.981 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.981 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "20", 2024-05-09T06:03:29.981 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.981 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.982 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.982 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-05-09T06:03:29.982 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.982 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.982 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.982 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.982 INFO:teuthology.orchestra.run.smithi039.stdout: "agent_starting_port": { 2024-05-09T06:03:29.982 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "agent_starting_port", 2024-05-09T06:03:29.982 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:29.982 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.982 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.982 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "4721", 2024-05-09T06:03:29.982 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.983 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.983 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.983 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-05-09T06:03:29.983 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.983 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.983 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.983 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.983 INFO:teuthology.orchestra.run.smithi039.stdout: "allow_ptrace": { 2024-05-09T06:03:29.983 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "allow_ptrace", 2024-05-09T06:03:29.983 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.983 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.983 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.983 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.983 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.984 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.984 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.984 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-05-09T06:03:29.984 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-05-09T06:03:29.984 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.984 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.984 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.984 INFO:teuthology.orchestra.run.smithi039.stdout: "autotune_interval": { 2024-05-09T06:03:29.984 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "autotune_interval", 2024-05-09T06:03:29.984 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-05-09T06:03:29.984 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.984 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.984 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "600", 2024-05-09T06:03:29.984 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.985 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.985 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.985 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "how frequently to autotune daemon memory", 2024-05-09T06:03:29.985 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.985 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.985 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.985 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.985 INFO:teuthology.orchestra.run.smithi039.stdout: "autotune_memory_target_ratio": { 2024-05-09T06:03:29.985 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "autotune_memory_target_ratio", 2024-05-09T06:03:29.985 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "float", 2024-05-09T06:03:29.985 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.985 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.985 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0.7", 2024-05-09T06:03:29.985 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.986 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.986 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.986 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-05-09T06:03:29.986 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.986 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.986 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.986 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.986 INFO:teuthology.orchestra.run.smithi039.stdout: "cephadm_log_destination": { 2024-05-09T06:03:29.986 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "cephadm_log_destination", 2024-05-09T06:03:29.986 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.986 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.986 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.986 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:29.986 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.987 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.987 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:29.987 INFO:teuthology.orchestra.run.smithi039.stdout: "file", 2024-05-09T06:03:29.987 INFO:teuthology.orchestra.run.smithi039.stdout: "file,syslog", 2024-05-09T06:03:29.987 INFO:teuthology.orchestra.run.smithi039.stdout: "syslog" 2024-05-09T06:03:29.987 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:29.987 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-05-09T06:03:29.987 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.987 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.987 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.987 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.987 INFO:teuthology.orchestra.run.smithi039.stdout: "cgroups_split": { 2024-05-09T06:03:29.987 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "cgroups_split", 2024-05-09T06:03:29.988 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.988 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.988 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.988 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:29.988 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.988 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.988 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.988 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-05-09T06:03:29.988 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.988 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.988 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.988 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.988 INFO:teuthology.orchestra.run.smithi039.stdout: "config_checks_enabled": { 2024-05-09T06:03:29.988 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "config_checks_enabled", 2024-05-09T06:03:29.989 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.989 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.989 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.989 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:29.989 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.989 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.989 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.989 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-05-09T06:03:29.989 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.989 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.989 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.989 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.989 INFO:teuthology.orchestra.run.smithi039.stdout: "config_dashboard": { 2024-05-09T06:03:29.989 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "config_dashboard", 2024-05-09T06:03:29.990 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:29.990 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.990 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.990 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:29.990 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.990 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.990 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.990 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-05-09T06:03:29.990 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.990 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.990 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.990 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.990 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_alertmanager": { 2024-05-09T06:03:29.990 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_alertmanager", 2024-05-09T06:03:29.991 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.991 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.991 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.991 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-05-09T06:03:29.991 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.991 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.991 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.991 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Prometheus container image", 2024-05-09T06:03:29.991 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.991 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.991 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.991 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.991 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_base": { 2024-05-09T06:03:29.991 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_base", 2024-05-09T06:03:29.992 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.992 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.992 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:29.992 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/ceph/ceph", 2024-05-09T06:03:29.992 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.992 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.992 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.992 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Container image name, without the tag", 2024-05-09T06:03:29.992 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.992 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.992 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.992 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.992 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_elasticsearch": { 2024-05-09T06:03:29.992 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_elasticsearch", 2024-05-09T06:03:29.993 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.993 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.993 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.993 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-05-09T06:03:29.993 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.993 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.993 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.993 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "elasticsearch container image", 2024-05-09T06:03:29.993 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.993 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.993 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.993 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.993 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_grafana": { 2024-05-09T06:03:29.993 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_grafana", 2024-05-09T06:03:29.994 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.994 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.994 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.994 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-05-09T06:03:29.994 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.994 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.994 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.994 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Prometheus container image", 2024-05-09T06:03:29.994 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.994 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.994 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.994 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.994 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_haproxy": { 2024-05-09T06:03:29.995 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_haproxy", 2024-05-09T06:03:29.995 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.995 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.995 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.995 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-05-09T06:03:29.995 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.995 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.995 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.995 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "HAproxy container image", 2024-05-09T06:03:29.995 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.995 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.995 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.995 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.995 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_jaeger_agent": { 2024-05-09T06:03:29.996 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_jaeger_agent", 2024-05-09T06:03:29.996 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.996 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.996 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.996 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-05-09T06:03:29.996 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.996 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.996 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.996 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Jaeger agent container image", 2024-05-09T06:03:29.996 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.996 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.996 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.996 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.996 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_jaeger_collector": { 2024-05-09T06:03:29.996 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_jaeger_collector", 2024-05-09T06:03:29.997 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.997 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.997 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.997 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-05-09T06:03:29.997 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.997 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.997 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.997 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Jaeger collector container image", 2024-05-09T06:03:29.997 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.997 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.997 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.997 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.997 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_jaeger_query": { 2024-05-09T06:03:29.998 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_jaeger_query", 2024-05-09T06:03:29.998 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.998 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.998 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.998 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-05-09T06:03:29.998 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.998 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.998 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.998 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Jaeger query container image", 2024-05-09T06:03:29.998 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.998 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.998 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.998 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.998 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_keepalived": { 2024-05-09T06:03:29.999 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_keepalived", 2024-05-09T06:03:29.999 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:29.999 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:29.999 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:29.999 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-05-09T06:03:29.999 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:29.999 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:29.999 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:29.999 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Keepalived container image", 2024-05-09T06:03:29.999 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:29.999 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:29.999 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:29.999 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:29.999 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_loki": { 2024-05-09T06:03:30.000 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_loki", 2024-05-09T06:03:30.000 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.000 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.000 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.000 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-05-09T06:03:30.000 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.000 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.000 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.000 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Loki container image", 2024-05-09T06:03:30.000 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.000 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.000 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.000 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.000 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_node_exporter": { 2024-05-09T06:03:30.001 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_node_exporter", 2024-05-09T06:03:30.001 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.001 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.001 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.001 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-05-09T06:03:30.001 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.001 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.001 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.001 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Prometheus container image", 2024-05-09T06:03:30.001 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.001 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.001 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.001 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.001 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_nvmeof": { 2024-05-09T06:03:30.001 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_nvmeof", 2024-05-09T06:03:30.002 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.002 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.002 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.002 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.1", 2024-05-09T06:03:30.002 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.002 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.002 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.002 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Nvme-of container image", 2024-05-09T06:03:30.002 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.002 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.002 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.002 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.002 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_prometheus": { 2024-05-09T06:03:30.003 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_prometheus", 2024-05-09T06:03:30.003 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.003 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.003 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.003 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-05-09T06:03:30.003 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.003 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.003 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.003 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Prometheus container image", 2024-05-09T06:03:30.003 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.003 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.003 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.003 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.003 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_promtail": { 2024-05-09T06:03:30.004 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_promtail", 2024-05-09T06:03:30.004 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.004 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.004 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.004 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-05-09T06:03:30.004 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.004 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.004 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.004 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Promtail container image", 2024-05-09T06:03:30.004 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.004 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.004 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.004 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.004 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_samba": { 2024-05-09T06:03:30.005 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_samba", 2024-05-09T06:03:30.005 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.005 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.005 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.005 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-05-09T06:03:30.005 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.005 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.005 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.005 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Samba/SMB container image", 2024-05-09T06:03:30.005 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.005 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.005 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.005 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.005 INFO:teuthology.orchestra.run.smithi039.stdout: "container_image_snmp_gateway": { 2024-05-09T06:03:30.005 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_image_snmp_gateway", 2024-05-09T06:03:30.006 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.006 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.006 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.006 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-05-09T06:03:30.006 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.006 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.006 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.006 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "SNMP Gateway container image", 2024-05-09T06:03:30.006 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.006 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.006 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.006 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.006 INFO:teuthology.orchestra.run.smithi039.stdout: "container_init": { 2024-05-09T06:03:30.006 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "container_init", 2024-05-09T06:03:30.007 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.007 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.007 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.007 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:30.007 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.007 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.007 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.007 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Run podman/docker with `--init`", 2024-05-09T06:03:30.007 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.007 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.007 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.007 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.007 INFO:teuthology.orchestra.run.smithi039.stdout: "daemon_cache_timeout": { 2024-05-09T06:03:30.007 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "daemon_cache_timeout", 2024-05-09T06:03:30.008 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-05-09T06:03:30.008 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.008 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.008 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "600", 2024-05-09T06:03:30.008 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.008 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.008 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.008 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-05-09T06:03:30.008 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.008 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.008 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.008 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.008 INFO:teuthology.orchestra.run.smithi039.stdout: "default_cephadm_command_timeout": { 2024-05-09T06:03:30.008 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "default_cephadm_command_timeout", 2024-05-09T06:03:30.008 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:30.009 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.009 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.009 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "900", 2024-05-09T06:03:30.009 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.009 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.009 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.009 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-05-09T06:03:30.009 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.009 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.009 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.009 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.009 INFO:teuthology.orchestra.run.smithi039.stdout: "default_registry": { 2024-05-09T06:03:30.009 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "default_registry", 2024-05-09T06:03:30.009 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.010 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.010 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.010 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "docker.io", 2024-05-09T06:03:30.010 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.010 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.010 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.010 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-05-09T06:03:30.010 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.010 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.010 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.010 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.010 INFO:teuthology.orchestra.run.smithi039.stdout: "device_cache_timeout": { 2024-05-09T06:03:30.010 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "device_cache_timeout", 2024-05-09T06:03:30.010 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-05-09T06:03:30.011 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.011 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.011 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "1800", 2024-05-09T06:03:30.011 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.011 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.011 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.011 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "seconds to cache device inventory", 2024-05-09T06:03:30.011 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.011 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.011 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.011 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.011 INFO:teuthology.orchestra.run.smithi039.stdout: "device_enhanced_scan": { 2024-05-09T06:03:30.011 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "device_enhanced_scan", 2024-05-09T06:03:30.011 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.012 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.012 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.012 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:30.012 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.012 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.012 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.012 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Use libstoragemgmt during device scans", 2024-05-09T06:03:30.012 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.012 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.012 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.012 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.012 INFO:teuthology.orchestra.run.smithi039.stdout: "facts_cache_timeout": { 2024-05-09T06:03:30.012 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "facts_cache_timeout", 2024-05-09T06:03:30.012 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-05-09T06:03:30.013 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.013 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.013 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "60", 2024-05-09T06:03:30.013 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.013 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.013 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.013 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "seconds to cache host facts data", 2024-05-09T06:03:30.013 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.013 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.013 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.013 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.013 INFO:teuthology.orchestra.run.smithi039.stdout: "grafana_dashboards_path": { 2024-05-09T06:03:30.013 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "grafana_dashboards_path", 2024-05-09T06:03:30.013 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.014 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.014 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.014 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-05-09T06:03:30.014 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.014 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.014 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.014 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-05-09T06:03:30.014 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.014 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.014 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.014 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.014 INFO:teuthology.orchestra.run.smithi039.stdout: "host_check_interval": { 2024-05-09T06:03:30.014 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "host_check_interval", 2024-05-09T06:03:30.014 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-05-09T06:03:30.015 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.015 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.015 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "600", 2024-05-09T06:03:30.015 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.015 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.015 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.015 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "how frequently to perform a host check", 2024-05-09T06:03:30.015 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.015 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.015 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.015 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.015 INFO:teuthology.orchestra.run.smithi039.stdout: "hw_monitoring": { 2024-05-09T06:03:30.015 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "hw_monitoring", 2024-05-09T06:03:30.015 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.016 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.016 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.016 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:30.016 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.016 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.016 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.016 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-05-09T06:03:30.016 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.016 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.016 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.016 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.016 INFO:teuthology.orchestra.run.smithi039.stdout: "inventory_list_all": { 2024-05-09T06:03:30.016 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "inventory_list_all", 2024-05-09T06:03:30.017 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.017 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.017 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.017 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:30.017 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.017 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.017 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.017 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-05-09T06:03:30.017 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.017 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.017 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.017 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.017 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:30.017 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:30.017 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.018 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.018 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.018 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:30.018 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.018 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.018 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:30.018 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:30.018 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:30.018 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:30.018 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:30.018 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:30.018 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:30.018 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:30.019 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.019 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.019 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.019 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.019 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.019 INFO:teuthology.orchestra.run.smithi039.stdout: "log_refresh_metadata": { 2024-05-09T06:03:30.019 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_refresh_metadata", 2024-05-09T06:03:30.019 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.019 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.019 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.019 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:30.019 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.019 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.019 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.019 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-05-09T06:03:30.020 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.020 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.020 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.020 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.020 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:30.020 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:30.020 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.020 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.020 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.020 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:30.020 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.020 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.020 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.020 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-05-09T06:03:30.021 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.021 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.021 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.021 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.021 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:30.021 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:30.021 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.021 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.021 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.021 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:30.021 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.021 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.021 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:30.021 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:30.022 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:30.022 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:30.022 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:30.022 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:30.022 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:30.022 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:30.022 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.022 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.022 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.022 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.022 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.022 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:30.022 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:30.022 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.023 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.023 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.023 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:30.023 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.023 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.023 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.023 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.023 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.023 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.023 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.023 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.023 INFO:teuthology.orchestra.run.smithi039.stdout: "manage_etc_ceph_ceph_conf": { 2024-05-09T06:03:30.023 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-05-09T06:03:30.023 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.023 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.024 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.024 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:30.024 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.024 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.024 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.024 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-05-09T06:03:30.024 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.024 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.024 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.024 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.024 INFO:teuthology.orchestra.run.smithi039.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-05-09T06:03:30.024 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-05-09T06:03:30.024 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.024 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.024 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.025 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "*", 2024-05-09T06:03:30.025 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.025 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.025 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.025 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-05-09T06:03:30.025 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.025 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.025 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.025 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.025 INFO:teuthology.orchestra.run.smithi039.stdout: "max_count_per_host": { 2024-05-09T06:03:30.025 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "max_count_per_host", 2024-05-09T06:03:30.025 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:30.025 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.025 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.025 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10", 2024-05-09T06:03:30.026 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.026 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.026 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.026 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "max number of daemons per service per host", 2024-05-09T06:03:30.026 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.026 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.026 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.026 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.026 INFO:teuthology.orchestra.run.smithi039.stdout: "max_osd_draining_count": { 2024-05-09T06:03:30.026 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "max_osd_draining_count", 2024-05-09T06:03:30.027 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:30.027 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.027 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.027 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10", 2024-05-09T06:03:30.027 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.027 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.027 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.027 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-05-09T06:03:30.027 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.027 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.027 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.027 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.027 INFO:teuthology.orchestra.run.smithi039.stdout: "migration_current": { 2024-05-09T06:03:30.028 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "migration_current", 2024-05-09T06:03:30.028 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:30.028 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.028 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.028 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:30.028 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.028 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.028 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.028 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "internal - do not modify", 2024-05-09T06:03:30.028 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.028 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.028 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.028 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.028 INFO:teuthology.orchestra.run.smithi039.stdout: "mode": { 2024-05-09T06:03:30.029 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "mode", 2024-05-09T06:03:30.029 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.029 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.029 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.029 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "root", 2024-05-09T06:03:30.029 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.029 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.029 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:30.029 INFO:teuthology.orchestra.run.smithi039.stdout: "cephadm-package", 2024-05-09T06:03:30.029 INFO:teuthology.orchestra.run.smithi039.stdout: "root" 2024-05-09T06:03:30.029 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:30.029 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "mode for remote execution of cephadm", 2024-05-09T06:03:30.029 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.030 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.030 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.030 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.030 INFO:teuthology.orchestra.run.smithi039.stdout: "oob_default_addr": { 2024-05-09T06:03:30.030 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "oob_default_addr", 2024-05-09T06:03:30.030 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.030 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.030 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.030 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "169.254.1.1", 2024-05-09T06:03:30.030 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.030 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.030 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.030 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Default address for RedFish API (oob management).", 2024-05-09T06:03:30.030 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.031 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.031 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.031 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.031 INFO:teuthology.orchestra.run.smithi039.stdout: "prometheus_alerts_path": { 2024-05-09T06:03:30.031 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "prometheus_alerts_path", 2024-05-09T06:03:30.031 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.031 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.031 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.031 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-05-09T06:03:30.031 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.031 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.031 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.031 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-05-09T06:03:30.031 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.031 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.032 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.032 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.032 INFO:teuthology.orchestra.run.smithi039.stdout: "registry_insecure": { 2024-05-09T06:03:30.032 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "registry_insecure", 2024-05-09T06:03:30.032 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.032 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.032 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.032 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:30.032 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.032 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.032 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.032 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-05-09T06:03:30.032 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.032 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.033 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.033 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.033 INFO:teuthology.orchestra.run.smithi039.stdout: "registry_password": { 2024-05-09T06:03:30.033 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "registry_password", 2024-05-09T06:03:30.033 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.033 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.033 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.033 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:30.033 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.033 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.033 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.033 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-05-09T06:03:30.033 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.033 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.033 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.034 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.034 INFO:teuthology.orchestra.run.smithi039.stdout: "registry_url": { 2024-05-09T06:03:30.034 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "registry_url", 2024-05-09T06:03:30.034 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.034 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.034 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.034 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:30.034 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.034 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.034 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.034 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-05-09T06:03:30.034 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.034 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.034 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.035 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.035 INFO:teuthology.orchestra.run.smithi039.stdout: "registry_username": { 2024-05-09T06:03:30.035 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "registry_username", 2024-05-09T06:03:30.035 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.035 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.035 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.035 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:30.035 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.035 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.035 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.035 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-05-09T06:03:30.035 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.035 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.035 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.035 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.036 INFO:teuthology.orchestra.run.smithi039.stdout: "secure_monitoring_stack": { 2024-05-09T06:03:30.036 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "secure_monitoring_stack", 2024-05-09T06:03:30.036 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.036 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.036 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.036 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:30.036 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.036 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.036 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.036 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-05-09T06:03:30.036 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.036 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.036 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.036 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.037 INFO:teuthology.orchestra.run.smithi039.stdout: "service_discovery_port": { 2024-05-09T06:03:30.037 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "service_discovery_port", 2024-05-09T06:03:30.037 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:30.037 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.037 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.037 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "8765", 2024-05-09T06:03:30.037 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.037 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.037 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.037 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "cephadm service discovery port", 2024-05-09T06:03:30.037 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.037 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.037 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.037 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.037 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:30.038 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:30.038 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:30.038 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:30.038 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.038 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:30.038 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.038 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.038 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.038 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.038 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.038 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.038 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.038 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.038 INFO:teuthology.orchestra.run.smithi039.stdout: "ssh_config_file": { 2024-05-09T06:03:30.039 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ssh_config_file", 2024-05-09T06:03:30.039 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.039 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.039 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.039 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:30.039 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.039 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.039 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.039 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-05-09T06:03:30.039 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.039 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.039 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.039 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.039 INFO:teuthology.orchestra.run.smithi039.stdout: "use_agent": { 2024-05-09T06:03:30.039 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "use_agent", 2024-05-09T06:03:30.040 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.040 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.040 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.040 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:30.040 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.040 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.040 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.040 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-05-09T06:03:30.040 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.040 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.040 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.040 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.040 INFO:teuthology.orchestra.run.smithi039.stdout: "use_repo_digest": { 2024-05-09T06:03:30.040 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "use_repo_digest", 2024-05-09T06:03:30.041 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.041 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.041 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.041 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:30.041 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.041 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.041 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.041 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-05-09T06:03:30.041 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.041 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.041 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.041 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.041 INFO:teuthology.orchestra.run.smithi039.stdout: "warn_on_failed_host_check": { 2024-05-09T06:03:30.042 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "warn_on_failed_host_check", 2024-05-09T06:03:30.042 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.042 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.042 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.042 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:30.042 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.042 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.042 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.042 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "raise a health warning if the host check fails", 2024-05-09T06:03:30.042 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.042 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.042 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.042 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.042 INFO:teuthology.orchestra.run.smithi039.stdout: "warn_on_stray_daemons": { 2024-05-09T06:03:30.043 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "warn_on_stray_daemons", 2024-05-09T06:03:30.043 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.043 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.043 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.043 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:30.043 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.043 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.043 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.043 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-05-09T06:03:30.043 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.043 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.043 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.043 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.043 INFO:teuthology.orchestra.run.smithi039.stdout: "warn_on_stray_hosts": { 2024-05-09T06:03:30.043 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "warn_on_stray_hosts", 2024-05-09T06:03:30.044 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.044 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.044 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.044 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:30.044 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.044 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.044 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.044 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-05-09T06:03:30.044 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.044 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.044 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.044 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:30.044 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:30.044 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.045 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:30.045 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "crash", 2024-05-09T06:03:30.045 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-05-09T06:03:30.045 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-05-09T06:03:30.045 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:30.045 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:30.045 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:30.045 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.045 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.045 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.045 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:30.045 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.045 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.045 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:30.046 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:30.046 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:30.046 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:30.046 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:30.046 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:30.046 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:30.046 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:30.046 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.046 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.046 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.046 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.046 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.046 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:30.046 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:30.046 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.047 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.047 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.047 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:30.047 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.047 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.047 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.049 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.049 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.049 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.049 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.049 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.049 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:30.049 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:30.049 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.050 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.050 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.050 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:30.050 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.050 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.050 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:30.050 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:30.050 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:30.050 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:30.050 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:30.050 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:30.050 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:30.050 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:30.050 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.051 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.051 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.051 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.051 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.051 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:30.051 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:30.051 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.051 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.051 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.051 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:30.051 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.051 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.051 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.051 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.052 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.052 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.052 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.052 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.052 INFO:teuthology.orchestra.run.smithi039.stdout: "retain_interval": { 2024-05-09T06:03:30.052 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "retain_interval", 2024-05-09T06:03:30.052 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-05-09T06:03:30.052 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.052 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.052 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "31536000", 2024-05-09T06:03:30.052 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.052 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.052 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.052 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "how long to retain crashes before pruning them", 2024-05-09T06:03:30.052 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.053 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.053 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.053 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.053 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:30.053 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:30.053 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:30.053 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:30.053 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.053 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:30.053 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.053 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.053 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.053 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.053 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.053 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.054 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.054 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.054 INFO:teuthology.orchestra.run.smithi039.stdout: "warn_recent_interval": { 2024-05-09T06:03:30.054 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "warn_recent_interval", 2024-05-09T06:03:30.054 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-05-09T06:03:30.054 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.054 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.054 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "1209600", 2024-05-09T06:03:30.054 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.054 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.054 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.054 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "time interval in which to warn about recent crashes", 2024-05-09T06:03:30.054 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.055 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.055 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.055 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:30.055 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:30.055 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.055 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:30.055 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "dashboard", 2024-05-09T06:03:30.055 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-05-09T06:03:30.055 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-05-09T06:03:30.055 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:30.055 INFO:teuthology.orchestra.run.smithi039.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-05-09T06:03:30.055 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-05-09T06:03:30.055 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:30.056 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.056 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.056 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10", 2024-05-09T06:03:30.056 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.056 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.056 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.056 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.056 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.056 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.056 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.056 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.056 INFO:teuthology.orchestra.run.smithi039.stdout: "ALERTMANAGER_API_HOST": { 2024-05-09T06:03:30.056 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ALERTMANAGER_API_HOST", 2024-05-09T06:03:30.056 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.057 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.057 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.057 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:30.057 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.057 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.057 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.057 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.057 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.057 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.057 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.057 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.057 INFO:teuthology.orchestra.run.smithi039.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-05-09T06:03:30.057 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-05-09T06:03:30.057 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.057 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.058 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.058 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:30.058 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.058 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.058 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.058 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.058 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.058 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.058 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.058 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.058 INFO:teuthology.orchestra.run.smithi039.stdout: "AUDIT_API_ENABLED": { 2024-05-09T06:03:30.058 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "AUDIT_API_ENABLED", 2024-05-09T06:03:30.058 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.058 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.059 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.059 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:30.059 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.059 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.059 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.059 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.059 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.059 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.059 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.059 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.059 INFO:teuthology.orchestra.run.smithi039.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-05-09T06:03:30.059 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-05-09T06:03:30.059 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.060 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.060 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.060 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:30.060 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.060 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.060 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.060 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.060 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.060 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.060 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.060 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.060 INFO:teuthology.orchestra.run.smithi039.stdout: "ENABLE_BROWSABLE_API": { 2024-05-09T06:03:30.060 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ENABLE_BROWSABLE_API", 2024-05-09T06:03:30.061 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.061 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.061 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.061 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:30.061 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.061 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.061 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.061 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.061 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.061 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.061 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.061 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.061 INFO:teuthology.orchestra.run.smithi039.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-05-09T06:03:30.061 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-05-09T06:03:30.062 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.062 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.062 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.062 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:30.062 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.062 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.062 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.062 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.062 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.062 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.062 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.062 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.062 INFO:teuthology.orchestra.run.smithi039.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-05-09T06:03:30.063 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-05-09T06:03:30.063 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.063 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.063 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.063 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:30.063 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.063 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.063 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.063 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.063 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.063 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.063 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.063 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.063 INFO:teuthology.orchestra.run.smithi039.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-05-09T06:03:30.064 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-05-09T06:03:30.064 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.064 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.064 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.064 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:30.064 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.064 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.064 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.064 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.064 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.064 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.064 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.064 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.064 INFO:teuthology.orchestra.run.smithi039.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-05-09T06:03:30.065 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-05-09T06:03:30.065 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.065 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.065 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.065 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:30.065 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.065 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.065 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.065 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.065 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.065 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.065 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.065 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.066 INFO:teuthology.orchestra.run.smithi039.stdout: "FEATURE_TOGGLE_NFS": { 2024-05-09T06:03:30.066 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-05-09T06:03:30.066 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.066 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.066 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.066 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:30.066 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.066 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.066 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.066 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.066 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.066 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.066 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.066 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.067 INFO:teuthology.orchestra.run.smithi039.stdout: "FEATURE_TOGGLE_RBD": { 2024-05-09T06:03:30.067 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-05-09T06:03:30.067 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.067 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.067 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.067 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:30.067 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.067 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.067 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.067 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.067 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.067 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.067 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.068 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.068 INFO:teuthology.orchestra.run.smithi039.stdout: "FEATURE_TOGGLE_RGW": { 2024-05-09T06:03:30.068 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-05-09T06:03:30.068 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.068 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.068 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.068 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:30.068 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.068 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.068 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.068 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.068 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.068 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.068 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.069 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.069 INFO:teuthology.orchestra.run.smithi039.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-05-09T06:03:30.069 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-05-09T06:03:30.069 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.069 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.069 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.069 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:30.069 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.069 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.069 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.069 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.069 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.069 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.069 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.070 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.070 INFO:teuthology.orchestra.run.smithi039.stdout: "GRAFANA_API_PASSWORD": { 2024-05-09T06:03:30.070 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "GRAFANA_API_PASSWORD", 2024-05-09T06:03:30.070 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.070 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.070 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.070 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "admin", 2024-05-09T06:03:30.070 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.070 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.070 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.070 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.070 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.070 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.070 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.071 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.071 INFO:teuthology.orchestra.run.smithi039.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-05-09T06:03:30.071 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-05-09T06:03:30.071 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.071 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.071 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.071 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:30.071 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.071 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.071 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.071 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.071 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.071 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.071 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.071 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.072 INFO:teuthology.orchestra.run.smithi039.stdout: "GRAFANA_API_URL": { 2024-05-09T06:03:30.072 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "GRAFANA_API_URL", 2024-05-09T06:03:30.072 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.072 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.072 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.072 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:30.072 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.072 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.072 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.072 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.072 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.072 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.072 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.073 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.073 INFO:teuthology.orchestra.run.smithi039.stdout: "GRAFANA_API_USERNAME": { 2024-05-09T06:03:30.073 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "GRAFANA_API_USERNAME", 2024-05-09T06:03:30.073 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.073 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.073 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.073 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "admin", 2024-05-09T06:03:30.073 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.073 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.073 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.073 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.073 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.073 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.073 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.073 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.074 INFO:teuthology.orchestra.run.smithi039.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-05-09T06:03:30.074 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-05-09T06:03:30.074 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.074 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.074 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.074 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:30.074 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.074 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.074 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.074 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.074 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.074 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.074 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.074 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.075 INFO:teuthology.orchestra.run.smithi039.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-05-09T06:03:30.075 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-05-09T06:03:30.075 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.075 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.075 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.075 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:30.075 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.075 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.075 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.075 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.075 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.075 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.075 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.075 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.076 INFO:teuthology.orchestra.run.smithi039.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-05-09T06:03:30.076 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-05-09T06:03:30.076 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.076 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.076 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.076 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:30.076 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.076 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.076 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.076 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.076 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.076 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.076 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.076 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.077 INFO:teuthology.orchestra.run.smithi039.stdout: "ISSUE_TRACKER_API_KEY": { 2024-05-09T06:03:30.077 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-05-09T06:03:30.077 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.077 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.077 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.077 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:30.077 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.077 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.077 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.077 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.077 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.077 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.077 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.077 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.078 INFO:teuthology.orchestra.run.smithi039.stdout: "MANAGED_BY_CLUSTERS": { 2024-05-09T06:03:30.078 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-05-09T06:03:30.078 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.078 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.078 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.078 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "[]", 2024-05-09T06:03:30.078 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.078 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.078 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.078 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.078 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.078 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.078 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.078 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.079 INFO:teuthology.orchestra.run.smithi039.stdout: "MULTICLUSTER_CONFIG": { 2024-05-09T06:03:30.079 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "MULTICLUSTER_CONFIG", 2024-05-09T06:03:30.079 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.079 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.079 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.079 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "{}", 2024-05-09T06:03:30.079 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.079 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.079 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.079 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.079 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.079 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.079 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.079 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.080 INFO:teuthology.orchestra.run.smithi039.stdout: "PROMETHEUS_API_HOST": { 2024-05-09T06:03:30.080 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PROMETHEUS_API_HOST", 2024-05-09T06:03:30.080 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.080 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.080 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.080 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:30.080 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.080 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.080 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.080 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.080 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.080 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.080 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.080 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.080 INFO:teuthology.orchestra.run.smithi039.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-05-09T06:03:30.081 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-05-09T06:03:30.081 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.081 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.081 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.081 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:30.081 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.081 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.081 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.081 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.081 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.081 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.081 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.081 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.081 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-05-09T06:03:30.082 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-05-09T06:03:30.082 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.082 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.082 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.082 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:30.082 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.082 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.082 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.082 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.082 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.082 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.082 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.082 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.082 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-05-09T06:03:30.083 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-05-09T06:03:30.083 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.083 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.083 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.083 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:30.083 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.083 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.083 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.083 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.083 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.083 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.083 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.083 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.083 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-05-09T06:03:30.084 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-05-09T06:03:30.084 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.084 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.084 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.084 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:30.084 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.084 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.084 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.084 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.084 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.084 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.084 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.084 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.084 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-05-09T06:03:30.084 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-05-09T06:03:30.085 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.085 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.085 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.085 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:30.085 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.085 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.085 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.085 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.085 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.085 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.085 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.085 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.085 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-05-09T06:03:30.085 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-05-09T06:03:30.086 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.086 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.086 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.086 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:30.086 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.086 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.086 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.086 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.086 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.086 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.086 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.086 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.086 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-05-09T06:03:30.086 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-05-09T06:03:30.087 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.087 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.087 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.087 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:30.087 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.087 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.087 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.087 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.087 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.087 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.087 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.087 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.087 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-05-09T06:03:30.087 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-05-09T06:03:30.088 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.088 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.088 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.088 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:30.088 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.088 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.088 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.088 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.088 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.088 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.088 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.088 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.088 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_ENABLED": { 2024-05-09T06:03:30.088 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_ENABLED", 2024-05-09T06:03:30.088 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.089 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.089 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.089 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:30.089 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.089 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.089 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.089 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.089 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.089 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.089 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.089 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.089 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-05-09T06:03:30.089 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-05-09T06:03:30.089 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.090 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.090 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.090 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-05-09T06:03:30.090 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.090 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.090 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.090 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.090 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.090 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.090 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.090 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.090 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-05-09T06:03:30.090 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-05-09T06:03:30.090 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:30.091 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.091 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.091 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10", 2024-05-09T06:03:30.091 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.091 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.091 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.091 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.091 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.091 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.091 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.091 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.091 INFO:teuthology.orchestra.run.smithi039.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-05-09T06:03:30.091 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-05-09T06:03:30.091 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:30.092 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.092 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.092 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "8", 2024-05-09T06:03:30.092 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.092 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.092 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.092 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.092 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.092 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.092 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.092 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.092 INFO:teuthology.orchestra.run.smithi039.stdout: "REST_REQUESTS_TIMEOUT": { 2024-05-09T06:03:30.092 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-05-09T06:03:30.092 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:30.093 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.093 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.093 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "45", 2024-05-09T06:03:30.093 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.093 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.093 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.093 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.093 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.093 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.093 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.093 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.093 INFO:teuthology.orchestra.run.smithi039.stdout: "RGW_API_ACCESS_KEY": { 2024-05-09T06:03:30.093 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "RGW_API_ACCESS_KEY", 2024-05-09T06:03:30.093 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.093 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.094 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.094 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:30.094 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.094 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.094 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.094 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.094 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.094 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.094 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.094 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.094 INFO:teuthology.orchestra.run.smithi039.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-05-09T06:03:30.094 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-05-09T06:03:30.094 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.095 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.095 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.095 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "admin", 2024-05-09T06:03:30.095 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.095 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.095 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.095 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.095 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.095 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.095 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.095 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.095 INFO:teuthology.orchestra.run.smithi039.stdout: "RGW_API_SECRET_KEY": { 2024-05-09T06:03:30.095 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "RGW_API_SECRET_KEY", 2024-05-09T06:03:30.095 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.096 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.096 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.096 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:30.096 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.096 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.096 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.096 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.096 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.096 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.096 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.096 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.096 INFO:teuthology.orchestra.run.smithi039.stdout: "RGW_API_SSL_VERIFY": { 2024-05-09T06:03:30.096 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "RGW_API_SSL_VERIFY", 2024-05-09T06:03:30.096 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.096 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.097 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.097 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:30.097 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.097 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.097 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.097 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.097 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.097 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.097 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.097 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.097 INFO:teuthology.orchestra.run.smithi039.stdout: "UNSAFE_TLS_v1_2": { 2024-05-09T06:03:30.097 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "UNSAFE_TLS_v1_2", 2024-05-09T06:03:30.097 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.097 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.097 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.098 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:30.098 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.098 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.098 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.098 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.098 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.098 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.098 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.098 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.098 INFO:teuthology.orchestra.run.smithi039.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-05-09T06:03:30.098 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-05-09T06:03:30.098 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:30.098 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.099 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.099 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:30.099 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.099 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.099 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.099 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.099 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.099 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.099 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.099 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.099 INFO:teuthology.orchestra.run.smithi039.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-05-09T06:03:30.099 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-05-09T06:03:30.099 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:30.099 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.100 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.100 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10", 2024-05-09T06:03:30.100 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.100 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.100 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.100 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.100 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.100 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.100 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.100 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.100 INFO:teuthology.orchestra.run.smithi039.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-05-09T06:03:30.100 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-05-09T06:03:30.100 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:30.100 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.101 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.101 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "5", 2024-05-09T06:03:30.101 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.101 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.101 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.101 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.101 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.101 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.101 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.101 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.101 INFO:teuthology.orchestra.run.smithi039.stdout: "cross_origin_url": { 2024-05-09T06:03:30.101 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "cross_origin_url", 2024-05-09T06:03:30.101 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.101 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.101 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.102 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:30.102 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.102 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.102 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.102 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.102 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.102 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.102 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.102 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.102 INFO:teuthology.orchestra.run.smithi039.stdout: "crt_file": { 2024-05-09T06:03:30.102 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "crt_file", 2024-05-09T06:03:30.102 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.102 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.102 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.102 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:30.103 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.103 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.103 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.103 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.103 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.103 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.103 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.103 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.103 INFO:teuthology.orchestra.run.smithi039.stdout: "debug": { 2024-05-09T06:03:30.103 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "debug", 2024-05-09T06:03:30.103 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.103 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.103 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.103 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:30.104 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.104 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.104 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.104 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Enable/disable debug options", 2024-05-09T06:03:30.104 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.104 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.104 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.104 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.104 INFO:teuthology.orchestra.run.smithi039.stdout: "jwt_token_ttl": { 2024-05-09T06:03:30.104 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "jwt_token_ttl", 2024-05-09T06:03:30.104 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:30.104 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.104 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.104 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "28800", 2024-05-09T06:03:30.104 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.105 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.105 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.105 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.105 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.105 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.105 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.105 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.105 INFO:teuthology.orchestra.run.smithi039.stdout: "key_file": { 2024-05-09T06:03:30.105 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "key_file", 2024-05-09T06:03:30.105 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.105 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.105 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.105 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:30.105 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.105 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.106 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.106 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.106 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.106 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.106 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.106 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.106 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:30.106 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:30.106 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.106 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.106 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.106 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:30.106 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.106 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.107 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:30.107 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:30.107 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:30.107 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:30.107 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:30.107 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:30.107 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:30.107 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:30.107 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.107 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.107 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.107 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.107 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.107 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:30.107 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:30.108 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.108 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.108 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.108 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:30.108 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.108 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.108 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.108 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.108 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.108 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.108 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.108 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.108 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:30.108 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:30.109 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.109 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.109 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.109 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:30.109 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.109 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.109 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:30.109 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:30.109 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:30.109 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:30.109 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:30.109 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:30.109 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:30.109 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:30.109 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.110 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.110 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.110 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.110 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.110 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:30.110 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:30.110 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.110 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.110 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.110 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:30.110 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.110 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.110 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.110 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.111 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.111 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.111 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.111 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.111 INFO:teuthology.orchestra.run.smithi039.stdout: "motd": { 2024-05-09T06:03:30.111 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "motd", 2024-05-09T06:03:30.111 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.111 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.111 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.111 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:30.111 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.111 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.111 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.111 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "The message of the day", 2024-05-09T06:03:30.112 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.112 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.112 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.112 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.112 INFO:teuthology.orchestra.run.smithi039.stdout: "redirect_resolve_ip_addr": { 2024-05-09T06:03:30.112 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "redirect_resolve_ip_addr", 2024-05-09T06:03:30.112 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.112 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.112 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.112 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:30.112 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.112 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.112 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.112 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.112 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.113 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.113 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.113 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.113 INFO:teuthology.orchestra.run.smithi039.stdout: "server_addr": { 2024-05-09T06:03:30.113 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "server_addr", 2024-05-09T06:03:30.113 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.113 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.113 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.113 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "::", 2024-05-09T06:03:30.113 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.113 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.113 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.113 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.113 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.113 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.114 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.114 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.114 INFO:teuthology.orchestra.run.smithi039.stdout: "server_port": { 2024-05-09T06:03:30.114 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "server_port", 2024-05-09T06:03:30.114 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:30.114 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.114 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.114 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "8080", 2024-05-09T06:03:30.114 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.114 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.114 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.114 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.114 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.114 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.115 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.115 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.115 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:30.115 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:30.115 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:30.115 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:30.115 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.115 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:30.115 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.115 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.115 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.115 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.115 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.115 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.116 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.116 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.116 INFO:teuthology.orchestra.run.smithi039.stdout: "ssl": { 2024-05-09T06:03:30.116 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ssl", 2024-05-09T06:03:30.116 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.116 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.116 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.116 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:30.116 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.116 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.116 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.116 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.116 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.116 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.117 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.117 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.117 INFO:teuthology.orchestra.run.smithi039.stdout: "ssl_server_port": { 2024-05-09T06:03:30.117 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ssl_server_port", 2024-05-09T06:03:30.117 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:30.117 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.117 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.117 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "8443", 2024-05-09T06:03:30.117 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.117 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.117 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.117 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.117 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.117 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.117 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.118 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.118 INFO:teuthology.orchestra.run.smithi039.stdout: "standby_behaviour": { 2024-05-09T06:03:30.118 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "standby_behaviour", 2024-05-09T06:03:30.118 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.118 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.118 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.118 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "redirect", 2024-05-09T06:03:30.118 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.118 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.118 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:30.118 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:30.118 INFO:teuthology.orchestra.run.smithi039.stdout: "redirect" 2024-05-09T06:03:30.118 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:30.118 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.119 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.119 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.119 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.119 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.119 INFO:teuthology.orchestra.run.smithi039.stdout: "standby_error_status_code": { 2024-05-09T06:03:30.119 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "standby_error_status_code", 2024-05-09T06:03:30.119 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:30.119 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.119 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.119 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "500", 2024-05-09T06:03:30.119 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "400", 2024-05-09T06:03:30.119 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "599", 2024-05-09T06:03:30.119 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.119 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.119 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.119 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.120 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.120 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.120 INFO:teuthology.orchestra.run.smithi039.stdout: "url_prefix": { 2024-05-09T06:03:30.120 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "url_prefix", 2024-05-09T06:03:30.120 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.120 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.120 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.120 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:30.120 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.120 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.120 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.120 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.120 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.120 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.121 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.121 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:30.121 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:30.121 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.121 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:30.121 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "devicehealth", 2024-05-09T06:03:30.121 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-05-09T06:03:30.121 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-05-09T06:03:30.121 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:30.121 INFO:teuthology.orchestra.run.smithi039.stdout: "enable_monitoring": { 2024-05-09T06:03:30.121 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "enable_monitoring", 2024-05-09T06:03:30.121 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.121 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.121 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.121 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:30.122 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.122 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.122 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.122 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "monitor device health metrics", 2024-05-09T06:03:30.122 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.122 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.122 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.122 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.122 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:30.122 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:30.122 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.122 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.122 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.122 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:30.123 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.123 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.123 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:30.123 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:30.123 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:30.123 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:30.123 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:30.123 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:30.123 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:30.123 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:30.123 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.123 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.123 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.123 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.123 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.124 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:30.124 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:30.124 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.124 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.124 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.124 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:30.124 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.124 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.124 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.124 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.124 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.124 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.124 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.124 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.125 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:30.125 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:30.125 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.125 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.125 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.125 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:30.125 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.125 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.125 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:30.125 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:30.125 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:30.125 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:30.125 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:30.125 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:30.125 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:30.126 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:30.126 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.126 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.126 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.126 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.126 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.126 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:30.126 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:30.126 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.126 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.126 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.126 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:30.126 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.127 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.127 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.127 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.127 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.127 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.127 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.127 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.127 INFO:teuthology.orchestra.run.smithi039.stdout: "mark_out_threshold": { 2024-05-09T06:03:30.127 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "mark_out_threshold", 2024-05-09T06:03:30.127 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-05-09T06:03:30.127 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.127 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.127 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "2419200", 2024-05-09T06:03:30.128 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.128 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.128 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.128 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-05-09T06:03:30.128 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.128 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.128 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.128 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.128 INFO:teuthology.orchestra.run.smithi039.stdout: "pool_name": { 2024-05-09T06:03:30.128 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "pool_name", 2024-05-09T06:03:30.128 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.128 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.128 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.128 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "device_health_metrics", 2024-05-09T06:03:30.129 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.129 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.129 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.129 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "name of pool in which to store device health metrics", 2024-05-09T06:03:30.129 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.129 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.129 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.129 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.129 INFO:teuthology.orchestra.run.smithi039.stdout: "retention_period": { 2024-05-09T06:03:30.129 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "retention_period", 2024-05-09T06:03:30.129 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-05-09T06:03:30.129 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.129 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.129 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "15552000", 2024-05-09T06:03:30.130 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.130 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.130 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.130 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "how long to retain device health metrics", 2024-05-09T06:03:30.130 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.130 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.130 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.130 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.130 INFO:teuthology.orchestra.run.smithi039.stdout: "scrape_frequency": { 2024-05-09T06:03:30.130 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "scrape_frequency", 2024-05-09T06:03:30.130 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-05-09T06:03:30.130 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.130 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.131 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "86400", 2024-05-09T06:03:30.131 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.131 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.131 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.131 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "how frequently to scrape device health metrics", 2024-05-09T06:03:30.131 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.131 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.131 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.131 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.131 INFO:teuthology.orchestra.run.smithi039.stdout: "self_heal": { 2024-05-09T06:03:30.131 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "self_heal", 2024-05-09T06:03:30.131 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.131 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.131 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.131 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:30.132 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.132 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.132 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.132 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-05-09T06:03:30.132 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.132 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.132 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.132 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.132 INFO:teuthology.orchestra.run.smithi039.stdout: "sleep_interval": { 2024-05-09T06:03:30.132 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sleep_interval", 2024-05-09T06:03:30.132 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-05-09T06:03:30.132 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.132 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.132 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "600", 2024-05-09T06:03:30.133 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.133 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.133 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.133 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "how frequently to wake up and check device health", 2024-05-09T06:03:30.133 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.133 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.133 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.133 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.133 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:30.133 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:30.133 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:30.133 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:30.133 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.133 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:30.134 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.134 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.134 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.134 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.134 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.134 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.134 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.134 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.134 INFO:teuthology.orchestra.run.smithi039.stdout: "warn_threshold": { 2024-05-09T06:03:30.134 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "warn_threshold", 2024-05-09T06:03:30.134 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-05-09T06:03:30.134 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.134 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.134 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "7257600", 2024-05-09T06:03:30.135 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.135 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.135 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.135 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-05-09T06:03:30.135 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.135 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.135 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.135 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:30.135 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:30.135 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.135 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:30.135 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "diskprediction_local", 2024-05-09T06:03:30.135 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-05-09T06:03:30.135 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-05-09T06:03:30.135 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:30.136 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:30.136 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:30.136 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.136 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.136 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.136 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:30.136 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.136 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.136 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:30.136 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:30.136 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:30.136 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:30.136 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:30.136 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:30.137 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:30.137 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:30.137 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.137 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.137 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.137 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.137 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.137 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:30.137 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:30.137 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.137 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.137 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.137 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:30.137 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.137 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.138 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.138 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.138 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.138 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.138 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.138 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.138 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:30.138 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:30.138 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.138 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.138 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.138 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:30.138 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.138 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.139 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:30.139 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:30.139 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:30.139 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:30.139 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:30.139 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:30.139 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:30.139 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:30.139 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.139 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.139 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.139 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.139 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.139 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:30.139 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:30.140 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.140 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.140 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.140 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:30.140 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.140 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.140 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.140 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.140 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.140 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.140 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.140 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.140 INFO:teuthology.orchestra.run.smithi039.stdout: "predict_interval": { 2024-05-09T06:03:30.141 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "predict_interval", 2024-05-09T06:03:30.141 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.141 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.141 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.141 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "86400", 2024-05-09T06:03:30.141 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.141 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.141 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.141 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.141 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.141 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.141 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.141 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.141 INFO:teuthology.orchestra.run.smithi039.stdout: "predictor_model": { 2024-05-09T06:03:30.142 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "predictor_model", 2024-05-09T06:03:30.142 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.142 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.142 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.142 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "prophetstor", 2024-05-09T06:03:30.142 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.142 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.142 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.142 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.142 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.142 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.142 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.142 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.142 INFO:teuthology.orchestra.run.smithi039.stdout: "sleep_interval": { 2024-05-09T06:03:30.143 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sleep_interval", 2024-05-09T06:03:30.143 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.143 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.143 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.143 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "600", 2024-05-09T06:03:30.143 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.143 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.143 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.143 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.143 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.143 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.143 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.143 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.143 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:30.144 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:30.144 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:30.144 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:30.144 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.144 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:30.144 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.144 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.144 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.144 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.144 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.144 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.144 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.144 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:30.144 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:30.145 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.145 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:30.145 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "influx", 2024-05-09T06:03:30.145 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": false, 2024-05-09T06:03:30.145 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "influxdb python module not found", 2024-05-09T06:03:30.145 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:30.145 INFO:teuthology.orchestra.run.smithi039.stdout: "batch_size": { 2024-05-09T06:03:30.145 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "batch_size", 2024-05-09T06:03:30.145 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:30.145 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.145 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.145 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "5000", 2024-05-09T06:03:30.145 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.145 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.145 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.146 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-05-09T06:03:30.146 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.146 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.146 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.146 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.146 INFO:teuthology.orchestra.run.smithi039.stdout: "database": { 2024-05-09T06:03:30.146 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "database", 2024-05-09T06:03:30.146 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.146 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.146 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.146 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "ceph", 2024-05-09T06:03:30.146 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.146 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.146 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.147 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-05-09T06:03:30.147 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.147 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.147 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.147 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.147 INFO:teuthology.orchestra.run.smithi039.stdout: "hostname": { 2024-05-09T06:03:30.147 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "hostname", 2024-05-09T06:03:30.147 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.147 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.147 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.147 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:30.147 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.147 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.147 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.148 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "InfluxDB server hostname", 2024-05-09T06:03:30.148 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.148 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.148 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.148 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.148 INFO:teuthology.orchestra.run.smithi039.stdout: "interval": { 2024-05-09T06:03:30.148 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "interval", 2024-05-09T06:03:30.148 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-05-09T06:03:30.148 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.148 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.148 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "30", 2024-05-09T06:03:30.148 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "5", 2024-05-09T06:03:30.148 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.148 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.148 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-05-09T06:03:30.149 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.149 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.149 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.149 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.149 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:30.149 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:30.149 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.149 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.149 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.149 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:30.149 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.149 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.149 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:30.149 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:30.149 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:30.150 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:30.150 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:30.150 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:30.150 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:30.150 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:30.150 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.150 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.150 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.150 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.150 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.150 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:30.150 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:30.150 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.150 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.151 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.151 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:30.151 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.151 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.151 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.151 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.151 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.151 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.151 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.151 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.151 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:30.151 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:30.151 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.151 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.151 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.151 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:30.152 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.152 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.152 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:30.152 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:30.152 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:30.152 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:30.152 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:30.152 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:30.152 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:30.152 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:30.152 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.152 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.152 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.152 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.152 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.153 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:30.153 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:30.153 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.153 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.153 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.153 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:30.153 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.153 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.153 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.153 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.153 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.153 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.153 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.153 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.153 INFO:teuthology.orchestra.run.smithi039.stdout: "password": { 2024-05-09T06:03:30.154 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "password", 2024-05-09T06:03:30.154 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.154 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.154 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.154 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:30.154 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.154 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.154 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.154 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "password of InfluxDB server user", 2024-05-09T06:03:30.154 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.154 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.154 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.154 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.154 INFO:teuthology.orchestra.run.smithi039.stdout: "port": { 2024-05-09T06:03:30.155 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "port", 2024-05-09T06:03:30.155 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:30.155 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.155 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.155 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "8086", 2024-05-09T06:03:30.155 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.155 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.155 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.155 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "InfluxDB server port", 2024-05-09T06:03:30.155 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.155 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.155 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.155 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.155 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:30.156 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:30.156 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:30.156 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:30.156 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.156 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:30.156 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.156 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.156 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.156 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.156 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.156 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.156 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.156 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.156 INFO:teuthology.orchestra.run.smithi039.stdout: "ssl": { 2024-05-09T06:03:30.157 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ssl", 2024-05-09T06:03:30.157 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.157 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.157 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.157 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "false", 2024-05-09T06:03:30.157 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.157 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.157 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.157 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-05-09T06:03:30.157 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.157 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.157 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.157 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.157 INFO:teuthology.orchestra.run.smithi039.stdout: "threads": { 2024-05-09T06:03:30.158 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "threads", 2024-05-09T06:03:30.158 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:30.158 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.158 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.158 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "5", 2024-05-09T06:03:30.158 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "1", 2024-05-09T06:03:30.158 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "32", 2024-05-09T06:03:30.158 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.158 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-05-09T06:03:30.158 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.158 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.158 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.158 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.158 INFO:teuthology.orchestra.run.smithi039.stdout: "username": { 2024-05-09T06:03:30.159 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "username", 2024-05-09T06:03:30.159 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.159 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.159 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.159 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:30.159 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.159 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.159 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.159 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "username of InfluxDB server user", 2024-05-09T06:03:30.159 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.159 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.159 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.159 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.159 INFO:teuthology.orchestra.run.smithi039.stdout: "verify_ssl": { 2024-05-09T06:03:30.160 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "verify_ssl", 2024-05-09T06:03:30.160 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.160 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.160 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.160 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "true", 2024-05-09T06:03:30.160 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.160 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.160 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.160 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-05-09T06:03:30.160 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.160 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.160 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.160 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:30.160 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:30.161 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.161 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:30.161 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "insights", 2024-05-09T06:03:30.161 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-05-09T06:03:30.161 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-05-09T06:03:30.161 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:30.161 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:30.161 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:30.161 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.161 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.161 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.161 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:30.161 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.161 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.161 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:30.162 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:30.162 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:30.162 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:30.162 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:30.162 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:30.162 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:30.162 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:30.162 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.162 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.162 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.162 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.162 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.162 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:30.163 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:30.163 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.163 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.163 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.163 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:30.163 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.163 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.163 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.163 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.163 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.163 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.163 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.163 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.163 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:30.163 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:30.164 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.164 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.164 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.164 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:30.164 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.164 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.164 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:30.164 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:30.164 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:30.164 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:30.164 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:30.164 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:30.164 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:30.164 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:30.165 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.165 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.165 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.165 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.165 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.165 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:30.165 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:30.165 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.165 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.165 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.165 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:30.165 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.165 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.165 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.165 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.166 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.166 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.166 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.166 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.166 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:30.166 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:30.166 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:30.166 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:30.166 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.166 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:30.166 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.166 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.166 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.167 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.167 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.167 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.167 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.167 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:30.167 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:30.167 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.167 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:30.167 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "iostat", 2024-05-09T06:03:30.167 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-05-09T06:03:30.167 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-05-09T06:03:30.167 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:30.167 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:30.167 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:30.167 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.168 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.168 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.168 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:30.168 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.168 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.168 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:30.168 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:30.168 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:30.168 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:30.168 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:30.168 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:30.168 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:30.168 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:30.168 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.169 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.169 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.169 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.169 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.169 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:30.169 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:30.169 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.169 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.169 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.169 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:30.169 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.169 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.169 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.169 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.170 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.170 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.170 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.170 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.170 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:30.170 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:30.170 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.170 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.170 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.170 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:30.170 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.170 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.170 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:30.170 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:30.171 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:30.171 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:30.171 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:30.171 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:30.171 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:30.171 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:30.171 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.171 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.171 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.171 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.171 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.171 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:30.171 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:30.171 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.172 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.172 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.172 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:30.172 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.172 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.172 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.172 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.172 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.172 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.172 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.172 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.172 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:30.172 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:30.172 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:30.172 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:30.173 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.173 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:30.173 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.173 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.173 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.173 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.173 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.173 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.173 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.173 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:30.173 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:30.173 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.173 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:30.173 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "k8sevents", 2024-05-09T06:03:30.174 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-05-09T06:03:30.174 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-05-09T06:03:30.174 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:30.174 INFO:teuthology.orchestra.run.smithi039.stdout: "ceph_event_retention_days": { 2024-05-09T06:03:30.174 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "ceph_event_retention_days", 2024-05-09T06:03:30.174 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:30.174 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.174 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.174 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "7", 2024-05-09T06:03:30.174 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.174 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.174 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.174 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Days to hold ceph event information within local cache", 2024-05-09T06:03:30.174 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.175 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.175 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.175 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.175 INFO:teuthology.orchestra.run.smithi039.stdout: "config_check_secs": { 2024-05-09T06:03:30.175 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "config_check_secs", 2024-05-09T06:03:30.175 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:30.175 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.175 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.175 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10", 2024-05-09T06:03:30.175 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "10", 2024-05-09T06:03:30.175 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.175 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.175 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-05-09T06:03:30.175 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.176 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.176 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.176 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.176 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:30.176 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:30.176 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.176 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.176 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.176 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:30.176 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.176 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.176 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:30.176 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:30.176 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:30.177 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:30.177 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:30.177 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:30.177 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:30.177 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:30.177 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.177 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.177 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.177 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.177 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.177 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:30.177 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:30.177 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.177 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.178 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.178 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:30.178 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.178 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.178 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.178 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.178 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.178 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.178 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.178 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.178 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:30.178 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:30.178 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.178 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.179 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.179 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:30.179 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.179 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.179 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:30.179 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:30.179 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:30.179 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:30.179 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:30.179 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:30.179 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:30.179 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:30.179 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.179 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.180 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.180 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.180 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.180 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:30.180 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:30.180 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.180 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.180 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.180 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:30.180 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.180 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.180 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.180 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.180 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.181 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.181 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.181 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.181 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:30.181 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:30.181 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:30.181 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:30.181 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.181 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:30.181 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.181 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.181 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.181 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.181 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.181 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.182 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.182 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:30.182 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:30.182 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.182 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:30.182 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "localpool", 2024-05-09T06:03:30.182 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-05-09T06:03:30.182 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-05-09T06:03:30.182 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:30.182 INFO:teuthology.orchestra.run.smithi039.stdout: "failure_domain": { 2024-05-09T06:03:30.182 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "failure_domain", 2024-05-09T06:03:30.182 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.182 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.182 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.183 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "host", 2024-05-09T06:03:30.183 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.183 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.183 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.183 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "failure domain for any created local pool", 2024-05-09T06:03:30.183 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-05-09T06:03:30.183 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.183 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.183 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.183 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:30.183 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:30.183 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.183 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.183 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.183 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:30.184 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.184 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.184 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:30.184 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:30.184 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:30.184 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:30.184 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:30.184 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:30.184 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:30.184 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:30.184 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.184 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.184 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.184 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.185 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.185 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:30.185 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:30.185 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.185 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.185 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.185 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:30.185 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.185 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.185 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.185 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.185 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.185 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.186 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.186 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.186 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:30.186 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:30.186 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.186 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.186 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.186 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:30.186 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.186 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.186 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:30.186 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:30.186 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:30.186 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:30.187 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:30.187 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:30.187 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:30.187 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:30.187 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.187 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.187 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.187 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.187 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.187 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:30.187 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:30.187 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.187 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.187 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.188 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:30.188 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.188 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.188 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.188 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.188 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.188 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.188 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.188 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.188 INFO:teuthology.orchestra.run.smithi039.stdout: "min_size": { 2024-05-09T06:03:30.188 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "min_size", 2024-05-09T06:03:30.188 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:30.188 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.188 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.188 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:30.189 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.189 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.189 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.189 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "default min_size for any created local pool", 2024-05-09T06:03:30.189 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-05-09T06:03:30.189 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.189 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.189 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.189 INFO:teuthology.orchestra.run.smithi039.stdout: "num_rep": { 2024-05-09T06:03:30.189 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "num_rep", 2024-05-09T06:03:30.189 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:30.189 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.189 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.189 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "3", 2024-05-09T06:03:30.190 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.190 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.190 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.190 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "default replica count for any created local pool", 2024-05-09T06:03:30.190 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.190 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.190 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.190 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.190 INFO:teuthology.orchestra.run.smithi039.stdout: "pg_num": { 2024-05-09T06:03:30.190 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "pg_num", 2024-05-09T06:03:30.190 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:30.190 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.190 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.190 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "128", 2024-05-09T06:03:30.191 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.191 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.191 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.191 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "default pg_num for any created local pool", 2024-05-09T06:03:30.191 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.191 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.191 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.191 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.191 INFO:teuthology.orchestra.run.smithi039.stdout: "prefix": { 2024-05-09T06:03:30.191 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "prefix", 2024-05-09T06:03:30.191 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.191 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.191 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.191 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:30.192 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.192 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.192 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.192 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "name prefix for any created local pool", 2024-05-09T06:03:30.192 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.192 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.192 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.192 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.192 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:30.192 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:30.192 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:30.192 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:30.192 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.192 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:30.193 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.193 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.193 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.193 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.193 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.193 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.193 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.193 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.193 INFO:teuthology.orchestra.run.smithi039.stdout: "subtree": { 2024-05-09T06:03:30.193 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "subtree", 2024-05-09T06:03:30.193 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.193 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.193 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.193 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "rack", 2024-05-09T06:03:30.193 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.194 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.194 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.194 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "CRUSH level for which to create a local pool", 2024-05-09T06:03:30.194 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-05-09T06:03:30.194 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.194 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.194 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:30.194 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:30.194 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.194 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:30.194 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "mds_autoscaler", 2024-05-09T06:03:30.194 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-05-09T06:03:30.194 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-05-09T06:03:30.194 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:30.195 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:30.195 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:30.195 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.195 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.195 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.195 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:30.195 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.195 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.195 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:30.195 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:30.195 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:30.195 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:30.195 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:30.195 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:30.196 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:30.196 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:30.196 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.196 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.196 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.196 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.196 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.196 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:30.196 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:30.196 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.196 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.196 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.196 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:30.196 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.196 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.197 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.197 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.197 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.197 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.197 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.197 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.197 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:30.197 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:30.197 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.197 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.197 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.197 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:30.197 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.197 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.198 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:30.198 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:30.198 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:30.198 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:30.198 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:30.198 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:30.198 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:30.198 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:30.198 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.198 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.198 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.198 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.198 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.198 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:30.199 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:30.199 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.199 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.199 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.199 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:30.199 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.199 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.199 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.199 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.199 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.199 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.199 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.199 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.199 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:30.200 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:30.200 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:30.200 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:30.200 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.200 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:30.200 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.200 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.200 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.200 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.200 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.200 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.200 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.200 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:30.200 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:30.201 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.201 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:30.201 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "mirroring", 2024-05-09T06:03:30.201 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-05-09T06:03:30.201 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-05-09T06:03:30.201 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:30.201 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:30.201 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:30.201 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.201 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.201 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.201 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:30.201 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.201 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.201 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:30.202 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:30.202 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:30.202 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:30.202 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:30.202 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:30.202 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:30.202 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:30.202 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.202 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.202 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.202 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.202 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.202 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:30.203 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:30.203 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.203 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.203 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.203 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:30.203 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.203 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.203 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.203 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.203 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.203 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.203 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.203 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.203 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:30.203 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:30.204 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.204 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.204 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.204 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:30.204 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.204 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.204 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:30.204 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:30.204 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:30.204 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:30.204 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:30.204 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:30.204 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:30.204 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:30.205 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.205 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.205 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.205 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.205 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.205 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:30.205 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:30.205 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.205 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.205 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.205 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:30.205 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.205 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.205 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.206 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.206 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.206 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.206 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.206 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.206 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:30.206 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:30.206 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:30.206 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:30.206 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.206 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:30.206 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.206 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.207 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.207 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.207 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.207 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.207 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.207 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:30.207 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:30.207 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.207 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:30.207 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "nfs", 2024-05-09T06:03:30.207 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-05-09T06:03:30.207 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-05-09T06:03:30.207 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:30.207 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:30.208 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:30.208 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.208 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.208 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.208 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:30.208 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.208 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.208 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:30.208 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:30.208 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:30.208 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:30.208 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:30.208 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:30.208 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:30.208 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:30.209 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.209 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.209 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.209 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.209 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.209 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:30.209 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:30.209 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.209 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.209 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.209 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:30.209 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.209 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.209 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.210 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.210 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.210 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.210 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.210 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.210 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:30.210 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:30.210 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.210 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.210 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.210 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:30.210 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.210 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.210 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:30.211 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:30.211 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:30.211 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:30.211 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:30.211 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:30.211 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:30.211 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:30.211 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.211 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.211 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.211 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.211 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.211 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:30.211 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:30.212 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.212 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.212 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.212 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:30.212 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.212 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.212 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.212 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.212 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.212 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.212 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.212 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.212 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:30.213 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:30.213 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:30.213 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:30.213 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.213 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:30.213 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.213 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.213 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.213 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.213 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.213 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.213 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.213 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:30.213 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:30.214 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.214 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:30.214 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "orchestrator", 2024-05-09T06:03:30.214 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-05-09T06:03:30.214 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-05-09T06:03:30.214 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:30.214 INFO:teuthology.orchestra.run.smithi039.stdout: "fail_fs": { 2024-05-09T06:03:30.214 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "fail_fs", 2024-05-09T06:03:30.214 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.214 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.214 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.214 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:30.214 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.215 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.215 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.215 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-05-09T06:03:30.215 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.215 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.215 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.215 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.215 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:30.215 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:30.215 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.215 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.215 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.215 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:30.215 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.215 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.216 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:30.216 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:30.216 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:30.216 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:30.216 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:30.216 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:30.216 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:30.216 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:30.216 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.216 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.216 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.216 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.216 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.216 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:30.216 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:30.217 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.217 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.217 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.217 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:30.217 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.217 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.217 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.217 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.217 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.217 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.217 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.217 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.217 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:30.217 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:30.218 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.218 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.218 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.218 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:30.218 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.218 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.218 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:30.218 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:30.218 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:30.218 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:30.218 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:30.218 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:30.218 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:30.219 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:30.219 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.219 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.219 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.219 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.219 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.219 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:30.219 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:30.219 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.219 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.219 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.219 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:30.219 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.219 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.219 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.220 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.220 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.220 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.220 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.220 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.220 INFO:teuthology.orchestra.run.smithi039.stdout: "orchestrator": { 2024-05-09T06:03:30.220 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "orchestrator", 2024-05-09T06:03:30.220 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.220 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.220 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.220 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:30.220 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.220 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.220 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:30.221 INFO:teuthology.orchestra.run.smithi039.stdout: "cephadm", 2024-05-09T06:03:30.221 INFO:teuthology.orchestra.run.smithi039.stdout: "rook", 2024-05-09T06:03:30.221 INFO:teuthology.orchestra.run.smithi039.stdout: "test_orchestrator" 2024-05-09T06:03:30.221 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:30.221 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Orchestrator backend", 2024-05-09T06:03:30.221 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.221 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.221 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.221 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.221 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:30.221 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:30.221 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:30.221 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:30.221 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.222 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:30.222 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.222 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.222 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.222 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.222 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.222 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.222 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.222 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:30.222 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:30.222 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.222 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:30.222 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "osd_perf_query", 2024-05-09T06:03:30.222 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-05-09T06:03:30.223 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-05-09T06:03:30.223 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:30.223 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:30.223 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:30.223 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.223 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.223 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.223 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:30.223 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.223 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.223 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:30.223 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:30.223 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:30.223 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:30.224 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:30.224 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:30.224 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:30.224 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:30.224 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.224 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.224 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.224 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.224 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.224 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:30.224 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:30.224 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.224 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.224 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.225 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:30.225 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.225 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.225 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.225 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.225 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.225 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.225 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.225 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.225 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:30.225 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:30.225 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.225 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.225 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.225 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:30.226 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.226 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.226 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:30.226 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:30.226 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:30.226 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:30.226 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:30.226 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:30.226 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:30.226 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:30.226 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.226 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.226 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.227 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.227 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.227 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:30.227 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:30.227 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.227 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.227 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.227 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:30.227 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.227 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.227 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.227 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.227 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.227 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.228 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.228 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.228 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:30.228 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:30.228 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:30.228 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:30.228 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.228 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:30.228 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.228 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.228 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.228 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.228 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.228 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.228 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.229 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:30.229 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:30.229 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.229 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:30.229 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "osd_support", 2024-05-09T06:03:30.229 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-05-09T06:03:30.229 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-05-09T06:03:30.229 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:30.229 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:30.229 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:30.229 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.229 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.229 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.229 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:30.230 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.230 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.230 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:30.230 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:30.230 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:30.230 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:30.230 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:30.230 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:30.230 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:30.230 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:30.230 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.230 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.230 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.231 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.231 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.231 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:30.231 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:30.231 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.231 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.231 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.231 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:30.231 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.231 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.231 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.231 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.231 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.232 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.232 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.232 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.232 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:30.232 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:30.232 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.232 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.232 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.232 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:30.232 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.232 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.232 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:30.232 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:30.232 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:30.233 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:30.233 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:30.233 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:30.233 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:30.233 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:30.233 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.233 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.233 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.233 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.233 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.233 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:30.233 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:30.233 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.233 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.233 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.234 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:30.234 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.234 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.234 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.234 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.234 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.234 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.234 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.234 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.234 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:30.234 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:30.234 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:30.234 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:30.235 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.235 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:30.235 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.235 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.235 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.235 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.235 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.235 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.235 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.235 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:30.235 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:30.235 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.235 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:30.235 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "pg_autoscaler", 2024-05-09T06:03:30.235 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-05-09T06:03:30.235 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-05-09T06:03:30.236 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:30.236 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:30.236 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:30.236 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.236 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.236 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.236 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:30.236 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.236 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.236 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:30.236 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:30.236 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:30.236 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:30.236 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:30.237 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:30.237 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:30.237 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:30.237 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.237 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.237 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.237 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.237 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.237 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:30.237 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:30.237 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.237 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.237 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.237 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:30.237 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.238 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.238 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.238 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.238 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.238 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.238 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.238 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.238 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:30.238 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:30.238 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.238 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.238 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.238 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:30.238 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.239 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.239 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:30.239 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:30.239 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:30.239 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:30.239 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:30.239 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:30.239 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:30.239 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:30.239 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.239 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.239 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.239 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.239 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.239 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:30.240 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:30.240 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.240 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.240 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.240 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:30.240 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.240 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.240 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.240 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.240 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.240 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.240 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.240 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.240 INFO:teuthology.orchestra.run.smithi039.stdout: "sleep_interval": { 2024-05-09T06:03:30.241 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sleep_interval", 2024-05-09T06:03:30.241 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-05-09T06:03:30.241 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.241 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.241 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "60", 2024-05-09T06:03:30.241 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.241 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.241 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.241 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.241 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.241 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.241 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.241 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.241 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:30.242 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:30.242 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:30.242 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:30.242 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.242 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:30.242 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.242 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.242 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.242 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.242 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.242 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.242 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.242 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.243 INFO:teuthology.orchestra.run.smithi039.stdout: "threshold": { 2024-05-09T06:03:30.243 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "threshold", 2024-05-09T06:03:30.243 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "float", 2024-05-09T06:03:30.243 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.243 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.243 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "3.0", 2024-05-09T06:03:30.243 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "1.0", 2024-05-09T06:03:30.243 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.243 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.243 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "scaling threshold", 2024-05-09T06:03:30.243 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-05-09T06:03:30.243 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.243 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.243 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:30.243 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:30.244 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.244 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:30.244 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "progress", 2024-05-09T06:03:30.244 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-05-09T06:03:30.244 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-05-09T06:03:30.244 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:30.244 INFO:teuthology.orchestra.run.smithi039.stdout: "allow_pg_recovery_event": { 2024-05-09T06:03:30.244 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "allow_pg_recovery_event", 2024-05-09T06:03:30.244 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.244 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.244 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.244 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:30.244 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.244 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.244 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.244 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "allow the module to show pg recovery progress", 2024-05-09T06:03:30.245 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.245 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.245 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.245 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.245 INFO:teuthology.orchestra.run.smithi039.stdout: "enabled": { 2024-05-09T06:03:30.245 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "enabled", 2024-05-09T06:03:30.245 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.245 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.245 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.245 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:30.245 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.245 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.245 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.245 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.245 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.246 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.246 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.246 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.246 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:30.246 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:30.246 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.246 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.246 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.246 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:30.246 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.246 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.246 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:30.246 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:30.247 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:30.247 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:30.247 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:30.247 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:30.247 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:30.247 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:30.247 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.247 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.247 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.247 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.247 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.247 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:30.247 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:30.247 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.248 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.248 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.248 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:30.248 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.248 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.248 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.248 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.248 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.248 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.248 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.248 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.248 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:30.248 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:30.248 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.248 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.249 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.249 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:30.249 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.249 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.249 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:30.249 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:30.249 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:30.249 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:30.249 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:30.249 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:30.249 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:30.249 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:30.249 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.249 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.250 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.250 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.250 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.250 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:30.250 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:30.250 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.250 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.250 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.250 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:30.250 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.250 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.250 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.250 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.250 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.251 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.251 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.251 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.251 INFO:teuthology.orchestra.run.smithi039.stdout: "max_completed_events": { 2024-05-09T06:03:30.251 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "max_completed_events", 2024-05-09T06:03:30.251 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:30.251 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.251 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.251 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "50", 2024-05-09T06:03:30.251 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.251 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.251 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.251 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "number of past completed events to remember", 2024-05-09T06:03:30.251 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.253 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.253 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.253 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.253 INFO:teuthology.orchestra.run.smithi039.stdout: "sleep_interval": { 2024-05-09T06:03:30.253 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sleep_interval", 2024-05-09T06:03:30.253 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-05-09T06:03:30.253 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.253 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.254 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "5", 2024-05-09T06:03:30.254 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.254 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.254 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.254 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "how long the module is going to sleep", 2024-05-09T06:03:30.254 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.254 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.254 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.254 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.254 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:30.254 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:30.254 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:30.254 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:30.254 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.255 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:30.255 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.255 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.255 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.255 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.255 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.255 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.255 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.255 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:30.255 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:30.255 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.255 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:30.255 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "prometheus", 2024-05-09T06:03:30.256 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-05-09T06:03:30.256 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-05-09T06:03:30.256 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:30.256 INFO:teuthology.orchestra.run.smithi039.stdout: "cache": { 2024-05-09T06:03:30.256 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "cache", 2024-05-09T06:03:30.256 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.256 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.256 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.256 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:30.256 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.256 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.256 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.256 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.256 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.257 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.257 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.257 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.257 INFO:teuthology.orchestra.run.smithi039.stdout: "exclude_perf_counters": { 2024-05-09T06:03:30.257 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "exclude_perf_counters", 2024-05-09T06:03:30.257 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.257 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.257 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.257 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:30.257 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.257 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.257 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.257 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-05-09T06:03:30.257 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-05-09T06:03:30.258 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.258 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.258 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.258 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:30.258 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:30.258 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.258 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.258 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.258 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:30.258 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.258 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.258 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:30.258 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:30.258 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:30.259 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:30.259 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:30.259 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:30.259 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:30.259 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:30.259 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.259 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.259 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.259 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.259 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.259 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:30.259 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:30.259 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.260 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.260 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.260 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:30.260 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.260 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.260 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.260 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.260 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.260 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.260 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.260 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.260 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:30.260 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:30.260 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.261 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.261 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.261 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:30.261 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.261 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.261 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:30.261 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:30.261 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:30.261 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:30.261 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:30.261 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:30.261 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:30.261 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:30.261 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.261 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.262 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.262 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.262 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.262 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:30.262 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:30.262 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.262 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.262 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.262 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:30.262 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.262 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.262 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.262 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.262 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.263 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.263 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.263 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.263 INFO:teuthology.orchestra.run.smithi039.stdout: "rbd_stats_pools": { 2024-05-09T06:03:30.263 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rbd_stats_pools", 2024-05-09T06:03:30.263 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.263 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.263 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.263 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:30.263 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.263 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.263 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.263 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.263 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.264 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.264 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.264 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.264 INFO:teuthology.orchestra.run.smithi039.stdout: "rbd_stats_pools_refresh_interval": { 2024-05-09T06:03:30.264 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-05-09T06:03:30.264 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:30.264 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.264 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.264 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "300", 2024-05-09T06:03:30.264 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.264 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.264 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.264 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.264 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.264 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.264 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.265 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.265 INFO:teuthology.orchestra.run.smithi039.stdout: "scrape_interval": { 2024-05-09T06:03:30.265 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "scrape_interval", 2024-05-09T06:03:30.265 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "float", 2024-05-09T06:03:30.265 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.265 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.265 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "15.0", 2024-05-09T06:03:30.265 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.265 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.265 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.265 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.265 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.265 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.265 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.265 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.266 INFO:teuthology.orchestra.run.smithi039.stdout: "server_addr": { 2024-05-09T06:03:30.266 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "server_addr", 2024-05-09T06:03:30.266 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.266 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.266 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.266 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "::", 2024-05-09T06:03:30.266 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.266 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.266 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.266 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-05-09T06:03:30.266 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.266 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.266 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.266 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.267 INFO:teuthology.orchestra.run.smithi039.stdout: "server_port": { 2024-05-09T06:03:30.267 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "server_port", 2024-05-09T06:03:30.267 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:30.267 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.267 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.267 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "9283", 2024-05-09T06:03:30.267 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.267 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.267 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.267 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-05-09T06:03:30.267 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.267 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.267 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.267 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.267 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:30.267 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:30.268 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:30.268 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:30.268 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.268 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:30.268 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.268 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.268 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.268 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.268 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.268 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.268 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.268 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.268 INFO:teuthology.orchestra.run.smithi039.stdout: "stale_cache_strategy": { 2024-05-09T06:03:30.268 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "stale_cache_strategy", 2024-05-09T06:03:30.268 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.269 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.269 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.269 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "log", 2024-05-09T06:03:30.269 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.269 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.269 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.269 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.269 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.269 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.269 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.269 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.269 INFO:teuthology.orchestra.run.smithi039.stdout: "standby_behaviour": { 2024-05-09T06:03:30.269 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "standby_behaviour", 2024-05-09T06:03:30.269 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.270 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.270 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.270 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "default", 2024-05-09T06:03:30.270 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.270 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.270 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:30.270 INFO:teuthology.orchestra.run.smithi039.stdout: "default", 2024-05-09T06:03:30.270 INFO:teuthology.orchestra.run.smithi039.stdout: "error" 2024-05-09T06:03:30.270 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:30.270 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.270 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.270 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.270 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.270 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.271 INFO:teuthology.orchestra.run.smithi039.stdout: "standby_error_status_code": { 2024-05-09T06:03:30.271 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "standby_error_status_code", 2024-05-09T06:03:30.271 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:30.271 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.271 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.271 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "500", 2024-05-09T06:03:30.271 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "400", 2024-05-09T06:03:30.271 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "599", 2024-05-09T06:03:30.271 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.271 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.271 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.271 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.271 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.271 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:30.271 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:30.272 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.272 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:30.272 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rbd_support", 2024-05-09T06:03:30.272 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-05-09T06:03:30.272 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-05-09T06:03:30.272 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:30.272 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:30.272 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:30.272 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.272 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.272 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.272 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:30.272 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.272 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.273 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:30.273 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:30.273 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:30.273 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:30.273 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:30.273 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:30.273 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:30.273 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:30.273 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.273 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.273 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.273 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.273 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.273 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:30.273 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:30.274 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.274 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.274 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.274 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:30.274 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.274 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.274 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.274 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.274 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.274 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.274 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.274 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.274 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:30.275 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:30.275 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.275 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.275 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.275 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:30.275 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.275 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.275 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:30.275 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:30.275 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:30.275 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:30.275 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:30.275 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:30.275 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:30.276 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:30.276 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.276 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.276 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.276 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.276 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.276 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:30.276 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:30.276 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.276 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.276 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.276 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:30.276 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.277 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.277 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.277 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.277 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.277 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.277 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.277 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.277 INFO:teuthology.orchestra.run.smithi039.stdout: "max_concurrent_snap_create": { 2024-05-09T06:03:30.277 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "max_concurrent_snap_create", 2024-05-09T06:03:30.277 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:30.277 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.277 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.277 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10", 2024-05-09T06:03:30.277 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.278 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.278 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.278 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.278 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.278 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.278 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.278 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.278 INFO:teuthology.orchestra.run.smithi039.stdout: "mirror_snapshot_schedule": { 2024-05-09T06:03:30.278 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "mirror_snapshot_schedule", 2024-05-09T06:03:30.278 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.278 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.278 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.278 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:30.278 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.279 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.279 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.279 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.279 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.279 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.279 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.279 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.279 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:30.279 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:30.279 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:30.279 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:30.279 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.279 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:30.279 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.280 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.280 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.280 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.280 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.280 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.280 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.280 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.280 INFO:teuthology.orchestra.run.smithi039.stdout: "trash_purge_schedule": { 2024-05-09T06:03:30.280 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "trash_purge_schedule", 2024-05-09T06:03:30.280 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.280 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.280 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.280 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:30.280 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.281 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.281 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.281 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.281 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.281 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.281 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.281 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:30.281 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:30.281 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.281 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:30.281 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "restful", 2024-05-09T06:03:30.281 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-05-09T06:03:30.281 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-05-09T06:03:30.281 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:30.282 INFO:teuthology.orchestra.run.smithi039.stdout: "enable_auth": { 2024-05-09T06:03:30.282 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "enable_auth", 2024-05-09T06:03:30.282 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.282 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.282 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.282 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:30.282 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.282 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.282 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.282 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.282 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.282 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.282 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.282 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.283 INFO:teuthology.orchestra.run.smithi039.stdout: "key_file": { 2024-05-09T06:03:30.283 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "key_file", 2024-05-09T06:03:30.283 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.283 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.283 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.283 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:30.283 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.283 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.283 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.283 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.283 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.283 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.283 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.283 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.284 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:30.284 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:30.284 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.284 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.284 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.284 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:30.284 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.284 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.284 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:30.284 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:30.284 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:30.284 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:30.284 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:30.284 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:30.285 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:30.285 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:30.285 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.285 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.285 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.285 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.285 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.285 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:30.285 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:30.285 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.285 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.285 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.285 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:30.286 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.286 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.286 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.286 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.286 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.286 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.286 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.286 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.286 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:30.286 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:30.286 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.286 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.286 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.286 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:30.287 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.287 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.287 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:30.287 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:30.287 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:30.287 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:30.287 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:30.287 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:30.287 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:30.287 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:30.287 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.287 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.287 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.287 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.288 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.288 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:30.288 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:30.288 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.288 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.288 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.288 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:30.288 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.288 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.288 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.288 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.288 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.288 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.288 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.289 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.289 INFO:teuthology.orchestra.run.smithi039.stdout: "server_addr": { 2024-05-09T06:03:30.289 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "server_addr", 2024-05-09T06:03:30.289 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.289 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.289 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.289 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:30.289 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.289 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.289 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.289 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.289 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.289 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.289 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.289 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.289 INFO:teuthology.orchestra.run.smithi039.stdout: "server_port": { 2024-05-09T06:03:30.290 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "server_port", 2024-05-09T06:03:30.290 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.290 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.290 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.290 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:30.290 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.290 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.290 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.290 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.290 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.290 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.290 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.290 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.291 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:30.291 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:30.291 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:30.291 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:30.291 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.291 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:30.291 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.291 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.291 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.291 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.291 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.291 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.291 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.291 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:30.292 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:30.292 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.292 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:30.292 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rgw", 2024-05-09T06:03:30.292 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-05-09T06:03:30.292 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-05-09T06:03:30.292 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:30.292 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:30.292 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:30.292 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.292 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.292 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.292 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:30.292 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.293 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.293 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:30.293 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:30.293 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:30.293 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:30.293 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:30.293 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:30.293 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:30.293 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:30.293 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.293 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.293 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.293 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.293 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.293 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:30.293 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:30.294 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.294 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.294 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.294 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:30.294 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.294 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.294 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.294 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.294 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.294 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.294 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.294 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.294 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:30.294 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:30.295 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.295 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.295 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.295 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:30.295 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.295 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.295 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:30.295 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:30.295 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:30.295 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:30.295 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:30.295 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:30.295 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:30.295 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:30.296 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.296 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.296 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.296 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.296 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.296 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:30.296 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:30.296 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.296 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.296 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.296 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:30.296 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.296 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.296 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.297 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.297 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.297 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.297 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.297 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.297 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:30.297 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:30.297 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:30.297 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:30.297 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.297 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:30.297 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.297 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.297 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.298 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.298 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.298 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.298 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.298 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:30.298 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:30.298 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.298 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:30.298 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rook", 2024-05-09T06:03:30.298 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-05-09T06:03:30.298 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-05-09T06:03:30.298 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:30.298 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:30.298 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:30.299 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.299 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.299 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.299 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:30.299 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.299 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.299 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:30.299 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:30.299 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:30.299 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:30.299 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:30.299 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:30.299 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:30.299 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:30.300 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.300 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.300 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.300 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.300 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.300 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:30.300 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:30.300 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.300 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.300 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.300 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:30.300 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.300 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.300 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.300 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.301 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.301 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.301 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.301 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.301 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:30.301 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:30.301 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.301 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.301 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.301 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:30.301 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.301 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.301 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:30.301 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:30.302 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:30.302 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:30.302 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:30.302 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:30.302 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:30.302 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:30.302 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.302 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.302 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.302 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.302 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.302 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:30.302 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:30.302 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.303 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.303 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.303 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:30.303 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.303 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.303 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.303 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.303 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.303 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.303 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.303 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.303 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:30.303 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:30.303 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:30.304 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:30.304 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.304 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:30.304 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.304 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.304 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.304 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.304 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.304 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.304 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.304 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.304 INFO:teuthology.orchestra.run.smithi039.stdout: "storage_class": { 2024-05-09T06:03:30.304 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "storage_class", 2024-05-09T06:03:30.304 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.305 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.305 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.305 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "local", 2024-05-09T06:03:30.305 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.305 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.305 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.305 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-05-09T06:03:30.305 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.305 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.305 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.305 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:30.305 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:30.305 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.305 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:30.305 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "selftest", 2024-05-09T06:03:30.306 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-05-09T06:03:30.306 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-05-09T06:03:30.306 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:30.306 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:30.306 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:30.306 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.306 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.306 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.306 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:30.306 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.306 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.306 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:30.306 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:30.307 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:30.307 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:30.307 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:30.307 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:30.307 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:30.307 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:30.307 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.307 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.307 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.307 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.307 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.307 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:30.307 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:30.307 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.308 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.308 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.308 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:30.308 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.308 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.308 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.308 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.308 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.308 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.308 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.308 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.308 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:30.308 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:30.309 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.309 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.309 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.309 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:30.309 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.309 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.309 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:30.309 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:30.309 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:30.309 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:30.309 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:30.309 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:30.309 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:30.309 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:30.310 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.310 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.310 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.310 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.310 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.310 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:30.310 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:30.310 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.310 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.310 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.310 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:30.310 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.310 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.311 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.311 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.311 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.311 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.311 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.311 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.311 INFO:teuthology.orchestra.run.smithi039.stdout: "roption1": { 2024-05-09T06:03:30.311 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "roption1", 2024-05-09T06:03:30.311 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.311 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.311 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.311 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:30.311 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.311 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.312 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.312 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.312 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.312 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.312 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.312 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.312 INFO:teuthology.orchestra.run.smithi039.stdout: "roption2": { 2024-05-09T06:03:30.312 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "roption2", 2024-05-09T06:03:30.312 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.312 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.312 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.312 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "xyz", 2024-05-09T06:03:30.312 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.312 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.313 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.313 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.313 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.313 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.313 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.313 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.313 INFO:teuthology.orchestra.run.smithi039.stdout: "rwoption1": { 2024-05-09T06:03:30.313 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rwoption1", 2024-05-09T06:03:30.313 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.313 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.313 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.313 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:30.313 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.313 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.313 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.314 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.314 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.314 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.314 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.314 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.314 INFO:teuthology.orchestra.run.smithi039.stdout: "rwoption2": { 2024-05-09T06:03:30.314 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rwoption2", 2024-05-09T06:03:30.314 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:30.314 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.314 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.314 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:30.314 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.314 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.314 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.315 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.315 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.315 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.315 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.315 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.315 INFO:teuthology.orchestra.run.smithi039.stdout: "rwoption3": { 2024-05-09T06:03:30.315 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rwoption3", 2024-05-09T06:03:30.315 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "float", 2024-05-09T06:03:30.315 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.315 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.315 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:30.315 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.315 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.315 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.316 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.316 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.316 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.316 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.316 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.316 INFO:teuthology.orchestra.run.smithi039.stdout: "rwoption4": { 2024-05-09T06:03:30.316 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rwoption4", 2024-05-09T06:03:30.316 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.316 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.316 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.316 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:30.316 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.316 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.316 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.316 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.316 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.317 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.317 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.317 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.317 INFO:teuthology.orchestra.run.smithi039.stdout: "rwoption5": { 2024-05-09T06:03:30.317 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rwoption5", 2024-05-09T06:03:30.317 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.317 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.317 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.317 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:30.317 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.317 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.317 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.317 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.317 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.317 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.317 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.318 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.318 INFO:teuthology.orchestra.run.smithi039.stdout: "rwoption6": { 2024-05-09T06:03:30.318 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rwoption6", 2024-05-09T06:03:30.318 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.318 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.318 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.318 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:30.318 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.318 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.318 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.318 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.318 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.318 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.318 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.319 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.319 INFO:teuthology.orchestra.run.smithi039.stdout: "rwoption7": { 2024-05-09T06:03:30.319 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rwoption7", 2024-05-09T06:03:30.319 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:30.319 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.319 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.319 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:30.319 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "1", 2024-05-09T06:03:30.319 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "42", 2024-05-09T06:03:30.319 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.319 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.319 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.319 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.319 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.319 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.319 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:30.320 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:30.320 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:30.320 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:30.320 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.320 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:30.320 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.320 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.320 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.320 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.320 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.320 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.320 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.320 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.320 INFO:teuthology.orchestra.run.smithi039.stdout: "testkey": { 2024-05-09T06:03:30.320 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "testkey", 2024-05-09T06:03:30.320 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.321 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.321 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.321 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:30.321 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.321 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.321 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.321 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.321 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.321 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.321 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.321 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.321 INFO:teuthology.orchestra.run.smithi039.stdout: "testlkey": { 2024-05-09T06:03:30.321 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "testlkey", 2024-05-09T06:03:30.321 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.321 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.321 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.322 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:30.322 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.322 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.322 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.322 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.322 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.322 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.322 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.322 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.322 INFO:teuthology.orchestra.run.smithi039.stdout: "testnewline": { 2024-05-09T06:03:30.322 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "testnewline", 2024-05-09T06:03:30.322 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.322 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.322 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.323 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:30.323 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.323 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.323 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.323 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.323 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.323 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.323 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.323 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:30.323 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:30.323 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.323 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:30.323 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "smb", 2024-05-09T06:03:30.323 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-05-09T06:03:30.323 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-05-09T06:03:30.324 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:30.324 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:30.324 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:30.324 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.324 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.324 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.324 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:30.324 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.324 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.324 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:30.324 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:30.324 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:30.324 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:30.324 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:30.324 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:30.325 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:30.325 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:30.325 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.325 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.325 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.325 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.325 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.325 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:30.325 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:30.325 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.325 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.325 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.325 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:30.325 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.325 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.326 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.326 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.326 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.326 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.326 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.326 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.326 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:30.326 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:30.326 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.326 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.326 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.326 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:30.326 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.326 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.327 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:30.327 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:30.327 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:30.327 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:30.327 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:30.327 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:30.327 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:30.327 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:30.327 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.327 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.327 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.327 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.327 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.327 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:30.327 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:30.327 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.328 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.328 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.328 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:30.328 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.328 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.328 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.328 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.328 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.328 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.328 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.328 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.328 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:30.328 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:30.328 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:30.328 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:30.329 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.329 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:30.329 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.329 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.329 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.329 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.329 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.329 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.329 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.329 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.329 INFO:teuthology.orchestra.run.smithi039.stdout: "update_orchestration": { 2024-05-09T06:03:30.329 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "update_orchestration", 2024-05-09T06:03:30.329 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.329 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.330 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.330 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:30.330 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.330 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.330 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.330 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-05-09T06:03:30.330 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.330 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.330 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.330 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:30.330 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:30.330 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.330 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:30.330 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "snap_schedule", 2024-05-09T06:03:30.331 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-05-09T06:03:30.331 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-05-09T06:03:30.331 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:30.331 INFO:teuthology.orchestra.run.smithi039.stdout: "allow_m_granularity": { 2024-05-09T06:03:30.331 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "allow_m_granularity", 2024-05-09T06:03:30.331 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.331 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.331 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.331 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:30.331 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.331 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.331 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.331 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "allow minute scheduled snapshots", 2024-05-09T06:03:30.332 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.332 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.332 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.332 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.332 INFO:teuthology.orchestra.run.smithi039.stdout: "dump_on_update": { 2024-05-09T06:03:30.332 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "dump_on_update", 2024-05-09T06:03:30.332 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.332 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.332 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.332 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:30.332 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.332 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.332 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.332 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "dump database to debug log on update", 2024-05-09T06:03:30.333 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.333 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.333 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.333 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.333 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:30.333 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:30.333 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.333 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.333 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.333 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:30.333 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.333 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.333 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:30.333 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:30.334 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:30.334 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:30.334 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:30.334 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:30.334 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:30.334 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:30.334 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.334 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.334 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.334 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.334 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.334 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:30.334 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:30.334 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.335 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.335 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.335 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:30.335 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.335 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.335 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.335 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.335 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.335 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.335 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.335 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.335 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:30.335 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:30.335 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.335 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.336 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.336 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:30.336 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.336 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.336 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:30.336 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:30.336 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:30.336 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:30.336 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:30.336 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:30.336 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:30.336 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:30.336 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.336 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.337 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.337 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.337 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.337 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:30.337 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:30.337 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.337 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.337 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.337 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:30.337 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.337 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.337 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.337 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.337 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.337 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.338 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.338 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.338 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:30.338 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:30.338 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:30.338 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:30.338 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.338 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:30.338 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.338 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.338 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.338 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.338 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.338 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.339 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.339 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:30.339 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:30.339 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.339 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:30.339 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "stats", 2024-05-09T06:03:30.339 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-05-09T06:03:30.339 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-05-09T06:03:30.339 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:30.339 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:30.339 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:30.339 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.339 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.339 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.340 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:30.340 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.340 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.340 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:30.340 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:30.340 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:30.340 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:30.340 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:30.340 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:30.340 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:30.340 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:30.340 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.340 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.340 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.340 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.341 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.341 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:30.341 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:30.341 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.341 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.341 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.341 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:30.341 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.341 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.341 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.341 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.341 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.341 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.341 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.342 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.342 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:30.342 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:30.342 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.342 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.342 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.342 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:30.342 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.342 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.342 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:30.342 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:30.342 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:30.342 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:30.342 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:30.343 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:30.343 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:30.343 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:30.343 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.343 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.343 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.343 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.343 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.343 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:30.343 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:30.343 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.343 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.343 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.343 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:30.344 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.344 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.344 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.344 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.344 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.344 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.344 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.344 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.344 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:30.344 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:30.344 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:30.344 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:30.344 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.344 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:30.344 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.345 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.345 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.345 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.345 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.345 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.345 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.345 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:30.345 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:30.345 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.345 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:30.345 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "status", 2024-05-09T06:03:30.345 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-05-09T06:03:30.345 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-05-09T06:03:30.345 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:30.345 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:30.346 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:30.346 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.346 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.346 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.346 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:30.346 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.346 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.346 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:30.346 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:30.346 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:30.346 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:30.346 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:30.346 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:30.346 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:30.347 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:30.347 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.347 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.347 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.347 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.347 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.347 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:30.347 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:30.347 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.347 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.347 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.347 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:30.347 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.347 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.348 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.348 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.348 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.348 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.348 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.348 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.348 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:30.348 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:30.348 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.348 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.348 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.348 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:30.348 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.348 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.349 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:30.349 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:30.349 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:30.349 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:30.349 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:30.349 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:30.349 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:30.349 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:30.349 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.349 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.349 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.349 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.349 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.349 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:30.349 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:30.349 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.350 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.350 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.350 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:30.350 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.350 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.350 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.350 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.350 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.350 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.350 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.350 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.350 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:30.350 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:30.351 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:30.351 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:30.351 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.351 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:30.351 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.351 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.351 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.351 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.351 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.351 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.351 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.351 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:30.351 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:30.351 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.351 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:30.352 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "telegraf", 2024-05-09T06:03:30.352 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-05-09T06:03:30.352 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-05-09T06:03:30.352 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:30.352 INFO:teuthology.orchestra.run.smithi039.stdout: "address": { 2024-05-09T06:03:30.352 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "address", 2024-05-09T06:03:30.352 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.352 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.352 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.352 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-05-09T06:03:30.352 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.352 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.352 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.352 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.352 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.353 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.353 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.353 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.353 INFO:teuthology.orchestra.run.smithi039.stdout: "interval": { 2024-05-09T06:03:30.353 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "interval", 2024-05-09T06:03:30.353 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-05-09T06:03:30.353 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.353 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.353 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "15", 2024-05-09T06:03:30.353 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.353 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.353 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.353 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.353 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.354 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.354 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.354 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.354 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:30.354 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:30.354 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.354 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.354 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.354 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:30.354 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.354 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.354 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:30.354 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:30.355 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:30.355 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:30.355 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:30.355 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:30.355 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:30.355 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:30.355 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.355 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.355 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.355 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.355 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.355 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:30.355 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:30.355 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.356 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.356 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.356 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:30.356 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.356 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.356 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.356 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.356 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.356 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.356 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.356 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.356 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:30.356 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:30.356 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.356 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.357 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.357 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:30.357 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.357 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.357 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:30.357 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:30.357 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:30.357 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:30.357 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:30.357 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:30.357 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:30.357 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:30.357 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.357 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.358 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.358 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.358 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.358 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:30.358 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:30.358 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.358 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.358 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.358 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:30.358 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.358 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.358 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.358 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.358 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.358 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.359 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.359 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.359 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:30.359 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:30.359 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:30.359 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:30.359 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.359 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:30.359 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.359 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.359 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.359 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.359 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.359 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.360 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.360 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:30.360 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:30.360 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.360 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:30.360 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "telemetry", 2024-05-09T06:03:30.360 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-05-09T06:03:30.360 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-05-09T06:03:30.360 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:30.360 INFO:teuthology.orchestra.run.smithi039.stdout: "channel_basic": { 2024-05-09T06:03:30.360 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "channel_basic", 2024-05-09T06:03:30.360 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.360 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.360 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.361 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:30.361 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.361 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.361 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.361 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Share basic cluster information (size, version)", 2024-05-09T06:03:30.361 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.361 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.361 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.361 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.361 INFO:teuthology.orchestra.run.smithi039.stdout: "channel_crash": { 2024-05-09T06:03:30.361 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "channel_crash", 2024-05-09T06:03:30.361 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.361 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.361 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.362 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:30.362 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.362 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.362 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.362 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-05-09T06:03:30.362 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.362 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.362 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.362 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.362 INFO:teuthology.orchestra.run.smithi039.stdout: "channel_device": { 2024-05-09T06:03:30.362 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "channel_device", 2024-05-09T06:03:30.362 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.362 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.362 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.363 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:30.363 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.363 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.363 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.363 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-05-09T06:03:30.363 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.363 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.363 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.363 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.363 INFO:teuthology.orchestra.run.smithi039.stdout: "channel_ident": { 2024-05-09T06:03:30.363 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "channel_ident", 2024-05-09T06:03:30.363 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.363 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.363 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.364 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:30.364 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.364 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.364 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.364 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-05-09T06:03:30.364 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.364 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.364 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.364 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.364 INFO:teuthology.orchestra.run.smithi039.stdout: "channel_perf": { 2024-05-09T06:03:30.364 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "channel_perf", 2024-05-09T06:03:30.364 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.364 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.364 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.364 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:30.365 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.365 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.365 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.365 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Share various performance metrics of a cluster", 2024-05-09T06:03:30.365 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.365 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.365 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.365 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.365 INFO:teuthology.orchestra.run.smithi039.stdout: "contact": { 2024-05-09T06:03:30.365 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "contact", 2024-05-09T06:03:30.365 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.365 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.365 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.365 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:30.365 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.366 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.366 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.366 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.366 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.366 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.366 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.366 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.366 INFO:teuthology.orchestra.run.smithi039.stdout: "description": { 2024-05-09T06:03:30.366 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "description", 2024-05-09T06:03:30.366 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.366 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.366 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.366 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:30.367 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.367 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.367 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.367 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.367 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.367 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.367 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.367 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.367 INFO:teuthology.orchestra.run.smithi039.stdout: "device_url": { 2024-05-09T06:03:30.367 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "device_url", 2024-05-09T06:03:30.367 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.367 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.367 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.367 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-05-09T06:03:30.368 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.368 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.368 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.368 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.368 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.368 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.368 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.368 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.368 INFO:teuthology.orchestra.run.smithi039.stdout: "enabled": { 2024-05-09T06:03:30.368 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "enabled", 2024-05-09T06:03:30.368 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.368 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.368 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.368 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:30.369 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.369 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.369 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.369 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.369 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.369 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.369 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.369 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.369 INFO:teuthology.orchestra.run.smithi039.stdout: "interval": { 2024-05-09T06:03:30.369 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "interval", 2024-05-09T06:03:30.369 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:30.369 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.369 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.369 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "24", 2024-05-09T06:03:30.370 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "8", 2024-05-09T06:03:30.370 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.370 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.370 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.370 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.370 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.370 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.370 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.370 INFO:teuthology.orchestra.run.smithi039.stdout: "last_opt_revision": { 2024-05-09T06:03:30.370 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "last_opt_revision", 2024-05-09T06:03:30.370 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:30.370 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.370 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.370 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "1", 2024-05-09T06:03:30.370 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.371 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.371 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.371 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.371 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.371 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.371 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.371 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.371 INFO:teuthology.orchestra.run.smithi039.stdout: "leaderboard": { 2024-05-09T06:03:30.371 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "leaderboard", 2024-05-09T06:03:30.371 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.371 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.371 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.371 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:30.372 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.372 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.372 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.372 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.372 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.372 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.372 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.372 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.372 INFO:teuthology.orchestra.run.smithi039.stdout: "leaderboard_description": { 2024-05-09T06:03:30.372 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "leaderboard_description", 2024-05-09T06:03:30.372 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.372 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.372 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.372 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:30.372 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.373 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.373 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.373 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.373 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.373 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.373 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.373 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.373 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:30.373 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:30.373 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.373 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.373 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.373 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:30.373 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.374 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.374 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:30.374 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:30.374 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:30.374 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:30.374 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:30.374 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:30.374 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:30.374 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:30.374 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.374 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.374 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.374 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.374 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.375 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:30.375 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:30.375 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.375 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.375 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.375 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:30.375 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.375 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.375 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.375 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.375 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.375 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.375 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.375 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.376 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:30.376 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:30.376 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.376 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.376 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.376 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:30.376 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.376 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.376 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:30.376 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:30.376 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:30.376 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:30.376 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:30.376 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:30.377 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:30.377 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:30.377 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.377 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.377 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.377 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.377 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.377 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:30.377 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:30.377 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.377 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.377 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.377 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:30.377 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.378 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.378 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.378 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.378 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.378 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.378 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.378 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.378 INFO:teuthology.orchestra.run.smithi039.stdout: "organization": { 2024-05-09T06:03:30.378 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "organization", 2024-05-09T06:03:30.378 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.378 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.378 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.378 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:30.378 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.378 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.379 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.379 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.379 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.379 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.379 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.379 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.379 INFO:teuthology.orchestra.run.smithi039.stdout: "proxy": { 2024-05-09T06:03:30.379 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "proxy", 2024-05-09T06:03:30.379 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.379 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.379 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.379 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:30.380 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.380 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.380 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.380 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.380 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.380 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.380 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.380 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.380 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:30.380 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:30.380 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:30.380 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:30.380 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.381 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:30.381 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.381 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.381 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.381 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.381 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.381 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.381 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.381 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.381 INFO:teuthology.orchestra.run.smithi039.stdout: "url": { 2024-05-09T06:03:30.381 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "url", 2024-05-09T06:03:30.381 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.381 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.382 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.382 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-05-09T06:03:30.382 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.382 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.382 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.382 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.382 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.382 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.382 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.382 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:30.382 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:30.382 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.382 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:30.382 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "test_orchestrator", 2024-05-09T06:03:30.383 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-05-09T06:03:30.383 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-05-09T06:03:30.383 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:30.383 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:30.383 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:30.383 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.383 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.383 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.383 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:30.383 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.383 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.383 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:30.383 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:30.383 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:30.383 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:30.384 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:30.384 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:30.384 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:30.384 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:30.384 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.384 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.384 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.384 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.384 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.384 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:30.384 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:30.384 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.384 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.384 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.384 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:30.385 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.385 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.385 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.385 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.385 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.385 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.385 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.385 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.385 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:30.385 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:30.385 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.385 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.385 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.385 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:30.385 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.386 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.386 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:30.386 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:30.386 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:30.386 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:30.386 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:30.386 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:30.386 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:30.386 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:30.386 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.386 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.386 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.386 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.386 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.387 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:30.387 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:30.387 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.387 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.387 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.387 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:30.387 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.387 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.387 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.387 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.387 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.387 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.387 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.387 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.388 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:30.388 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:30.388 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:30.388 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:30.388 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.388 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:30.388 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.388 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.388 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.388 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.388 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.388 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.388 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.388 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:30.388 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:30.389 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.389 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:30.389 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "volumes", 2024-05-09T06:03:30.389 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-05-09T06:03:30.389 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-05-09T06:03:30.389 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:30.389 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:30.389 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:30.389 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.389 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.389 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.389 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:30.389 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.389 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.389 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:30.390 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:30.390 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:30.390 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:30.390 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:30.390 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:30.390 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:30.390 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:30.390 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.390 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.390 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.390 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.390 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.390 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:30.390 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:30.391 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.391 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.391 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.391 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:30.391 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.391 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.391 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.391 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.391 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.391 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.391 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.391 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.391 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:30.392 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:30.392 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.392 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.392 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.392 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:30.392 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.392 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.392 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:30.392 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:30.392 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:30.392 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:30.392 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:30.392 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:30.392 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:30.392 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:30.393 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.393 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.393 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.393 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.393 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.393 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:30.393 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:30.393 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.393 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.393 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.393 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:30.393 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.393 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.393 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.393 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.394 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.394 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.394 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.394 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.394 INFO:teuthology.orchestra.run.smithi039.stdout: "max_concurrent_clones": { 2024-05-09T06:03:30.394 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "max_concurrent_clones", 2024-05-09T06:03:30.394 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:30.394 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.394 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.394 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "4", 2024-05-09T06:03:30.394 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.394 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.394 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.395 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Number of asynchronous cloner threads", 2024-05-09T06:03:30.395 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.395 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.395 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.395 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.395 INFO:teuthology.orchestra.run.smithi039.stdout: "periodic_async_work": { 2024-05-09T06:03:30.395 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "periodic_async_work", 2024-05-09T06:03:30.395 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.395 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.395 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.395 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:30.395 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.395 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.395 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.395 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Periodically check for async work", 2024-05-09T06:03:30.396 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.396 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.396 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.396 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.396 INFO:teuthology.orchestra.run.smithi039.stdout: "snapshot_clone_delay": { 2024-05-09T06:03:30.396 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "snapshot_clone_delay", 2024-05-09T06:03:30.396 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:30.396 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.396 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.396 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:30.396 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.396 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.396 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.396 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-05-09T06:03:30.396 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.397 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.397 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.397 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.397 INFO:teuthology.orchestra.run.smithi039.stdout: "snapshot_clone_no_wait": { 2024-05-09T06:03:30.397 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "snapshot_clone_no_wait", 2024-05-09T06:03:30.397 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.397 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.397 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.397 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "True", 2024-05-09T06:03:30.397 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.397 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.397 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.397 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-05-09T06:03:30.397 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.397 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.398 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.398 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.398 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:30.398 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:30.398 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:30.398 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:30.398 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.398 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:30.398 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.398 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.398 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.398 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.398 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.398 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.399 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.399 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:30.399 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:30.399 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.399 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:30.399 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "zabbix", 2024-05-09T06:03:30.399 INFO:teuthology.orchestra.run.smithi039.stdout: "can_run": true, 2024-05-09T06:03:30.399 INFO:teuthology.orchestra.run.smithi039.stdout: "error_string": "", 2024-05-09T06:03:30.399 INFO:teuthology.orchestra.run.smithi039.stdout: "module_options": { 2024-05-09T06:03:30.399 INFO:teuthology.orchestra.run.smithi039.stdout: "discovery_interval": { 2024-05-09T06:03:30.399 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "discovery_interval", 2024-05-09T06:03:30.399 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "uint", 2024-05-09T06:03:30.399 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.399 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.399 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "100", 2024-05-09T06:03:30.399 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.400 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.400 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.400 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.400 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.400 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.400 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.400 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.400 INFO:teuthology.orchestra.run.smithi039.stdout: "identifier": { 2024-05-09T06:03:30.400 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "identifier", 2024-05-09T06:03:30.400 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.400 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.400 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.400 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:30.400 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.400 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.401 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.401 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.401 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.401 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.401 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.401 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.401 INFO:teuthology.orchestra.run.smithi039.stdout: "interval": { 2024-05-09T06:03:30.401 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "interval", 2024-05-09T06:03:30.401 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "secs", 2024-05-09T06:03:30.401 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.401 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.401 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "60", 2024-05-09T06:03:30.401 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.401 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.401 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.402 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.402 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.402 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.402 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.402 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.402 INFO:teuthology.orchestra.run.smithi039.stdout: "log_level": { 2024-05-09T06:03:30.402 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_level", 2024-05-09T06:03:30.402 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.402 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.402 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.402 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:30.402 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.402 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.403 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:30.403 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:30.403 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:30.403 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:30.403 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:30.403 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:30.403 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:30.403 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:30.403 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.403 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.403 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.403 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.403 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.403 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster": { 2024-05-09T06:03:30.403 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster", 2024-05-09T06:03:30.404 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.404 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.404 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.404 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:30.404 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.404 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.404 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.404 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.404 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.404 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.404 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.404 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.404 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_cluster_level": { 2024-05-09T06:03:30.404 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_cluster_level", 2024-05-09T06:03:30.405 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.405 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.405 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.405 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "info", 2024-05-09T06:03:30.405 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.405 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.405 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [ 2024-05-09T06:03:30.405 INFO:teuthology.orchestra.run.smithi039.stdout: "", 2024-05-09T06:03:30.405 INFO:teuthology.orchestra.run.smithi039.stdout: "critical", 2024-05-09T06:03:30.405 INFO:teuthology.orchestra.run.smithi039.stdout: "debug", 2024-05-09T06:03:30.405 INFO:teuthology.orchestra.run.smithi039.stdout: "error", 2024-05-09T06:03:30.405 INFO:teuthology.orchestra.run.smithi039.stdout: "info", 2024-05-09T06:03:30.405 INFO:teuthology.orchestra.run.smithi039.stdout: "warning" 2024-05-09T06:03:30.405 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:30.406 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.406 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.406 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.406 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.406 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.406 INFO:teuthology.orchestra.run.smithi039.stdout: "log_to_file": { 2024-05-09T06:03:30.406 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "log_to_file", 2024-05-09T06:03:30.406 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "bool", 2024-05-09T06:03:30.406 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.406 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.406 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "False", 2024-05-09T06:03:30.406 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.406 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.407 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.407 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.407 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.407 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.407 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.407 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.407 INFO:teuthology.orchestra.run.smithi039.stdout: "sqlite3_killpoint": { 2024-05-09T06:03:30.407 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "sqlite3_killpoint", 2024-05-09T06:03:30.407 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:30.407 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "dev", 2024-05-09T06:03:30.407 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 1, 2024-05-09T06:03:30.407 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "0", 2024-05-09T06:03:30.407 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.408 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.408 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.408 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.408 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.408 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.408 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.408 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.408 INFO:teuthology.orchestra.run.smithi039.stdout: "zabbix_host": { 2024-05-09T06:03:30.408 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "zabbix_host", 2024-05-09T06:03:30.408 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.408 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.408 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.408 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "", 2024-05-09T06:03:30.408 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.409 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.409 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.409 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.409 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.409 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.409 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.409 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.409 INFO:teuthology.orchestra.run.smithi039.stdout: "zabbix_port": { 2024-05-09T06:03:30.409 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "zabbix_port", 2024-05-09T06:03:30.409 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "int", 2024-05-09T06:03:30.409 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.409 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.409 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "10051", 2024-05-09T06:03:30.409 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.410 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.410 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.410 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.410 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.410 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.410 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.410 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.410 INFO:teuthology.orchestra.run.smithi039.stdout: "zabbix_sender": { 2024-05-09T06:03:30.410 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "zabbix_sender", 2024-05-09T06:03:30.410 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "str", 2024-05-09T06:03:30.410 INFO:teuthology.orchestra.run.smithi039.stdout: "level": "advanced", 2024-05-09T06:03:30.410 INFO:teuthology.orchestra.run.smithi039.stdout: "flags": 0, 2024-05-09T06:03:30.410 INFO:teuthology.orchestra.run.smithi039.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-05-09T06:03:30.410 INFO:teuthology.orchestra.run.smithi039.stdout: "min": "", 2024-05-09T06:03:30.411 INFO:teuthology.orchestra.run.smithi039.stdout: "max": "", 2024-05-09T06:03:30.411 INFO:teuthology.orchestra.run.smithi039.stdout: "enum_allowed": [], 2024-05-09T06:03:30.411 INFO:teuthology.orchestra.run.smithi039.stdout: "desc": "", 2024-05-09T06:03:30.411 INFO:teuthology.orchestra.run.smithi039.stdout: "long_desc": "", 2024-05-09T06:03:30.411 INFO:teuthology.orchestra.run.smithi039.stdout: "tags": [], 2024-05-09T06:03:30.411 INFO:teuthology.orchestra.run.smithi039.stdout: "see_also": [] 2024-05-09T06:03:30.411 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:30.411 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:30.411 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:30.411 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:30.411 INFO:teuthology.orchestra.run.smithi039.stdout: "services": { 2024-05-09T06:03:30.411 INFO:teuthology.orchestra.run.smithi039.stdout: "dashboard": "https://172.21.15.39:8443/" 2024-05-09T06:03:30.411 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.411 INFO:teuthology.orchestra.run.smithi039.stdout: "always_on_modules": { 2024-05-09T06:03:30.412 INFO:teuthology.orchestra.run.smithi039.stdout: "octopus": [ 2024-05-09T06:03:30.412 INFO:teuthology.orchestra.run.smithi039.stdout: "balancer", 2024-05-09T06:03:30.412 INFO:teuthology.orchestra.run.smithi039.stdout: "crash", 2024-05-09T06:03:30.412 INFO:teuthology.orchestra.run.smithi039.stdout: "devicehealth", 2024-05-09T06:03:30.412 INFO:teuthology.orchestra.run.smithi039.stdout: "orchestrator", 2024-05-09T06:03:30.412 INFO:teuthology.orchestra.run.smithi039.stdout: "pg_autoscaler", 2024-05-09T06:03:30.412 INFO:teuthology.orchestra.run.smithi039.stdout: "progress", 2024-05-09T06:03:30.412 INFO:teuthology.orchestra.run.smithi039.stdout: "rbd_support", 2024-05-09T06:03:30.412 INFO:teuthology.orchestra.run.smithi039.stdout: "status", 2024-05-09T06:03:30.412 INFO:teuthology.orchestra.run.smithi039.stdout: "telemetry", 2024-05-09T06:03:30.412 INFO:teuthology.orchestra.run.smithi039.stdout: "volumes" 2024-05-09T06:03:30.412 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:30.412 INFO:teuthology.orchestra.run.smithi039.stdout: "pacific": [ 2024-05-09T06:03:30.412 INFO:teuthology.orchestra.run.smithi039.stdout: "balancer", 2024-05-09T06:03:30.413 INFO:teuthology.orchestra.run.smithi039.stdout: "crash", 2024-05-09T06:03:30.413 INFO:teuthology.orchestra.run.smithi039.stdout: "devicehealth", 2024-05-09T06:03:30.413 INFO:teuthology.orchestra.run.smithi039.stdout: "orchestrator", 2024-05-09T06:03:30.413 INFO:teuthology.orchestra.run.smithi039.stdout: "pg_autoscaler", 2024-05-09T06:03:30.413 INFO:teuthology.orchestra.run.smithi039.stdout: "progress", 2024-05-09T06:03:30.413 INFO:teuthology.orchestra.run.smithi039.stdout: "rbd_support", 2024-05-09T06:03:30.413 INFO:teuthology.orchestra.run.smithi039.stdout: "status", 2024-05-09T06:03:30.413 INFO:teuthology.orchestra.run.smithi039.stdout: "telemetry", 2024-05-09T06:03:30.413 INFO:teuthology.orchestra.run.smithi039.stdout: "volumes" 2024-05-09T06:03:30.413 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:30.413 INFO:teuthology.orchestra.run.smithi039.stdout: "quincy": [ 2024-05-09T06:03:30.413 INFO:teuthology.orchestra.run.smithi039.stdout: "balancer", 2024-05-09T06:03:30.413 INFO:teuthology.orchestra.run.smithi039.stdout: "crash", 2024-05-09T06:03:30.413 INFO:teuthology.orchestra.run.smithi039.stdout: "devicehealth", 2024-05-09T06:03:30.413 INFO:teuthology.orchestra.run.smithi039.stdout: "orchestrator", 2024-05-09T06:03:30.414 INFO:teuthology.orchestra.run.smithi039.stdout: "pg_autoscaler", 2024-05-09T06:03:30.414 INFO:teuthology.orchestra.run.smithi039.stdout: "progress", 2024-05-09T06:03:30.414 INFO:teuthology.orchestra.run.smithi039.stdout: "rbd_support", 2024-05-09T06:03:30.414 INFO:teuthology.orchestra.run.smithi039.stdout: "status", 2024-05-09T06:03:30.414 INFO:teuthology.orchestra.run.smithi039.stdout: "telemetry", 2024-05-09T06:03:30.414 INFO:teuthology.orchestra.run.smithi039.stdout: "volumes" 2024-05-09T06:03:30.414 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:30.414 INFO:teuthology.orchestra.run.smithi039.stdout: "reef": [ 2024-05-09T06:03:30.414 INFO:teuthology.orchestra.run.smithi039.stdout: "balancer", 2024-05-09T06:03:30.414 INFO:teuthology.orchestra.run.smithi039.stdout: "crash", 2024-05-09T06:03:30.414 INFO:teuthology.orchestra.run.smithi039.stdout: "devicehealth", 2024-05-09T06:03:30.414 INFO:teuthology.orchestra.run.smithi039.stdout: "orchestrator", 2024-05-09T06:03:30.414 INFO:teuthology.orchestra.run.smithi039.stdout: "pg_autoscaler", 2024-05-09T06:03:30.414 INFO:teuthology.orchestra.run.smithi039.stdout: "progress", 2024-05-09T06:03:30.415 INFO:teuthology.orchestra.run.smithi039.stdout: "rbd_support", 2024-05-09T06:03:30.415 INFO:teuthology.orchestra.run.smithi039.stdout: "status", 2024-05-09T06:03:30.415 INFO:teuthology.orchestra.run.smithi039.stdout: "telemetry", 2024-05-09T06:03:30.415 INFO:teuthology.orchestra.run.smithi039.stdout: "volumes" 2024-05-09T06:03:30.415 INFO:teuthology.orchestra.run.smithi039.stdout: ], 2024-05-09T06:03:30.415 INFO:teuthology.orchestra.run.smithi039.stdout: "squid": [ 2024-05-09T06:03:30.415 INFO:teuthology.orchestra.run.smithi039.stdout: "balancer", 2024-05-09T06:03:30.415 INFO:teuthology.orchestra.run.smithi039.stdout: "crash", 2024-05-09T06:03:30.415 INFO:teuthology.orchestra.run.smithi039.stdout: "devicehealth", 2024-05-09T06:03:30.415 INFO:teuthology.orchestra.run.smithi039.stdout: "orchestrator", 2024-05-09T06:03:30.415 INFO:teuthology.orchestra.run.smithi039.stdout: "pg_autoscaler", 2024-05-09T06:03:30.415 INFO:teuthology.orchestra.run.smithi039.stdout: "progress", 2024-05-09T06:03:30.415 INFO:teuthology.orchestra.run.smithi039.stdout: "rbd_support", 2024-05-09T06:03:30.415 INFO:teuthology.orchestra.run.smithi039.stdout: "status", 2024-05-09T06:03:30.416 INFO:teuthology.orchestra.run.smithi039.stdout: "telemetry", 2024-05-09T06:03:30.416 INFO:teuthology.orchestra.run.smithi039.stdout: "volumes" 2024-05-09T06:03:30.416 INFO:teuthology.orchestra.run.smithi039.stdout: ] 2024-05-09T06:03:30.416 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.416 INFO:teuthology.orchestra.run.smithi039.stdout: "last_failure_osd_epoch": 3, 2024-05-09T06:03:30.416 INFO:teuthology.orchestra.run.smithi039.stdout: "active_clients": [ 2024-05-09T06:03:30.416 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:30.416 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "devicehealth", 2024-05-09T06:03:30.416 INFO:teuthology.orchestra.run.smithi039.stdout: "addrvec": [ 2024-05-09T06:03:30.416 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:30.416 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "v2", 2024-05-09T06:03:30.416 INFO:teuthology.orchestra.run.smithi039.stdout: "addr": "172.21.15.39:0", 2024-05-09T06:03:30.416 INFO:teuthology.orchestra.run.smithi039.stdout: "nonce": 1651077727 2024-05-09T06:03:30.416 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:30.417 INFO:teuthology.orchestra.run.smithi039.stdout: ] 2024-05-09T06:03:30.417 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.417 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:30.417 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "libcephsqlite", 2024-05-09T06:03:30.417 INFO:teuthology.orchestra.run.smithi039.stdout: "addrvec": [ 2024-05-09T06:03:30.417 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:30.417 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "v2", 2024-05-09T06:03:30.417 INFO:teuthology.orchestra.run.smithi039.stdout: "addr": "172.21.15.39:0", 2024-05-09T06:03:30.417 INFO:teuthology.orchestra.run.smithi039.stdout: "nonce": 4138942827 2024-05-09T06:03:30.417 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:30.417 INFO:teuthology.orchestra.run.smithi039.stdout: ] 2024-05-09T06:03:30.417 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.417 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:30.417 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "rbd_support", 2024-05-09T06:03:30.417 INFO:teuthology.orchestra.run.smithi039.stdout: "addrvec": [ 2024-05-09T06:03:30.417 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:30.418 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "v2", 2024-05-09T06:03:30.418 INFO:teuthology.orchestra.run.smithi039.stdout: "addr": "172.21.15.39:0", 2024-05-09T06:03:30.418 INFO:teuthology.orchestra.run.smithi039.stdout: "nonce": 269920905 2024-05-09T06:03:30.418 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:30.418 INFO:teuthology.orchestra.run.smithi039.stdout: ] 2024-05-09T06:03:30.418 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:30.418 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:30.418 INFO:teuthology.orchestra.run.smithi039.stdout: "name": "volumes", 2024-05-09T06:03:30.418 INFO:teuthology.orchestra.run.smithi039.stdout: "addrvec": [ 2024-05-09T06:03:30.418 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-09T06:03:30.418 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "v2", 2024-05-09T06:03:30.418 INFO:teuthology.orchestra.run.smithi039.stdout: "addr": "172.21.15.39:0", 2024-05-09T06:03:30.418 INFO:teuthology.orchestra.run.smithi039.stdout: "nonce": 1634469341 2024-05-09T06:03:30.418 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:30.419 INFO:teuthology.orchestra.run.smithi039.stdout: ] 2024-05-09T06:03:30.419 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:30.419 INFO:teuthology.orchestra.run.smithi039.stdout: ] 2024-05-09T06:03:30.419 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-05-09T06:03:30.420 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:03:28 smithi060 ceph-mon[34555]: from='client.? 172.21.15.39:0/827190920' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-09T06:03:30.420 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:03:28 smithi060 ceph-mon[34555]: from='client.? 172.21.15.39:0/3597578218' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-09T06:03:30.420 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:03:28 smithi060 ceph-mon[34555]: from='client.? 172.21.15.39:0/267278863' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-09T06:03:30.420 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:03:29 smithi060 ceph-mon[34555]: pgmap v1153: 97 pgs: 97 active+clean; 621 MiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.7 MiB/s wr, 330 op/s 2024-05-09T06:03:30.420 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:03:29 smithi060 ceph-mon[34555]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-09T06:03:30.420 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:03:29 smithi060 ceph-mon[34555]: from='client.? 172.21.15.39:0/1442543806' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-05-09T06:03:30.421 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:03:28 smithi100 ceph-mon[34353]: from='client.? 172.21.15.39:0/827190920' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-09T06:03:30.421 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:03:28 smithi100 ceph-mon[34353]: from='client.? 172.21.15.39:0/3597578218' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-09T06:03:30.421 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:03:28 smithi100 ceph-mon[34353]: from='client.? 172.21.15.39:0/267278863' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-09T06:03:30.421 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:03:29 smithi100 ceph-mon[34353]: pgmap v1153: 97 pgs: 97 active+clean; 621 MiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.7 MiB/s wr, 330 op/s 2024-05-09T06:03:30.421 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:03:29 smithi100 ceph-mon[34353]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-09T06:03:30.421 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:03:29 smithi100 ceph-mon[34353]: from='client.? 172.21.15.39:0/1442543806' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-05-09T06:03:30.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:29.007+0000 7fa4a0300640 1 -- 172.21.15.39:0/1442543806 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fa4800b27f0 msgr2=0x7fa4800b4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:03:30.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:29.007+0000 7fa4a0300640 1 --2- 172.21.15.39:0/1442543806 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fa4800b27f0 0x7fa4800b4d00 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fa490005fd0 tx=0x7fa49000b410 comp rx=0 tx=0).stop 2024-05-09T06:03:30.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:29.007+0000 7fa4a0300640 1 -- 172.21.15.39:0/1442543806 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa498103d30 msgr2=0x7fa49819f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:03:30.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:29.007+0000 7fa4a0300640 1 --2- 172.21.15.39:0/1442543806 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa498103d30 0x7fa49819f050 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fa48c00d770 tx=0x7fa48c00dc30 comp rx=0 tx=0).stop 2024-05-09T06:03:30.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:29.007+0000 7fa4a0300640 1 -- 172.21.15.39:0/1442543806 shutdown_connections 2024-05-09T06:03:30.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:29.007+0000 7fa4a0300640 1 --2- 172.21.15.39:0/1442543806 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fa4800b27f0 0x7fa4800b4d00 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:03:30.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:29.007+0000 7fa4a0300640 1 --2- 172.21.15.39:0/1442543806 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa498108a30 0x7fa4981a1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:03:30.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:29.007+0000 7fa4a0300640 1 --2- 172.21.15.39:0/1442543806 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa498103d30 0x7fa49819f050 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:03:30.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:29.007+0000 7fa4a0300640 1 --2- 172.21.15.39:0/1442543806 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa498102af0 0x7fa49806aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:03:30.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:29.007+0000 7fa4a0300640 1 -- 172.21.15.39:0/1442543806 >> 172.21.15.39:0/1442543806 conn(0x7fa4980fdd00 msgr2=0x7fa498104a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:03:30.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:29.007+0000 7fa4a0300640 1 -- 172.21.15.39:0/1442543806 shutdown_connections 2024-05-09T06:03:30.423 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:03:29.007+0000 7fa4a0300640 1 -- 172.21.15.39:0/1442543806 wait complete. 2024-05-09T06:03:30.429 DEBUG:tasks.check_counter:Getting stats from a 2024-05-09T06:03:30.429 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph daemon mds.a perf dump 2024-05-09T06:03:30.429 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:03:29 smithi039 ceph-mon[30439]: pgmap v1153: 97 pgs: 97 active+clean; 621 MiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.7 MiB/s wr, 330 op/s 2024-05-09T06:03:30.430 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:03:29 smithi039 ceph-mon[30439]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-09T06:03:30.430 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:03:29 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/1442543806' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-05-09T06:03:30.686 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T06:03:31.078 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:03:30 smithi039 ceph-mon[30439]: pgmap v1154: 97 pgs: 97 active+clean; 570 MiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 4.7 MiB/s wr, 320 op/s 2024-05-09T06:03:31.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:03:30 smithi100 ceph-mon[34353]: pgmap v1154: 97 pgs: 97 active+clean; 570 MiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 4.7 MiB/s wr, 320 op/s 2024-05-09T06:03:31.289 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:03:30 smithi060 ceph-mon[34555]: pgmap v1154: 97 pgs: 97 active+clean; 570 MiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 4.7 MiB/s wr, 320 op/s 2024-05-09T06:03:32.711 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-05-09T06:03:32.712 INFO:teuthology.orchestra.run.smithi039.stdout: "AsyncMessenger::Worker-0": { 2024-05-09T06:03:32.712 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_messages": 0, 2024-05-09T06:03:32.712 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages": 2, 2024-05-09T06:03:32.712 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_bytes": 0, 2024-05-09T06:03:32.712 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_bytes": 0, 2024-05-09T06:03:32.712 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_created_connections": 4, 2024-05-09T06:03:32.712 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_active_connections": 0, 2024-05-09T06:03:32.712 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_total_time": 0.001509740, 2024-05-09T06:03:32.712 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_send_time": 0.000000000, 2024-05-09T06:03:32.712 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_recv_time": 0.000370944, 2024-05-09T06:03:32.712 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-09T06:03:32.712 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T06:03:32.713 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-05-09T06:03:32.713 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-05-09T06:03:32.713 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-05-09T06:03:32.713 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:32.713 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_handle_ack_lat": { 2024-05-09T06:03:32.713 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-05-09T06:03:32.713 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-05-09T06:03:32.713 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-05-09T06:03:32.713 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:32.713 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-09T06:03:32.713 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_encrypted_bytes": 0 2024-05-09T06:03:32.713 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:32.713 INFO:teuthology.orchestra.run.smithi039.stdout: "AsyncMessenger::Worker-1": { 2024-05-09T06:03:32.713 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_messages": 2, 2024-05-09T06:03:32.714 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages": 351, 2024-05-09T06:03:32.714 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_bytes": 320, 2024-05-09T06:03:32.714 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_bytes": 219408, 2024-05-09T06:03:32.714 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_created_connections": 4, 2024-05-09T06:03:32.714 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_active_connections": 2, 2024-05-09T06:03:32.714 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_total_time": 0.022588456, 2024-05-09T06:03:32.714 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_send_time": 0.017633928, 2024-05-09T06:03:32.714 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_recv_time": 0.001662985, 2024-05-09T06:03:32.714 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-09T06:03:32.714 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T06:03:32.714 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 349, 2024-05-09T06:03:32.714 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.013901457, 2024-05-09T06:03:32.714 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000039832 2024-05-09T06:03:32.715 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:32.715 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_handle_ack_lat": { 2024-05-09T06:03:32.715 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-05-09T06:03:32.715 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-05-09T06:03:32.715 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-05-09T06:03:32.715 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:32.715 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_encrypted_bytes": 320, 2024-05-09T06:03:32.715 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_encrypted_bytes": 219408 2024-05-09T06:03:32.715 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:32.717 INFO:teuthology.orchestra.run.smithi039.stdout: "AsyncMessenger::Worker-2": { 2024-05-09T06:03:32.718 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_messages": 469, 2024-05-09T06:03:32.718 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages": 462, 2024-05-09T06:03:32.718 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_bytes": 886368, 2024-05-09T06:03:32.718 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_bytes": 285040, 2024-05-09T06:03:32.718 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_created_connections": 2, 2024-05-09T06:03:32.718 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_active_connections": 1, 2024-05-09T06:03:32.718 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_total_time": 0.061019734, 2024-05-09T06:03:32.718 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_send_time": 0.024519269, 2024-05-09T06:03:32.718 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_recv_time": 0.026504564, 2024-05-09T06:03:32.718 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_fast_dispatch_time": 0.008557663, 2024-05-09T06:03:32.718 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T06:03:32.718 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 462, 2024-05-09T06:03:32.718 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.018106809, 2024-05-09T06:03:32.719 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000039192 2024-05-09T06:03:32.719 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:32.719 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_handle_ack_lat": { 2024-05-09T06:03:32.719 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-05-09T06:03:32.719 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-05-09T06:03:32.719 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-05-09T06:03:32.719 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:32.719 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_encrypted_bytes": 886368, 2024-05-09T06:03:32.719 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_encrypted_bytes": 285040 2024-05-09T06:03:32.719 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:32.719 INFO:teuthology.orchestra.run.smithi039.stdout: "cct": { 2024-05-09T06:03:32.719 INFO:teuthology.orchestra.run.smithi039.stdout: "total_workers": 0, 2024-05-09T06:03:32.719 INFO:teuthology.orchestra.run.smithi039.stdout: "unhealthy_workers": 0 2024-05-09T06:03:32.719 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:32.720 INFO:teuthology.orchestra.run.smithi039.stdout: "mempool": { 2024-05-09T06:03:32.720 INFO:teuthology.orchestra.run.smithi039.stdout: "bloom_filter_bytes": 0, 2024-05-09T06:03:32.720 INFO:teuthology.orchestra.run.smithi039.stdout: "bloom_filter_items": 0, 2024-05-09T06:03:32.720 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_alloc_bytes": 0, 2024-05-09T06:03:32.720 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_alloc_items": 0, 2024-05-09T06:03:32.720 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_data_bytes": 0, 2024-05-09T06:03:32.720 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_data_items": 0, 2024-05-09T06:03:32.720 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-09T06:03:32.720 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_onode_items": 0, 2024-05-09T06:03:32.720 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-09T06:03:32.720 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_meta_items": 0, 2024-05-09T06:03:32.720 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_other_bytes": 0, 2024-05-09T06:03:32.720 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_other_items": 0, 2024-05-09T06:03:32.720 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-09T06:03:32.721 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_buffer_items": 0, 2024-05-09T06:03:32.721 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_extent_bytes": 0, 2024-05-09T06:03:32.721 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_extent_items": 0, 2024-05-09T06:03:32.721 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_blob_bytes": 0, 2024-05-09T06:03:32.721 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_blob_items": 0, 2024-05-09T06:03:32.721 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-09T06:03:32.721 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_shared_blob_items": 0, 2024-05-09T06:03:32.721 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-09T06:03:32.721 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_inline_bl_items": 0, 2024-05-09T06:03:32.721 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_fsck_bytes": 0, 2024-05-09T06:03:32.721 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_fsck_items": 0, 2024-05-09T06:03:32.721 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_txc_bytes": 0, 2024-05-09T06:03:32.721 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_txc_items": 0, 2024-05-09T06:03:32.721 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-09T06:03:32.722 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_writing_deferred_items": 0, 2024-05-09T06:03:32.722 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_writing_bytes": 0, 2024-05-09T06:03:32.722 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_writing_items": 0, 2024-05-09T06:03:32.722 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_bytes": 0, 2024-05-09T06:03:32.722 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_items": 0, 2024-05-09T06:03:32.722 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_file_reader_bytes": 0, 2024-05-09T06:03:32.722 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_file_reader_items": 0, 2024-05-09T06:03:32.722 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_file_writer_bytes": 0, 2024-05-09T06:03:32.722 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_file_writer_items": 0, 2024-05-09T06:03:32.722 INFO:teuthology.orchestra.run.smithi039.stdout: "buffer_anon_bytes": 148761, 2024-05-09T06:03:32.722 INFO:teuthology.orchestra.run.smithi039.stdout: "buffer_anon_items": 31, 2024-05-09T06:03:32.722 INFO:teuthology.orchestra.run.smithi039.stdout: "buffer_meta_bytes": 0, 2024-05-09T06:03:32.722 INFO:teuthology.orchestra.run.smithi039.stdout: "buffer_meta_items": 0, 2024-05-09T06:03:32.722 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_bytes": 0, 2024-05-09T06:03:32.722 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_items": 0, 2024-05-09T06:03:32.723 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_mapbl_bytes": 0, 2024-05-09T06:03:32.723 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_mapbl_items": 0, 2024-05-09T06:03:32.723 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_pglog_bytes": 0, 2024-05-09T06:03:32.723 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_pglog_items": 0, 2024-05-09T06:03:32.723 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_bytes": 0, 2024-05-09T06:03:32.723 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_items": 0, 2024-05-09T06:03:32.723 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_mapping_bytes": 0, 2024-05-09T06:03:32.723 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_mapping_items": 0, 2024-05-09T06:03:32.723 INFO:teuthology.orchestra.run.smithi039.stdout: "pgmap_bytes": 0, 2024-05-09T06:03:32.723 INFO:teuthology.orchestra.run.smithi039.stdout: "pgmap_items": 0, 2024-05-09T06:03:32.723 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_co_bytes": 928, 2024-05-09T06:03:32.723 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_co_items": 2, 2024-05-09T06:03:32.723 INFO:teuthology.orchestra.run.smithi039.stdout: "unittest_1_bytes": 0, 2024-05-09T06:03:32.723 INFO:teuthology.orchestra.run.smithi039.stdout: "unittest_1_items": 0, 2024-05-09T06:03:32.724 INFO:teuthology.orchestra.run.smithi039.stdout: "unittest_2_bytes": 0, 2024-05-09T06:03:32.724 INFO:teuthology.orchestra.run.smithi039.stdout: "unittest_2_items": 0 2024-05-09T06:03:32.724 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:32.724 INFO:teuthology.orchestra.run.smithi039.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-09T06:03:32.724 INFO:teuthology.orchestra.run.smithi039.stdout: "val": 0, 2024-05-09T06:03:32.724 INFO:teuthology.orchestra.run.smithi039.stdout: "max": 104857600, 2024-05-09T06:03:32.724 INFO:teuthology.orchestra.run.smithi039.stdout: "get_started": 0, 2024-05-09T06:03:32.724 INFO:teuthology.orchestra.run.smithi039.stdout: "get": 467, 2024-05-09T06:03:32.724 INFO:teuthology.orchestra.run.smithi039.stdout: "get_sum": 817545, 2024-05-09T06:03:32.724 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_fail": 0, 2024-05-09T06:03:32.724 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_success": 467, 2024-05-09T06:03:32.724 INFO:teuthology.orchestra.run.smithi039.stdout: "take": 0, 2024-05-09T06:03:32.724 INFO:teuthology.orchestra.run.smithi039.stdout: "take_sum": 0, 2024-05-09T06:03:32.724 INFO:teuthology.orchestra.run.smithi039.stdout: "put": 467, 2024-05-09T06:03:32.725 INFO:teuthology.orchestra.run.smithi039.stdout: "put_sum": 817545, 2024-05-09T06:03:32.725 INFO:teuthology.orchestra.run.smithi039.stdout: "wait": { 2024-05-09T06:03:32.725 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-05-09T06:03:32.725 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-05-09T06:03:32.725 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-05-09T06:03:32.725 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:32.725 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:32.725 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-05-09T06:03:33.612 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.a 2024-05-09T06:03:33.612 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.a 2024-05-09T06:03:33.612 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.a 2024-05-09T06:03:33.612 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.a 2024-05-09T06:03:33.612 DEBUG:tasks.check_counter:Getting stats from d 2024-05-09T06:03:33.613 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph daemon mds.d perf dump 2024-05-09T06:03:33.852 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:03:33 smithi039 ceph-mon[30439]: pgmap v1155: 97 pgs: 97 active+clean; 536 MiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 4.7 MiB/s wr, 307 op/s 2024-05-09T06:03:33.878 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T06:03:33.915 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:03:33 smithi100 ceph-mon[34353]: pgmap v1155: 97 pgs: 97 active+clean; 536 MiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 4.7 MiB/s wr, 307 op/s 2024-05-09T06:03:34.038 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:03:33 smithi060 ceph-mon[34555]: pgmap v1155: 97 pgs: 97 active+clean; 536 MiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 4.7 MiB/s wr, 307 op/s 2024-05-09T06:03:34.916 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:03:34 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:03:34.948 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:03:34 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:03:35.038 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:03:34 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T06:03:35.852 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:03:35 smithi039 ceph-mon[30439]: pgmap v1156: 97 pgs: 97 active+clean; 532 MiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.8 MiB/s wr, 235 op/s 2024-05-09T06:03:35.916 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:03:35 smithi100 ceph-mon[34353]: pgmap v1156: 97 pgs: 97 active+clean; 532 MiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.8 MiB/s wr, 235 op/s 2024-05-09T06:03:35.972 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-05-09T06:03:35.972 INFO:teuthology.orchestra.run.smithi039.stdout: "AsyncMessenger::Worker-0": { 2024-05-09T06:03:35.972 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_messages": 4, 2024-05-09T06:03:35.972 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages": 4, 2024-05-09T06:03:35.973 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_bytes": 3040, 2024-05-09T06:03:35.973 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_bytes": 448, 2024-05-09T06:03:35.973 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_created_connections": 4, 2024-05-09T06:03:35.973 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_active_connections": 0, 2024-05-09T06:03:35.973 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_total_time": 0.002241760, 2024-05-09T06:03:35.973 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_send_time": 0.000048472, 2024-05-09T06:03:35.973 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_recv_time": 0.000766186, 2024-05-09T06:03:35.973 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-09T06:03:35.973 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T06:03:35.973 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 3, 2024-05-09T06:03:35.973 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000919576, 2024-05-09T06:03:35.973 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000306525 2024-05-09T06:03:35.973 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:35.974 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_handle_ack_lat": { 2024-05-09T06:03:35.974 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-05-09T06:03:35.974 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-05-09T06:03:35.974 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-05-09T06:03:35.974 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:35.974 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_encrypted_bytes": 3040, 2024-05-09T06:03:35.974 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_encrypted_bytes": 448 2024-05-09T06:03:35.974 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:35.974 INFO:teuthology.orchestra.run.smithi039.stdout: "AsyncMessenger::Worker-1": { 2024-05-09T06:03:35.974 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_messages": 472, 2024-05-09T06:03:35.974 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages": 467, 2024-05-09T06:03:35.974 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_bytes": 885232, 2024-05-09T06:03:35.974 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_bytes": 289072, 2024-05-09T06:03:35.974 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_created_connections": 2, 2024-05-09T06:03:35.975 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_active_connections": 1, 2024-05-09T06:03:35.975 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_total_time": 0.065373286, 2024-05-09T06:03:35.975 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_send_time": 0.025817518, 2024-05-09T06:03:35.975 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_recv_time": 0.030203872, 2024-05-09T06:03:35.975 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_fast_dispatch_time": 0.008765980, 2024-05-09T06:03:35.975 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T06:03:35.975 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 466, 2024-05-09T06:03:35.975 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.017754475, 2024-05-09T06:03:35.975 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000038099 2024-05-09T06:03:35.975 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:35.975 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_handle_ack_lat": { 2024-05-09T06:03:35.975 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-05-09T06:03:35.975 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-05-09T06:03:35.975 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-05-09T06:03:35.975 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:35.976 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_encrypted_bytes": 885232, 2024-05-09T06:03:35.976 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_encrypted_bytes": 289072 2024-05-09T06:03:35.976 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:35.976 INFO:teuthology.orchestra.run.smithi039.stdout: "AsyncMessenger::Worker-2": { 2024-05-09T06:03:35.976 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_messages": 2, 2024-05-09T06:03:35.976 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages": 357, 2024-05-09T06:03:35.976 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_bytes": 320, 2024-05-09T06:03:35.976 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_bytes": 220464, 2024-05-09T06:03:35.976 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_created_connections": 4, 2024-05-09T06:03:35.976 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_active_connections": 2, 2024-05-09T06:03:35.976 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_total_time": 0.024001687, 2024-05-09T06:03:35.976 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_send_time": 0.018583048, 2024-05-09T06:03:35.976 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_recv_time": 0.001849320, 2024-05-09T06:03:35.976 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-09T06:03:35.977 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T06:03:35.977 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 355, 2024-05-09T06:03:35.977 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.015684354, 2024-05-09T06:03:35.977 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000044181 2024-05-09T06:03:35.977 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:35.977 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_handle_ack_lat": { 2024-05-09T06:03:35.977 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-05-09T06:03:35.977 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-05-09T06:03:35.977 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-05-09T06:03:35.977 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:35.977 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_encrypted_bytes": 320, 2024-05-09T06:03:35.977 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_encrypted_bytes": 220464 2024-05-09T06:03:35.977 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:35.977 INFO:teuthology.orchestra.run.smithi039.stdout: "cct": { 2024-05-09T06:03:35.977 INFO:teuthology.orchestra.run.smithi039.stdout: "total_workers": 0, 2024-05-09T06:03:35.978 INFO:teuthology.orchestra.run.smithi039.stdout: "unhealthy_workers": 0 2024-05-09T06:03:35.978 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:35.978 INFO:teuthology.orchestra.run.smithi039.stdout: "mempool": { 2024-05-09T06:03:35.978 INFO:teuthology.orchestra.run.smithi039.stdout: "bloom_filter_bytes": 0, 2024-05-09T06:03:35.978 INFO:teuthology.orchestra.run.smithi039.stdout: "bloom_filter_items": 0, 2024-05-09T06:03:35.978 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_alloc_bytes": 0, 2024-05-09T06:03:35.978 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_alloc_items": 0, 2024-05-09T06:03:35.978 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_data_bytes": 0, 2024-05-09T06:03:35.978 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_data_items": 0, 2024-05-09T06:03:35.978 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-09T06:03:35.978 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_onode_items": 0, 2024-05-09T06:03:35.978 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-09T06:03:35.978 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_meta_items": 0, 2024-05-09T06:03:35.978 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_other_bytes": 0, 2024-05-09T06:03:35.979 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_other_items": 0, 2024-05-09T06:03:35.979 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-09T06:03:35.979 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_buffer_items": 0, 2024-05-09T06:03:35.979 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_extent_bytes": 0, 2024-05-09T06:03:35.979 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_extent_items": 0, 2024-05-09T06:03:35.979 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_blob_bytes": 0, 2024-05-09T06:03:35.979 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_blob_items": 0, 2024-05-09T06:03:35.979 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-09T06:03:35.979 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_shared_blob_items": 0, 2024-05-09T06:03:35.979 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-09T06:03:35.979 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_inline_bl_items": 0, 2024-05-09T06:03:35.979 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_fsck_bytes": 0, 2024-05-09T06:03:35.979 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_fsck_items": 0, 2024-05-09T06:03:35.979 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_txc_bytes": 0, 2024-05-09T06:03:35.980 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_txc_items": 0, 2024-05-09T06:03:35.980 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-09T06:03:35.980 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_writing_deferred_items": 0, 2024-05-09T06:03:35.980 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_writing_bytes": 0, 2024-05-09T06:03:35.980 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_writing_items": 0, 2024-05-09T06:03:35.980 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_bytes": 0, 2024-05-09T06:03:35.980 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_items": 0, 2024-05-09T06:03:35.980 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_file_reader_bytes": 0, 2024-05-09T06:03:35.980 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_file_reader_items": 0, 2024-05-09T06:03:35.980 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_file_writer_bytes": 0, 2024-05-09T06:03:35.980 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_file_writer_items": 0, 2024-05-09T06:03:35.980 INFO:teuthology.orchestra.run.smithi039.stdout: "buffer_anon_bytes": 148721, 2024-05-09T06:03:35.980 INFO:teuthology.orchestra.run.smithi039.stdout: "buffer_anon_items": 30, 2024-05-09T06:03:35.980 INFO:teuthology.orchestra.run.smithi039.stdout: "buffer_meta_bytes": 0, 2024-05-09T06:03:35.981 INFO:teuthology.orchestra.run.smithi039.stdout: "buffer_meta_items": 0, 2024-05-09T06:03:35.981 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_bytes": 0, 2024-05-09T06:03:35.981 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_items": 0, 2024-05-09T06:03:35.981 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_mapbl_bytes": 0, 2024-05-09T06:03:35.981 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_mapbl_items": 0, 2024-05-09T06:03:35.981 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_pglog_bytes": 0, 2024-05-09T06:03:35.981 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_pglog_items": 0, 2024-05-09T06:03:35.981 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_bytes": 0, 2024-05-09T06:03:35.981 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_items": 0, 2024-05-09T06:03:35.981 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_mapping_bytes": 0, 2024-05-09T06:03:35.981 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_mapping_items": 0, 2024-05-09T06:03:35.981 INFO:teuthology.orchestra.run.smithi039.stdout: "pgmap_bytes": 0, 2024-05-09T06:03:35.981 INFO:teuthology.orchestra.run.smithi039.stdout: "pgmap_items": 0, 2024-05-09T06:03:35.981 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_co_bytes": 928, 2024-05-09T06:03:35.981 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_co_items": 2, 2024-05-09T06:03:35.982 INFO:teuthology.orchestra.run.smithi039.stdout: "unittest_1_bytes": 0, 2024-05-09T06:03:35.982 INFO:teuthology.orchestra.run.smithi039.stdout: "unittest_1_items": 0, 2024-05-09T06:03:35.982 INFO:teuthology.orchestra.run.smithi039.stdout: "unittest_2_bytes": 0, 2024-05-09T06:03:35.982 INFO:teuthology.orchestra.run.smithi039.stdout: "unittest_2_items": 0 2024-05-09T06:03:35.982 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:35.982 INFO:teuthology.orchestra.run.smithi039.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-09T06:03:35.982 INFO:teuthology.orchestra.run.smithi039.stdout: "val": 0, 2024-05-09T06:03:35.982 INFO:teuthology.orchestra.run.smithi039.stdout: "max": 104857600, 2024-05-09T06:03:35.982 INFO:teuthology.orchestra.run.smithi039.stdout: "get_started": 0, 2024-05-09T06:03:35.982 INFO:teuthology.orchestra.run.smithi039.stdout: "get": 474, 2024-05-09T06:03:35.982 INFO:teuthology.orchestra.run.smithi039.stdout: "get_sum": 818455, 2024-05-09T06:03:35.982 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_fail": 0, 2024-05-09T06:03:35.982 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_success": 474, 2024-05-09T06:03:35.982 INFO:teuthology.orchestra.run.smithi039.stdout: "take": 0, 2024-05-09T06:03:35.983 INFO:teuthology.orchestra.run.smithi039.stdout: "take_sum": 0, 2024-05-09T06:03:35.983 INFO:teuthology.orchestra.run.smithi039.stdout: "put": 474, 2024-05-09T06:03:35.983 INFO:teuthology.orchestra.run.smithi039.stdout: "put_sum": 818455, 2024-05-09T06:03:35.983 INFO:teuthology.orchestra.run.smithi039.stdout: "wait": { 2024-05-09T06:03:35.983 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-05-09T06:03:35.983 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-05-09T06:03:35.983 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-05-09T06:03:35.983 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:35.983 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:35.983 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-05-09T06:03:36.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:03:35 smithi060 ceph-mon[34555]: pgmap v1156: 97 pgs: 97 active+clean; 532 MiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.8 MiB/s wr, 235 op/s 2024-05-09T06:03:36.741 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-05-09T06:03:36.741 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-05-09T06:03:36.741 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.d 2024-05-09T06:03:36.741 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.d 2024-05-09T06:03:36.741 DEBUG:tasks.check_counter:Getting stats from g 2024-05-09T06:03:36.741 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph daemon mds.g perf dump 2024-05-09T06:03:37.916 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:03:37 smithi100 ceph-mon[34353]: pgmap v1157: 97 pgs: 97 active+clean; 534 MiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 931 KiB/s rd, 3.5 MiB/s wr, 206 op/s 2024-05-09T06:03:37.927 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:03:37 smithi039 ceph-mon[30439]: pgmap v1157: 97 pgs: 97 active+clean; 534 MiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 931 KiB/s rd, 3.5 MiB/s wr, 206 op/s 2024-05-09T06:03:37.932 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:03:37 smithi060 ceph-mon[34555]: pgmap v1157: 97 pgs: 97 active+clean; 534 MiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 931 KiB/s rd, 3.5 MiB/s wr, 206 op/s 2024-05-09T06:03:38.258 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T06:03:39.916 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:03:39 smithi100 ceph-mon[34353]: pgmap v1158: 97 pgs: 97 active+clean; 530 MiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 555 KiB/s rd, 3.6 MiB/s wr, 184 op/s 2024-05-09T06:03:39.916 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:03:39 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T06:03:39.916 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:03:39 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T06:03:40.038 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:03:39 smithi060 ceph-mon[34555]: pgmap v1158: 97 pgs: 97 active+clean; 530 MiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 555 KiB/s rd, 3.6 MiB/s wr, 184 op/s 2024-05-09T06:03:40.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:03:39 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T06:03:40.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:03:39 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T06:03:40.095 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:03:39 smithi039 ceph-mon[30439]: pgmap v1158: 97 pgs: 97 active+clean; 530 MiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 555 KiB/s rd, 3.6 MiB/s wr, 184 op/s 2024-05-09T06:03:40.095 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:03:39 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T06:03:40.095 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:03:39 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T06:03:40.639 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-05-09T06:03:40.639 INFO:teuthology.orchestra.run.smithi039.stdout: "AsyncMessenger::Worker-0": { 2024-05-09T06:03:40.639 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_messages": 4, 2024-05-09T06:03:40.639 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages": 4, 2024-05-09T06:03:40.639 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_bytes": 3040, 2024-05-09T06:03:40.639 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_bytes": 448, 2024-05-09T06:03:40.639 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_created_connections": 4, 2024-05-09T06:03:40.639 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_active_connections": 0, 2024-05-09T06:03:40.640 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_total_time": 0.002213229, 2024-05-09T06:03:40.640 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_send_time": 0.000044482, 2024-05-09T06:03:40.640 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_recv_time": 0.000976970, 2024-05-09T06:03:40.640 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-09T06:03:40.640 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T06:03:40.640 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 3, 2024-05-09T06:03:40.640 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.001086064, 2024-05-09T06:03:40.640 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000362021 2024-05-09T06:03:40.640 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:40.640 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_handle_ack_lat": { 2024-05-09T06:03:40.640 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-05-09T06:03:40.640 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-05-09T06:03:40.640 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-05-09T06:03:40.640 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:40.641 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_encrypted_bytes": 3040, 2024-05-09T06:03:40.641 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_encrypted_bytes": 448 2024-05-09T06:03:40.641 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:40.641 INFO:teuthology.orchestra.run.smithi039.stdout: "AsyncMessenger::Worker-1": { 2024-05-09T06:03:40.641 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_messages": 469, 2024-05-09T06:03:40.641 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages": 464, 2024-05-09T06:03:40.641 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_bytes": 884416, 2024-05-09T06:03:40.641 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_bytes": 287152, 2024-05-09T06:03:40.641 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_created_connections": 2, 2024-05-09T06:03:40.641 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_active_connections": 1, 2024-05-09T06:03:40.641 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_total_time": 0.062808545, 2024-05-09T06:03:40.641 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_send_time": 0.025357818, 2024-05-09T06:03:40.641 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_recv_time": 0.027795706, 2024-05-09T06:03:40.641 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_fast_dispatch_time": 0.008638581, 2024-05-09T06:03:40.642 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T06:03:40.642 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 463, 2024-05-09T06:03:40.642 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.018054638, 2024-05-09T06:03:40.642 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000038994 2024-05-09T06:03:40.642 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:40.642 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_handle_ack_lat": { 2024-05-09T06:03:40.642 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-05-09T06:03:40.642 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-05-09T06:03:40.642 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-05-09T06:03:40.642 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:40.642 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_encrypted_bytes": 884416, 2024-05-09T06:03:40.642 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_encrypted_bytes": 287152 2024-05-09T06:03:40.642 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:40.642 INFO:teuthology.orchestra.run.smithi039.stdout: "AsyncMessenger::Worker-2": { 2024-05-09T06:03:40.643 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_messages": 2, 2024-05-09T06:03:40.643 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages": 354, 2024-05-09T06:03:40.643 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_bytes": 320, 2024-05-09T06:03:40.643 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_bytes": 219936, 2024-05-09T06:03:40.643 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_created_connections": 4, 2024-05-09T06:03:40.643 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_active_connections": 2, 2024-05-09T06:03:40.643 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_total_time": 0.024721253, 2024-05-09T06:03:40.643 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_send_time": 0.019293836, 2024-05-09T06:03:40.643 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_recv_time": 0.001894733, 2024-05-09T06:03:40.643 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-09T06:03:40.643 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T06:03:40.643 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 352, 2024-05-09T06:03:40.644 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.018780537, 2024-05-09T06:03:40.644 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000053353 2024-05-09T06:03:40.644 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:40.644 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_handle_ack_lat": { 2024-05-09T06:03:40.644 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-05-09T06:03:40.644 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-05-09T06:03:40.644 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-05-09T06:03:40.644 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:40.644 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_encrypted_bytes": 320, 2024-05-09T06:03:40.644 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_encrypted_bytes": 219936 2024-05-09T06:03:40.644 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:40.644 INFO:teuthology.orchestra.run.smithi039.stdout: "cct": { 2024-05-09T06:03:40.644 INFO:teuthology.orchestra.run.smithi039.stdout: "total_workers": 0, 2024-05-09T06:03:40.645 INFO:teuthology.orchestra.run.smithi039.stdout: "unhealthy_workers": 0 2024-05-09T06:03:40.645 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:40.645 INFO:teuthology.orchestra.run.smithi039.stdout: "mempool": { 2024-05-09T06:03:40.645 INFO:teuthology.orchestra.run.smithi039.stdout: "bloom_filter_bytes": 0, 2024-05-09T06:03:40.645 INFO:teuthology.orchestra.run.smithi039.stdout: "bloom_filter_items": 0, 2024-05-09T06:03:40.645 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_alloc_bytes": 0, 2024-05-09T06:03:40.645 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_alloc_items": 0, 2024-05-09T06:03:40.645 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_data_bytes": 0, 2024-05-09T06:03:40.645 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_data_items": 0, 2024-05-09T06:03:40.645 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-09T06:03:40.645 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_onode_items": 0, 2024-05-09T06:03:40.645 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-09T06:03:40.645 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_meta_items": 0, 2024-05-09T06:03:40.646 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_other_bytes": 0, 2024-05-09T06:03:40.646 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_other_items": 0, 2024-05-09T06:03:40.646 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-09T06:03:40.646 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_buffer_items": 0, 2024-05-09T06:03:40.646 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_extent_bytes": 0, 2024-05-09T06:03:40.646 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_extent_items": 0, 2024-05-09T06:03:40.646 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_blob_bytes": 0, 2024-05-09T06:03:40.646 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_blob_items": 0, 2024-05-09T06:03:40.646 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-09T06:03:40.646 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_shared_blob_items": 0, 2024-05-09T06:03:40.646 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-09T06:03:40.646 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_inline_bl_items": 0, 2024-05-09T06:03:40.646 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_fsck_bytes": 0, 2024-05-09T06:03:40.646 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_fsck_items": 0, 2024-05-09T06:03:40.647 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_txc_bytes": 0, 2024-05-09T06:03:40.647 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_txc_items": 0, 2024-05-09T06:03:40.647 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-09T06:03:40.647 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_writing_deferred_items": 0, 2024-05-09T06:03:40.647 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_writing_bytes": 0, 2024-05-09T06:03:40.647 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_writing_items": 0, 2024-05-09T06:03:40.647 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_bytes": 0, 2024-05-09T06:03:40.647 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_items": 0, 2024-05-09T06:03:40.647 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_file_reader_bytes": 0, 2024-05-09T06:03:40.647 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_file_reader_items": 0, 2024-05-09T06:03:40.647 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_file_writer_bytes": 0, 2024-05-09T06:03:40.647 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_file_writer_items": 0, 2024-05-09T06:03:40.647 INFO:teuthology.orchestra.run.smithi039.stdout: "buffer_anon_bytes": 148744, 2024-05-09T06:03:40.647 INFO:teuthology.orchestra.run.smithi039.stdout: "buffer_anon_items": 30, 2024-05-09T06:03:40.648 INFO:teuthology.orchestra.run.smithi039.stdout: "buffer_meta_bytes": 0, 2024-05-09T06:03:40.648 INFO:teuthology.orchestra.run.smithi039.stdout: "buffer_meta_items": 0, 2024-05-09T06:03:40.648 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_bytes": 0, 2024-05-09T06:03:40.648 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_items": 0, 2024-05-09T06:03:40.648 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_mapbl_bytes": 0, 2024-05-09T06:03:40.648 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_mapbl_items": 0, 2024-05-09T06:03:40.648 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_pglog_bytes": 0, 2024-05-09T06:03:40.648 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_pglog_items": 0, 2024-05-09T06:03:40.648 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_bytes": 0, 2024-05-09T06:03:40.648 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_items": 0, 2024-05-09T06:03:40.648 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_mapping_bytes": 0, 2024-05-09T06:03:40.649 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_mapping_items": 0, 2024-05-09T06:03:40.649 INFO:teuthology.orchestra.run.smithi039.stdout: "pgmap_bytes": 0, 2024-05-09T06:03:40.649 INFO:teuthology.orchestra.run.smithi039.stdout: "pgmap_items": 0, 2024-05-09T06:03:40.649 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_co_bytes": 928, 2024-05-09T06:03:40.649 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_co_items": 2, 2024-05-09T06:03:40.649 INFO:teuthology.orchestra.run.smithi039.stdout: "unittest_1_bytes": 0, 2024-05-09T06:03:40.649 INFO:teuthology.orchestra.run.smithi039.stdout: "unittest_1_items": 0, 2024-05-09T06:03:40.649 INFO:teuthology.orchestra.run.smithi039.stdout: "unittest_2_bytes": 0, 2024-05-09T06:03:40.649 INFO:teuthology.orchestra.run.smithi039.stdout: "unittest_2_items": 0 2024-05-09T06:03:40.649 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:40.650 INFO:teuthology.orchestra.run.smithi039.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-09T06:03:40.650 INFO:teuthology.orchestra.run.smithi039.stdout: "val": 0, 2024-05-09T06:03:40.650 INFO:teuthology.orchestra.run.smithi039.stdout: "max": 104857600, 2024-05-09T06:03:40.650 INFO:teuthology.orchestra.run.smithi039.stdout: "get_started": 0, 2024-05-09T06:03:40.650 INFO:teuthology.orchestra.run.smithi039.stdout: "get": 471, 2024-05-09T06:03:40.650 INFO:teuthology.orchestra.run.smithi039.stdout: "get_sum": 818065, 2024-05-09T06:03:40.650 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_fail": 0, 2024-05-09T06:03:40.650 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_success": 471, 2024-05-09T06:03:40.650 INFO:teuthology.orchestra.run.smithi039.stdout: "take": 0, 2024-05-09T06:03:40.650 INFO:teuthology.orchestra.run.smithi039.stdout: "take_sum": 0, 2024-05-09T06:03:40.650 INFO:teuthology.orchestra.run.smithi039.stdout: "put": 471, 2024-05-09T06:03:40.651 INFO:teuthology.orchestra.run.smithi039.stdout: "put_sum": 818065, 2024-05-09T06:03:40.651 INFO:teuthology.orchestra.run.smithi039.stdout: "wait": { 2024-05-09T06:03:40.651 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-05-09T06:03:40.651 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-05-09T06:03:40.651 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-05-09T06:03:40.651 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:40.651 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:40.651 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-05-09T06:03:41.243 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.g 2024-05-09T06:03:41.243 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.g 2024-05-09T06:03:41.243 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.g 2024-05-09T06:03:41.243 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.g 2024-05-09T06:03:41.243 DEBUG:tasks.check_counter:Getting stats from j 2024-05-09T06:03:41.244 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph daemon mds.j perf dump 2024-05-09T06:03:41.416 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:03:41 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T06:03:41.416 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:03:41 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T06:03:41.416 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:03:41 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:03:41.416 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:03:41 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:03:41.416 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:03:41 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:03:41.417 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:03:41 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:03:41.417 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:03:41 smithi100 ceph-mon[34353]: Adjusting osd_memory_target on smithi039 to 176.2M 2024-05-09T06:03:41.417 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:03:41 smithi100 ceph-mon[34353]: Unable to set osd_memory_target on smithi039 to 184773836: error parsing value: Value '184773836' is below minimum 939524096 2024-05-09T06:03:41.417 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:03:41 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:03:41.417 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:03:41 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:03:41.417 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:03:41 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T06:03:41.417 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:03:41 smithi100 ceph-mon[34353]: pgmap v1159: 97 pgs: 97 active+clean; 528 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 3.6 MiB/s wr, 162 op/s 2024-05-09T06:03:41.499 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T06:03:41.539 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:03:41 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T06:03:41.539 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:03:41 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T06:03:41.539 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:03:41 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:03:41.539 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:03:41 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:03:41.539 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:03:41 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:03:41.539 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:03:41 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:03:41.540 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:03:41 smithi060 ceph-mon[34555]: Adjusting osd_memory_target on smithi039 to 176.2M 2024-05-09T06:03:41.540 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:03:41 smithi060 ceph-mon[34555]: Unable to set osd_memory_target on smithi039 to 184773836: error parsing value: Value '184773836' is below minimum 939524096 2024-05-09T06:03:41.540 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:03:41 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:03:41.540 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:03:41 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:03:41.540 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:03:41 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T06:03:41.540 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:03:41 smithi060 ceph-mon[34555]: pgmap v1159: 97 pgs: 97 active+clean; 528 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 3.6 MiB/s wr, 162 op/s 2024-05-09T06:03:41.602 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:03:41 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T06:03:41.602 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:03:41 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T06:03:41.603 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:03:41 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:03:41.603 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:03:41 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:03:41.603 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:03:41 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:03:41.603 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:03:41 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-09T06:03:41.603 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:03:41 smithi039 ceph-mon[30439]: Adjusting osd_memory_target on smithi039 to 176.2M 2024-05-09T06:03:41.603 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:03:41 smithi039 ceph-mon[30439]: Unable to set osd_memory_target on smithi039 to 184773836: error parsing value: Value '184773836' is below minimum 939524096 2024-05-09T06:03:41.603 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:03:41 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T06:03:41.603 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:03:41 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T06:03:41.603 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:03:41 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' 2024-05-09T06:03:41.603 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:03:41 smithi039 ceph-mon[30439]: pgmap v1159: 97 pgs: 97 active+clean; 528 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 3.6 MiB/s wr, 162 op/s 2024-05-09T06:03:43.170 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-05-09T06:03:43.170 INFO:teuthology.orchestra.run.smithi039.stdout: "AsyncMessenger::Worker-0": { 2024-05-09T06:03:43.171 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_messages": 0, 2024-05-09T06:03:43.171 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages": 2, 2024-05-09T06:03:43.171 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_bytes": 0, 2024-05-09T06:03:43.171 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_bytes": 0, 2024-05-09T06:03:43.171 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_created_connections": 4, 2024-05-09T06:03:43.171 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_active_connections": 0, 2024-05-09T06:03:43.171 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_total_time": 0.001501102, 2024-05-09T06:03:43.171 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_send_time": 0.000000000, 2024-05-09T06:03:43.171 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_recv_time": 0.000331063, 2024-05-09T06:03:43.171 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-09T06:03:43.171 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T06:03:43.171 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-05-09T06:03:43.171 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-05-09T06:03:43.172 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-05-09T06:03:43.172 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:43.172 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_handle_ack_lat": { 2024-05-09T06:03:43.172 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-05-09T06:03:43.172 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-05-09T06:03:43.172 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-05-09T06:03:43.172 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:43.172 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-09T06:03:43.172 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_encrypted_bytes": 0 2024-05-09T06:03:43.172 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:43.172 INFO:teuthology.orchestra.run.smithi039.stdout: "AsyncMessenger::Worker-1": { 2024-05-09T06:03:43.172 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_messages": 474, 2024-05-09T06:03:43.172 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages": 469, 2024-05-09T06:03:43.172 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_bytes": 885776, 2024-05-09T06:03:43.173 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_bytes": 290352, 2024-05-09T06:03:43.173 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_created_connections": 2, 2024-05-09T06:03:43.173 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_active_connections": 1, 2024-05-09T06:03:43.173 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_total_time": 0.063092926, 2024-05-09T06:03:43.173 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_send_time": 0.025755531, 2024-05-09T06:03:43.173 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_recv_time": 0.028245281, 2024-05-09T06:03:43.173 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_fast_dispatch_time": 0.008577435, 2024-05-09T06:03:43.173 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T06:03:43.173 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 468, 2024-05-09T06:03:43.173 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.017754686, 2024-05-09T06:03:43.173 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000037937 2024-05-09T06:03:43.173 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:43.173 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_handle_ack_lat": { 2024-05-09T06:03:43.173 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-05-09T06:03:43.173 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-05-09T06:03:43.174 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-05-09T06:03:43.174 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:43.174 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_encrypted_bytes": 885776, 2024-05-09T06:03:43.174 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_encrypted_bytes": 290352 2024-05-09T06:03:43.174 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:43.174 INFO:teuthology.orchestra.run.smithi039.stdout: "AsyncMessenger::Worker-2": { 2024-05-09T06:03:43.174 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_messages": 6, 2024-05-09T06:03:43.174 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages": 361, 2024-05-09T06:03:43.174 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_bytes": 3360, 2024-05-09T06:03:43.174 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_bytes": 221264, 2024-05-09T06:03:43.174 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_created_connections": 4, 2024-05-09T06:03:43.174 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_active_connections": 2, 2024-05-09T06:03:43.174 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_total_time": 0.024280419, 2024-05-09T06:03:43.174 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_send_time": 0.019097878, 2024-05-09T06:03:43.175 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_recv_time": 0.001940576, 2024-05-09T06:03:43.175 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-09T06:03:43.175 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T06:03:43.175 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 360, 2024-05-09T06:03:43.175 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.017527086, 2024-05-09T06:03:43.175 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000048686 2024-05-09T06:03:43.175 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:43.175 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_handle_ack_lat": { 2024-05-09T06:03:43.175 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-05-09T06:03:43.175 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-05-09T06:03:43.175 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-05-09T06:03:43.175 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:43.175 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_recv_encrypted_bytes": 3360, 2024-05-09T06:03:43.176 INFO:teuthology.orchestra.run.smithi039.stdout: "msgr_send_encrypted_bytes": 221264 2024-05-09T06:03:43.176 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:43.176 INFO:teuthology.orchestra.run.smithi039.stdout: "cct": { 2024-05-09T06:03:43.176 INFO:teuthology.orchestra.run.smithi039.stdout: "total_workers": 0, 2024-05-09T06:03:43.176 INFO:teuthology.orchestra.run.smithi039.stdout: "unhealthy_workers": 0 2024-05-09T06:03:43.176 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:43.176 INFO:teuthology.orchestra.run.smithi039.stdout: "mempool": { 2024-05-09T06:03:43.176 INFO:teuthology.orchestra.run.smithi039.stdout: "bloom_filter_bytes": 0, 2024-05-09T06:03:43.176 INFO:teuthology.orchestra.run.smithi039.stdout: "bloom_filter_items": 0, 2024-05-09T06:03:43.176 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_alloc_bytes": 0, 2024-05-09T06:03:43.176 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_alloc_items": 0, 2024-05-09T06:03:43.176 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_data_bytes": 0, 2024-05-09T06:03:43.176 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_data_items": 0, 2024-05-09T06:03:43.176 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-09T06:03:43.176 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_onode_items": 0, 2024-05-09T06:03:43.177 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-09T06:03:43.177 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_meta_items": 0, 2024-05-09T06:03:43.177 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_other_bytes": 0, 2024-05-09T06:03:43.177 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_other_items": 0, 2024-05-09T06:03:43.177 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-09T06:03:43.177 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_cache_buffer_items": 0, 2024-05-09T06:03:43.177 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_extent_bytes": 0, 2024-05-09T06:03:43.177 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_extent_items": 0, 2024-05-09T06:03:43.177 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_blob_bytes": 0, 2024-05-09T06:03:43.177 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_blob_items": 0, 2024-05-09T06:03:43.177 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-09T06:03:43.177 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_shared_blob_items": 0, 2024-05-09T06:03:43.177 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-09T06:03:43.177 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_inline_bl_items": 0, 2024-05-09T06:03:43.177 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_fsck_bytes": 0, 2024-05-09T06:03:43.178 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_fsck_items": 0, 2024-05-09T06:03:43.178 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_txc_bytes": 0, 2024-05-09T06:03:43.178 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_txc_items": 0, 2024-05-09T06:03:43.178 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-09T06:03:43.178 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_writing_deferred_items": 0, 2024-05-09T06:03:43.178 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_writing_bytes": 0, 2024-05-09T06:03:43.178 INFO:teuthology.orchestra.run.smithi039.stdout: "bluestore_writing_items": 0, 2024-05-09T06:03:43.178 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_bytes": 0, 2024-05-09T06:03:43.178 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_items": 0, 2024-05-09T06:03:43.178 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_file_reader_bytes": 0, 2024-05-09T06:03:43.178 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_file_reader_items": 0, 2024-05-09T06:03:43.178 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_file_writer_bytes": 0, 2024-05-09T06:03:43.178 INFO:teuthology.orchestra.run.smithi039.stdout: "bluefs_file_writer_items": 0, 2024-05-09T06:03:43.178 INFO:teuthology.orchestra.run.smithi039.stdout: "buffer_anon_bytes": 148721, 2024-05-09T06:03:43.179 INFO:teuthology.orchestra.run.smithi039.stdout: "buffer_anon_items": 30, 2024-05-09T06:03:43.179 INFO:teuthology.orchestra.run.smithi039.stdout: "buffer_meta_bytes": 0, 2024-05-09T06:03:43.179 INFO:teuthology.orchestra.run.smithi039.stdout: "buffer_meta_items": 0, 2024-05-09T06:03:43.179 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_bytes": 0, 2024-05-09T06:03:43.179 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_items": 0, 2024-05-09T06:03:43.179 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_mapbl_bytes": 0, 2024-05-09T06:03:43.179 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_mapbl_items": 0, 2024-05-09T06:03:43.179 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_pglog_bytes": 0, 2024-05-09T06:03:43.179 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_pglog_items": 0, 2024-05-09T06:03:43.179 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_bytes": 0, 2024-05-09T06:03:43.179 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_items": 0, 2024-05-09T06:03:43.179 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_mapping_bytes": 0, 2024-05-09T06:03:43.179 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_mapping_items": 0, 2024-05-09T06:03:43.179 INFO:teuthology.orchestra.run.smithi039.stdout: "pgmap_bytes": 0, 2024-05-09T06:03:43.179 INFO:teuthology.orchestra.run.smithi039.stdout: "pgmap_items": 0, 2024-05-09T06:03:43.180 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_co_bytes": 928, 2024-05-09T06:03:43.180 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_co_items": 2, 2024-05-09T06:03:43.180 INFO:teuthology.orchestra.run.smithi039.stdout: "unittest_1_bytes": 0, 2024-05-09T06:03:43.180 INFO:teuthology.orchestra.run.smithi039.stdout: "unittest_1_items": 0, 2024-05-09T06:03:43.180 INFO:teuthology.orchestra.run.smithi039.stdout: "unittest_2_bytes": 0, 2024-05-09T06:03:43.180 INFO:teuthology.orchestra.run.smithi039.stdout: "unittest_2_items": 0 2024-05-09T06:03:43.180 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-09T06:03:43.180 INFO:teuthology.orchestra.run.smithi039.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-09T06:03:43.180 INFO:teuthology.orchestra.run.smithi039.stdout: "val": 0, 2024-05-09T06:03:43.180 INFO:teuthology.orchestra.run.smithi039.stdout: "max": 104857600, 2024-05-09T06:03:43.180 INFO:teuthology.orchestra.run.smithi039.stdout: "get_started": 0, 2024-05-09T06:03:43.180 INFO:teuthology.orchestra.run.smithi039.stdout: "get": 476, 2024-05-09T06:03:43.180 INFO:teuthology.orchestra.run.smithi039.stdout: "get_sum": 818715, 2024-05-09T06:03:43.180 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_fail": 0, 2024-05-09T06:03:43.180 INFO:teuthology.orchestra.run.smithi039.stdout: "get_or_fail_success": 476, 2024-05-09T06:03:43.181 INFO:teuthology.orchestra.run.smithi039.stdout: "take": 0, 2024-05-09T06:03:43.181 INFO:teuthology.orchestra.run.smithi039.stdout: "take_sum": 0, 2024-05-09T06:03:43.181 INFO:teuthology.orchestra.run.smithi039.stdout: "put": 476, 2024-05-09T06:03:43.181 INFO:teuthology.orchestra.run.smithi039.stdout: "put_sum": 818715, 2024-05-09T06:03:43.181 INFO:teuthology.orchestra.run.smithi039.stdout: "wait": { 2024-05-09T06:03:43.181 INFO:teuthology.orchestra.run.smithi039.stdout: "avgcount": 0, 2024-05-09T06:03:43.181 INFO:teuthology.orchestra.run.smithi039.stdout: "sum": 0.000000000, 2024-05-09T06:03:43.181 INFO:teuthology.orchestra.run.smithi039.stdout: "avgtime": 0.000000000 2024-05-09T06:03:43.181 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:43.181 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-09T06:03:43.181 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-05-09T06:03:43.839 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:03:43 smithi039 ceph-mon[30439]: pgmap v1160: 97 pgs: 97 active+clean; 519 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 3.5 MiB/s wr, 135 op/s 2024-05-09T06:03:43.866 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-05-09T06:03:43.866 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-05-09T06:03:43.866 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.j 2024-05-09T06:03:43.867 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.j 2024-05-09T06:03:43.867 DEBUG:tasks.check_counter:Getting stats from b 2024-05-09T06:03:43.867 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph daemon mds.b perf dump 2024-05-09T06:03:43.916 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:03:43 smithi100 ceph-mon[34353]: pgmap v1160: 97 pgs: 97 active+clean; 519 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 3.5 MiB/s wr, 135 op/s 2024-05-09T06:03:44.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:03:43 smithi060 ceph-mon[34555]: pgmap v1160: 97 pgs: 97 active+clean; 519 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 3.5 MiB/s wr, 135 op/s 2024-05-09T06:03:45.003 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.b/config 2024-05-09T06:03:45.789 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:03:45 smithi060 ceph-mon[34555]: pgmap v1161: 97 pgs: 97 active+clean; 512 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 3.3 MiB/s wr, 119 op/s 2024-05-09T06:03:45.916 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:03:45 smithi100 ceph-mon[34353]: pgmap v1161: 97 pgs: 97 active+clean; 512 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 3.3 MiB/s wr, 119 op/s 2024-05-09T06:03:46.102 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:03:45 smithi039 ceph-mon[30439]: pgmap v1161: 97 pgs: 97 active+clean; 512 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 3.3 MiB/s wr, 119 op/s 2024-05-09T06:03:47.356 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-05-09T06:03:47.357 INFO:teuthology.orchestra.run.smithi060.stdout: "AsyncMessenger::Worker-0": { 2024-05-09T06:03:47.357 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_messages": 433271, 2024-05-09T06:03:47.357 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages": 630006, 2024-05-09T06:03:47.357 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_bytes": 98632959, 2024-05-09T06:03:47.357 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_bytes": 808532985, 2024-05-09T06:03:47.357 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_created_connections": 10, 2024-05-09T06:03:47.357 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_active_connections": 4, 2024-05-09T06:03:47.357 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_total_time": 34.624562463, 2024-05-09T06:03:47.357 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_send_time": 14.501141200, 2024-05-09T06:03:47.357 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_recv_time": 16.054835737, 2024-05-09T06:03:47.357 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_fast_dispatch_time": 4.622470792, 2024-05-09T06:03:47.357 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T06:03:47.357 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 630005, 2024-05-09T06:03:47.358 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 22.530326709, 2024-05-09T06:03:47.358 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000035762 2024-05-09T06:03:47.358 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:47.358 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_handle_ack_lat": { 2024-05-09T06:03:47.358 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 806121, 2024-05-09T06:03:47.358 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.154621648, 2024-05-09T06:03:47.358 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000191 2024-05-09T06:03:47.358 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:47.358 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_encrypted_bytes": 33536, 2024-05-09T06:03:47.358 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_encrypted_bytes": 1904 2024-05-09T06:03:47.358 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:47.358 INFO:teuthology.orchestra.run.smithi060.stdout: "AsyncMessenger::Worker-1": { 2024-05-09T06:03:47.359 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_messages": 387040, 2024-05-09T06:03:47.359 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages": 581915, 2024-05-09T06:03:47.359 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_bytes": 82933648, 2024-05-09T06:03:47.359 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_bytes": 532354446, 2024-05-09T06:03:47.359 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_created_connections": 8, 2024-05-09T06:03:47.359 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_active_connections": 5, 2024-05-09T06:03:47.359 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_total_time": 29.261396320, 2024-05-09T06:03:47.359 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_send_time": 11.167461854, 2024-05-09T06:03:47.359 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_recv_time": 15.205330526, 2024-05-09T06:03:47.359 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_fast_dispatch_time": 3.595376350, 2024-05-09T06:03:47.359 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T06:03:47.359 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 581916, 2024-05-09T06:03:47.359 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 20.844528642, 2024-05-09T06:03:47.359 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000035820 2024-05-09T06:03:47.360 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:47.360 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_handle_ack_lat": { 2024-05-09T06:03:47.360 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 766173, 2024-05-09T06:03:47.360 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.143399772, 2024-05-09T06:03:47.360 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000187 2024-05-09T06:03:47.360 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:47.360 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_encrypted_bytes": 160, 2024-05-09T06:03:47.360 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_encrypted_bytes": 714736 2024-05-09T06:03:47.360 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:47.360 INFO:teuthology.orchestra.run.smithi060.stdout: "AsyncMessenger::Worker-2": { 2024-05-09T06:03:47.360 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_messages": 1103162, 2024-05-09T06:03:47.360 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages": 1677066, 2024-05-09T06:03:47.360 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_bytes": 391367732, 2024-05-09T06:03:47.360 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_bytes": 1645340708, 2024-05-09T06:03:47.360 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_created_connections": 14, 2024-05-09T06:03:47.361 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_active_connections": 6, 2024-05-09T06:03:47.361 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_total_time": 78.377788293, 2024-05-09T06:03:47.361 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_send_time": 35.546865262, 2024-05-09T06:03:47.361 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_recv_time": 52.017890578, 2024-05-09T06:03:47.361 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_fast_dispatch_time": 2.965807841, 2024-05-09T06:03:47.361 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T06:03:47.361 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 1677062, 2024-05-09T06:03:47.361 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 55.908995796, 2024-05-09T06:03:47.361 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000033337 2024-05-09T06:03:47.361 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:47.361 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_handle_ack_lat": { 2024-05-09T06:03:47.361 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 2461176, 2024-05-09T06:03:47.361 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.414438993, 2024-05-09T06:03:47.361 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000168 2024-05-09T06:03:47.362 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:47.362 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_encrypted_bytes": 376156624, 2024-05-09T06:03:47.362 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_encrypted_bytes": 1398748240 2024-05-09T06:03:47.362 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:47.362 INFO:teuthology.orchestra.run.smithi060.stdout: "cct": { 2024-05-09T06:03:47.362 INFO:teuthology.orchestra.run.smithi060.stdout: "total_workers": 1, 2024-05-09T06:03:47.362 INFO:teuthology.orchestra.run.smithi060.stdout: "unhealthy_workers": 0 2024-05-09T06:03:47.362 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:47.362 INFO:teuthology.orchestra.run.smithi060.stdout: "finisher-MDSRank": { 2024-05-09T06:03:47.362 INFO:teuthology.orchestra.run.smithi060.stdout: "queue_len": 0, 2024-05-09T06:03:47.362 INFO:teuthology.orchestra.run.smithi060.stdout: "complete_latency": { 2024-05-09T06:03:47.362 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 258687, 2024-05-09T06:03:47.362 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 500.287189721, 2024-05-09T06:03:47.363 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.001933947 2024-05-09T06:03:47.363 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-05-09T06:03:47.363 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:47.363 INFO:teuthology.orchestra.run.smithi060.stdout: "finisher-PurgeQueue": { 2024-05-09T06:03:47.363 INFO:teuthology.orchestra.run.smithi060.stdout: "queue_len": 0, 2024-05-09T06:03:47.363 INFO:teuthology.orchestra.run.smithi060.stdout: "complete_latency": { 2024-05-09T06:03:47.363 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 192704, 2024-05-09T06:03:47.363 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 70.748981797, 2024-05-09T06:03:47.363 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000367138 2024-05-09T06:03:47.363 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-05-09T06:03:47.363 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:47.363 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": { 2024-05-09T06:03:47.363 INFO:teuthology.orchestra.run.smithi060.stdout: "request": 753720, 2024-05-09T06:03:47.363 INFO:teuthology.orchestra.run.smithi060.stdout: "reply": 738017, 2024-05-09T06:03:47.364 INFO:teuthology.orchestra.run.smithi060.stdout: "reply_latency": { 2024-05-09T06:03:47.364 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 738017, 2024-05-09T06:03:47.364 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 6508.660534240, 2024-05-09T06:03:47.364 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.008819120 2024-05-09T06:03:47.364 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:47.364 INFO:teuthology.orchestra.run.smithi060.stdout: "slow_reply": 0, 2024-05-09T06:03:47.364 INFO:teuthology.orchestra.run.smithi060.stdout: "forward": 15703, 2024-05-09T06:03:47.364 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_fetch_complete": 0, 2024-05-09T06:03:47.365 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_fetch_keys": 0, 2024-05-09T06:03:47.365 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_commit": 615, 2024-05-09T06:03:47.365 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_split": 35, 2024-05-09T06:03:47.365 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_merge": 50, 2024-05-09T06:03:47.365 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes": 5992, 2024-05-09T06:03:47.365 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes_top": 2576, 2024-05-09T06:03:47.365 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes_bottom": 1783, 2024-05-09T06:03:47.365 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes_pin_tail": 1633, 2024-05-09T06:03:47.365 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes_pinned": 2308, 2024-05-09T06:03:47.365 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes_expired": 440, 2024-05-09T06:03:47.365 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes_with_caps": 443, 2024-05-09T06:03:47.365 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": 443, 2024-05-09T06:03:47.365 INFO:teuthology.orchestra.run.smithi060.stdout: "subtrees": 4, 2024-05-09T06:03:47.365 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse": 1169186, 2024-05-09T06:03:47.365 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse_hit": 664696, 2024-05-09T06:03:47.366 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse_forward": 15698, 2024-05-09T06:03:47.366 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse_discover": 16, 2024-05-09T06:03:47.366 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse_dir_fetch": 0, 2024-05-09T06:03:47.366 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse_remote_ino": 0, 2024-05-09T06:03:47.366 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse_lock": 9835, 2024-05-09T06:03:47.366 INFO:teuthology.orchestra.run.smithi060.stdout: "load_cent": 0, 2024-05-09T06:03:47.366 INFO:teuthology.orchestra.run.smithi060.stdout: "q": 0, 2024-05-09T06:03:47.366 INFO:teuthology.orchestra.run.smithi060.stdout: "exported": 12, 2024-05-09T06:03:47.366 INFO:teuthology.orchestra.run.smithi060.stdout: "exported_inodes": 212, 2024-05-09T06:03:47.366 INFO:teuthology.orchestra.run.smithi060.stdout: "imported": 11, 2024-05-09T06:03:47.366 INFO:teuthology.orchestra.run.smithi060.stdout: "imported_inodes": 143, 2024-05-09T06:03:47.366 INFO:teuthology.orchestra.run.smithi060.stdout: "openino_dir_fetch": 0, 2024-05-09T06:03:47.366 INFO:teuthology.orchestra.run.smithi060.stdout: "openino_backtrace_fetch": 0, 2024-05-09T06:03:47.367 INFO:teuthology.orchestra.run.smithi060.stdout: "openino_peer_discover": 0, 2024-05-09T06:03:47.367 INFO:teuthology.orchestra.run.smithi060.stdout: "root_rfiles": 4, 2024-05-09T06:03:47.367 INFO:teuthology.orchestra.run.smithi060.stdout: "root_rbytes": 234, 2024-05-09T06:03:47.367 INFO:teuthology.orchestra.run.smithi060.stdout: "root_rsnaps": 0, 2024-05-09T06:03:47.367 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_backtrace_fetch": 0, 2024-05-09T06:03:47.367 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_set_tag": 0, 2024-05-09T06:03:47.367 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_backtrace_repaired": 0, 2024-05-09T06:03:47.367 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_inotable_repaired": 0, 2024-05-09T06:03:47.367 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_dir_inodes": 0, 2024-05-09T06:03:47.367 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_dir_base_inodes": 0, 2024-05-09T06:03:47.367 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_dirfrag_rstats": 0, 2024-05-09T06:03:47.367 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_file_inodes": 0, 2024-05-09T06:03:47.367 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_inode_file_caps": 30, 2024-05-09T06:03:47.367 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_cap_op_revoke": 52834, 2024-05-09T06:03:47.367 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_cap_op_grant": 441830, 2024-05-09T06:03:47.368 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_cap_op_trunc": 0, 2024-05-09T06:03:47.368 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-09T06:03:47.368 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-09T06:03:47.368 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_client_caps": 218416, 2024-05-09T06:03:47.368 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_client_caps_dirty": 96655, 2024-05-09T06:03:47.368 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_client_cap_release": 40976, 2024-05-09T06:03:47.368 INFO:teuthology.orchestra.run.smithi060.stdout: "process_request_cap_release": 466254 2024-05-09T06:03:47.368 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:47.368 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_cache": { 2024-05-09T06:03:47.368 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_update": 413, 2024-05-09T06:03:47.368 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_update_receipt": 18, 2024-05-09T06:03:47.368 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_try_discover": 12, 2024-05-09T06:03:47.368 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_send_discover": 22, 2024-05-09T06:03:47.368 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_handle_discover": 1622, 2024-05-09T06:03:47.368 INFO:teuthology.orchestra.run.smithi060.stdout: "num_strays": 469, 2024-05-09T06:03:47.369 INFO:teuthology.orchestra.run.smithi060.stdout: "num_strays_delayed": 0, 2024-05-09T06:03:47.369 INFO:teuthology.orchestra.run.smithi060.stdout: "num_strays_enqueuing": 0, 2024-05-09T06:03:47.369 INFO:teuthology.orchestra.run.smithi060.stdout: "strays_created": 118473, 2024-05-09T06:03:47.369 INFO:teuthology.orchestra.run.smithi060.stdout: "strays_enqueued": 118004, 2024-05-09T06:03:47.369 INFO:teuthology.orchestra.run.smithi060.stdout: "strays_reintegrated": 0, 2024-05-09T06:03:47.369 INFO:teuthology.orchestra.run.smithi060.stdout: "strays_migrated": 0, 2024-05-09T06:03:47.369 INFO:teuthology.orchestra.run.smithi060.stdout: "num_recovering_processing": 0, 2024-05-09T06:03:47.369 INFO:teuthology.orchestra.run.smithi060.stdout: "num_recovering_enqueued": 0, 2024-05-09T06:03:47.369 INFO:teuthology.orchestra.run.smithi060.stdout: "num_recovering_prioritized": 0, 2024-05-09T06:03:47.369 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_started": 0, 2024-05-09T06:03:47.369 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_completed": 0, 2024-05-09T06:03:47.369 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_quiesce_path": 0, 2024-05-09T06:03:47.369 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_quiesce_inode": 0, 2024-05-09T06:03:47.369 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_enqueue_scrub": 0, 2024-05-09T06:03:47.369 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_exportdir": 12, 2024-05-09T06:03:47.370 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_flush": 0, 2024-05-09T06:03:47.370 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_fragmentdir": 85, 2024-05-09T06:03:47.370 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_fragstats": 0, 2024-05-09T06:03:47.370 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_inodestats": 0 2024-05-09T06:03:47.370 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:47.370 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_log": { 2024-05-09T06:03:47.370 INFO:teuthology.orchestra.run.smithi060.stdout: "evlrg": 0, 2024-05-09T06:03:47.370 INFO:teuthology.orchestra.run.smithi060.stdout: "evadd": 571520, 2024-05-09T06:03:47.370 INFO:teuthology.orchestra.run.smithi060.stdout: "evex": 464147, 2024-05-09T06:03:47.370 INFO:teuthology.orchestra.run.smithi060.stdout: "evtrm": 454731, 2024-05-09T06:03:47.370 INFO:teuthology.orchestra.run.smithi060.stdout: "ev": 116789, 2024-05-09T06:03:47.370 INFO:teuthology.orchestra.run.smithi060.stdout: "evexg": 0, 2024-05-09T06:03:47.370 INFO:teuthology.orchestra.run.smithi060.stdout: "evexd": 9416, 2024-05-09T06:03:47.370 INFO:teuthology.orchestra.run.smithi060.stdout: "segadd": 679, 2024-05-09T06:03:47.371 INFO:teuthology.orchestra.run.smithi060.stdout: "segex": 551, 2024-05-09T06:03:47.371 INFO:teuthology.orchestra.run.smithi060.stdout: "segtrm": 541, 2024-05-09T06:03:47.371 INFO:teuthology.orchestra.run.smithi060.stdout: "seg": 138, 2024-05-09T06:03:47.371 INFO:teuthology.orchestra.run.smithi060.stdout: "segmjr": 10, 2024-05-09T06:03:47.371 INFO:teuthology.orchestra.run.smithi060.stdout: "segexg": 0, 2024-05-09T06:03:47.371 INFO:teuthology.orchestra.run.smithi060.stdout: "segexd": 10, 2024-05-09T06:03:47.371 INFO:teuthology.orchestra.run.smithi060.stdout: "expos": 963668934, 2024-05-09T06:03:47.371 INFO:teuthology.orchestra.run.smithi060.stdout: "wrpos": 1208037160, 2024-05-09T06:03:47.371 INFO:teuthology.orchestra.run.smithi060.stdout: "rdpos": 0, 2024-05-09T06:03:47.371 INFO:teuthology.orchestra.run.smithi060.stdout: "jlat": { 2024-05-09T06:03:47.371 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 154815, 2024-05-09T06:03:47.371 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 1171.940045842, 2024-05-09T06:03:47.371 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.007569938 2024-05-09T06:03:47.371 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:47.371 INFO:teuthology.orchestra.run.smithi060.stdout: "replayed": 0 2024-05-09T06:03:47.372 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:47.372 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_mem": { 2024-05-09T06:03:47.372 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 629, 2024-05-09T06:03:47.372 INFO:teuthology.orchestra.run.smithi060.stdout: "ino+": 118778, 2024-05-09T06:03:47.372 INFO:teuthology.orchestra.run.smithi060.stdout: "ino-": 118149, 2024-05-09T06:03:47.372 INFO:teuthology.orchestra.run.smithi060.stdout: "dir": 110, 2024-05-09T06:03:47.372 INFO:teuthology.orchestra.run.smithi060.stdout: "dir+": 480, 2024-05-09T06:03:47.372 INFO:teuthology.orchestra.run.smithi060.stdout: "dir-": 370, 2024-05-09T06:03:47.372 INFO:teuthology.orchestra.run.smithi060.stdout: "dn": 5773, 2024-05-09T06:03:47.372 INFO:teuthology.orchestra.run.smithi060.stdout: "dn+": 247280, 2024-05-09T06:03:47.372 INFO:teuthology.orchestra.run.smithi060.stdout: "dn-": 241507, 2024-05-09T06:03:47.372 INFO:teuthology.orchestra.run.smithi060.stdout: "cap": 443, 2024-05-09T06:03:47.372 INFO:teuthology.orchestra.run.smithi060.stdout: "cap+": 128915, 2024-05-09T06:03:47.372 INFO:teuthology.orchestra.run.smithi060.stdout: "cap-": 128472, 2024-05-09T06:03:47.373 INFO:teuthology.orchestra.run.smithi060.stdout: "rss": 177332, 2024-05-09T06:03:47.373 INFO:teuthology.orchestra.run.smithi060.stdout: "heap": 231824 2024-05-09T06:03:47.373 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:47.373 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_server": { 2024-05-09T06:03:47.373 INFO:teuthology.orchestra.run.smithi060.stdout: "dispatch_client_request": 975247, 2024-05-09T06:03:47.373 INFO:teuthology.orchestra.run.smithi060.stdout: "dispatch_server_request": 24559, 2024-05-09T06:03:47.373 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_client_request": 753720, 2024-05-09T06:03:47.373 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_client_session": 18640, 2024-05-09T06:03:47.373 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_peer_request": 53326, 2024-05-09T06:03:47.373 INFO:teuthology.orchestra.run.smithi060.stdout: "req_create_latency": { 2024-05-09T06:03:47.373 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 118465, 2024-05-09T06:03:47.373 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 983.147099493, 2024-05-09T06:03:47.373 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.008299051 2024-05-09T06:03:47.373 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:47.373 INFO:teuthology.orchestra.run.smithi060.stdout: "req_getattr_latency": { 2024-05-09T06:03:47.374 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 27497, 2024-05-09T06:03:47.374 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 478.197684221, 2024-05-09T06:03:47.374 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.017390903 2024-05-09T06:03:47.374 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:47.374 INFO:teuthology.orchestra.run.smithi060.stdout: "req_getfilelock_latency": { 2024-05-09T06:03:47.374 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:47.374 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:47.374 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:47.374 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:47.374 INFO:teuthology.orchestra.run.smithi060.stdout: "req_link_latency": { 2024-05-09T06:03:47.374 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:47.374 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:47.374 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:47.374 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:47.375 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lookup_latency": { 2024-05-09T06:03:47.375 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 266885, 2024-05-09T06:03:47.375 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 1855.425333886, 2024-05-09T06:03:47.375 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.006952152 2024-05-09T06:03:47.375 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:47.375 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lookuphash_latency": { 2024-05-09T06:03:47.375 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:47.375 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:47.375 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:47.375 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:47.375 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lookupino_latency": { 2024-05-09T06:03:47.375 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 2, 2024-05-09T06:03:47.375 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000315722, 2024-05-09T06:03:47.375 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000157861 2024-05-09T06:03:47.375 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:47.376 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lookupname_latency": { 2024-05-09T06:03:47.376 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:47.376 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:47.376 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:47.376 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:47.376 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lookupparent_latency": { 2024-05-09T06:03:47.376 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:47.376 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:47.376 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:47.376 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:47.377 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lookupsnap_latency": { 2024-05-09T06:03:47.377 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:47.377 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:47.377 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:47.377 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:47.377 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lssnap_latency": { 2024-05-09T06:03:47.377 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:47.377 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:47.377 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:47.378 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:47.378 INFO:teuthology.orchestra.run.smithi060.stdout: "req_mkdir_latency": { 2024-05-09T06:03:47.378 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 119, 2024-05-09T06:03:47.378 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.839395535, 2024-05-09T06:03:47.378 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.007053743 2024-05-09T06:03:47.378 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:47.378 INFO:teuthology.orchestra.run.smithi060.stdout: "req_mknod_latency": { 2024-05-09T06:03:47.378 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:47.378 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:47.378 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:47.378 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:47.378 INFO:teuthology.orchestra.run.smithi060.stdout: "req_mksnap_latency": { 2024-05-09T06:03:47.378 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:47.378 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:47.378 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:47.379 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:47.379 INFO:teuthology.orchestra.run.smithi060.stdout: "req_open_latency": { 2024-05-09T06:03:47.379 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 10, 2024-05-09T06:03:47.379 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.017690239, 2024-05-09T06:03:47.379 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.001769023 2024-05-09T06:03:47.379 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:47.379 INFO:teuthology.orchestra.run.smithi060.stdout: "req_readdir_latency": { 2024-05-09T06:03:47.379 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 177438, 2024-05-09T06:03:47.379 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 1997.600178191, 2024-05-09T06:03:47.379 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.011258017 2024-05-09T06:03:47.379 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:47.379 INFO:teuthology.orchestra.run.smithi060.stdout: "req_rename_latency": { 2024-05-09T06:03:47.379 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 24899, 2024-05-09T06:03:47.379 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 217.303527624, 2024-05-09T06:03:47.380 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.008727399 2024-05-09T06:03:47.380 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:47.380 INFO:teuthology.orchestra.run.smithi060.stdout: "req_renamesnap_latency": { 2024-05-09T06:03:47.380 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:47.380 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:47.380 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:47.380 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:47.380 INFO:teuthology.orchestra.run.smithi060.stdout: "req_snapdiff_latency": { 2024-05-09T06:03:47.380 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:47.380 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:47.380 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:47.380 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:47.380 INFO:teuthology.orchestra.run.smithi060.stdout: "req_rmdir_latency": { 2024-05-09T06:03:47.380 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 114, 2024-05-09T06:03:47.381 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.863634117, 2024-05-09T06:03:47.381 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.007575737 2024-05-09T06:03:47.381 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:47.381 INFO:teuthology.orchestra.run.smithi060.stdout: "req_rmsnap_latency": { 2024-05-09T06:03:47.381 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:47.381 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:47.381 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:47.381 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:47.381 INFO:teuthology.orchestra.run.smithi060.stdout: "req_rmxattr_latency": { 2024-05-09T06:03:47.381 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:47.381 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:47.381 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:47.381 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:47.381 INFO:teuthology.orchestra.run.smithi060.stdout: "req_setattr_latency": { 2024-05-09T06:03:47.382 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 118, 2024-05-09T06:03:47.382 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 3.987601135, 2024-05-09T06:03:47.382 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.033793229 2024-05-09T06:03:47.382 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:47.382 INFO:teuthology.orchestra.run.smithi060.stdout: "req_setdirlayout_latency": { 2024-05-09T06:03:47.382 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:47.382 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:47.382 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:47.382 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:47.382 INFO:teuthology.orchestra.run.smithi060.stdout: "req_setfilelock_latency": { 2024-05-09T06:03:47.382 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 4092, 2024-05-09T06:03:47.382 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 27.688780282, 2024-05-09T06:03:47.382 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.006766564 2024-05-09T06:03:47.383 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:47.383 INFO:teuthology.orchestra.run.smithi060.stdout: "req_setlayout_latency": { 2024-05-09T06:03:47.383 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:47.383 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:47.383 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:47.383 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:47.383 INFO:teuthology.orchestra.run.smithi060.stdout: "req_setxattr_latency": { 2024-05-09T06:03:47.383 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 8, 2024-05-09T06:03:47.383 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.025126233, 2024-05-09T06:03:47.383 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.003140779 2024-05-09T06:03:47.383 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:47.383 INFO:teuthology.orchestra.run.smithi060.stdout: "req_symlink_latency": { 2024-05-09T06:03:47.383 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:47.383 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:47.384 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:47.384 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:47.384 INFO:teuthology.orchestra.run.smithi060.stdout: "req_unlink_latency": { 2024-05-09T06:03:47.384 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 118370, 2024-05-09T06:03:47.384 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 943.564167562, 2024-05-09T06:03:47.384 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.007971311 2024-05-09T06:03:47.384 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:47.384 INFO:teuthology.orchestra.run.smithi060.stdout: "cap_revoke_eviction": 0, 2024-05-09T06:03:47.384 INFO:teuthology.orchestra.run.smithi060.stdout: "cap_acquisition_throttle": 0, 2024-05-09T06:03:47.384 INFO:teuthology.orchestra.run.smithi060.stdout: "req_getvxattr_latency": { 2024-05-09T06:03:47.384 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:47.384 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:47.384 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:47.384 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-05-09T06:03:47.385 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:47.385 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_sessions": { 2024-05-09T06:03:47.385 INFO:teuthology.orchestra.run.smithi060.stdout: "session_count": 1, 2024-05-09T06:03:47.385 INFO:teuthology.orchestra.run.smithi060.stdout: "session_add": 3, 2024-05-09T06:03:47.385 INFO:teuthology.orchestra.run.smithi060.stdout: "session_remove": 2, 2024-05-09T06:03:47.385 INFO:teuthology.orchestra.run.smithi060.stdout: "sessions_open": 1, 2024-05-09T06:03:47.385 INFO:teuthology.orchestra.run.smithi060.stdout: "sessions_stale": 0, 2024-05-09T06:03:47.385 INFO:teuthology.orchestra.run.smithi060.stdout: "total_load": 54843, 2024-05-09T06:03:47.385 INFO:teuthology.orchestra.run.smithi060.stdout: "average_load": 54843, 2024-05-09T06:03:47.385 INFO:teuthology.orchestra.run.smithi060.stdout: "avg_session_uptime": 1551, 2024-05-09T06:03:47.385 INFO:teuthology.orchestra.run.smithi060.stdout: "mdthresh_evicted": 0 2024-05-09T06:03:47.385 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:47.385 INFO:teuthology.orchestra.run.smithi060.stdout: "mempool": { 2024-05-09T06:03:47.385 INFO:teuthology.orchestra.run.smithi060.stdout: "bloom_filter_bytes": 360, 2024-05-09T06:03:47.386 INFO:teuthology.orchestra.run.smithi060.stdout: "bloom_filter_items": 360, 2024-05-09T06:03:47.386 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_alloc_bytes": 0, 2024-05-09T06:03:47.386 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_alloc_items": 0, 2024-05-09T06:03:47.386 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_data_bytes": 0, 2024-05-09T06:03:47.386 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_data_items": 0, 2024-05-09T06:03:47.386 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-09T06:03:47.386 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_onode_items": 0, 2024-05-09T06:03:47.386 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-09T06:03:47.386 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_meta_items": 0, 2024-05-09T06:03:47.386 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_other_bytes": 0, 2024-05-09T06:03:47.386 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_other_items": 0, 2024-05-09T06:03:47.386 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-09T06:03:47.386 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_buffer_items": 0, 2024-05-09T06:03:47.386 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_extent_bytes": 0, 2024-05-09T06:03:47.387 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_extent_items": 0, 2024-05-09T06:03:47.387 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_blob_bytes": 0, 2024-05-09T06:03:47.387 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_blob_items": 0, 2024-05-09T06:03:47.387 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-09T06:03:47.387 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_shared_blob_items": 0, 2024-05-09T06:03:47.387 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-09T06:03:47.387 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_inline_bl_items": 0, 2024-05-09T06:03:47.387 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_fsck_bytes": 0, 2024-05-09T06:03:47.387 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_fsck_items": 0, 2024-05-09T06:03:47.387 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_txc_bytes": 0, 2024-05-09T06:03:47.387 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_txc_items": 0, 2024-05-09T06:03:47.387 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-09T06:03:47.387 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_writing_deferred_items": 0, 2024-05-09T06:03:47.387 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_writing_bytes": 0, 2024-05-09T06:03:47.388 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_writing_items": 0, 2024-05-09T06:03:47.388 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_bytes": 0, 2024-05-09T06:03:47.388 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_items": 0, 2024-05-09T06:03:47.388 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_file_reader_bytes": 0, 2024-05-09T06:03:47.388 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_file_reader_items": 0, 2024-05-09T06:03:47.388 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_file_writer_bytes": 0, 2024-05-09T06:03:47.388 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_file_writer_items": 0, 2024-05-09T06:03:47.388 INFO:teuthology.orchestra.run.smithi060.stdout: "buffer_anon_bytes": 4641477, 2024-05-09T06:03:47.388 INFO:teuthology.orchestra.run.smithi060.stdout: "buffer_anon_items": 2097, 2024-05-09T06:03:47.388 INFO:teuthology.orchestra.run.smithi060.stdout: "buffer_meta_bytes": 0, 2024-05-09T06:03:47.388 INFO:teuthology.orchestra.run.smithi060.stdout: "buffer_meta_items": 0, 2024-05-09T06:03:47.388 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_bytes": 0, 2024-05-09T06:03:47.388 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_items": 0, 2024-05-09T06:03:47.388 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_mapbl_bytes": 0, 2024-05-09T06:03:47.389 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_mapbl_items": 0, 2024-05-09T06:03:47.389 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_pglog_bytes": 0, 2024-05-09T06:03:47.389 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_pglog_items": 0, 2024-05-09T06:03:47.389 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_bytes": 7528, 2024-05-09T06:03:47.389 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_items": 158, 2024-05-09T06:03:47.389 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_mapping_bytes": 0, 2024-05-09T06:03:47.389 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_mapping_items": 0, 2024-05-09T06:03:47.389 INFO:teuthology.orchestra.run.smithi060.stdout: "pgmap_bytes": 0, 2024-05-09T06:03:47.389 INFO:teuthology.orchestra.run.smithi060.stdout: "pgmap_items": 0, 2024-05-09T06:03:47.389 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_co_bytes": 7649607, 2024-05-09T06:03:47.389 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_co_items": 209780, 2024-05-09T06:03:47.389 INFO:teuthology.orchestra.run.smithi060.stdout: "unittest_1_bytes": 0, 2024-05-09T06:03:47.389 INFO:teuthology.orchestra.run.smithi060.stdout: "unittest_1_items": 0, 2024-05-09T06:03:47.389 INFO:teuthology.orchestra.run.smithi060.stdout: "unittest_2_bytes": 0, 2024-05-09T06:03:47.389 INFO:teuthology.orchestra.run.smithi060.stdout: "unittest_2_items": 0 2024-05-09T06:03:47.390 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:47.390 INFO:teuthology.orchestra.run.smithi060.stdout: "objecter": { 2024-05-09T06:03:47.390 INFO:teuthology.orchestra.run.smithi060.stdout: "op_active": 0, 2024-05-09T06:03:47.390 INFO:teuthology.orchestra.run.smithi060.stdout: "op_laggy": 0, 2024-05-09T06:03:47.390 INFO:teuthology.orchestra.run.smithi060.stdout: "op_send": 283576, 2024-05-09T06:03:47.390 INFO:teuthology.orchestra.run.smithi060.stdout: "op_send_bytes": 1233737311, 2024-05-09T06:03:47.390 INFO:teuthology.orchestra.run.smithi060.stdout: "op_resend": 37, 2024-05-09T06:03:47.390 INFO:teuthology.orchestra.run.smithi060.stdout: "op_reply": 283576, 2024-05-09T06:03:47.390 INFO:teuthology.orchestra.run.smithi060.stdout: "op_latency": { 2024-05-09T06:03:47.390 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 283576, 2024-05-09T06:03:47.390 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 1538.661799048, 2024-05-09T06:03:47.390 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.005425923 2024-05-09T06:03:47.390 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:47.390 INFO:teuthology.orchestra.run.smithi060.stdout: "op_inflight": 0, 2024-05-09T06:03:47.391 INFO:teuthology.orchestra.run.smithi060.stdout: "oplen_avg": { 2024-05-09T06:03:47.391 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 283576, 2024-05-09T06:03:47.391 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 288435 2024-05-09T06:03:47.391 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:47.391 INFO:teuthology.orchestra.run.smithi060.stdout: "op": 283576, 2024-05-09T06:03:47.391 INFO:teuthology.orchestra.run.smithi060.stdout: "op_r": 2778, 2024-05-09T06:03:47.391 INFO:teuthology.orchestra.run.smithi060.stdout: "op_w": 280798, 2024-05-09T06:03:47.391 INFO:teuthology.orchestra.run.smithi060.stdout: "op_rmw": 0, 2024-05-09T06:03:47.391 INFO:teuthology.orchestra.run.smithi060.stdout: "op_pg": 0, 2024-05-09T06:03:47.391 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_stat": 169, 2024-05-09T06:03:47.391 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_create": 610, 2024-05-09T06:03:47.391 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_read": 2778, 2024-05-09T06:03:47.391 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_write": 157593, 2024-05-09T06:03:47.391 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_writefull": 1249, 2024-05-09T06:03:47.392 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_writesame": 0, 2024-05-09T06:03:47.392 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_append": 0, 2024-05-09T06:03:47.392 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_zero": 0, 2024-05-09T06:03:47.392 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_truncate": 33, 2024-05-09T06:03:47.392 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_delete": 119280, 2024-05-09T06:03:47.392 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_mapext": 0, 2024-05-09T06:03:47.392 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_sparse_read": 0, 2024-05-09T06:03:47.392 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_clonerange": 0, 2024-05-09T06:03:47.392 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_getxattr": 0, 2024-05-09T06:03:47.392 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_setxattr": 1220, 2024-05-09T06:03:47.392 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_cmpxattr": 0, 2024-05-09T06:03:47.392 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_rmxattr": 0, 2024-05-09T06:03:47.392 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_resetxattrs": 0, 2024-05-09T06:03:47.392 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_call": 0, 2024-05-09T06:03:47.392 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_watch": 0, 2024-05-09T06:03:47.393 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_notify": 0, 2024-05-09T06:03:47.393 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_src_cmpxattr": 0, 2024-05-09T06:03:47.393 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_pgls": 0, 2024-05-09T06:03:47.393 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_pgls_filter": 0, 2024-05-09T06:03:47.393 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_other": 0, 2024-05-09T06:03:47.393 INFO:teuthology.orchestra.run.smithi060.stdout: "linger_active": 0, 2024-05-09T06:03:47.393 INFO:teuthology.orchestra.run.smithi060.stdout: "linger_send": 0, 2024-05-09T06:03:47.393 INFO:teuthology.orchestra.run.smithi060.stdout: "linger_resend": 0, 2024-05-09T06:03:47.393 INFO:teuthology.orchestra.run.smithi060.stdout: "linger_ping": 0, 2024-05-09T06:03:47.393 INFO:teuthology.orchestra.run.smithi060.stdout: "poolop_active": 0, 2024-05-09T06:03:47.393 INFO:teuthology.orchestra.run.smithi060.stdout: "poolop_send": 0, 2024-05-09T06:03:47.393 INFO:teuthology.orchestra.run.smithi060.stdout: "poolop_resend": 0, 2024-05-09T06:03:47.393 INFO:teuthology.orchestra.run.smithi060.stdout: "poolstat_active": 0, 2024-05-09T06:03:47.393 INFO:teuthology.orchestra.run.smithi060.stdout: "poolstat_send": 0, 2024-05-09T06:03:47.393 INFO:teuthology.orchestra.run.smithi060.stdout: "poolstat_resend": 0, 2024-05-09T06:03:47.394 INFO:teuthology.orchestra.run.smithi060.stdout: "statfs_active": 0, 2024-05-09T06:03:47.394 INFO:teuthology.orchestra.run.smithi060.stdout: "statfs_send": 0, 2024-05-09T06:03:47.394 INFO:teuthology.orchestra.run.smithi060.stdout: "statfs_resend": 0, 2024-05-09T06:03:47.394 INFO:teuthology.orchestra.run.smithi060.stdout: "command_active": 0, 2024-05-09T06:03:47.394 INFO:teuthology.orchestra.run.smithi060.stdout: "command_send": 0, 2024-05-09T06:03:47.394 INFO:teuthology.orchestra.run.smithi060.stdout: "command_resend": 0, 2024-05-09T06:03:47.394 INFO:teuthology.orchestra.run.smithi060.stdout: "map_epoch": 83, 2024-05-09T06:03:47.394 INFO:teuthology.orchestra.run.smithi060.stdout: "map_full": 0, 2024-05-09T06:03:47.394 INFO:teuthology.orchestra.run.smithi060.stdout: "map_inc": 2, 2024-05-09T06:03:47.394 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_sessions": 12, 2024-05-09T06:03:47.394 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_session_open": 12, 2024-05-09T06:03:47.394 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_session_close": 0, 2024-05-09T06:03:47.394 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_laggy": 0, 2024-05-09T06:03:47.394 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_wr": 3991, 2024-05-09T06:03:47.395 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_rd": 0, 2024-05-09T06:03:47.395 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_del": 1512 2024-05-09T06:03:47.395 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:47.395 INFO:teuthology.orchestra.run.smithi060.stdout: "oft": { 2024-05-09T06:03:47.395 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_total_objs": 1, 2024-05-09T06:03:47.395 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_total_kv_pairs": 0, 2024-05-09T06:03:47.395 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_total_updates": 0, 2024-05-09T06:03:47.395 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_total_removes": 0 2024-05-09T06:03:47.395 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:47.395 INFO:teuthology.orchestra.run.smithi060.stdout: "osd-slow-ops": { 2024-05-09T06:03:47.395 INFO:teuthology.orchestra.run.smithi060.stdout: "slow_ops_count": 0 2024-05-09T06:03:47.395 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:47.395 INFO:teuthology.orchestra.run.smithi060.stdout: "purge_queue": { 2024-05-09T06:03:47.395 INFO:teuthology.orchestra.run.smithi060.stdout: "pq_executing_ops": 0, 2024-05-09T06:03:47.395 INFO:teuthology.orchestra.run.smithi060.stdout: "pq_executing_ops_high_water": 10, 2024-05-09T06:03:47.395 INFO:teuthology.orchestra.run.smithi060.stdout: "pq_executing": 0, 2024-05-09T06:03:47.396 INFO:teuthology.orchestra.run.smithi060.stdout: "pq_executing_high_water": 10, 2024-05-09T06:03:47.396 INFO:teuthology.orchestra.run.smithi060.stdout: "pq_executed_ops": 118004, 2024-05-09T06:03:47.396 INFO:teuthology.orchestra.run.smithi060.stdout: "pq_executed": 118004, 2024-05-09T06:03:47.396 INFO:teuthology.orchestra.run.smithi060.stdout: "pq_item_in_journal": 0 2024-05-09T06:03:47.396 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:47.396 INFO:teuthology.orchestra.run.smithi060.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-09T06:03:47.396 INFO:teuthology.orchestra.run.smithi060.stdout: "val": 0, 2024-05-09T06:03:47.396 INFO:teuthology.orchestra.run.smithi060.stdout: "max": 104857600, 2024-05-09T06:03:47.396 INFO:teuthology.orchestra.run.smithi060.stdout: "get_started": 0, 2024-05-09T06:03:47.396 INFO:teuthology.orchestra.run.smithi060.stdout: "get": 1923469, 2024-05-09T06:03:47.396 INFO:teuthology.orchestra.run.smithi060.stdout: "get_sum": 352693428, 2024-05-09T06:03:47.396 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_fail": 0, 2024-05-09T06:03:47.396 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_success": 1923469, 2024-05-09T06:03:47.396 INFO:teuthology.orchestra.run.smithi060.stdout: "take": 0, 2024-05-09T06:03:47.396 INFO:teuthology.orchestra.run.smithi060.stdout: "take_sum": 0, 2024-05-09T06:03:47.397 INFO:teuthology.orchestra.run.smithi060.stdout: "put": 1923469, 2024-05-09T06:03:47.397 INFO:teuthology.orchestra.run.smithi060.stdout: "put_sum": 352693428, 2024-05-09T06:03:47.397 INFO:teuthology.orchestra.run.smithi060.stdout: "wait": { 2024-05-09T06:03:47.397 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:47.397 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:47.397 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:47.397 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-05-09T06:03:47.397 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:47.397 INFO:teuthology.orchestra.run.smithi060.stdout: "throttle-objecter_bytes": { 2024-05-09T06:03:47.397 INFO:teuthology.orchestra.run.smithi060.stdout: "val": 0, 2024-05-09T06:03:47.397 INFO:teuthology.orchestra.run.smithi060.stdout: "max": 104857600, 2024-05-09T06:03:47.397 INFO:teuthology.orchestra.run.smithi060.stdout: "get_started": 0, 2024-05-09T06:03:47.397 INFO:teuthology.orchestra.run.smithi060.stdout: "get": 0, 2024-05-09T06:03:47.397 INFO:teuthology.orchestra.run.smithi060.stdout: "get_sum": 0, 2024-05-09T06:03:47.398 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_fail": 0, 2024-05-09T06:03:47.398 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_success": 0, 2024-05-09T06:03:47.398 INFO:teuthology.orchestra.run.smithi060.stdout: "take": 283576, 2024-05-09T06:03:47.398 INFO:teuthology.orchestra.run.smithi060.stdout: "take_sum": 1245655715, 2024-05-09T06:03:47.398 INFO:teuthology.orchestra.run.smithi060.stdout: "put": 283576, 2024-05-09T06:03:47.398 INFO:teuthology.orchestra.run.smithi060.stdout: "put_sum": 1245655715, 2024-05-09T06:03:47.398 INFO:teuthology.orchestra.run.smithi060.stdout: "wait": { 2024-05-09T06:03:47.398 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:47.398 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:47.398 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:47.398 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-05-09T06:03:47.398 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:47.398 INFO:teuthology.orchestra.run.smithi060.stdout: "throttle-objecter_ops": { 2024-05-09T06:03:47.398 INFO:teuthology.orchestra.run.smithi060.stdout: "val": 0, 2024-05-09T06:03:47.399 INFO:teuthology.orchestra.run.smithi060.stdout: "max": 1024, 2024-05-09T06:03:47.399 INFO:teuthology.orchestra.run.smithi060.stdout: "get_started": 0, 2024-05-09T06:03:47.399 INFO:teuthology.orchestra.run.smithi060.stdout: "get": 0, 2024-05-09T06:03:47.399 INFO:teuthology.orchestra.run.smithi060.stdout: "get_sum": 0, 2024-05-09T06:03:47.399 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_fail": 0, 2024-05-09T06:03:47.399 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_success": 0, 2024-05-09T06:03:47.399 INFO:teuthology.orchestra.run.smithi060.stdout: "take": 283576, 2024-05-09T06:03:47.399 INFO:teuthology.orchestra.run.smithi060.stdout: "take_sum": 283576, 2024-05-09T06:03:47.399 INFO:teuthology.orchestra.run.smithi060.stdout: "put": 283576, 2024-05-09T06:03:47.399 INFO:teuthology.orchestra.run.smithi060.stdout: "put_sum": 283576, 2024-05-09T06:03:47.399 INFO:teuthology.orchestra.run.smithi060.stdout: "wait": { 2024-05-09T06:03:47.399 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:47.399 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:47.399 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:47.399 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-05-09T06:03:47.400 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:47.400 INFO:teuthology.orchestra.run.smithi060.stdout: "throttle-write_buf_throttle": { 2024-05-09T06:03:47.400 INFO:teuthology.orchestra.run.smithi060.stdout: "val": 0, 2024-05-09T06:03:47.400 INFO:teuthology.orchestra.run.smithi060.stdout: "max": 3758096384, 2024-05-09T06:03:47.400 INFO:teuthology.orchestra.run.smithi060.stdout: "get_started": 0, 2024-05-09T06:03:47.400 INFO:teuthology.orchestra.run.smithi060.stdout: "get": 118004, 2024-05-09T06:03:47.400 INFO:teuthology.orchestra.run.smithi060.stdout: "get_sum": 11918404, 2024-05-09T06:03:47.400 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_fail": 0, 2024-05-09T06:03:47.400 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_success": 118004, 2024-05-09T06:03:47.400 INFO:teuthology.orchestra.run.smithi060.stdout: "take": 0, 2024-05-09T06:03:47.400 INFO:teuthology.orchestra.run.smithi060.stdout: "take_sum": 0, 2024-05-09T06:03:47.400 INFO:teuthology.orchestra.run.smithi060.stdout: "put": 2778, 2024-05-09T06:03:47.400 INFO:teuthology.orchestra.run.smithi060.stdout: "put_sum": 11918404, 2024-05-09T06:03:47.400 INFO:teuthology.orchestra.run.smithi060.stdout: "wait": { 2024-05-09T06:03:47.401 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:47.401 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:47.401 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:47.401 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-05-09T06:03:47.401 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:47.401 INFO:teuthology.orchestra.run.smithi060.stdout: "throttle-write_buf_throttle-0x564d8a302680": { 2024-05-09T06:03:47.401 INFO:teuthology.orchestra.run.smithi060.stdout: "val": 77608, 2024-05-09T06:03:47.401 INFO:teuthology.orchestra.run.smithi060.stdout: "max": 3758096384, 2024-05-09T06:03:47.401 INFO:teuthology.orchestra.run.smithi060.stdout: "get_started": 0, 2024-05-09T06:03:47.401 INFO:teuthology.orchestra.run.smithi060.stdout: "get": 571520, 2024-05-09T06:03:47.401 INFO:teuthology.orchestra.run.smithi060.stdout: "get_sum": 1203842856, 2024-05-09T06:03:47.401 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_fail": 0, 2024-05-09T06:03:47.401 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_success": 571520, 2024-05-09T06:03:47.401 INFO:teuthology.orchestra.run.smithi060.stdout: "take": 0, 2024-05-09T06:03:47.401 INFO:teuthology.orchestra.run.smithi060.stdout: "take_sum": 0, 2024-05-09T06:03:47.402 INFO:teuthology.orchestra.run.smithi060.stdout: "put": 154815, 2024-05-09T06:03:47.402 INFO:teuthology.orchestra.run.smithi060.stdout: "put_sum": 1203765248, 2024-05-09T06:03:47.402 INFO:teuthology.orchestra.run.smithi060.stdout: "wait": { 2024-05-09T06:03:47.402 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:47.402 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:47.402 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:47.402 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-05-09T06:03:47.402 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-05-09T06:03:47.402 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-05-09T06:03:47.916 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:03:47 smithi100 ceph-mon[34353]: pgmap v1162: 97 pgs: 97 active+clean; 504 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 3.4 MiB/s wr, 124 op/s 2024-05-09T06:03:48.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:03:47 smithi060 ceph-mon[34555]: pgmap v1162: 97 pgs: 97 active+clean; 504 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 3.4 MiB/s wr, 124 op/s 2024-05-09T06:03:48.102 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:03:47 smithi039 ceph-mon[30439]: pgmap v1162: 97 pgs: 97 active+clean; 504 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 3.4 MiB/s wr, 124 op/s 2024-05-09T06:03:48.122 INFO:tasks.check_counter:Daemon mds.b mds.exported=12 2024-05-09T06:03:48.122 INFO:tasks.check_counter:Daemon mds.b mds.imported=11 2024-05-09T06:03:48.122 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=413 2024-05-09T06:03:48.122 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=18 2024-05-09T06:03:48.122 DEBUG:tasks.check_counter:Getting stats from e 2024-05-09T06:03:48.123 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph daemon mds.e perf dump 2024-05-09T06:03:48.372 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.b/config 2024-05-09T06:03:49.789 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:03:49 smithi060 ceph-mon[34555]: pgmap v1163: 97 pgs: 97 active+clean; 502 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 3.8 MiB/s wr, 127 op/s 2024-05-09T06:03:49.916 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:03:49 smithi100 ceph-mon[34353]: pgmap v1163: 97 pgs: 97 active+clean; 502 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 3.8 MiB/s wr, 127 op/s 2024-05-09T06:03:50.102 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:03:49 smithi039 ceph-mon[30439]: pgmap v1163: 97 pgs: 97 active+clean; 502 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 3.8 MiB/s wr, 127 op/s 2024-05-09T06:03:50.227 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-05-09T06:03:50.227 INFO:teuthology.orchestra.run.smithi060.stdout: "AsyncMessenger::Worker-0": { 2024-05-09T06:03:50.227 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_messages": 1802, 2024-05-09T06:03:50.227 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages": 1771, 2024-05-09T06:03:50.227 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_bytes": 13923776, 2024-05-09T06:03:50.228 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_bytes": 703674, 2024-05-09T06:03:50.228 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_created_connections": 7, 2024-05-09T06:03:50.228 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_active_connections": 2, 2024-05-09T06:03:50.228 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_total_time": 0.159758316, 2024-05-09T06:03:50.228 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_send_time": 0.043535471, 2024-05-09T06:03:50.228 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_recv_time": 0.069146931, 2024-05-09T06:03:50.228 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_fast_dispatch_time": 0.041087317, 2024-05-09T06:03:50.228 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T06:03:50.228 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 1770, 2024-05-09T06:03:50.228 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.055163780, 2024-05-09T06:03:50.228 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000031165 2024-05-09T06:03:50.228 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:50.228 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_handle_ack_lat": { 2024-05-09T06:03:50.229 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:50.229 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:50.229 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:50.229 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:50.229 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_encrypted_bytes": 1013312, 2024-05-09T06:03:50.229 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_encrypted_bytes": 292176 2024-05-09T06:03:50.229 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:50.229 INFO:teuthology.orchestra.run.smithi060.stdout: "AsyncMessenger::Worker-1": { 2024-05-09T06:03:50.229 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_messages": 1074, 2024-05-09T06:03:50.229 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages": 1431, 2024-05-09T06:03:50.229 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_bytes": 21242564, 2024-05-09T06:03:50.229 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_bytes": 1048051, 2024-05-09T06:03:50.229 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_created_connections": 6, 2024-05-09T06:03:50.229 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_active_connections": 5, 2024-05-09T06:03:50.230 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_total_time": 0.111274477, 2024-05-09T06:03:50.230 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_send_time": 0.034312894, 2024-05-09T06:03:50.230 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_recv_time": 0.038662488, 2024-05-09T06:03:50.230 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_fast_dispatch_time": 0.028069950, 2024-05-09T06:03:50.230 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T06:03:50.230 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 1429, 2024-05-09T06:03:50.230 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.041734963, 2024-05-09T06:03:50.230 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000029205 2024-05-09T06:03:50.230 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:50.230 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_handle_ack_lat": { 2024-05-09T06:03:50.230 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:50.230 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:50.230 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:50.231 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:50.231 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_encrypted_bytes": 160, 2024-05-09T06:03:50.231 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_encrypted_bytes": 706832 2024-05-09T06:03:50.231 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:50.231 INFO:teuthology.orchestra.run.smithi060.stdout: "AsyncMessenger::Worker-2": { 2024-05-09T06:03:50.231 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_messages": 3690, 2024-05-09T06:03:50.231 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages": 3690, 2024-05-09T06:03:50.231 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_bytes": 30860124, 2024-05-09T06:03:50.231 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_bytes": 1172654, 2024-05-09T06:03:50.231 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_created_connections": 6, 2024-05-09T06:03:50.231 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_active_connections": 5, 2024-05-09T06:03:50.231 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_total_time": 0.297960327, 2024-05-09T06:03:50.231 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_send_time": 0.084114226, 2024-05-09T06:03:50.231 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_recv_time": 0.094821459, 2024-05-09T06:03:50.232 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_fast_dispatch_time": 0.094442187, 2024-05-09T06:03:50.232 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T06:03:50.232 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 3689, 2024-05-09T06:03:50.232 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.103229716, 2024-05-09T06:03:50.232 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000027983 2024-05-09T06:03:50.232 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:50.232 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_handle_ack_lat": { 2024-05-09T06:03:50.232 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:50.232 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:50.232 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:50.232 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:50.232 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_encrypted_bytes": 3040, 2024-05-09T06:03:50.232 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_encrypted_bytes": 448 2024-05-09T06:03:50.233 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:50.233 INFO:teuthology.orchestra.run.smithi060.stdout: "cct": { 2024-05-09T06:03:50.233 INFO:teuthology.orchestra.run.smithi060.stdout: "total_workers": 1, 2024-05-09T06:03:50.233 INFO:teuthology.orchestra.run.smithi060.stdout: "unhealthy_workers": 0 2024-05-09T06:03:50.233 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:50.233 INFO:teuthology.orchestra.run.smithi060.stdout: "finisher-MDSRank": { 2024-05-09T06:03:50.233 INFO:teuthology.orchestra.run.smithi060.stdout: "queue_len": 0, 2024-05-09T06:03:50.233 INFO:teuthology.orchestra.run.smithi060.stdout: "complete_latency": { 2024-05-09T06:03:50.233 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 10378, 2024-05-09T06:03:50.233 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.232982550, 2024-05-09T06:03:50.233 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000022449 2024-05-09T06:03:50.233 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-05-09T06:03:50.233 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:50.233 INFO:teuthology.orchestra.run.smithi060.stdout: "finisher-PurgeQueue": { 2024-05-09T06:03:50.234 INFO:teuthology.orchestra.run.smithi060.stdout: "queue_len": 0, 2024-05-09T06:03:50.234 INFO:teuthology.orchestra.run.smithi060.stdout: "complete_latency": { 2024-05-09T06:03:50.234 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:50.234 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:50.234 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:50.234 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-05-09T06:03:50.234 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:50.234 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": { 2024-05-09T06:03:50.234 INFO:teuthology.orchestra.run.smithi060.stdout: "request": 0, 2024-05-09T06:03:50.234 INFO:teuthology.orchestra.run.smithi060.stdout: "reply": 0, 2024-05-09T06:03:50.234 INFO:teuthology.orchestra.run.smithi060.stdout: "reply_latency": { 2024-05-09T06:03:50.234 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:50.234 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:50.234 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:50.235 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:50.235 INFO:teuthology.orchestra.run.smithi060.stdout: "slow_reply": 0, 2024-05-09T06:03:50.235 INFO:teuthology.orchestra.run.smithi060.stdout: "forward": 0, 2024-05-09T06:03:50.235 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_fetch_complete": 0, 2024-05-09T06:03:50.235 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_fetch_keys": 0, 2024-05-09T06:03:50.235 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_commit": 0, 2024-05-09T06:03:50.235 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_split": 0, 2024-05-09T06:03:50.235 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_merge": 0, 2024-05-09T06:03:50.235 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes": 8809, 2024-05-09T06:03:50.235 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes_top": 0, 2024-05-09T06:03:50.235 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes_bottom": 8809, 2024-05-09T06:03:50.235 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes_pin_tail": 0, 2024-05-09T06:03:50.235 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes_pinned": 8809, 2024-05-09T06:03:50.236 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes_expired": 0, 2024-05-09T06:03:50.236 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes_with_caps": 0, 2024-05-09T06:03:50.236 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": 0, 2024-05-09T06:03:50.236 INFO:teuthology.orchestra.run.smithi060.stdout: "subtrees": 1, 2024-05-09T06:03:50.236 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse": 0, 2024-05-09T06:03:50.236 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse_hit": 0, 2024-05-09T06:03:50.236 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse_forward": 0, 2024-05-09T06:03:50.236 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse_discover": 0, 2024-05-09T06:03:50.236 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse_dir_fetch": 0, 2024-05-09T06:03:50.236 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse_remote_ino": 0, 2024-05-09T06:03:50.236 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse_lock": 0, 2024-05-09T06:03:50.236 INFO:teuthology.orchestra.run.smithi060.stdout: "load_cent": 0, 2024-05-09T06:03:50.236 INFO:teuthology.orchestra.run.smithi060.stdout: "q": 0, 2024-05-09T06:03:50.236 INFO:teuthology.orchestra.run.smithi060.stdout: "exported": 0, 2024-05-09T06:03:50.237 INFO:teuthology.orchestra.run.smithi060.stdout: "exported_inodes": 0, 2024-05-09T06:03:50.237 INFO:teuthology.orchestra.run.smithi060.stdout: "imported": 0, 2024-05-09T06:03:50.237 INFO:teuthology.orchestra.run.smithi060.stdout: "imported_inodes": 0, 2024-05-09T06:03:50.237 INFO:teuthology.orchestra.run.smithi060.stdout: "openino_dir_fetch": 0, 2024-05-09T06:03:50.237 INFO:teuthology.orchestra.run.smithi060.stdout: "openino_backtrace_fetch": 0, 2024-05-09T06:03:50.237 INFO:teuthology.orchestra.run.smithi060.stdout: "openino_peer_discover": 0, 2024-05-09T06:03:50.237 INFO:teuthology.orchestra.run.smithi060.stdout: "root_rfiles": 0, 2024-05-09T06:03:50.237 INFO:teuthology.orchestra.run.smithi060.stdout: "root_rbytes": 0, 2024-05-09T06:03:50.237 INFO:teuthology.orchestra.run.smithi060.stdout: "root_rsnaps": 0, 2024-05-09T06:03:50.237 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_backtrace_fetch": 0, 2024-05-09T06:03:50.237 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_set_tag": 0, 2024-05-09T06:03:50.237 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_backtrace_repaired": 0, 2024-05-09T06:03:50.237 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_inotable_repaired": 0, 2024-05-09T06:03:50.237 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_dir_inodes": 0, 2024-05-09T06:03:50.238 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_dir_base_inodes": 0, 2024-05-09T06:03:50.238 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_dirfrag_rstats": 0, 2024-05-09T06:03:50.238 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_file_inodes": 0, 2024-05-09T06:03:50.238 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_inode_file_caps": 0, 2024-05-09T06:03:50.238 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_cap_op_revoke": 0, 2024-05-09T06:03:50.238 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_cap_op_grant": 0, 2024-05-09T06:03:50.238 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_cap_op_trunc": 0, 2024-05-09T06:03:50.238 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-09T06:03:50.238 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-09T06:03:50.238 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_client_caps": 0, 2024-05-09T06:03:50.238 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_client_caps_dirty": 0, 2024-05-09T06:03:50.238 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_client_cap_release": 0, 2024-05-09T06:03:50.238 INFO:teuthology.orchestra.run.smithi060.stdout: "process_request_cap_release": 0 2024-05-09T06:03:50.239 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:50.239 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_cache": { 2024-05-09T06:03:50.239 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_update": 0, 2024-05-09T06:03:50.239 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_update_receipt": 0, 2024-05-09T06:03:50.239 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_try_discover": 0, 2024-05-09T06:03:50.239 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_send_discover": 0, 2024-05-09T06:03:50.239 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_handle_discover": 0, 2024-05-09T06:03:50.239 INFO:teuthology.orchestra.run.smithi060.stdout: "num_strays": 0, 2024-05-09T06:03:50.239 INFO:teuthology.orchestra.run.smithi060.stdout: "num_strays_delayed": 0, 2024-05-09T06:03:50.239 INFO:teuthology.orchestra.run.smithi060.stdout: "num_strays_enqueuing": 0, 2024-05-09T06:03:50.239 INFO:teuthology.orchestra.run.smithi060.stdout: "strays_created": 0, 2024-05-09T06:03:50.239 INFO:teuthology.orchestra.run.smithi060.stdout: "strays_enqueued": 0, 2024-05-09T06:03:50.239 INFO:teuthology.orchestra.run.smithi060.stdout: "strays_reintegrated": 0, 2024-05-09T06:03:50.239 INFO:teuthology.orchestra.run.smithi060.stdout: "strays_migrated": 0, 2024-05-09T06:03:50.240 INFO:teuthology.orchestra.run.smithi060.stdout: "num_recovering_processing": 0, 2024-05-09T06:03:50.240 INFO:teuthology.orchestra.run.smithi060.stdout: "num_recovering_enqueued": 0, 2024-05-09T06:03:50.240 INFO:teuthology.orchestra.run.smithi060.stdout: "num_recovering_prioritized": 0, 2024-05-09T06:03:50.240 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_started": 0, 2024-05-09T06:03:50.240 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_completed": 0, 2024-05-09T06:03:50.240 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_quiesce_path": 0, 2024-05-09T06:03:50.240 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_quiesce_inode": 0, 2024-05-09T06:03:50.240 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_enqueue_scrub": 0, 2024-05-09T06:03:50.240 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_exportdir": 0, 2024-05-09T06:03:50.240 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_flush": 0, 2024-05-09T06:03:50.240 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_fragmentdir": 0, 2024-05-09T06:03:50.240 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_fragstats": 0, 2024-05-09T06:03:50.240 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_inodestats": 0 2024-05-09T06:03:50.240 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:50.241 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_log": { 2024-05-09T06:03:50.241 INFO:teuthology.orchestra.run.smithi060.stdout: "evlrg": 0, 2024-05-09T06:03:50.241 INFO:teuthology.orchestra.run.smithi060.stdout: "evadd": 0, 2024-05-09T06:03:50.241 INFO:teuthology.orchestra.run.smithi060.stdout: "evex": 0, 2024-05-09T06:03:50.241 INFO:teuthology.orchestra.run.smithi060.stdout: "evtrm": 0, 2024-05-09T06:03:50.241 INFO:teuthology.orchestra.run.smithi060.stdout: "ev": 50642, 2024-05-09T06:03:50.241 INFO:teuthology.orchestra.run.smithi060.stdout: "evexg": 0, 2024-05-09T06:03:50.241 INFO:teuthology.orchestra.run.smithi060.stdout: "evexd": 0, 2024-05-09T06:03:50.241 INFO:teuthology.orchestra.run.smithi060.stdout: "segadd": 0, 2024-05-09T06:03:50.241 INFO:teuthology.orchestra.run.smithi060.stdout: "segex": 0, 2024-05-09T06:03:50.241 INFO:teuthology.orchestra.run.smithi060.stdout: "segtrm": 0, 2024-05-09T06:03:50.241 INFO:teuthology.orchestra.run.smithi060.stdout: "seg": 65, 2024-05-09T06:03:50.241 INFO:teuthology.orchestra.run.smithi060.stdout: "segmjr": 6, 2024-05-09T06:03:50.241 INFO:teuthology.orchestra.run.smithi060.stdout: "segexg": 0, 2024-05-09T06:03:50.242 INFO:teuthology.orchestra.run.smithi060.stdout: "segexd": 0, 2024-05-09T06:03:50.242 INFO:teuthology.orchestra.run.smithi060.stdout: "expos": 4194304, 2024-05-09T06:03:50.242 INFO:teuthology.orchestra.run.smithi060.stdout: "wrpos": 67523790, 2024-05-09T06:03:50.242 INFO:teuthology.orchestra.run.smithi060.stdout: "rdpos": 67523191, 2024-05-09T06:03:50.242 INFO:teuthology.orchestra.run.smithi060.stdout: "jlat": { 2024-05-09T06:03:50.242 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:50.242 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:50.242 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:50.242 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:50.242 INFO:teuthology.orchestra.run.smithi060.stdout: "replayed": 50642 2024-05-09T06:03:50.242 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:50.242 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_mem": { 2024-05-09T06:03:50.242 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 39, 2024-05-09T06:03:50.242 INFO:teuthology.orchestra.run.smithi060.stdout: "ino+": 8874, 2024-05-09T06:03:50.243 INFO:teuthology.orchestra.run.smithi060.stdout: "ino-": 8835, 2024-05-09T06:03:50.243 INFO:teuthology.orchestra.run.smithi060.stdout: "dir": 11, 2024-05-09T06:03:50.243 INFO:teuthology.orchestra.run.smithi060.stdout: "dir+": 54, 2024-05-09T06:03:50.243 INFO:teuthology.orchestra.run.smithi060.stdout: "dir-": 43, 2024-05-09T06:03:50.243 INFO:teuthology.orchestra.run.smithi060.stdout: "dn": 8809, 2024-05-09T06:03:50.243 INFO:teuthology.orchestra.run.smithi060.stdout: "dn+": 8934, 2024-05-09T06:03:50.243 INFO:teuthology.orchestra.run.smithi060.stdout: "dn-": 125, 2024-05-09T06:03:50.243 INFO:teuthology.orchestra.run.smithi060.stdout: "cap": 0, 2024-05-09T06:03:50.243 INFO:teuthology.orchestra.run.smithi060.stdout: "cap+": 0, 2024-05-09T06:03:50.243 INFO:teuthology.orchestra.run.smithi060.stdout: "cap-": 0, 2024-05-09T06:03:50.243 INFO:teuthology.orchestra.run.smithi060.stdout: "rss": 130776, 2024-05-09T06:03:50.243 INFO:teuthology.orchestra.run.smithi060.stdout: "heap": 215440 2024-05-09T06:03:50.243 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:50.243 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_server": { 2024-05-09T06:03:50.244 INFO:teuthology.orchestra.run.smithi060.stdout: "dispatch_client_request": 0, 2024-05-09T06:03:50.244 INFO:teuthology.orchestra.run.smithi060.stdout: "dispatch_server_request": 0, 2024-05-09T06:03:50.244 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_client_request": 0, 2024-05-09T06:03:50.244 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_client_session": 0, 2024-05-09T06:03:50.244 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_peer_request": 0, 2024-05-09T06:03:50.244 INFO:teuthology.orchestra.run.smithi060.stdout: "req_create_latency": { 2024-05-09T06:03:50.244 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:50.244 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:50.244 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:50.244 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:50.244 INFO:teuthology.orchestra.run.smithi060.stdout: "req_getattr_latency": { 2024-05-09T06:03:50.244 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:50.244 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:50.244 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:50.245 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:50.245 INFO:teuthology.orchestra.run.smithi060.stdout: "req_getfilelock_latency": { 2024-05-09T06:03:50.245 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:50.245 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:50.245 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:50.245 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:50.245 INFO:teuthology.orchestra.run.smithi060.stdout: "req_link_latency": { 2024-05-09T06:03:50.245 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:50.245 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:50.245 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:50.245 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:50.245 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lookup_latency": { 2024-05-09T06:03:50.245 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:50.245 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:50.246 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:50.246 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:50.246 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lookuphash_latency": { 2024-05-09T06:03:50.246 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:50.246 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:50.246 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:50.246 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:50.246 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lookupino_latency": { 2024-05-09T06:03:50.246 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:50.246 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:50.246 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:50.246 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:50.246 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lookupname_latency": { 2024-05-09T06:03:50.246 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:50.247 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:50.247 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:50.247 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:50.247 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lookupparent_latency": { 2024-05-09T06:03:50.247 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:50.247 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:50.247 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:50.247 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:50.247 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lookupsnap_latency": { 2024-05-09T06:03:50.247 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:50.247 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:50.247 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:50.247 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:50.247 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lssnap_latency": { 2024-05-09T06:03:50.248 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:50.248 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:50.248 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:50.248 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:50.248 INFO:teuthology.orchestra.run.smithi060.stdout: "req_mkdir_latency": { 2024-05-09T06:03:50.249 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:50.249 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:50.249 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:50.249 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:50.249 INFO:teuthology.orchestra.run.smithi060.stdout: "req_mknod_latency": { 2024-05-09T06:03:50.249 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:50.249 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:50.249 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:50.249 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:50.249 INFO:teuthology.orchestra.run.smithi060.stdout: "req_mksnap_latency": { 2024-05-09T06:03:50.250 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:50.250 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:50.250 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:50.250 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:50.250 INFO:teuthology.orchestra.run.smithi060.stdout: "req_open_latency": { 2024-05-09T06:03:50.250 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:50.250 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:50.250 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:50.250 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:50.250 INFO:teuthology.orchestra.run.smithi060.stdout: "req_readdir_latency": { 2024-05-09T06:03:50.250 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:50.250 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:50.251 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:50.251 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:50.251 INFO:teuthology.orchestra.run.smithi060.stdout: "req_rename_latency": { 2024-05-09T06:03:50.251 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:50.251 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:50.251 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:50.251 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:50.251 INFO:teuthology.orchestra.run.smithi060.stdout: "req_renamesnap_latency": { 2024-05-09T06:03:50.251 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:50.251 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:50.251 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:50.251 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:50.251 INFO:teuthology.orchestra.run.smithi060.stdout: "req_snapdiff_latency": { 2024-05-09T06:03:50.251 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:50.252 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:50.252 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:50.252 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:50.252 INFO:teuthology.orchestra.run.smithi060.stdout: "req_rmdir_latency": { 2024-05-09T06:03:50.252 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:50.252 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:50.252 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:50.252 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:50.252 INFO:teuthology.orchestra.run.smithi060.stdout: "req_rmsnap_latency": { 2024-05-09T06:03:50.252 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:50.252 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:50.252 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:50.252 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:50.252 INFO:teuthology.orchestra.run.smithi060.stdout: "req_rmxattr_latency": { 2024-05-09T06:03:50.253 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:50.253 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:50.253 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:50.253 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:50.253 INFO:teuthology.orchestra.run.smithi060.stdout: "req_setattr_latency": { 2024-05-09T06:03:50.253 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:50.253 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:50.253 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:50.253 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:50.253 INFO:teuthology.orchestra.run.smithi060.stdout: "req_setdirlayout_latency": { 2024-05-09T06:03:50.253 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:50.253 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:50.253 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:50.253 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:50.254 INFO:teuthology.orchestra.run.smithi060.stdout: "req_setfilelock_latency": { 2024-05-09T06:03:50.254 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:50.254 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:50.254 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:50.254 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:50.254 INFO:teuthology.orchestra.run.smithi060.stdout: "req_setlayout_latency": { 2024-05-09T06:03:50.254 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:50.254 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:50.254 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:50.254 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:50.254 INFO:teuthology.orchestra.run.smithi060.stdout: "req_setxattr_latency": { 2024-05-09T06:03:50.254 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:50.254 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:50.255 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:50.255 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:50.255 INFO:teuthology.orchestra.run.smithi060.stdout: "req_symlink_latency": { 2024-05-09T06:03:50.255 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:50.255 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:50.255 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:50.255 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:50.255 INFO:teuthology.orchestra.run.smithi060.stdout: "req_unlink_latency": { 2024-05-09T06:03:50.255 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:50.255 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:50.255 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:50.255 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:50.255 INFO:teuthology.orchestra.run.smithi060.stdout: "cap_revoke_eviction": 0, 2024-05-09T06:03:50.256 INFO:teuthology.orchestra.run.smithi060.stdout: "cap_acquisition_throttle": 0, 2024-05-09T06:03:50.256 INFO:teuthology.orchestra.run.smithi060.stdout: "req_getvxattr_latency": { 2024-05-09T06:03:50.256 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:50.256 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:50.256 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:50.256 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-05-09T06:03:50.256 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:50.256 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_sessions": { 2024-05-09T06:03:50.256 INFO:teuthology.orchestra.run.smithi060.stdout: "session_count": 1, 2024-05-09T06:03:50.256 INFO:teuthology.orchestra.run.smithi060.stdout: "session_add": 3, 2024-05-09T06:03:50.256 INFO:teuthology.orchestra.run.smithi060.stdout: "session_remove": 2, 2024-05-09T06:03:50.256 INFO:teuthology.orchestra.run.smithi060.stdout: "sessions_open": 2, 2024-05-09T06:03:50.256 INFO:teuthology.orchestra.run.smithi060.stdout: "sessions_stale": 0, 2024-05-09T06:03:50.256 INFO:teuthology.orchestra.run.smithi060.stdout: "total_load": 0, 2024-05-09T06:03:50.256 INFO:teuthology.orchestra.run.smithi060.stdout: "average_load": 0, 2024-05-09T06:03:50.257 INFO:teuthology.orchestra.run.smithi060.stdout: "avg_session_uptime": 4491, 2024-05-09T06:03:50.257 INFO:teuthology.orchestra.run.smithi060.stdout: "mdthresh_evicted": 0 2024-05-09T06:03:50.257 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:50.257 INFO:teuthology.orchestra.run.smithi060.stdout: "mempool": { 2024-05-09T06:03:50.257 INFO:teuthology.orchestra.run.smithi060.stdout: "bloom_filter_bytes": 0, 2024-05-09T06:03:50.257 INFO:teuthology.orchestra.run.smithi060.stdout: "bloom_filter_items": 0, 2024-05-09T06:03:50.257 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_alloc_bytes": 0, 2024-05-09T06:03:50.257 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_alloc_items": 0, 2024-05-09T06:03:50.257 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_data_bytes": 0, 2024-05-09T06:03:50.258 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_data_items": 0, 2024-05-09T06:03:50.258 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-09T06:03:50.258 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_onode_items": 0, 2024-05-09T06:03:50.258 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-09T06:03:50.258 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_meta_items": 0, 2024-05-09T06:03:50.258 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_other_bytes": 0, 2024-05-09T06:03:50.258 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_other_items": 0, 2024-05-09T06:03:50.258 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-09T06:03:50.258 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_buffer_items": 0, 2024-05-09T06:03:50.258 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_extent_bytes": 0, 2024-05-09T06:03:50.258 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_extent_items": 0, 2024-05-09T06:03:50.258 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_blob_bytes": 0, 2024-05-09T06:03:50.258 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_blob_items": 0, 2024-05-09T06:03:50.259 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-09T06:03:50.259 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_shared_blob_items": 0, 2024-05-09T06:03:50.259 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-09T06:03:50.259 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_inline_bl_items": 0, 2024-05-09T06:03:50.259 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_fsck_bytes": 0, 2024-05-09T06:03:50.259 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_fsck_items": 0, 2024-05-09T06:03:50.260 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_txc_bytes": 0, 2024-05-09T06:03:50.260 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_txc_items": 0, 2024-05-09T06:03:50.260 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-09T06:03:50.260 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_writing_deferred_items": 0, 2024-05-09T06:03:50.260 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_writing_bytes": 0, 2024-05-09T06:03:50.260 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_writing_items": 0, 2024-05-09T06:03:50.260 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_bytes": 0, 2024-05-09T06:03:50.260 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_items": 0, 2024-05-09T06:03:50.260 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_file_reader_bytes": 0, 2024-05-09T06:03:50.260 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_file_reader_items": 0, 2024-05-09T06:03:50.261 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_file_writer_bytes": 0, 2024-05-09T06:03:50.261 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_file_writer_items": 0, 2024-05-09T06:03:50.261 INFO:teuthology.orchestra.run.smithi060.stdout: "buffer_anon_bytes": 225838, 2024-05-09T06:03:50.261 INFO:teuthology.orchestra.run.smithi060.stdout: "buffer_anon_items": 101, 2024-05-09T06:03:50.261 INFO:teuthology.orchestra.run.smithi060.stdout: "buffer_meta_bytes": 0, 2024-05-09T06:03:50.261 INFO:teuthology.orchestra.run.smithi060.stdout: "buffer_meta_items": 0, 2024-05-09T06:03:50.261 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_bytes": 0, 2024-05-09T06:03:50.261 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_items": 0, 2024-05-09T06:03:50.261 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_mapbl_bytes": 0, 2024-05-09T06:03:50.261 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_mapbl_items": 0, 2024-05-09T06:03:50.261 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_pglog_bytes": 0, 2024-05-09T06:03:50.261 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_pglog_items": 0, 2024-05-09T06:03:50.261 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_bytes": 7528, 2024-05-09T06:03:50.262 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_items": 158, 2024-05-09T06:03:50.262 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_mapping_bytes": 0, 2024-05-09T06:03:50.262 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_mapping_items": 0, 2024-05-09T06:03:50.262 INFO:teuthology.orchestra.run.smithi060.stdout: "pgmap_bytes": 0, 2024-05-09T06:03:50.262 INFO:teuthology.orchestra.run.smithi060.stdout: "pgmap_items": 0, 2024-05-09T06:03:50.262 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_co_bytes": 6311283, 2024-05-09T06:03:50.262 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_co_items": 38915, 2024-05-09T06:03:50.262 INFO:teuthology.orchestra.run.smithi060.stdout: "unittest_1_bytes": 0, 2024-05-09T06:03:50.262 INFO:teuthology.orchestra.run.smithi060.stdout: "unittest_1_items": 0, 2024-05-09T06:03:50.262 INFO:teuthology.orchestra.run.smithi060.stdout: "unittest_2_bytes": 0, 2024-05-09T06:03:50.262 INFO:teuthology.orchestra.run.smithi060.stdout: "unittest_2_items": 0 2024-05-09T06:03:50.262 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:50.262 INFO:teuthology.orchestra.run.smithi060.stdout: "objecter": { 2024-05-09T06:03:50.262 INFO:teuthology.orchestra.run.smithi060.stdout: "op_active": 0, 2024-05-09T06:03:50.263 INFO:teuthology.orchestra.run.smithi060.stdout: "op_laggy": 0, 2024-05-09T06:03:50.263 INFO:teuthology.orchestra.run.smithi060.stdout: "op_send": 6053, 2024-05-09T06:03:50.263 INFO:teuthology.orchestra.run.smithi060.stdout: "op_send_bytes": 21, 2024-05-09T06:03:50.263 INFO:teuthology.orchestra.run.smithi060.stdout: "op_resend": 3, 2024-05-09T06:03:50.263 INFO:teuthology.orchestra.run.smithi060.stdout: "op_reply": 6053, 2024-05-09T06:03:50.263 INFO:teuthology.orchestra.run.smithi060.stdout: "op_latency": { 2024-05-09T06:03:50.263 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 6053, 2024-05-09T06:03:50.263 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 3.903965701, 2024-05-09T06:03:50.263 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000644963 2024-05-09T06:03:50.263 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:50.263 INFO:teuthology.orchestra.run.smithi060.stdout: "op_inflight": 0, 2024-05-09T06:03:50.263 INFO:teuthology.orchestra.run.smithi060.stdout: "oplen_avg": { 2024-05-09T06:03:50.263 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 6053, 2024-05-09T06:03:50.263 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 6054 2024-05-09T06:03:50.264 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:50.264 INFO:teuthology.orchestra.run.smithi060.stdout: "op": 6053, 2024-05-09T06:03:50.264 INFO:teuthology.orchestra.run.smithi060.stdout: "op_r": 6053, 2024-05-09T06:03:50.264 INFO:teuthology.orchestra.run.smithi060.stdout: "op_w": 0, 2024-05-09T06:03:50.264 INFO:teuthology.orchestra.run.smithi060.stdout: "op_rmw": 0, 2024-05-09T06:03:50.264 INFO:teuthology.orchestra.run.smithi060.stdout: "op_pg": 0, 2024-05-09T06:03:50.264 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_stat": 3313, 2024-05-09T06:03:50.264 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_create": 0, 2024-05-09T06:03:50.264 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_read": 2738, 2024-05-09T06:03:50.264 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_write": 0, 2024-05-09T06:03:50.264 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_writefull": 0, 2024-05-09T06:03:50.264 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_writesame": 0, 2024-05-09T06:03:50.264 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_append": 0, 2024-05-09T06:03:50.264 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_zero": 0, 2024-05-09T06:03:50.265 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_truncate": 0, 2024-05-09T06:03:50.265 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_delete": 0, 2024-05-09T06:03:50.265 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_mapext": 0, 2024-05-09T06:03:50.265 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_sparse_read": 0, 2024-05-09T06:03:50.265 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_clonerange": 0, 2024-05-09T06:03:50.265 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_getxattr": 1, 2024-05-09T06:03:50.265 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_setxattr": 0, 2024-05-09T06:03:50.265 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_cmpxattr": 0, 2024-05-09T06:03:50.265 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_rmxattr": 0, 2024-05-09T06:03:50.265 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_resetxattrs": 0, 2024-05-09T06:03:50.265 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_call": 0, 2024-05-09T06:03:50.265 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_watch": 0, 2024-05-09T06:03:50.265 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_notify": 0, 2024-05-09T06:03:50.265 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_src_cmpxattr": 0, 2024-05-09T06:03:50.265 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_pgls": 0, 2024-05-09T06:03:50.266 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_pgls_filter": 0, 2024-05-09T06:03:50.266 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_other": 0, 2024-05-09T06:03:50.266 INFO:teuthology.orchestra.run.smithi060.stdout: "linger_active": 0, 2024-05-09T06:03:50.266 INFO:teuthology.orchestra.run.smithi060.stdout: "linger_send": 0, 2024-05-09T06:03:50.266 INFO:teuthology.orchestra.run.smithi060.stdout: "linger_resend": 0, 2024-05-09T06:03:50.266 INFO:teuthology.orchestra.run.smithi060.stdout: "linger_ping": 0, 2024-05-09T06:03:50.266 INFO:teuthology.orchestra.run.smithi060.stdout: "poolop_active": 0, 2024-05-09T06:03:50.266 INFO:teuthology.orchestra.run.smithi060.stdout: "poolop_send": 0, 2024-05-09T06:03:50.266 INFO:teuthology.orchestra.run.smithi060.stdout: "poolop_resend": 0, 2024-05-09T06:03:50.266 INFO:teuthology.orchestra.run.smithi060.stdout: "poolstat_active": 0, 2024-05-09T06:03:50.266 INFO:teuthology.orchestra.run.smithi060.stdout: "poolstat_send": 0, 2024-05-09T06:03:50.266 INFO:teuthology.orchestra.run.smithi060.stdout: "poolstat_resend": 0, 2024-05-09T06:03:50.266 INFO:teuthology.orchestra.run.smithi060.stdout: "statfs_active": 0, 2024-05-09T06:03:50.266 INFO:teuthology.orchestra.run.smithi060.stdout: "statfs_send": 0, 2024-05-09T06:03:50.267 INFO:teuthology.orchestra.run.smithi060.stdout: "statfs_resend": 0, 2024-05-09T06:03:50.267 INFO:teuthology.orchestra.run.smithi060.stdout: "command_active": 0, 2024-05-09T06:03:50.267 INFO:teuthology.orchestra.run.smithi060.stdout: "command_send": 0, 2024-05-09T06:03:50.267 INFO:teuthology.orchestra.run.smithi060.stdout: "command_resend": 0, 2024-05-09T06:03:50.267 INFO:teuthology.orchestra.run.smithi060.stdout: "map_epoch": 83, 2024-05-09T06:03:50.267 INFO:teuthology.orchestra.run.smithi060.stdout: "map_full": 0, 2024-05-09T06:03:50.267 INFO:teuthology.orchestra.run.smithi060.stdout: "map_inc": 2, 2024-05-09T06:03:50.267 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_sessions": 9, 2024-05-09T06:03:50.267 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_session_open": 10, 2024-05-09T06:03:50.267 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_session_close": 1, 2024-05-09T06:03:50.267 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_laggy": 0, 2024-05-09T06:03:50.267 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_wr": 0, 2024-05-09T06:03:50.267 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_rd": 2, 2024-05-09T06:03:50.267 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_del": 0 2024-05-09T06:03:50.268 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:50.268 INFO:teuthology.orchestra.run.smithi060.stdout: "oft": { 2024-05-09T06:03:50.268 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_total_objs": 0, 2024-05-09T06:03:50.268 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_total_kv_pairs": 0, 2024-05-09T06:03:50.268 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_total_updates": 0, 2024-05-09T06:03:50.268 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_total_removes": 0 2024-05-09T06:03:50.268 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:50.268 INFO:teuthology.orchestra.run.smithi060.stdout: "osd-slow-ops": { 2024-05-09T06:03:50.268 INFO:teuthology.orchestra.run.smithi060.stdout: "slow_ops_count": 0 2024-05-09T06:03:50.268 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:50.268 INFO:teuthology.orchestra.run.smithi060.stdout: "purge_queue": { 2024-05-09T06:03:50.268 INFO:teuthology.orchestra.run.smithi060.stdout: "pq_executing_ops": 0, 2024-05-09T06:03:50.268 INFO:teuthology.orchestra.run.smithi060.stdout: "pq_executing_ops_high_water": 0, 2024-05-09T06:03:50.268 INFO:teuthology.orchestra.run.smithi060.stdout: "pq_executing": 0, 2024-05-09T06:03:50.269 INFO:teuthology.orchestra.run.smithi060.stdout: "pq_executing_high_water": 0, 2024-05-09T06:03:50.269 INFO:teuthology.orchestra.run.smithi060.stdout: "pq_executed_ops": 0, 2024-05-09T06:03:50.269 INFO:teuthology.orchestra.run.smithi060.stdout: "pq_executed": 0, 2024-05-09T06:03:50.269 INFO:teuthology.orchestra.run.smithi060.stdout: "pq_item_in_journal": 0 2024-05-09T06:03:50.269 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:50.269 INFO:teuthology.orchestra.run.smithi060.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-09T06:03:50.269 INFO:teuthology.orchestra.run.smithi060.stdout: "val": 0, 2024-05-09T06:03:50.269 INFO:teuthology.orchestra.run.smithi060.stdout: "max": 104857600, 2024-05-09T06:03:50.269 INFO:teuthology.orchestra.run.smithi060.stdout: "get_started": 0, 2024-05-09T06:03:50.269 INFO:teuthology.orchestra.run.smithi060.stdout: "get": 6562, 2024-05-09T06:03:50.269 INFO:teuthology.orchestra.run.smithi060.stdout: "get_sum": 65406718, 2024-05-09T06:03:50.269 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_fail": 0, 2024-05-09T06:03:50.269 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_success": 6562, 2024-05-09T06:03:50.269 INFO:teuthology.orchestra.run.smithi060.stdout: "take": 0, 2024-05-09T06:03:50.270 INFO:teuthology.orchestra.run.smithi060.stdout: "take_sum": 0, 2024-05-09T06:03:50.270 INFO:teuthology.orchestra.run.smithi060.stdout: "put": 6562, 2024-05-09T06:03:50.270 INFO:teuthology.orchestra.run.smithi060.stdout: "put_sum": 65406718, 2024-05-09T06:03:50.270 INFO:teuthology.orchestra.run.smithi060.stdout: "wait": { 2024-05-09T06:03:50.270 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:50.270 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:50.270 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:50.270 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-05-09T06:03:50.270 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:50.270 INFO:teuthology.orchestra.run.smithi060.stdout: "throttle-objecter_bytes": { 2024-05-09T06:03:50.270 INFO:teuthology.orchestra.run.smithi060.stdout: "val": 0, 2024-05-09T06:03:50.270 INFO:teuthology.orchestra.run.smithi060.stdout: "max": 104857600, 2024-05-09T06:03:50.270 INFO:teuthology.orchestra.run.smithi060.stdout: "get_started": 0, 2024-05-09T06:03:50.270 INFO:teuthology.orchestra.run.smithi060.stdout: "get": 0, 2024-05-09T06:03:50.271 INFO:teuthology.orchestra.run.smithi060.stdout: "get_sum": 0, 2024-05-09T06:03:50.271 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_fail": 0, 2024-05-09T06:03:50.271 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_success": 0, 2024-05-09T06:03:50.271 INFO:teuthology.orchestra.run.smithi060.stdout: "take": 6053, 2024-05-09T06:03:50.271 INFO:teuthology.orchestra.run.smithi060.stdout: "take_sum": 63336752, 2024-05-09T06:03:50.271 INFO:teuthology.orchestra.run.smithi060.stdout: "put": 6053, 2024-05-09T06:03:50.271 INFO:teuthology.orchestra.run.smithi060.stdout: "put_sum": 63336752, 2024-05-09T06:03:50.271 INFO:teuthology.orchestra.run.smithi060.stdout: "wait": { 2024-05-09T06:03:50.271 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:50.271 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:50.271 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:50.271 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-05-09T06:03:50.271 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:50.272 INFO:teuthology.orchestra.run.smithi060.stdout: "throttle-objecter_ops": { 2024-05-09T06:03:50.272 INFO:teuthology.orchestra.run.smithi060.stdout: "val": 0, 2024-05-09T06:03:50.272 INFO:teuthology.orchestra.run.smithi060.stdout: "max": 1024, 2024-05-09T06:03:50.272 INFO:teuthology.orchestra.run.smithi060.stdout: "get_started": 0, 2024-05-09T06:03:50.272 INFO:teuthology.orchestra.run.smithi060.stdout: "get": 0, 2024-05-09T06:03:50.272 INFO:teuthology.orchestra.run.smithi060.stdout: "get_sum": 0, 2024-05-09T06:03:50.272 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_fail": 0, 2024-05-09T06:03:50.272 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_success": 0, 2024-05-09T06:03:50.272 INFO:teuthology.orchestra.run.smithi060.stdout: "take": 6053, 2024-05-09T06:03:50.272 INFO:teuthology.orchestra.run.smithi060.stdout: "take_sum": 6053, 2024-05-09T06:03:50.272 INFO:teuthology.orchestra.run.smithi060.stdout: "put": 6053, 2024-05-09T06:03:50.272 INFO:teuthology.orchestra.run.smithi060.stdout: "put_sum": 6053, 2024-05-09T06:03:50.272 INFO:teuthology.orchestra.run.smithi060.stdout: "wait": { 2024-05-09T06:03:50.272 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:50.273 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:50.273 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:50.273 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-05-09T06:03:50.273 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:50.273 INFO:teuthology.orchestra.run.smithi060.stdout: "throttle-write_buf_throttle": { 2024-05-09T06:03:50.273 INFO:teuthology.orchestra.run.smithi060.stdout: "val": 0, 2024-05-09T06:03:50.273 INFO:teuthology.orchestra.run.smithi060.stdout: "max": 3758096384, 2024-05-09T06:03:50.273 INFO:teuthology.orchestra.run.smithi060.stdout: "get_started": 0, 2024-05-09T06:03:50.273 INFO:teuthology.orchestra.run.smithi060.stdout: "get": 0, 2024-05-09T06:03:50.273 INFO:teuthology.orchestra.run.smithi060.stdout: "get_sum": 0, 2024-05-09T06:03:50.273 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_fail": 0, 2024-05-09T06:03:50.273 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_success": 0, 2024-05-09T06:03:50.273 INFO:teuthology.orchestra.run.smithi060.stdout: "take": 0, 2024-05-09T06:03:50.273 INFO:teuthology.orchestra.run.smithi060.stdout: "take_sum": 0, 2024-05-09T06:03:50.274 INFO:teuthology.orchestra.run.smithi060.stdout: "put": 0, 2024-05-09T06:03:50.274 INFO:teuthology.orchestra.run.smithi060.stdout: "put_sum": 0, 2024-05-09T06:03:50.274 INFO:teuthology.orchestra.run.smithi060.stdout: "wait": { 2024-05-09T06:03:50.274 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:50.274 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:50.274 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:50.274 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-05-09T06:03:50.274 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:50.274 INFO:teuthology.orchestra.run.smithi060.stdout: "throttle-write_buf_throttle-0x55c8f112a8f0": { 2024-05-09T06:03:50.274 INFO:teuthology.orchestra.run.smithi060.stdout: "val": 0, 2024-05-09T06:03:50.274 INFO:teuthology.orchestra.run.smithi060.stdout: "max": 3758096384, 2024-05-09T06:03:50.274 INFO:teuthology.orchestra.run.smithi060.stdout: "get_started": 0, 2024-05-09T06:03:50.274 INFO:teuthology.orchestra.run.smithi060.stdout: "get": 0, 2024-05-09T06:03:50.274 INFO:teuthology.orchestra.run.smithi060.stdout: "get_sum": 0, 2024-05-09T06:03:50.275 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_fail": 0, 2024-05-09T06:03:50.275 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_success": 0, 2024-05-09T06:03:50.275 INFO:teuthology.orchestra.run.smithi060.stdout: "take": 0, 2024-05-09T06:03:50.275 INFO:teuthology.orchestra.run.smithi060.stdout: "take_sum": 0, 2024-05-09T06:03:50.275 INFO:teuthology.orchestra.run.smithi060.stdout: "put": 0, 2024-05-09T06:03:50.275 INFO:teuthology.orchestra.run.smithi060.stdout: "put_sum": 0, 2024-05-09T06:03:50.275 INFO:teuthology.orchestra.run.smithi060.stdout: "wait": { 2024-05-09T06:03:50.275 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:50.275 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:50.275 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:50.275 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-05-09T06:03:50.275 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-05-09T06:03:50.275 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-05-09T06:03:51.042 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-05-09T06:03:51.042 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-05-09T06:03:51.042 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update=0 2024-05-09T06:03:51.042 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update_receipt=0 2024-05-09T06:03:51.042 DEBUG:tasks.check_counter:Getting stats from h 2024-05-09T06:03:51.043 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph daemon mds.h perf dump 2024-05-09T06:03:51.292 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.b/config 2024-05-09T06:03:52.022 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:03:51 smithi060 ceph-mon[34555]: pgmap v1164: 97 pgs: 97 active+clean; 501 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 3.8 MiB/s wr, 130 op/s 2024-05-09T06:03:52.102 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:03:51 smithi039 ceph-mon[30439]: pgmap v1164: 97 pgs: 97 active+clean; 501 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 3.8 MiB/s wr, 130 op/s 2024-05-09T06:03:52.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:03:51 smithi100 ceph-mon[34353]: pgmap v1164: 97 pgs: 97 active+clean; 501 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 3.8 MiB/s wr, 130 op/s 2024-05-09T06:03:52.901 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-05-09T06:03:52.901 INFO:teuthology.orchestra.run.smithi060.stdout: "AsyncMessenger::Worker-0": { 2024-05-09T06:03:52.901 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_messages": 4230, 2024-05-09T06:03:52.901 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages": 4232, 2024-05-09T06:03:52.901 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_bytes": 68325007, 2024-05-09T06:03:52.901 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_bytes": 1345147, 2024-05-09T06:03:52.901 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_created_connections": 8, 2024-05-09T06:03:52.901 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_active_connections": 4, 2024-05-09T06:03:52.901 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_total_time": 0.344902179, 2024-05-09T06:03:52.902 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_send_time": 0.092796054, 2024-05-09T06:03:52.902 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_recv_time": 0.121941892, 2024-05-09T06:03:52.902 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_fast_dispatch_time": 0.105310850, 2024-05-09T06:03:52.902 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T06:03:52.902 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 4230, 2024-05-09T06:03:52.902 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.114355044, 2024-05-09T06:03:52.902 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000027034 2024-05-09T06:03:52.902 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:52.902 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_handle_ack_lat": { 2024-05-09T06:03:52.902 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:52.902 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:52.902 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:52.903 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:52.903 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-09T06:03:52.903 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_encrypted_bytes": 0 2024-05-09T06:03:52.903 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:52.903 INFO:teuthology.orchestra.run.smithi060.stdout: "AsyncMessenger::Worker-1": { 2024-05-09T06:03:52.903 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_messages": 1156, 2024-05-09T06:03:52.903 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages": 1125, 2024-05-09T06:03:52.903 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_bytes": 54107475, 2024-05-09T06:03:52.903 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_bytes": 497658, 2024-05-09T06:03:52.903 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_created_connections": 5, 2024-05-09T06:03:52.903 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_active_connections": 4, 2024-05-09T06:03:52.903 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_total_time": 0.139000735, 2024-05-09T06:03:52.903 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_send_time": 0.035442537, 2024-05-09T06:03:52.903 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_recv_time": 0.075081526, 2024-05-09T06:03:52.904 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_fast_dispatch_time": 0.026683316, 2024-05-09T06:03:52.904 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T06:03:52.904 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 1124, 2024-05-09T06:03:52.904 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.042287938, 2024-05-09T06:03:52.904 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000037622 2024-05-09T06:03:52.904 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:52.904 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_handle_ack_lat": { 2024-05-09T06:03:52.904 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:52.904 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:52.904 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:52.904 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:52.905 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_encrypted_bytes": 1012768, 2024-05-09T06:03:52.905 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_encrypted_bytes": 290896 2024-05-09T06:03:52.905 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:52.905 INFO:teuthology.orchestra.run.smithi060.stdout: "AsyncMessenger::Worker-2": { 2024-05-09T06:03:52.905 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_messages": 738, 2024-05-09T06:03:52.905 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages": 1092, 2024-05-09T06:03:52.905 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_bytes": 63103678, 2024-05-09T06:03:52.905 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_bytes": 1028328, 2024-05-09T06:03:52.905 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_created_connections": 7, 2024-05-09T06:03:52.905 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_active_connections": 5, 2024-05-09T06:03:52.905 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_total_time": 0.107044980, 2024-05-09T06:03:52.905 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_send_time": 0.026650543, 2024-05-09T06:03:52.905 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_recv_time": 0.054787294, 2024-05-09T06:03:52.906 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_fast_dispatch_time": 0.018475829, 2024-05-09T06:03:52.906 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T06:03:52.906 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 1091, 2024-05-09T06:03:52.906 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.045337099, 2024-05-09T06:03:52.906 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000041555 2024-05-09T06:03:52.906 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:52.906 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_handle_ack_lat": { 2024-05-09T06:03:52.906 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:52.906 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:52.906 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:52.906 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:52.906 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_encrypted_bytes": 3360, 2024-05-09T06:03:52.906 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_encrypted_bytes": 795552 2024-05-09T06:03:52.907 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:52.907 INFO:teuthology.orchestra.run.smithi060.stdout: "cct": { 2024-05-09T06:03:52.907 INFO:teuthology.orchestra.run.smithi060.stdout: "total_workers": 1, 2024-05-09T06:03:52.907 INFO:teuthology.orchestra.run.smithi060.stdout: "unhealthy_workers": 0 2024-05-09T06:03:52.907 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:52.907 INFO:teuthology.orchestra.run.smithi060.stdout: "finisher-MDSRank": { 2024-05-09T06:03:52.907 INFO:teuthology.orchestra.run.smithi060.stdout: "queue_len": 0, 2024-05-09T06:03:52.907 INFO:teuthology.orchestra.run.smithi060.stdout: "complete_latency": { 2024-05-09T06:03:52.907 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 9679, 2024-05-09T06:03:52.907 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.214994054, 2024-05-09T06:03:52.907 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000022212 2024-05-09T06:03:52.907 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-05-09T06:03:52.907 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:52.908 INFO:teuthology.orchestra.run.smithi060.stdout: "finisher-PurgeQueue": { 2024-05-09T06:03:52.908 INFO:teuthology.orchestra.run.smithi060.stdout: "queue_len": 0, 2024-05-09T06:03:52.908 INFO:teuthology.orchestra.run.smithi060.stdout: "complete_latency": { 2024-05-09T06:03:52.908 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:52.908 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:52.908 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:52.908 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-05-09T06:03:52.908 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:52.908 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": { 2024-05-09T06:03:52.908 INFO:teuthology.orchestra.run.smithi060.stdout: "request": 0, 2024-05-09T06:03:52.908 INFO:teuthology.orchestra.run.smithi060.stdout: "reply": 0, 2024-05-09T06:03:52.908 INFO:teuthology.orchestra.run.smithi060.stdout: "reply_latency": { 2024-05-09T06:03:52.908 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:52.909 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:52.909 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:52.909 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:52.909 INFO:teuthology.orchestra.run.smithi060.stdout: "slow_reply": 0, 2024-05-09T06:03:52.909 INFO:teuthology.orchestra.run.smithi060.stdout: "forward": 0, 2024-05-09T06:03:52.909 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_fetch_complete": 0, 2024-05-09T06:03:52.909 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_fetch_keys": 0, 2024-05-09T06:03:52.909 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_commit": 0, 2024-05-09T06:03:52.909 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_split": 0, 2024-05-09T06:03:52.909 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_merge": 0, 2024-05-09T06:03:52.909 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes": 18994, 2024-05-09T06:03:52.909 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes_top": 2, 2024-05-09T06:03:52.909 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes_bottom": 18992, 2024-05-09T06:03:52.910 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes_pin_tail": 0, 2024-05-09T06:03:52.910 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes_pinned": 18990, 2024-05-09T06:03:52.910 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes_expired": 0, 2024-05-09T06:03:52.910 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes_with_caps": 0, 2024-05-09T06:03:52.910 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": 0, 2024-05-09T06:03:52.910 INFO:teuthology.orchestra.run.smithi060.stdout: "subtrees": 1, 2024-05-09T06:03:52.910 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse": 0, 2024-05-09T06:03:52.910 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse_hit": 0, 2024-05-09T06:03:52.910 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse_forward": 0, 2024-05-09T06:03:52.910 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse_discover": 0, 2024-05-09T06:03:52.910 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse_dir_fetch": 0, 2024-05-09T06:03:52.911 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse_remote_ino": 0, 2024-05-09T06:03:52.911 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse_lock": 0, 2024-05-09T06:03:52.911 INFO:teuthology.orchestra.run.smithi060.stdout: "load_cent": 0, 2024-05-09T06:03:52.911 INFO:teuthology.orchestra.run.smithi060.stdout: "q": 0, 2024-05-09T06:03:52.911 INFO:teuthology.orchestra.run.smithi060.stdout: "exported": 0, 2024-05-09T06:03:52.911 INFO:teuthology.orchestra.run.smithi060.stdout: "exported_inodes": 0, 2024-05-09T06:03:52.911 INFO:teuthology.orchestra.run.smithi060.stdout: "imported": 0, 2024-05-09T06:03:52.911 INFO:teuthology.orchestra.run.smithi060.stdout: "imported_inodes": 0, 2024-05-09T06:03:52.911 INFO:teuthology.orchestra.run.smithi060.stdout: "openino_dir_fetch": 0, 2024-05-09T06:03:52.911 INFO:teuthology.orchestra.run.smithi060.stdout: "openino_backtrace_fetch": 0, 2024-05-09T06:03:52.911 INFO:teuthology.orchestra.run.smithi060.stdout: "openino_peer_discover": 0, 2024-05-09T06:03:52.911 INFO:teuthology.orchestra.run.smithi060.stdout: "root_rfiles": 0, 2024-05-09T06:03:52.911 INFO:teuthology.orchestra.run.smithi060.stdout: "root_rbytes": 0, 2024-05-09T06:03:52.912 INFO:teuthology.orchestra.run.smithi060.stdout: "root_rsnaps": 0, 2024-05-09T06:03:52.912 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_backtrace_fetch": 0, 2024-05-09T06:03:52.912 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_set_tag": 0, 2024-05-09T06:03:52.912 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_backtrace_repaired": 0, 2024-05-09T06:03:52.912 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_inotable_repaired": 0, 2024-05-09T06:03:52.912 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_dir_inodes": 0, 2024-05-09T06:03:52.912 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_dir_base_inodes": 0, 2024-05-09T06:03:52.912 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_dirfrag_rstats": 0, 2024-05-09T06:03:52.912 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_file_inodes": 0, 2024-05-09T06:03:52.912 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_inode_file_caps": 0, 2024-05-09T06:03:52.912 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_cap_op_revoke": 0, 2024-05-09T06:03:52.912 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_cap_op_grant": 0, 2024-05-09T06:03:52.912 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_cap_op_trunc": 0, 2024-05-09T06:03:52.912 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-09T06:03:52.912 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-09T06:03:52.913 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_client_caps": 0, 2024-05-09T06:03:52.913 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_client_caps_dirty": 0, 2024-05-09T06:03:52.913 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_client_cap_release": 0, 2024-05-09T06:03:52.913 INFO:teuthology.orchestra.run.smithi060.stdout: "process_request_cap_release": 0 2024-05-09T06:03:52.913 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:52.913 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_cache": { 2024-05-09T06:03:52.913 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_update": 0, 2024-05-09T06:03:52.913 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_update_receipt": 0, 2024-05-09T06:03:52.913 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_try_discover": 0, 2024-05-09T06:03:52.913 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_send_discover": 0, 2024-05-09T06:03:52.913 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_handle_discover": 0, 2024-05-09T06:03:52.913 INFO:teuthology.orchestra.run.smithi060.stdout: "num_strays": 0, 2024-05-09T06:03:52.913 INFO:teuthology.orchestra.run.smithi060.stdout: "num_strays_delayed": 0, 2024-05-09T06:03:52.914 INFO:teuthology.orchestra.run.smithi060.stdout: "num_strays_enqueuing": 0, 2024-05-09T06:03:52.914 INFO:teuthology.orchestra.run.smithi060.stdout: "strays_created": 0, 2024-05-09T06:03:52.914 INFO:teuthology.orchestra.run.smithi060.stdout: "strays_enqueued": 0, 2024-05-09T06:03:52.914 INFO:teuthology.orchestra.run.smithi060.stdout: "strays_reintegrated": 0, 2024-05-09T06:03:52.914 INFO:teuthology.orchestra.run.smithi060.stdout: "strays_migrated": 0, 2024-05-09T06:03:52.914 INFO:teuthology.orchestra.run.smithi060.stdout: "num_recovering_processing": 0, 2024-05-09T06:03:52.914 INFO:teuthology.orchestra.run.smithi060.stdout: "num_recovering_enqueued": 0, 2024-05-09T06:03:52.914 INFO:teuthology.orchestra.run.smithi060.stdout: "num_recovering_prioritized": 0, 2024-05-09T06:03:52.914 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_started": 0, 2024-05-09T06:03:52.914 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_completed": 0, 2024-05-09T06:03:52.914 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_quiesce_path": 0, 2024-05-09T06:03:52.914 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_quiesce_inode": 0, 2024-05-09T06:03:52.914 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_enqueue_scrub": 0, 2024-05-09T06:03:52.915 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_exportdir": 0, 2024-05-09T06:03:52.915 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_flush": 0, 2024-05-09T06:03:52.915 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_fragmentdir": 0, 2024-05-09T06:03:52.915 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_fragstats": 0, 2024-05-09T06:03:52.915 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_inodestats": 0 2024-05-09T06:03:52.915 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:52.915 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_log": { 2024-05-09T06:03:52.915 INFO:teuthology.orchestra.run.smithi060.stdout: "evlrg": 0, 2024-05-09T06:03:52.915 INFO:teuthology.orchestra.run.smithi060.stdout: "evadd": 0, 2024-05-09T06:03:52.915 INFO:teuthology.orchestra.run.smithi060.stdout: "evex": 0, 2024-05-09T06:03:52.915 INFO:teuthology.orchestra.run.smithi060.stdout: "evtrm": 0, 2024-05-09T06:03:52.915 INFO:teuthology.orchestra.run.smithi060.stdout: "ev": 93743, 2024-05-09T06:03:52.915 INFO:teuthology.orchestra.run.smithi060.stdout: "evexg": 0, 2024-05-09T06:03:52.916 INFO:teuthology.orchestra.run.smithi060.stdout: "evexd": 0, 2024-05-09T06:03:52.916 INFO:teuthology.orchestra.run.smithi060.stdout: "segadd": 0, 2024-05-09T06:03:52.916 INFO:teuthology.orchestra.run.smithi060.stdout: "segex": 0, 2024-05-09T06:03:52.916 INFO:teuthology.orchestra.run.smithi060.stdout: "segtrm": 0, 2024-05-09T06:03:52.916 INFO:teuthology.orchestra.run.smithi060.stdout: "seg": 130, 2024-05-09T06:03:52.916 INFO:teuthology.orchestra.run.smithi060.stdout: "segmjr": 9, 2024-05-09T06:03:52.916 INFO:teuthology.orchestra.run.smithi060.stdout: "segexg": 0, 2024-05-09T06:03:52.916 INFO:teuthology.orchestra.run.smithi060.stdout: "segexd": 0, 2024-05-09T06:03:52.916 INFO:teuthology.orchestra.run.smithi060.stdout: "expos": 4194352, 2024-05-09T06:03:52.916 INFO:teuthology.orchestra.run.smithi060.stdout: "wrpos": 187147399, 2024-05-09T06:03:52.916 INFO:teuthology.orchestra.run.smithi060.stdout: "rdpos": 187145324, 2024-05-09T06:03:52.916 INFO:teuthology.orchestra.run.smithi060.stdout: "jlat": { 2024-05-09T06:03:52.916 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:52.917 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:52.917 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:52.917 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:52.917 INFO:teuthology.orchestra.run.smithi060.stdout: "replayed": 93743 2024-05-09T06:03:52.917 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:52.917 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_mem": { 2024-05-09T06:03:52.917 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 134, 2024-05-09T06:03:52.917 INFO:teuthology.orchestra.run.smithi060.stdout: "ino+": 18995, 2024-05-09T06:03:52.917 INFO:teuthology.orchestra.run.smithi060.stdout: "ino-": 18861, 2024-05-09T06:03:52.917 INFO:teuthology.orchestra.run.smithi060.stdout: "dir": 13, 2024-05-09T06:03:52.917 INFO:teuthology.orchestra.run.smithi060.stdout: "dir+": 38, 2024-05-09T06:03:52.917 INFO:teuthology.orchestra.run.smithi060.stdout: "dir-": 25, 2024-05-09T06:03:52.917 INFO:teuthology.orchestra.run.smithi060.stdout: "dn": 18994, 2024-05-09T06:03:52.917 INFO:teuthology.orchestra.run.smithi060.stdout: "dn+": 19204, 2024-05-09T06:03:52.918 INFO:teuthology.orchestra.run.smithi060.stdout: "dn-": 210, 2024-05-09T06:03:52.918 INFO:teuthology.orchestra.run.smithi060.stdout: "cap": 0, 2024-05-09T06:03:52.918 INFO:teuthology.orchestra.run.smithi060.stdout: "cap+": 0, 2024-05-09T06:03:52.918 INFO:teuthology.orchestra.run.smithi060.stdout: "cap-": 0, 2024-05-09T06:03:52.918 INFO:teuthology.orchestra.run.smithi060.stdout: "rss": 141588, 2024-05-09T06:03:52.918 INFO:teuthology.orchestra.run.smithi060.stdout: "heap": 215440 2024-05-09T06:03:52.918 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:52.918 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_server": { 2024-05-09T06:03:52.918 INFO:teuthology.orchestra.run.smithi060.stdout: "dispatch_client_request": 0, 2024-05-09T06:03:52.918 INFO:teuthology.orchestra.run.smithi060.stdout: "dispatch_server_request": 0, 2024-05-09T06:03:52.918 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_client_request": 0, 2024-05-09T06:03:52.918 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_client_session": 0, 2024-05-09T06:03:52.918 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_peer_request": 0, 2024-05-09T06:03:52.919 INFO:teuthology.orchestra.run.smithi060.stdout: "req_create_latency": { 2024-05-09T06:03:52.919 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:52.919 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:52.919 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:52.919 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:52.919 INFO:teuthology.orchestra.run.smithi060.stdout: "req_getattr_latency": { 2024-05-09T06:03:52.919 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:52.919 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:52.919 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:52.919 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:52.919 INFO:teuthology.orchestra.run.smithi060.stdout: "req_getfilelock_latency": { 2024-05-09T06:03:52.919 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:52.919 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:52.919 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:52.920 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:52.920 INFO:teuthology.orchestra.run.smithi060.stdout: "req_link_latency": { 2024-05-09T06:03:52.920 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:52.920 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:52.920 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:52.920 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:52.920 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lookup_latency": { 2024-05-09T06:03:52.920 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:52.920 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:52.920 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:52.920 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:52.920 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lookuphash_latency": { 2024-05-09T06:03:52.920 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:52.920 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:52.921 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:52.921 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:52.921 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lookupino_latency": { 2024-05-09T06:03:52.921 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:52.921 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:52.921 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:52.921 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:52.921 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lookupname_latency": { 2024-05-09T06:03:52.921 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:52.921 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:52.921 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:52.921 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:52.921 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lookupparent_latency": { 2024-05-09T06:03:52.921 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:52.922 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:52.922 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:52.922 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:52.922 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lookupsnap_latency": { 2024-05-09T06:03:52.922 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:52.922 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:52.922 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:52.922 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:52.922 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lssnap_latency": { 2024-05-09T06:03:52.922 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:52.922 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:52.922 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:52.922 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:52.923 INFO:teuthology.orchestra.run.smithi060.stdout: "req_mkdir_latency": { 2024-05-09T06:03:52.923 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:52.923 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:52.923 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:52.923 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:52.924 INFO:teuthology.orchestra.run.smithi060.stdout: "req_mknod_latency": { 2024-05-09T06:03:52.924 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:52.924 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:52.924 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:52.924 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:52.924 INFO:teuthology.orchestra.run.smithi060.stdout: "req_mksnap_latency": { 2024-05-09T06:03:52.924 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:52.924 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:52.924 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:52.924 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:52.924 INFO:teuthology.orchestra.run.smithi060.stdout: "req_open_latency": { 2024-05-09T06:03:52.924 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:52.924 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:52.924 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:52.925 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:52.925 INFO:teuthology.orchestra.run.smithi060.stdout: "req_readdir_latency": { 2024-05-09T06:03:52.925 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:52.925 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:52.925 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:52.925 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:52.925 INFO:teuthology.orchestra.run.smithi060.stdout: "req_rename_latency": { 2024-05-09T06:03:52.925 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:52.925 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:52.925 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:52.925 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:52.925 INFO:teuthology.orchestra.run.smithi060.stdout: "req_renamesnap_latency": { 2024-05-09T06:03:52.925 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:52.926 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:52.926 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:52.926 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:52.926 INFO:teuthology.orchestra.run.smithi060.stdout: "req_snapdiff_latency": { 2024-05-09T06:03:52.926 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:52.926 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:52.926 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:52.926 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:52.926 INFO:teuthology.orchestra.run.smithi060.stdout: "req_rmdir_latency": { 2024-05-09T06:03:52.926 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:52.926 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:52.926 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:52.926 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:52.926 INFO:teuthology.orchestra.run.smithi060.stdout: "req_rmsnap_latency": { 2024-05-09T06:03:52.927 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:52.927 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:52.927 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:52.927 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:52.927 INFO:teuthology.orchestra.run.smithi060.stdout: "req_rmxattr_latency": { 2024-05-09T06:03:52.927 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:52.927 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:52.927 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:52.927 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:52.927 INFO:teuthology.orchestra.run.smithi060.stdout: "req_setattr_latency": { 2024-05-09T06:03:52.927 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:52.927 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:52.927 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:52.927 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:52.928 INFO:teuthology.orchestra.run.smithi060.stdout: "req_setdirlayout_latency": { 2024-05-09T06:03:52.928 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:52.928 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:52.928 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:52.928 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:52.928 INFO:teuthology.orchestra.run.smithi060.stdout: "req_setfilelock_latency": { 2024-05-09T06:03:52.928 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:52.928 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:52.928 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:52.928 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:52.928 INFO:teuthology.orchestra.run.smithi060.stdout: "req_setlayout_latency": { 2024-05-09T06:03:52.928 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:52.928 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:52.929 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:52.929 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:52.929 INFO:teuthology.orchestra.run.smithi060.stdout: "req_setxattr_latency": { 2024-05-09T06:03:52.929 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:52.929 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:52.929 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:52.929 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:52.929 INFO:teuthology.orchestra.run.smithi060.stdout: "req_symlink_latency": { 2024-05-09T06:03:52.929 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:52.929 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:52.929 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:52.929 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:52.929 INFO:teuthology.orchestra.run.smithi060.stdout: "req_unlink_latency": { 2024-05-09T06:03:52.929 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:52.930 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:52.930 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:52.930 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:52.930 INFO:teuthology.orchestra.run.smithi060.stdout: "cap_revoke_eviction": 0, 2024-05-09T06:03:52.930 INFO:teuthology.orchestra.run.smithi060.stdout: "cap_acquisition_throttle": 0, 2024-05-09T06:03:52.930 INFO:teuthology.orchestra.run.smithi060.stdout: "req_getvxattr_latency": { 2024-05-09T06:03:52.930 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:52.930 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:52.930 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:52.930 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-05-09T06:03:52.930 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:52.930 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_sessions": { 2024-05-09T06:03:52.930 INFO:teuthology.orchestra.run.smithi060.stdout: "session_count": 1, 2024-05-09T06:03:52.930 INFO:teuthology.orchestra.run.smithi060.stdout: "session_add": 1, 2024-05-09T06:03:52.931 INFO:teuthology.orchestra.run.smithi060.stdout: "session_remove": 0, 2024-05-09T06:03:52.931 INFO:teuthology.orchestra.run.smithi060.stdout: "sessions_open": 1, 2024-05-09T06:03:52.931 INFO:teuthology.orchestra.run.smithi060.stdout: "sessions_stale": 0, 2024-05-09T06:03:52.931 INFO:teuthology.orchestra.run.smithi060.stdout: "total_load": 0, 2024-05-09T06:03:52.931 INFO:teuthology.orchestra.run.smithi060.stdout: "average_load": 0, 2024-05-09T06:03:52.931 INFO:teuthology.orchestra.run.smithi060.stdout: "avg_session_uptime": 3025, 2024-05-09T06:03:52.931 INFO:teuthology.orchestra.run.smithi060.stdout: "mdthresh_evicted": 0 2024-05-09T06:03:52.931 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:52.931 INFO:teuthology.orchestra.run.smithi060.stdout: "mempool": { 2024-05-09T06:03:52.931 INFO:teuthology.orchestra.run.smithi060.stdout: "bloom_filter_bytes": 0, 2024-05-09T06:03:52.931 INFO:teuthology.orchestra.run.smithi060.stdout: "bloom_filter_items": 0, 2024-05-09T06:03:52.931 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_alloc_bytes": 0, 2024-05-09T06:03:52.931 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_alloc_items": 0, 2024-05-09T06:03:52.931 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_data_bytes": 0, 2024-05-09T06:03:52.931 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_data_items": 0, 2024-05-09T06:03:52.932 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-09T06:03:52.932 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_onode_items": 0, 2024-05-09T06:03:52.932 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-09T06:03:52.932 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_meta_items": 0, 2024-05-09T06:03:52.932 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_other_bytes": 0, 2024-05-09T06:03:52.932 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_other_items": 0, 2024-05-09T06:03:52.932 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-09T06:03:52.932 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_buffer_items": 0, 2024-05-09T06:03:52.932 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_extent_bytes": 0, 2024-05-09T06:03:52.932 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_extent_items": 0, 2024-05-09T06:03:52.932 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_blob_bytes": 0, 2024-05-09T06:03:52.932 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_blob_items": 0, 2024-05-09T06:03:52.932 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-09T06:03:52.932 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_shared_blob_items": 0, 2024-05-09T06:03:52.933 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-09T06:03:52.933 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_inline_bl_items": 0, 2024-05-09T06:03:52.933 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_fsck_bytes": 0, 2024-05-09T06:03:52.933 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_fsck_items": 0, 2024-05-09T06:03:52.933 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_txc_bytes": 0, 2024-05-09T06:03:52.933 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_txc_items": 0, 2024-05-09T06:03:52.933 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-09T06:03:52.933 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_writing_deferred_items": 0, 2024-05-09T06:03:52.933 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_writing_bytes": 0, 2024-05-09T06:03:52.933 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_writing_items": 0, 2024-05-09T06:03:52.933 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_bytes": 0, 2024-05-09T06:03:52.933 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_items": 0, 2024-05-09T06:03:52.933 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_file_reader_bytes": 0, 2024-05-09T06:03:52.934 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_file_reader_items": 0, 2024-05-09T06:03:52.934 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_file_writer_bytes": 0, 2024-05-09T06:03:52.934 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_file_writer_items": 0, 2024-05-09T06:03:52.934 INFO:teuthology.orchestra.run.smithi060.stdout: "buffer_anon_bytes": 236652, 2024-05-09T06:03:52.934 INFO:teuthology.orchestra.run.smithi060.stdout: "buffer_anon_items": 198, 2024-05-09T06:03:52.934 INFO:teuthology.orchestra.run.smithi060.stdout: "buffer_meta_bytes": 0, 2024-05-09T06:03:52.934 INFO:teuthology.orchestra.run.smithi060.stdout: "buffer_meta_items": 0, 2024-05-09T06:03:52.934 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_bytes": 0, 2024-05-09T06:03:52.934 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_items": 0, 2024-05-09T06:03:52.934 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_mapbl_bytes": 0, 2024-05-09T06:03:52.934 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_mapbl_items": 0, 2024-05-09T06:03:52.934 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_pglog_bytes": 0, 2024-05-09T06:03:52.934 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_pglog_items": 0, 2024-05-09T06:03:52.934 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_bytes": 7528, 2024-05-09T06:03:52.935 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_items": 158, 2024-05-09T06:03:52.935 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_mapping_bytes": 0, 2024-05-09T06:03:52.935 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_mapping_items": 0, 2024-05-09T06:03:52.935 INFO:teuthology.orchestra.run.smithi060.stdout: "pgmap_bytes": 0, 2024-05-09T06:03:52.935 INFO:teuthology.orchestra.run.smithi060.stdout: "pgmap_items": 0, 2024-05-09T06:03:52.935 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_co_bytes": 13710096, 2024-05-09T06:03:52.935 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_co_items": 91992, 2024-05-09T06:03:52.935 INFO:teuthology.orchestra.run.smithi060.stdout: "unittest_1_bytes": 0, 2024-05-09T06:03:52.935 INFO:teuthology.orchestra.run.smithi060.stdout: "unittest_1_items": 0, 2024-05-09T06:03:52.935 INFO:teuthology.orchestra.run.smithi060.stdout: "unittest_2_bytes": 0, 2024-05-09T06:03:52.935 INFO:teuthology.orchestra.run.smithi060.stdout: "unittest_2_items": 0 2024-05-09T06:03:52.935 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:52.935 INFO:teuthology.orchestra.run.smithi060.stdout: "objecter": { 2024-05-09T06:03:52.935 INFO:teuthology.orchestra.run.smithi060.stdout: "op_active": 0, 2024-05-09T06:03:52.935 INFO:teuthology.orchestra.run.smithi060.stdout: "op_laggy": 0, 2024-05-09T06:03:52.936 INFO:teuthology.orchestra.run.smithi060.stdout: "op_send": 5612, 2024-05-09T06:03:52.936 INFO:teuthology.orchestra.run.smithi060.stdout: "op_send_bytes": 21, 2024-05-09T06:03:52.936 INFO:teuthology.orchestra.run.smithi060.stdout: "op_resend": 3, 2024-05-09T06:03:52.936 INFO:teuthology.orchestra.run.smithi060.stdout: "op_reply": 5612, 2024-05-09T06:03:52.936 INFO:teuthology.orchestra.run.smithi060.stdout: "op_latency": { 2024-05-09T06:03:52.936 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 5612, 2024-05-09T06:03:52.936 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 6.426944704, 2024-05-09T06:03:52.936 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.001145214 2024-05-09T06:03:52.936 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:52.936 INFO:teuthology.orchestra.run.smithi060.stdout: "op_inflight": 0, 2024-05-09T06:03:52.936 INFO:teuthology.orchestra.run.smithi060.stdout: "oplen_avg": { 2024-05-09T06:03:52.936 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 5612, 2024-05-09T06:03:52.936 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 5613 2024-05-09T06:03:52.936 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:52.936 INFO:teuthology.orchestra.run.smithi060.stdout: "op": 5612, 2024-05-09T06:03:52.937 INFO:teuthology.orchestra.run.smithi060.stdout: "op_r": 5612, 2024-05-09T06:03:52.937 INFO:teuthology.orchestra.run.smithi060.stdout: "op_w": 0, 2024-05-09T06:03:52.937 INFO:teuthology.orchestra.run.smithi060.stdout: "op_rmw": 0, 2024-05-09T06:03:52.937 INFO:teuthology.orchestra.run.smithi060.stdout: "op_pg": 0, 2024-05-09T06:03:52.937 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_stat": 3153, 2024-05-09T06:03:52.937 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_create": 0, 2024-05-09T06:03:52.937 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_read": 2457, 2024-05-09T06:03:52.937 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_write": 0, 2024-05-09T06:03:52.937 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_writefull": 0, 2024-05-09T06:03:52.937 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_writesame": 0, 2024-05-09T06:03:52.937 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_append": 0, 2024-05-09T06:03:52.937 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_zero": 0, 2024-05-09T06:03:52.937 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_truncate": 0, 2024-05-09T06:03:52.937 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_delete": 0, 2024-05-09T06:03:52.938 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_mapext": 0, 2024-05-09T06:03:52.938 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_sparse_read": 0, 2024-05-09T06:03:52.938 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_clonerange": 0, 2024-05-09T06:03:52.938 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_getxattr": 1, 2024-05-09T06:03:52.938 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_setxattr": 0, 2024-05-09T06:03:52.938 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_cmpxattr": 0, 2024-05-09T06:03:52.938 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_rmxattr": 0, 2024-05-09T06:03:52.938 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_resetxattrs": 0, 2024-05-09T06:03:52.938 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_call": 0, 2024-05-09T06:03:52.938 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_watch": 0, 2024-05-09T06:03:52.938 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_notify": 0, 2024-05-09T06:03:52.938 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_src_cmpxattr": 0, 2024-05-09T06:03:52.939 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_pgls": 0, 2024-05-09T06:03:52.939 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_pgls_filter": 0, 2024-05-09T06:03:52.939 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_other": 0, 2024-05-09T06:03:52.939 INFO:teuthology.orchestra.run.smithi060.stdout: "linger_active": 0, 2024-05-09T06:03:52.939 INFO:teuthology.orchestra.run.smithi060.stdout: "linger_send": 0, 2024-05-09T06:03:52.939 INFO:teuthology.orchestra.run.smithi060.stdout: "linger_resend": 0, 2024-05-09T06:03:52.939 INFO:teuthology.orchestra.run.smithi060.stdout: "linger_ping": 0, 2024-05-09T06:03:52.939 INFO:teuthology.orchestra.run.smithi060.stdout: "poolop_active": 0, 2024-05-09T06:03:52.939 INFO:teuthology.orchestra.run.smithi060.stdout: "poolop_send": 0, 2024-05-09T06:03:52.939 INFO:teuthology.orchestra.run.smithi060.stdout: "poolop_resend": 0, 2024-05-09T06:03:52.939 INFO:teuthology.orchestra.run.smithi060.stdout: "poolstat_active": 0, 2024-05-09T06:03:52.939 INFO:teuthology.orchestra.run.smithi060.stdout: "poolstat_send": 0, 2024-05-09T06:03:52.939 INFO:teuthology.orchestra.run.smithi060.stdout: "poolstat_resend": 0, 2024-05-09T06:03:52.939 INFO:teuthology.orchestra.run.smithi060.stdout: "statfs_active": 0, 2024-05-09T06:03:52.939 INFO:teuthology.orchestra.run.smithi060.stdout: "statfs_send": 0, 2024-05-09T06:03:52.940 INFO:teuthology.orchestra.run.smithi060.stdout: "statfs_resend": 0, 2024-05-09T06:03:52.940 INFO:teuthology.orchestra.run.smithi060.stdout: "command_active": 0, 2024-05-09T06:03:52.940 INFO:teuthology.orchestra.run.smithi060.stdout: "command_send": 0, 2024-05-09T06:03:52.940 INFO:teuthology.orchestra.run.smithi060.stdout: "command_resend": 0, 2024-05-09T06:03:52.940 INFO:teuthology.orchestra.run.smithi060.stdout: "map_epoch": 83, 2024-05-09T06:03:52.940 INFO:teuthology.orchestra.run.smithi060.stdout: "map_full": 0, 2024-05-09T06:03:52.940 INFO:teuthology.orchestra.run.smithi060.stdout: "map_inc": 2, 2024-05-09T06:03:52.940 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_sessions": 10, 2024-05-09T06:03:52.940 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_session_open": 10, 2024-05-09T06:03:52.940 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_session_close": 0, 2024-05-09T06:03:52.940 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_laggy": 0, 2024-05-09T06:03:52.940 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_wr": 0, 2024-05-09T06:03:52.940 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_rd": 2, 2024-05-09T06:03:52.940 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_del": 0 2024-05-09T06:03:52.940 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:52.940 INFO:teuthology.orchestra.run.smithi060.stdout: "oft": { 2024-05-09T06:03:52.941 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_total_objs": 0, 2024-05-09T06:03:52.941 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_total_kv_pairs": 0, 2024-05-09T06:03:52.941 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_total_updates": 0, 2024-05-09T06:03:52.941 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_total_removes": 0 2024-05-09T06:03:52.941 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:52.941 INFO:teuthology.orchestra.run.smithi060.stdout: "osd-slow-ops": { 2024-05-09T06:03:52.941 INFO:teuthology.orchestra.run.smithi060.stdout: "slow_ops_count": 0 2024-05-09T06:03:52.941 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:52.941 INFO:teuthology.orchestra.run.smithi060.stdout: "purge_queue": { 2024-05-09T06:03:52.941 INFO:teuthology.orchestra.run.smithi060.stdout: "pq_executing_ops": 0, 2024-05-09T06:03:52.941 INFO:teuthology.orchestra.run.smithi060.stdout: "pq_executing_ops_high_water": 0, 2024-05-09T06:03:52.941 INFO:teuthology.orchestra.run.smithi060.stdout: "pq_executing": 0, 2024-05-09T06:03:52.941 INFO:teuthology.orchestra.run.smithi060.stdout: "pq_executing_high_water": 0, 2024-05-09T06:03:52.941 INFO:teuthology.orchestra.run.smithi060.stdout: "pq_executed_ops": 0, 2024-05-09T06:03:52.942 INFO:teuthology.orchestra.run.smithi060.stdout: "pq_executed": 0, 2024-05-09T06:03:52.942 INFO:teuthology.orchestra.run.smithi060.stdout: "pq_item_in_journal": 0 2024-05-09T06:03:52.942 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:52.942 INFO:teuthology.orchestra.run.smithi060.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-09T06:03:52.942 INFO:teuthology.orchestra.run.smithi060.stdout: "val": 0, 2024-05-09T06:03:52.942 INFO:teuthology.orchestra.run.smithi060.stdout: "max": 104857600, 2024-05-09T06:03:52.942 INFO:teuthology.orchestra.run.smithi060.stdout: "get_started": 0, 2024-05-09T06:03:52.942 INFO:teuthology.orchestra.run.smithi060.stdout: "get": 6120, 2024-05-09T06:03:52.942 INFO:teuthology.orchestra.run.smithi060.stdout: "get_sum": 184956255, 2024-05-09T06:03:52.942 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_fail": 0, 2024-05-09T06:03:52.942 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_success": 6120, 2024-05-09T06:03:52.942 INFO:teuthology.orchestra.run.smithi060.stdout: "take": 0, 2024-05-09T06:03:52.942 INFO:teuthology.orchestra.run.smithi060.stdout: "take_sum": 0, 2024-05-09T06:03:52.942 INFO:teuthology.orchestra.run.smithi060.stdout: "put": 6120, 2024-05-09T06:03:52.942 INFO:teuthology.orchestra.run.smithi060.stdout: "put_sum": 184956255, 2024-05-09T06:03:52.943 INFO:teuthology.orchestra.run.smithi060.stdout: "wait": { 2024-05-09T06:03:52.943 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:52.943 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:52.943 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:52.943 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-05-09T06:03:52.943 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:52.943 INFO:teuthology.orchestra.run.smithi060.stdout: "throttle-objecter_bytes": { 2024-05-09T06:03:52.943 INFO:teuthology.orchestra.run.smithi060.stdout: "val": 0, 2024-05-09T06:03:52.943 INFO:teuthology.orchestra.run.smithi060.stdout: "max": 104857600, 2024-05-09T06:03:52.943 INFO:teuthology.orchestra.run.smithi060.stdout: "get_started": 0, 2024-05-09T06:03:52.943 INFO:teuthology.orchestra.run.smithi060.stdout: "get": 0, 2024-05-09T06:03:52.943 INFO:teuthology.orchestra.run.smithi060.stdout: "get_sum": 0, 2024-05-09T06:03:52.943 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_fail": 0, 2024-05-09T06:03:52.943 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_success": 0, 2024-05-09T06:03:52.943 INFO:teuthology.orchestra.run.smithi060.stdout: "take": 5612, 2024-05-09T06:03:52.944 INFO:teuthology.orchestra.run.smithi060.stdout: "take_sum": 182953100, 2024-05-09T06:03:52.944 INFO:teuthology.orchestra.run.smithi060.stdout: "put": 5612, 2024-05-09T06:03:52.944 INFO:teuthology.orchestra.run.smithi060.stdout: "put_sum": 182953100, 2024-05-09T06:03:52.944 INFO:teuthology.orchestra.run.smithi060.stdout: "wait": { 2024-05-09T06:03:52.944 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:52.944 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:52.944 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:52.944 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-05-09T06:03:52.944 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:52.944 INFO:teuthology.orchestra.run.smithi060.stdout: "throttle-objecter_ops": { 2024-05-09T06:03:52.944 INFO:teuthology.orchestra.run.smithi060.stdout: "val": 0, 2024-05-09T06:03:52.944 INFO:teuthology.orchestra.run.smithi060.stdout: "max": 1024, 2024-05-09T06:03:52.944 INFO:teuthology.orchestra.run.smithi060.stdout: "get_started": 0, 2024-05-09T06:03:52.944 INFO:teuthology.orchestra.run.smithi060.stdout: "get": 0, 2024-05-09T06:03:52.945 INFO:teuthology.orchestra.run.smithi060.stdout: "get_sum": 0, 2024-05-09T06:03:52.945 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_fail": 0, 2024-05-09T06:03:52.945 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_success": 0, 2024-05-09T06:03:52.945 INFO:teuthology.orchestra.run.smithi060.stdout: "take": 5612, 2024-05-09T06:03:52.945 INFO:teuthology.orchestra.run.smithi060.stdout: "take_sum": 5612, 2024-05-09T06:03:52.945 INFO:teuthology.orchestra.run.smithi060.stdout: "put": 5612, 2024-05-09T06:03:52.945 INFO:teuthology.orchestra.run.smithi060.stdout: "put_sum": 5612, 2024-05-09T06:03:52.945 INFO:teuthology.orchestra.run.smithi060.stdout: "wait": { 2024-05-09T06:03:52.945 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:52.945 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:52.945 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:52.945 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-05-09T06:03:52.945 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:52.945 INFO:teuthology.orchestra.run.smithi060.stdout: "throttle-write_buf_throttle": { 2024-05-09T06:03:52.945 INFO:teuthology.orchestra.run.smithi060.stdout: "val": 0, 2024-05-09T06:03:52.946 INFO:teuthology.orchestra.run.smithi060.stdout: "max": 3758096384, 2024-05-09T06:03:52.946 INFO:teuthology.orchestra.run.smithi060.stdout: "get_started": 0, 2024-05-09T06:03:52.946 INFO:teuthology.orchestra.run.smithi060.stdout: "get": 0, 2024-05-09T06:03:52.946 INFO:teuthology.orchestra.run.smithi060.stdout: "get_sum": 0, 2024-05-09T06:03:52.946 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_fail": 0, 2024-05-09T06:03:52.946 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_success": 0, 2024-05-09T06:03:52.946 INFO:teuthology.orchestra.run.smithi060.stdout: "take": 0, 2024-05-09T06:03:52.946 INFO:teuthology.orchestra.run.smithi060.stdout: "take_sum": 0, 2024-05-09T06:03:52.946 INFO:teuthology.orchestra.run.smithi060.stdout: "put": 0, 2024-05-09T06:03:52.946 INFO:teuthology.orchestra.run.smithi060.stdout: "put_sum": 0, 2024-05-09T06:03:52.946 INFO:teuthology.orchestra.run.smithi060.stdout: "wait": { 2024-05-09T06:03:52.946 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:52.946 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:52.947 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:52.947 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-05-09T06:03:52.947 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:52.947 INFO:teuthology.orchestra.run.smithi060.stdout: "throttle-write_buf_throttle-0x55ff8222c8f0": { 2024-05-09T06:03:52.947 INFO:teuthology.orchestra.run.smithi060.stdout: "val": 0, 2024-05-09T06:03:52.947 INFO:teuthology.orchestra.run.smithi060.stdout: "max": 3758096384, 2024-05-09T06:03:52.947 INFO:teuthology.orchestra.run.smithi060.stdout: "get_started": 0, 2024-05-09T06:03:52.947 INFO:teuthology.orchestra.run.smithi060.stdout: "get": 0, 2024-05-09T06:03:52.947 INFO:teuthology.orchestra.run.smithi060.stdout: "get_sum": 0, 2024-05-09T06:03:52.947 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_fail": 0, 2024-05-09T06:03:52.947 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_success": 0, 2024-05-09T06:03:52.947 INFO:teuthology.orchestra.run.smithi060.stdout: "take": 0, 2024-05-09T06:03:52.947 INFO:teuthology.orchestra.run.smithi060.stdout: "take_sum": 0, 2024-05-09T06:03:52.947 INFO:teuthology.orchestra.run.smithi060.stdout: "put": 0, 2024-05-09T06:03:52.947 INFO:teuthology.orchestra.run.smithi060.stdout: "put_sum": 0, 2024-05-09T06:03:52.948 INFO:teuthology.orchestra.run.smithi060.stdout: "wait": { 2024-05-09T06:03:52.948 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:52.948 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:52.948 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:52.948 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-05-09T06:03:52.948 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-05-09T06:03:52.948 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-05-09T06:03:53.790 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2024-05-09T06:03:53.790 INFO:tasks.check_counter:Daemon mds.h mds.imported=0 2024-05-09T06:03:53.790 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=0 2024-05-09T06:03:53.790 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=0 2024-05-09T06:03:53.790 DEBUG:tasks.check_counter:Getting stats from k 2024-05-09T06:03:53.790 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph daemon mds.k perf dump 2024-05-09T06:03:54.038 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:03:53 smithi060 ceph-mon[34555]: pgmap v1165: 97 pgs: 97 active+clean; 498 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 3.6 MiB/s wr, 129 op/s 2024-05-09T06:03:54.091 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.b/config 2024-05-09T06:03:54.102 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:03:53 smithi039 ceph-mon[30439]: pgmap v1165: 97 pgs: 97 active+clean; 498 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 3.6 MiB/s wr, 129 op/s 2024-05-09T06:03:54.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:03:53 smithi100 ceph-mon[34353]: pgmap v1165: 97 pgs: 97 active+clean; 498 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 3.6 MiB/s wr, 129 op/s 2024-05-09T06:03:55.580 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-05-09T06:03:55.580 INFO:teuthology.orchestra.run.smithi060.stdout: "AsyncMessenger::Worker-0": { 2024-05-09T06:03:55.580 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_messages": 0, 2024-05-09T06:03:55.580 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages": 2, 2024-05-09T06:03:55.580 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_bytes": 0, 2024-05-09T06:03:55.581 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_bytes": 0, 2024-05-09T06:03:55.581 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_created_connections": 4, 2024-05-09T06:03:55.581 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_active_connections": 0, 2024-05-09T06:03:55.581 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_total_time": 0.001341410, 2024-05-09T06:03:55.581 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_send_time": 0.000000000, 2024-05-09T06:03:55.581 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_recv_time": 0.000379307, 2024-05-09T06:03:55.581 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-09T06:03:55.581 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T06:03:55.581 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:55.581 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:55.581 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:55.581 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:55.581 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_handle_ack_lat": { 2024-05-09T06:03:55.581 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:55.582 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:55.582 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:55.582 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:55.582 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-09T06:03:55.582 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_encrypted_bytes": 0 2024-05-09T06:03:55.582 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:55.582 INFO:teuthology.orchestra.run.smithi060.stdout: "AsyncMessenger::Worker-1": { 2024-05-09T06:03:55.582 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_messages": 6, 2024-05-09T06:03:55.582 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages": 364, 2024-05-09T06:03:55.582 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_bytes": 3360, 2024-05-09T06:03:55.582 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_bytes": 221792, 2024-05-09T06:03:55.582 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_created_connections": 4, 2024-05-09T06:03:55.582 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_active_connections": 2, 2024-05-09T06:03:55.583 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_total_time": 0.017453406, 2024-05-09T06:03:55.583 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_send_time": 0.012358286, 2024-05-09T06:03:55.583 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_recv_time": 0.002097102, 2024-05-09T06:03:55.583 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-09T06:03:55.583 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T06:03:55.583 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 363, 2024-05-09T06:03:55.583 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.015311218, 2024-05-09T06:03:55.583 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000042179 2024-05-09T06:03:55.583 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:55.583 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_handle_ack_lat": { 2024-05-09T06:03:55.583 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:55.583 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:55.583 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:55.584 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:55.584 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_encrypted_bytes": 3360, 2024-05-09T06:03:55.584 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_encrypted_bytes": 221792 2024-05-09T06:03:55.584 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:55.584 INFO:teuthology.orchestra.run.smithi060.stdout: "AsyncMessenger::Worker-2": { 2024-05-09T06:03:55.584 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_messages": 479, 2024-05-09T06:03:55.584 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages": 474, 2024-05-09T06:03:55.584 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_bytes": 887136, 2024-05-09T06:03:55.584 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_bytes": 293552, 2024-05-09T06:03:55.584 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_created_connections": 2, 2024-05-09T06:03:55.584 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_active_connections": 1, 2024-05-09T06:03:55.584 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_total_time": 0.061392223, 2024-05-09T06:03:55.584 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_send_time": 0.021472790, 2024-05-09T06:03:55.585 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_recv_time": 0.031516998, 2024-05-09T06:03:55.585 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_fast_dispatch_time": 0.009973214, 2024-05-09T06:03:55.585 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T06:03:55.585 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 473, 2024-05-09T06:03:55.585 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.018651109, 2024-05-09T06:03:55.585 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000039431 2024-05-09T06:03:55.585 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:55.585 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_handle_ack_lat": { 2024-05-09T06:03:55.585 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:55.585 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:55.585 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:55.585 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:55.586 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_encrypted_bytes": 887136, 2024-05-09T06:03:55.586 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_encrypted_bytes": 293552 2024-05-09T06:03:55.586 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:55.586 INFO:teuthology.orchestra.run.smithi060.stdout: "cct": { 2024-05-09T06:03:55.586 INFO:teuthology.orchestra.run.smithi060.stdout: "total_workers": 0, 2024-05-09T06:03:55.586 INFO:teuthology.orchestra.run.smithi060.stdout: "unhealthy_workers": 0 2024-05-09T06:03:55.586 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:55.586 INFO:teuthology.orchestra.run.smithi060.stdout: "mempool": { 2024-05-09T06:03:55.586 INFO:teuthology.orchestra.run.smithi060.stdout: "bloom_filter_bytes": 0, 2024-05-09T06:03:55.586 INFO:teuthology.orchestra.run.smithi060.stdout: "bloom_filter_items": 0, 2024-05-09T06:03:55.586 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_alloc_bytes": 0, 2024-05-09T06:03:55.587 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_alloc_items": 0, 2024-05-09T06:03:55.587 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_data_bytes": 0, 2024-05-09T06:03:55.587 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_data_items": 0, 2024-05-09T06:03:55.587 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-09T06:03:55.587 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_onode_items": 0, 2024-05-09T06:03:55.587 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-09T06:03:55.587 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_meta_items": 0, 2024-05-09T06:03:55.587 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_other_bytes": 0, 2024-05-09T06:03:55.587 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_other_items": 0, 2024-05-09T06:03:55.587 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-09T06:03:55.587 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_buffer_items": 0, 2024-05-09T06:03:55.587 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_extent_bytes": 0, 2024-05-09T06:03:55.587 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_extent_items": 0, 2024-05-09T06:03:55.588 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_blob_bytes": 0, 2024-05-09T06:03:55.588 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_blob_items": 0, 2024-05-09T06:03:55.588 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-09T06:03:55.588 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_shared_blob_items": 0, 2024-05-09T06:03:55.588 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-09T06:03:55.588 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_inline_bl_items": 0, 2024-05-09T06:03:55.588 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_fsck_bytes": 0, 2024-05-09T06:03:55.588 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_fsck_items": 0, 2024-05-09T06:03:55.588 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_txc_bytes": 0, 2024-05-09T06:03:55.588 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_txc_items": 0, 2024-05-09T06:03:55.588 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-09T06:03:55.588 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_writing_deferred_items": 0, 2024-05-09T06:03:55.588 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_writing_bytes": 0, 2024-05-09T06:03:55.589 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_writing_items": 0, 2024-05-09T06:03:55.589 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_bytes": 0, 2024-05-09T06:03:55.589 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_items": 0, 2024-05-09T06:03:55.589 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_file_reader_bytes": 0, 2024-05-09T06:03:55.589 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_file_reader_items": 0, 2024-05-09T06:03:55.589 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_file_writer_bytes": 0, 2024-05-09T06:03:55.589 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_file_writer_items": 0, 2024-05-09T06:03:55.589 INFO:teuthology.orchestra.run.smithi060.stdout: "buffer_anon_bytes": 148704, 2024-05-09T06:03:55.589 INFO:teuthology.orchestra.run.smithi060.stdout: "buffer_anon_items": 29, 2024-05-09T06:03:55.589 INFO:teuthology.orchestra.run.smithi060.stdout: "buffer_meta_bytes": 0, 2024-05-09T06:03:55.589 INFO:teuthology.orchestra.run.smithi060.stdout: "buffer_meta_items": 0, 2024-05-09T06:03:55.589 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_bytes": 0, 2024-05-09T06:03:55.589 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_items": 0, 2024-05-09T06:03:55.589 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_mapbl_bytes": 0, 2024-05-09T06:03:55.590 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_mapbl_items": 0, 2024-05-09T06:03:55.590 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_pglog_bytes": 0, 2024-05-09T06:03:55.590 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_pglog_items": 0, 2024-05-09T06:03:55.590 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_bytes": 0, 2024-05-09T06:03:55.590 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_items": 0, 2024-05-09T06:03:55.590 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_mapping_bytes": 0, 2024-05-09T06:03:55.590 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_mapping_items": 0, 2024-05-09T06:03:55.590 INFO:teuthology.orchestra.run.smithi060.stdout: "pgmap_bytes": 0, 2024-05-09T06:03:55.590 INFO:teuthology.orchestra.run.smithi060.stdout: "pgmap_items": 0, 2024-05-09T06:03:55.590 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_co_bytes": 928, 2024-05-09T06:03:55.590 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_co_items": 2, 2024-05-09T06:03:55.591 INFO:teuthology.orchestra.run.smithi060.stdout: "unittest_1_bytes": 0, 2024-05-09T06:03:55.591 INFO:teuthology.orchestra.run.smithi060.stdout: "unittest_1_items": 0, 2024-05-09T06:03:55.591 INFO:teuthology.orchestra.run.smithi060.stdout: "unittest_2_bytes": 0, 2024-05-09T06:03:55.591 INFO:teuthology.orchestra.run.smithi060.stdout: "unittest_2_items": 0 2024-05-09T06:03:55.591 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-05-09T06:03:55.591 INFO:teuthology.orchestra.run.smithi060.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-09T06:03:55.591 INFO:teuthology.orchestra.run.smithi060.stdout: "val": 0, 2024-05-09T06:03:55.591 INFO:teuthology.orchestra.run.smithi060.stdout: "max": 104857600, 2024-05-09T06:03:55.591 INFO:teuthology.orchestra.run.smithi060.stdout: "get_started": 0, 2024-05-09T06:03:55.591 INFO:teuthology.orchestra.run.smithi060.stdout: "get": 481, 2024-05-09T06:03:55.591 INFO:teuthology.orchestra.run.smithi060.stdout: "get_sum": 819365, 2024-05-09T06:03:55.591 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_fail": 0, 2024-05-09T06:03:55.591 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_success": 481, 2024-05-09T06:03:55.591 INFO:teuthology.orchestra.run.smithi060.stdout: "take": 0, 2024-05-09T06:03:55.592 INFO:teuthology.orchestra.run.smithi060.stdout: "take_sum": 0, 2024-05-09T06:03:55.592 INFO:teuthology.orchestra.run.smithi060.stdout: "put": 481, 2024-05-09T06:03:55.592 INFO:teuthology.orchestra.run.smithi060.stdout: "put_sum": 819365, 2024-05-09T06:03:55.592 INFO:teuthology.orchestra.run.smithi060.stdout: "wait": { 2024-05-09T06:03:55.592 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-05-09T06:03:55.592 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-05-09T06:03:55.592 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-05-09T06:03:55.592 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-05-09T06:03:55.592 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-05-09T06:03:55.592 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-05-09T06:03:56.038 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:03:55 smithi060 ceph-mon[34555]: pgmap v1166: 97 pgs: 97 active+clean; 493 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 3.5 MiB/s wr, 129 op/s 2024-05-09T06:03:56.102 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:03:55 smithi039 ceph-mon[30439]: pgmap v1166: 97 pgs: 97 active+clean; 493 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 3.5 MiB/s wr, 129 op/s 2024-05-09T06:03:56.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:03:55 smithi100 ceph-mon[34353]: pgmap v1166: 97 pgs: 97 active+clean; 493 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 3.5 MiB/s wr, 129 op/s 2024-05-09T06:03:56.246 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.k 2024-05-09T06:03:56.246 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.k 2024-05-09T06:03:56.246 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.k 2024-05-09T06:03:56.246 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.k 2024-05-09T06:03:56.246 DEBUG:tasks.check_counter:Getting stats from c 2024-05-09T06:03:56.246 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph daemon mds.c perf dump 2024-05-09T06:03:56.535 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.c/config 2024-05-09T06:03:57.992 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:03:57 smithi100 ceph-mon[34353]: pgmap v1167: 97 pgs: 97 active+clean; 488 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 3.5 MiB/s wr, 134 op/s 2024-05-09T06:03:58.038 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:03:57 smithi060 ceph-mon[34555]: pgmap v1167: 97 pgs: 97 active+clean; 488 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 3.5 MiB/s wr, 134 op/s 2024-05-09T06:03:58.102 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:03:57 smithi039 ceph-mon[30439]: pgmap v1167: 97 pgs: 97 active+clean; 488 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 3.5 MiB/s wr, 134 op/s 2024-05-09T06:03:58.645 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-05-09T06:03:58.646 INFO:teuthology.orchestra.run.smithi100.stdout: "AsyncMessenger::Worker-0": { 2024-05-09T06:03:58.646 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_messages": 165714, 2024-05-09T06:03:58.646 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages": 224704, 2024-05-09T06:03:58.646 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_bytes": 56570790, 2024-05-09T06:03:58.646 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_bytes": 140950038, 2024-05-09T06:03:58.647 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_created_connections": 15, 2024-05-09T06:03:58.647 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_active_connections": 3, 2024-05-09T06:03:58.647 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_total_time": 11.821187323, 2024-05-09T06:03:58.647 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_send_time": 5.075467401, 2024-05-09T06:03:58.647 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_recv_time": 8.441715603, 2024-05-09T06:03:58.647 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_fast_dispatch_time": 0.228765589, 2024-05-09T06:03:58.647 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T06:03:58.647 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 224702, 2024-05-09T06:03:58.647 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 4.226827981, 2024-05-09T06:03:58.647 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000018810 2024-05-09T06:03:58.647 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:03:58.647 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_handle_ack_lat": { 2024-05-09T06:03:58.647 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 347825, 2024-05-09T06:03:58.648 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.051282046, 2024-05-09T06:03:58.648 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000147 2024-05-09T06:03:58.648 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:03:58.648 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_encrypted_bytes": 54665408, 2024-05-09T06:03:58.648 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_encrypted_bytes": 112817312 2024-05-09T06:03:58.648 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:03:58.648 INFO:teuthology.orchestra.run.smithi100.stdout: "AsyncMessenger::Worker-1": { 2024-05-09T06:03:58.648 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_messages": 70686, 2024-05-09T06:03:58.648 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages": 41954, 2024-05-09T06:03:58.648 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_bytes": 18886705, 2024-05-09T06:03:58.648 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_bytes": 40129206, 2024-05-09T06:03:58.648 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_created_connections": 10, 2024-05-09T06:03:58.648 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_active_connections": 6, 2024-05-09T06:03:58.648 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_total_time": 3.866078664, 2024-05-09T06:03:58.649 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_send_time": 1.608971242, 2024-05-09T06:03:58.649 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_recv_time": 2.631990489, 2024-05-09T06:03:58.649 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_fast_dispatch_time": 0.270899521, 2024-05-09T06:03:58.649 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T06:03:58.649 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 41953, 2024-05-09T06:03:58.649 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.727414156, 2024-05-09T06:03:58.649 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000017338 2024-05-09T06:03:58.649 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:03:58.650 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_handle_ack_lat": { 2024-05-09T06:03:58.650 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 91089, 2024-05-09T06:03:58.650 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.014792422, 2024-05-09T06:03:58.650 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000162 2024-05-09T06:03:58.650 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:03:58.651 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_encrypted_bytes": 5536, 2024-05-09T06:03:58.651 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_encrypted_bytes": 800672 2024-05-09T06:03:58.651 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:03:58.651 INFO:teuthology.orchestra.run.smithi100.stdout: "AsyncMessenger::Worker-2": { 2024-05-09T06:03:58.651 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_messages": 490322, 2024-05-09T06:03:58.651 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages": 295779, 2024-05-09T06:03:58.651 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_bytes": 133718002, 2024-05-09T06:03:58.652 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_bytes": 65825158, 2024-05-09T06:03:58.652 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_created_connections": 7, 2024-05-09T06:03:58.652 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_active_connections": 6, 2024-05-09T06:03:58.652 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_total_time": 21.847140771, 2024-05-09T06:03:58.652 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_send_time": 8.086204657, 2024-05-09T06:03:58.652 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_recv_time": 18.541806169, 2024-05-09T06:03:58.653 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_fast_dispatch_time": 0.201449119, 2024-05-09T06:03:58.653 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T06:03:58.653 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 295778, 2024-05-09T06:03:58.653 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 4.755514897, 2024-05-09T06:03:58.653 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000016077 2024-05-09T06:03:58.653 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:03:58.653 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_handle_ack_lat": { 2024-05-09T06:03:58.654 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 767539, 2024-05-09T06:03:58.654 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.112426691, 2024-05-09T06:03:58.654 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000146 2024-05-09T06:03:58.654 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:03:58.654 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_encrypted_bytes": 1023584, 2024-05-09T06:03:58.655 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_encrypted_bytes": 299504 2024-05-09T06:03:58.655 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:03:58.655 INFO:teuthology.orchestra.run.smithi100.stdout: "cct": { 2024-05-09T06:03:58.655 INFO:teuthology.orchestra.run.smithi100.stdout: "total_workers": 1, 2024-05-09T06:03:58.655 INFO:teuthology.orchestra.run.smithi100.stdout: "unhealthy_workers": 0 2024-05-09T06:03:58.655 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:03:58.656 INFO:teuthology.orchestra.run.smithi100.stdout: "finisher-MDSRank": { 2024-05-09T06:03:58.656 INFO:teuthology.orchestra.run.smithi100.stdout: "queue_len": 0, 2024-05-09T06:03:58.656 INFO:teuthology.orchestra.run.smithi100.stdout: "complete_latency": { 2024-05-09T06:03:58.656 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 25198, 2024-05-09T06:03:58.656 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 15.983400242, 2024-05-09T06:03:58.656 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000634312 2024-05-09T06:03:58.656 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-05-09T06:03:58.657 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:03:58.657 INFO:teuthology.orchestra.run.smithi100.stdout: "finisher-PurgeQueue": { 2024-05-09T06:03:58.657 INFO:teuthology.orchestra.run.smithi100.stdout: "queue_len": 0, 2024-05-09T06:03:58.657 INFO:teuthology.orchestra.run.smithi100.stdout: "complete_latency": { 2024-05-09T06:03:58.657 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 16468, 2024-05-09T06:03:58.658 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.879657395, 2024-05-09T06:03:58.658 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000053416 2024-05-09T06:03:58.658 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-05-09T06:03:58.658 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:03:58.658 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": { 2024-05-09T06:03:58.658 INFO:teuthology.orchestra.run.smithi100.stdout: "request": 126230, 2024-05-09T06:03:58.659 INFO:teuthology.orchestra.run.smithi100.stdout: "reply": 40640, 2024-05-09T06:03:58.659 INFO:teuthology.orchestra.run.smithi100.stdout: "reply_latency": { 2024-05-09T06:03:58.659 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 40640, 2024-05-09T06:03:58.659 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 87.754827461, 2024-05-09T06:03:58.659 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.002159321 2024-05-09T06:03:58.659 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:03:58.660 INFO:teuthology.orchestra.run.smithi100.stdout: "slow_reply": 0, 2024-05-09T06:03:58.660 INFO:teuthology.orchestra.run.smithi100.stdout: "forward": 85590, 2024-05-09T06:03:58.660 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_fetch_complete": 0, 2024-05-09T06:03:58.660 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_fetch_keys": 0, 2024-05-09T06:03:58.660 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_commit": 11, 2024-05-09T06:03:58.660 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_split": 0, 2024-05-09T06:03:58.661 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_merge": 0, 2024-05-09T06:03:58.661 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes": 24, 2024-05-09T06:03:58.661 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_top": 0, 2024-05-09T06:03:58.661 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_bottom": 1, 2024-05-09T06:03:58.661 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_pin_tail": 23, 2024-05-09T06:03:58.661 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_pinned": 23, 2024-05-09T06:03:58.662 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_expired": 307, 2024-05-09T06:03:58.662 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_with_caps": 0, 2024-05-09T06:03:58.662 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": 0, 2024-05-09T06:03:58.662 INFO:teuthology.orchestra.run.smithi100.stdout: "subtrees": 2, 2024-05-09T06:03:58.662 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse": 190728, 2024-05-09T06:03:58.662 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_hit": 46327, 2024-05-09T06:03:58.662 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_forward": 85587, 2024-05-09T06:03:58.662 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_discover": 147, 2024-05-09T06:03:58.663 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_dir_fetch": 0, 2024-05-09T06:03:58.663 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_remote_ino": 0, 2024-05-09T06:03:58.663 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_lock": 1832, 2024-05-09T06:03:58.663 INFO:teuthology.orchestra.run.smithi100.stdout: "load_cent": 0, 2024-05-09T06:03:58.663 INFO:teuthology.orchestra.run.smithi100.stdout: "q": 0, 2024-05-09T06:03:58.663 INFO:teuthology.orchestra.run.smithi100.stdout: "exported": 7, 2024-05-09T06:03:58.663 INFO:teuthology.orchestra.run.smithi100.stdout: "exported_inodes": 66, 2024-05-09T06:03:58.663 INFO:teuthology.orchestra.run.smithi100.stdout: "imported": 7, 2024-05-09T06:03:58.663 INFO:teuthology.orchestra.run.smithi100.stdout: "imported_inodes": 81, 2024-05-09T06:03:58.663 INFO:teuthology.orchestra.run.smithi100.stdout: "openino_dir_fetch": 0, 2024-05-09T06:03:58.663 INFO:teuthology.orchestra.run.smithi100.stdout: "openino_backtrace_fetch": 0, 2024-05-09T06:03:58.664 INFO:teuthology.orchestra.run.smithi100.stdout: "openino_peer_discover": 0, 2024-05-09T06:03:58.664 INFO:teuthology.orchestra.run.smithi100.stdout: "root_rfiles": 4, 2024-05-09T06:03:58.664 INFO:teuthology.orchestra.run.smithi100.stdout: "root_rbytes": 234, 2024-05-09T06:03:58.664 INFO:teuthology.orchestra.run.smithi100.stdout: "root_rsnaps": 0, 2024-05-09T06:03:58.664 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_backtrace_fetch": 0, 2024-05-09T06:03:58.664 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_set_tag": 0, 2024-05-09T06:03:58.665 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_backtrace_repaired": 0, 2024-05-09T06:03:58.665 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_inotable_repaired": 0, 2024-05-09T06:03:58.665 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_dir_inodes": 0, 2024-05-09T06:03:58.665 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_dir_base_inodes": 0, 2024-05-09T06:03:58.665 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_dirfrag_rstats": 0, 2024-05-09T06:03:58.665 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_file_inodes": 0, 2024-05-09T06:03:58.665 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_inode_file_caps": 0, 2024-05-09T06:03:58.665 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_cap_op_revoke": 14350, 2024-05-09T06:03:58.665 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_cap_op_grant": 47611, 2024-05-09T06:03:58.665 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_cap_op_trunc": 0, 2024-05-09T06:03:58.665 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-09T06:03:58.665 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-09T06:03:58.665 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_client_caps": 24607, 2024-05-09T06:03:58.666 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_client_caps_dirty": 6238, 2024-05-09T06:03:58.666 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_client_cap_release": 4085, 2024-05-09T06:03:58.666 INFO:teuthology.orchestra.run.smithi100.stdout: "process_request_cap_release": 42594 2024-05-09T06:03:58.666 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:03:58.666 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_cache": { 2024-05-09T06:03:58.666 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_update": 623, 2024-05-09T06:03:58.666 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_update_receipt": 1182, 2024-05-09T06:03:58.666 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_try_discover": 654, 2024-05-09T06:03:58.666 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_send_discover": 1081, 2024-05-09T06:03:58.666 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_handle_discover": 674, 2024-05-09T06:03:58.666 INFO:teuthology.orchestra.run.smithi100.stdout: "num_strays": 13, 2024-05-09T06:03:58.666 INFO:teuthology.orchestra.run.smithi100.stdout: "num_strays_delayed": 13, 2024-05-09T06:03:58.666 INFO:teuthology.orchestra.run.smithi100.stdout: "num_strays_enqueuing": 0, 2024-05-09T06:03:58.667 INFO:teuthology.orchestra.run.smithi100.stdout: "strays_created": 8799, 2024-05-09T06:03:58.667 INFO:teuthology.orchestra.run.smithi100.stdout: "strays_enqueued": 8786, 2024-05-09T06:03:58.667 INFO:teuthology.orchestra.run.smithi100.stdout: "strays_reintegrated": 0, 2024-05-09T06:03:58.667 INFO:teuthology.orchestra.run.smithi100.stdout: "strays_migrated": 0, 2024-05-09T06:03:58.667 INFO:teuthology.orchestra.run.smithi100.stdout: "num_recovering_processing": 0, 2024-05-09T06:03:58.667 INFO:teuthology.orchestra.run.smithi100.stdout: "num_recovering_enqueued": 0, 2024-05-09T06:03:58.667 INFO:teuthology.orchestra.run.smithi100.stdout: "num_recovering_prioritized": 0, 2024-05-09T06:03:58.667 INFO:teuthology.orchestra.run.smithi100.stdout: "recovery_started": 0, 2024-05-09T06:03:58.667 INFO:teuthology.orchestra.run.smithi100.stdout: "recovery_completed": 0, 2024-05-09T06:03:58.667 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_quiesce_path": 0, 2024-05-09T06:03:58.667 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_quiesce_inode": 0, 2024-05-09T06:03:58.667 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_enqueue_scrub": 0, 2024-05-09T06:03:58.667 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_exportdir": 8, 2024-05-09T06:03:58.667 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_flush": 0, 2024-05-09T06:03:58.668 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_fragmentdir": 0, 2024-05-09T06:03:58.668 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_fragstats": 0, 2024-05-09T06:03:58.668 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_inodestats": 0 2024-05-09T06:03:58.668 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:03:58.668 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_log": { 2024-05-09T06:03:58.668 INFO:teuthology.orchestra.run.smithi100.stdout: "evlrg": 0, 2024-05-09T06:03:58.668 INFO:teuthology.orchestra.run.smithi100.stdout: "evadd": 50669, 2024-05-09T06:03:58.668 INFO:teuthology.orchestra.run.smithi100.stdout: "evex": 0, 2024-05-09T06:03:58.668 INFO:teuthology.orchestra.run.smithi100.stdout: "evtrm": 0, 2024-05-09T06:03:58.668 INFO:teuthology.orchestra.run.smithi100.stdout: "ev": 50669, 2024-05-09T06:03:58.668 INFO:teuthology.orchestra.run.smithi100.stdout: "evexg": 0, 2024-05-09T06:03:58.668 INFO:teuthology.orchestra.run.smithi100.stdout: "evexd": 0, 2024-05-09T06:03:58.668 INFO:teuthology.orchestra.run.smithi100.stdout: "segadd": 65, 2024-05-09T06:03:58.668 INFO:teuthology.orchestra.run.smithi100.stdout: "segex": 0, 2024-05-09T06:03:58.668 INFO:teuthology.orchestra.run.smithi100.stdout: "segtrm": 0, 2024-05-09T06:03:58.668 INFO:teuthology.orchestra.run.smithi100.stdout: "seg": 65, 2024-05-09T06:03:58.669 INFO:teuthology.orchestra.run.smithi100.stdout: "segmjr": 6, 2024-05-09T06:03:58.669 INFO:teuthology.orchestra.run.smithi100.stdout: "segexg": 0, 2024-05-09T06:03:58.669 INFO:teuthology.orchestra.run.smithi100.stdout: "segexd": 0, 2024-05-09T06:03:58.669 INFO:teuthology.orchestra.run.smithi100.stdout: "expos": 4194304, 2024-05-09T06:03:58.669 INFO:teuthology.orchestra.run.smithi100.stdout: "wrpos": 67560269, 2024-05-09T06:03:58.669 INFO:teuthology.orchestra.run.smithi100.stdout: "rdpos": 0, 2024-05-09T06:03:58.669 INFO:teuthology.orchestra.run.smithi100.stdout: "jlat": { 2024-05-09T06:03:58.669 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 12363, 2024-05-09T06:03:58.669 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 32.162226584, 2024-05-09T06:03:58.669 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.002601490 2024-05-09T06:03:58.669 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:03:58.669 INFO:teuthology.orchestra.run.smithi100.stdout: "replayed": 0 2024-05-09T06:03:58.669 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:03:58.669 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_mem": { 2024-05-09T06:03:58.670 INFO:teuthology.orchestra.run.smithi100.stdout: "ino": 29, 2024-05-09T06:03:58.670 INFO:teuthology.orchestra.run.smithi100.stdout: "ino+": 8975, 2024-05-09T06:03:58.670 INFO:teuthology.orchestra.run.smithi100.stdout: "ino-": 8946, 2024-05-09T06:03:58.670 INFO:teuthology.orchestra.run.smithi100.stdout: "dir": 19, 2024-05-09T06:03:58.670 INFO:teuthology.orchestra.run.smithi100.stdout: "dir+": 584, 2024-05-09T06:03:58.670 INFO:teuthology.orchestra.run.smithi100.stdout: "dir-": 565, 2024-05-09T06:03:58.670 INFO:teuthology.orchestra.run.smithi100.stdout: "dn": 24, 2024-05-09T06:03:58.670 INFO:teuthology.orchestra.run.smithi100.stdout: "dn+": 9139, 2024-05-09T06:03:58.670 INFO:teuthology.orchestra.run.smithi100.stdout: "dn-": 9115, 2024-05-09T06:03:58.670 INFO:teuthology.orchestra.run.smithi100.stdout: "cap": 0, 2024-05-09T06:03:58.671 INFO:teuthology.orchestra.run.smithi100.stdout: "cap+": 8846, 2024-05-09T06:03:58.671 INFO:teuthology.orchestra.run.smithi100.stdout: "cap-": 8846, 2024-05-09T06:03:58.671 INFO:teuthology.orchestra.run.smithi100.stdout: "rss": 133988, 2024-05-09T06:03:58.671 INFO:teuthology.orchestra.run.smithi100.stdout: "heap": 223632 2024-05-09T06:03:58.671 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:03:58.671 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_server": { 2024-05-09T06:03:58.671 INFO:teuthology.orchestra.run.smithi100.stdout: "dispatch_client_request": 176368, 2024-05-09T06:03:58.671 INFO:teuthology.orchestra.run.smithi100.stdout: "dispatch_server_request": 7, 2024-05-09T06:03:58.671 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_client_request": 126230, 2024-05-09T06:03:58.671 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_client_session": 32, 2024-05-09T06:03:58.671 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_peer_request": 19488, 2024-05-09T06:03:58.671 INFO:teuthology.orchestra.run.smithi100.stdout: "req_create_latency": { 2024-05-09T06:03:58.671 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 8786, 2024-05-09T06:03:58.671 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 42.785550377, 2024-05-09T06:03:58.671 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.004869741 2024-05-09T06:03:58.672 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:03:58.672 INFO:teuthology.orchestra.run.smithi100.stdout: "req_getattr_latency": { 2024-05-09T06:03:58.672 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 2, 2024-05-09T06:03:58.672 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.004059845, 2024-05-09T06:03:58.672 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.002029922 2024-05-09T06:03:58.672 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:03:58.672 INFO:teuthology.orchestra.run.smithi100.stdout: "req_getfilelock_latency": { 2024-05-09T06:03:58.672 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-05-09T06:03:58.672 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-05-09T06:03:58.672 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-05-09T06:03:58.672 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:03:58.672 INFO:teuthology.orchestra.run.smithi100.stdout: "req_link_latency": { 2024-05-09T06:03:58.672 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-05-09T06:03:58.672 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-05-09T06:03:58.673 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-05-09T06:03:58.673 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:03:58.673 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookup_latency": { 2024-05-09T06:03:58.673 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 9582, 2024-05-09T06:03:58.673 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 6.964868619, 2024-05-09T06:03:58.673 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000726870 2024-05-09T06:03:58.673 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:03:58.673 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookuphash_latency": { 2024-05-09T06:03:58.673 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-05-09T06:03:58.673 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-05-09T06:03:58.673 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-05-09T06:03:58.673 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:03:58.673 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookupino_latency": { 2024-05-09T06:03:58.673 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-05-09T06:03:58.674 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-05-09T06:03:58.674 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-05-09T06:03:58.674 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:03:58.674 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookupname_latency": { 2024-05-09T06:03:58.674 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-05-09T06:03:58.674 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-05-09T06:03:58.674 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-05-09T06:03:58.674 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:03:58.674 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookupparent_latency": { 2024-05-09T06:03:58.674 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-05-09T06:03:58.674 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-05-09T06:03:58.674 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-05-09T06:03:58.675 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:03:58.675 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookupsnap_latency": { 2024-05-09T06:03:58.675 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-05-09T06:03:58.675 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-05-09T06:03:58.675 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-05-09T06:03:58.675 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:03:58.675 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lssnap_latency": { 2024-05-09T06:03:58.675 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-05-09T06:03:58.675 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-05-09T06:03:58.675 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-05-09T06:03:58.675 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:03:58.675 INFO:teuthology.orchestra.run.smithi100.stdout: "req_mkdir_latency": { 2024-05-09T06:03:58.676 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-05-09T06:03:58.676 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-05-09T06:03:58.676 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-05-09T06:03:58.676 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:03:58.676 INFO:teuthology.orchestra.run.smithi100.stdout: "req_mknod_latency": { 2024-05-09T06:03:58.676 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-05-09T06:03:58.676 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-05-09T06:03:58.676 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-05-09T06:03:58.676 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:03:58.676 INFO:teuthology.orchestra.run.smithi100.stdout: "req_mksnap_latency": { 2024-05-09T06:03:58.676 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-05-09T06:03:58.677 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-05-09T06:03:58.677 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-05-09T06:03:58.677 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:03:58.677 INFO:teuthology.orchestra.run.smithi100.stdout: "req_open_latency": { 2024-05-09T06:03:58.677 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-05-09T06:03:58.677 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-05-09T06:03:58.677 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-05-09T06:03:58.677 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:03:58.677 INFO:teuthology.orchestra.run.smithi100.stdout: "req_readdir_latency": { 2024-05-09T06:03:58.677 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 11635, 2024-05-09T06:03:58.677 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 5.867556244, 2024-05-09T06:03:58.677 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000504302 2024-05-09T06:03:58.678 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:03:58.678 INFO:teuthology.orchestra.run.smithi100.stdout: "req_rename_latency": { 2024-05-09T06:03:58.678 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 1836, 2024-05-09T06:03:58.678 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 8.111635307, 2024-05-09T06:03:58.678 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.004418102 2024-05-09T06:03:58.678 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:03:58.678 INFO:teuthology.orchestra.run.smithi100.stdout: "req_renamesnap_latency": { 2024-05-09T06:03:58.678 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-05-09T06:03:58.678 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-05-09T06:03:58.678 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-05-09T06:03:58.678 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:03:58.678 INFO:teuthology.orchestra.run.smithi100.stdout: "req_snapdiff_latency": { 2024-05-09T06:03:58.678 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-05-09T06:03:58.679 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-05-09T06:03:58.679 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-05-09T06:03:58.679 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:03:58.679 INFO:teuthology.orchestra.run.smithi100.stdout: "req_rmdir_latency": { 2024-05-09T06:03:58.679 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-05-09T06:03:58.679 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-05-09T06:03:58.679 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-05-09T06:03:58.679 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:03:58.679 INFO:teuthology.orchestra.run.smithi100.stdout: "req_rmsnap_latency": { 2024-05-09T06:03:58.679 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-05-09T06:03:58.679 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-05-09T06:03:58.679 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-05-09T06:03:58.679 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:03:58.679 INFO:teuthology.orchestra.run.smithi100.stdout: "req_rmxattr_latency": { 2024-05-09T06:03:58.680 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-05-09T06:03:58.680 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-05-09T06:03:58.680 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-05-09T06:03:58.680 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:03:58.680 INFO:teuthology.orchestra.run.smithi100.stdout: "req_setattr_latency": { 2024-05-09T06:03:58.680 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-05-09T06:03:58.680 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-05-09T06:03:58.680 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-05-09T06:03:58.680 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:03:58.680 INFO:teuthology.orchestra.run.smithi100.stdout: "req_setdirlayout_latency": { 2024-05-09T06:03:58.680 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-05-09T06:03:58.680 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-05-09T06:03:58.680 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-05-09T06:03:58.681 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:03:58.681 INFO:teuthology.orchestra.run.smithi100.stdout: "req_setfilelock_latency": { 2024-05-09T06:03:58.681 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-05-09T06:03:58.681 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-05-09T06:03:58.681 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-05-09T06:03:58.681 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:03:58.681 INFO:teuthology.orchestra.run.smithi100.stdout: "req_setlayout_latency": { 2024-05-09T06:03:58.681 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-05-09T06:03:58.681 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-05-09T06:03:58.682 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-05-09T06:03:58.682 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:03:58.682 INFO:teuthology.orchestra.run.smithi100.stdout: "req_setxattr_latency": { 2024-05-09T06:03:58.682 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-05-09T06:03:58.682 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-05-09T06:03:58.682 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-05-09T06:03:58.682 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:03:58.682 INFO:teuthology.orchestra.run.smithi100.stdout: "req_symlink_latency": { 2024-05-09T06:03:58.682 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-05-09T06:03:58.682 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-05-09T06:03:58.682 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-05-09T06:03:58.682 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:03:58.682 INFO:teuthology.orchestra.run.smithi100.stdout: "req_unlink_latency": { 2024-05-09T06:03:58.683 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 8799, 2024-05-09T06:03:58.683 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 24.021157069, 2024-05-09T06:03:58.683 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.002729987 2024-05-09T06:03:58.683 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:03:58.683 INFO:teuthology.orchestra.run.smithi100.stdout: "cap_revoke_eviction": 0, 2024-05-09T06:03:58.683 INFO:teuthology.orchestra.run.smithi100.stdout: "cap_acquisition_throttle": 0, 2024-05-09T06:03:58.683 INFO:teuthology.orchestra.run.smithi100.stdout: "req_getvxattr_latency": { 2024-05-09T06:03:58.683 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-05-09T06:03:58.683 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-05-09T06:03:58.683 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-05-09T06:03:58.683 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-05-09T06:03:58.683 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:03:58.683 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_sessions": { 2024-05-09T06:03:58.684 INFO:teuthology.orchestra.run.smithi100.stdout: "session_count": 1, 2024-05-09T06:03:58.684 INFO:teuthology.orchestra.run.smithi100.stdout: "session_add": 3, 2024-05-09T06:03:58.684 INFO:teuthology.orchestra.run.smithi100.stdout: "session_remove": 2, 2024-05-09T06:03:58.684 INFO:teuthology.orchestra.run.smithi100.stdout: "sessions_open": 1, 2024-05-09T06:03:58.684 INFO:teuthology.orchestra.run.smithi100.stdout: "sessions_stale": 0, 2024-05-09T06:03:58.684 INFO:teuthology.orchestra.run.smithi100.stdout: "total_load": 936, 2024-05-09T06:03:58.684 INFO:teuthology.orchestra.run.smithi100.stdout: "average_load": 936, 2024-05-09T06:03:58.684 INFO:teuthology.orchestra.run.smithi100.stdout: "avg_session_uptime": 1565, 2024-05-09T06:03:58.684 INFO:teuthology.orchestra.run.smithi100.stdout: "mdthresh_evicted": 0 2024-05-09T06:03:58.684 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:03:58.684 INFO:teuthology.orchestra.run.smithi100.stdout: "mempool": { 2024-05-09T06:03:58.684 INFO:teuthology.orchestra.run.smithi100.stdout: "bloom_filter_bytes": 0, 2024-05-09T06:03:58.684 INFO:teuthology.orchestra.run.smithi100.stdout: "bloom_filter_items": 0, 2024-05-09T06:03:58.684 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_alloc_bytes": 0, 2024-05-09T06:03:58.685 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_alloc_items": 0, 2024-05-09T06:03:58.685 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_data_bytes": 0, 2024-05-09T06:03:58.685 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_data_items": 0, 2024-05-09T06:03:58.685 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-09T06:03:58.685 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_onode_items": 0, 2024-05-09T06:03:58.685 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-09T06:03:58.685 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_meta_items": 0, 2024-05-09T06:03:58.685 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_other_bytes": 0, 2024-05-09T06:03:58.685 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_other_items": 0, 2024-05-09T06:03:58.685 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-09T06:03:58.686 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_buffer_items": 0, 2024-05-09T06:03:58.686 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_extent_bytes": 0, 2024-05-09T06:03:58.686 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_extent_items": 0, 2024-05-09T06:03:58.686 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_blob_bytes": 0, 2024-05-09T06:03:58.686 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_blob_items": 0, 2024-05-09T06:03:58.686 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-09T06:03:58.686 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_shared_blob_items": 0, 2024-05-09T06:03:58.686 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-09T06:03:58.686 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_inline_bl_items": 0, 2024-05-09T06:03:58.686 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_fsck_bytes": 0, 2024-05-09T06:03:58.686 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_fsck_items": 0, 2024-05-09T06:03:58.687 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_txc_bytes": 0, 2024-05-09T06:03:58.687 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_txc_items": 0, 2024-05-09T06:03:58.687 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-09T06:03:58.687 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_deferred_items": 0, 2024-05-09T06:03:58.687 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_bytes": 0, 2024-05-09T06:03:58.687 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_items": 0, 2024-05-09T06:03:58.687 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_bytes": 0, 2024-05-09T06:03:58.687 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_items": 0, 2024-05-09T06:03:58.687 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_reader_bytes": 0, 2024-05-09T06:03:58.687 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_reader_items": 0, 2024-05-09T06:03:58.687 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_writer_bytes": 0, 2024-05-09T06:03:58.687 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_writer_items": 0, 2024-05-09T06:03:58.687 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_anon_bytes": 449840, 2024-05-09T06:03:58.688 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_anon_items": 170, 2024-05-09T06:03:58.688 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_meta_bytes": 264, 2024-05-09T06:03:58.688 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_meta_items": 3, 2024-05-09T06:03:58.688 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_bytes": 0, 2024-05-09T06:03:58.688 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_items": 0, 2024-05-09T06:03:58.688 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_mapbl_bytes": 0, 2024-05-09T06:03:58.688 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_mapbl_items": 0, 2024-05-09T06:03:58.688 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_pglog_bytes": 0, 2024-05-09T06:03:58.688 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_pglog_items": 0, 2024-05-09T06:03:58.688 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_bytes": 7528, 2024-05-09T06:03:58.688 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_items": 158, 2024-05-09T06:03:58.688 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_mapping_bytes": 0, 2024-05-09T06:03:58.688 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_mapping_items": 0, 2024-05-09T06:03:58.688 INFO:teuthology.orchestra.run.smithi100.stdout: "pgmap_bytes": 0, 2024-05-09T06:03:58.689 INFO:teuthology.orchestra.run.smithi100.stdout: "pgmap_items": 0, 2024-05-09T06:03:58.689 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_co_bytes": 141321, 2024-05-09T06:03:58.689 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_co_items": 3769, 2024-05-09T06:03:58.689 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_1_bytes": 0, 2024-05-09T06:03:58.689 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_1_items": 0, 2024-05-09T06:03:58.689 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_2_bytes": 0, 2024-05-09T06:03:58.689 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_2_items": 0 2024-05-09T06:03:58.689 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:03:58.689 INFO:teuthology.orchestra.run.smithi100.stdout: "objecter": { 2024-05-09T06:03:58.689 INFO:teuthology.orchestra.run.smithi100.stdout: "op_active": 0, 2024-05-09T06:03:58.689 INFO:teuthology.orchestra.run.smithi100.stdout: "op_laggy": 0, 2024-05-09T06:03:58.689 INFO:teuthology.orchestra.run.smithi100.stdout: "op_send": 24980, 2024-05-09T06:03:58.689 INFO:teuthology.orchestra.run.smithi100.stdout: "op_send_bytes": 65327899, 2024-05-09T06:03:58.689 INFO:teuthology.orchestra.run.smithi100.stdout: "op_resend": 33, 2024-05-09T06:03:58.689 INFO:teuthology.orchestra.run.smithi100.stdout: "op_reply": 24980, 2024-05-09T06:03:58.689 INFO:teuthology.orchestra.run.smithi100.stdout: "op_latency": { 2024-05-09T06:03:58.690 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 24980, 2024-05-09T06:03:58.690 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 75.595110066, 2024-05-09T06:03:58.690 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.003026225 2024-05-09T06:03:58.690 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:03:58.690 INFO:teuthology.orchestra.run.smithi100.stdout: "op_inflight": 0, 2024-05-09T06:03:58.690 INFO:teuthology.orchestra.run.smithi100.stdout: "oplen_avg": { 2024-05-09T06:03:58.690 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 24980, 2024-05-09T06:03:58.690 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 26566 2024-05-09T06:03:58.690 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:03:58.690 INFO:teuthology.orchestra.run.smithi100.stdout: "op": 24980, 2024-05-09T06:03:58.690 INFO:teuthology.orchestra.run.smithi100.stdout: "op_r": 1027, 2024-05-09T06:03:58.690 INFO:teuthology.orchestra.run.smithi100.stdout: "op_w": 23953, 2024-05-09T06:03:58.690 INFO:teuthology.orchestra.run.smithi100.stdout: "op_rmw": 0, 2024-05-09T06:03:58.690 INFO:teuthology.orchestra.run.smithi100.stdout: "op_pg": 0, 2024-05-09T06:03:58.691 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_stat": 0, 2024-05-09T06:03:58.691 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_create": 10, 2024-05-09T06:03:58.691 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_read": 1027, 2024-05-09T06:03:58.691 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_write": 13390, 2024-05-09T06:03:58.691 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_writefull": 635, 2024-05-09T06:03:58.691 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_writesame": 0, 2024-05-09T06:03:58.691 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_append": 0, 2024-05-09T06:03:58.691 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_zero": 0, 2024-05-09T06:03:58.691 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_truncate": 0, 2024-05-09T06:03:58.691 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_delete": 8813, 2024-05-09T06:03:58.691 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_mapext": 0, 2024-05-09T06:03:58.692 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_sparse_read": 0, 2024-05-09T06:03:58.692 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_clonerange": 0, 2024-05-09T06:03:58.692 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_getxattr": 0, 2024-05-09T06:03:58.692 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_setxattr": 20, 2024-05-09T06:03:58.692 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_cmpxattr": 0, 2024-05-09T06:03:58.692 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_rmxattr": 0, 2024-05-09T06:03:58.692 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_resetxattrs": 0, 2024-05-09T06:03:58.692 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_call": 0, 2024-05-09T06:03:58.692 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_watch": 0, 2024-05-09T06:03:58.692 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_notify": 0, 2024-05-09T06:03:58.692 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_src_cmpxattr": 0, 2024-05-09T06:03:58.692 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_pgls": 0, 2024-05-09T06:03:58.692 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_pgls_filter": 0, 2024-05-09T06:03:58.692 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_other": 0, 2024-05-09T06:03:58.692 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_active": 0, 2024-05-09T06:03:58.693 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_send": 0, 2024-05-09T06:03:58.693 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_resend": 0, 2024-05-09T06:03:58.693 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_ping": 0, 2024-05-09T06:03:58.693 INFO:teuthology.orchestra.run.smithi100.stdout: "poolop_active": 0, 2024-05-09T06:03:58.693 INFO:teuthology.orchestra.run.smithi100.stdout: "poolop_send": 0, 2024-05-09T06:03:58.693 INFO:teuthology.orchestra.run.smithi100.stdout: "poolop_resend": 0, 2024-05-09T06:03:58.693 INFO:teuthology.orchestra.run.smithi100.stdout: "poolstat_active": 0, 2024-05-09T06:03:58.693 INFO:teuthology.orchestra.run.smithi100.stdout: "poolstat_send": 0, 2024-05-09T06:03:58.693 INFO:teuthology.orchestra.run.smithi100.stdout: "poolstat_resend": 0, 2024-05-09T06:03:58.693 INFO:teuthology.orchestra.run.smithi100.stdout: "statfs_active": 0, 2024-05-09T06:03:58.693 INFO:teuthology.orchestra.run.smithi100.stdout: "statfs_send": 0, 2024-05-09T06:03:58.693 INFO:teuthology.orchestra.run.smithi100.stdout: "statfs_resend": 0, 2024-05-09T06:03:58.693 INFO:teuthology.orchestra.run.smithi100.stdout: "command_active": 0, 2024-05-09T06:03:58.693 INFO:teuthology.orchestra.run.smithi100.stdout: "command_send": 0, 2024-05-09T06:03:58.694 INFO:teuthology.orchestra.run.smithi100.stdout: "command_resend": 0, 2024-05-09T06:03:58.694 INFO:teuthology.orchestra.run.smithi100.stdout: "map_epoch": 83, 2024-05-09T06:03:58.694 INFO:teuthology.orchestra.run.smithi100.stdout: "map_full": 0, 2024-05-09T06:03:58.694 INFO:teuthology.orchestra.run.smithi100.stdout: "map_inc": 2, 2024-05-09T06:03:58.694 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_sessions": 12, 2024-05-09T06:03:58.694 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_session_open": 12, 2024-05-09T06:03:58.694 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_session_close": 0, 2024-05-09T06:03:58.694 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_laggy": 0, 2024-05-09T06:03:58.694 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_wr": 2112, 2024-05-09T06:03:58.694 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_rd": 0, 2024-05-09T06:03:58.694 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_del": 559 2024-05-09T06:03:58.694 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:03:58.695 INFO:teuthology.orchestra.run.smithi100.stdout: "oft": { 2024-05-09T06:03:58.695 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_total_objs": 1, 2024-05-09T06:03:58.695 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_total_kv_pairs": 0, 2024-05-09T06:03:58.695 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_total_updates": 0, 2024-05-09T06:03:58.695 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_total_removes": 0 2024-05-09T06:03:58.695 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:03:58.695 INFO:teuthology.orchestra.run.smithi100.stdout: "osd-slow-ops": { 2024-05-09T06:03:58.695 INFO:teuthology.orchestra.run.smithi100.stdout: "slow_ops_count": 0 2024-05-09T06:03:58.695 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:03:58.695 INFO:teuthology.orchestra.run.smithi100.stdout: "purge_queue": { 2024-05-09T06:03:58.695 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executing_ops": 0, 2024-05-09T06:03:58.695 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executing_ops_high_water": 10, 2024-05-09T06:03:58.696 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executing": 0, 2024-05-09T06:03:58.696 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executing_high_water": 10, 2024-05-09T06:03:58.696 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executed_ops": 8786, 2024-05-09T06:03:58.696 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executed": 8786, 2024-05-09T06:03:58.696 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_item_in_journal": 0 2024-05-09T06:03:58.696 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:03:58.696 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-09T06:03:58.696 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-05-09T06:03:58.696 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 104857600, 2024-05-09T06:03:58.696 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-05-09T06:03:58.696 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 726718, 2024-05-09T06:03:58.696 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 136780669, 2024-05-09T06:03:58.696 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-05-09T06:03:58.697 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 726718, 2024-05-09T06:03:58.697 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 0, 2024-05-09T06:03:58.697 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 0, 2024-05-09T06:03:58.697 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 726718, 2024-05-09T06:03:58.697 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 136780669, 2024-05-09T06:03:58.697 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-05-09T06:03:58.697 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-05-09T06:03:58.697 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-05-09T06:03:58.697 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-05-09T06:03:58.697 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-05-09T06:03:58.697 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:03:58.697 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-objecter_bytes": { 2024-05-09T06:03:58.697 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-05-09T06:03:58.698 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 104857600, 2024-05-09T06:03:58.698 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-05-09T06:03:58.698 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 0, 2024-05-09T06:03:58.698 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 0, 2024-05-09T06:03:58.698 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-05-09T06:03:58.699 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 0, 2024-05-09T06:03:58.699 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 24980, 2024-05-09T06:03:58.699 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 66215285, 2024-05-09T06:03:58.699 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 24980, 2024-05-09T06:03:58.699 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 66215285, 2024-05-09T06:03:58.699 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-05-09T06:03:58.699 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-05-09T06:03:58.699 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-05-09T06:03:58.699 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-05-09T06:03:58.699 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-05-09T06:03:58.699 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:03:58.699 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-objecter_ops": { 2024-05-09T06:03:58.699 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-05-09T06:03:58.700 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 1024, 2024-05-09T06:03:58.700 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-05-09T06:03:58.700 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 0, 2024-05-09T06:03:58.700 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 0, 2024-05-09T06:03:58.700 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-05-09T06:03:58.700 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 0, 2024-05-09T06:03:58.700 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 24980, 2024-05-09T06:03:58.700 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 24980, 2024-05-09T06:03:58.700 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 24980, 2024-05-09T06:03:58.700 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 24980, 2024-05-09T06:03:58.700 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-05-09T06:03:58.700 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-05-09T06:03:58.700 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-05-09T06:03:58.700 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-05-09T06:03:58.700 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-05-09T06:03:58.701 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:03:58.701 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-write_buf_throttle": { 2024-05-09T06:03:58.701 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-05-09T06:03:58.701 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 3758096384, 2024-05-09T06:03:58.701 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-05-09T06:03:58.701 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 8786, 2024-05-09T06:03:58.701 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 887386, 2024-05-09T06:03:58.701 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-05-09T06:03:58.701 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 8786, 2024-05-09T06:03:58.701 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 0, 2024-05-09T06:03:58.701 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 0, 2024-05-09T06:03:58.701 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 1027, 2024-05-09T06:03:58.701 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 887386, 2024-05-09T06:03:58.701 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-05-09T06:03:58.702 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-05-09T06:03:58.702 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-05-09T06:03:58.702 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-05-09T06:03:58.702 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-05-09T06:03:58.702 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:03:58.702 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-write_buf_throttle-0x55a30a94e410": { 2024-05-09T06:03:58.702 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-05-09T06:03:58.702 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 3758096384, 2024-05-09T06:03:58.702 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-05-09T06:03:58.702 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 50669, 2024-05-09T06:03:58.702 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 63365965, 2024-05-09T06:03:58.702 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-05-09T06:03:58.702 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 50669, 2024-05-09T06:03:58.703 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 0, 2024-05-09T06:03:58.703 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 0, 2024-05-09T06:03:58.703 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 12363, 2024-05-09T06:03:58.703 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 63365965, 2024-05-09T06:03:58.703 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-05-09T06:03:58.703 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-05-09T06:03:58.703 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-05-09T06:03:58.703 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-05-09T06:03:58.703 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-05-09T06:03:58.703 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-05-09T06:03:58.703 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-05-09T06:03:59.458 INFO:tasks.check_counter:Daemon mds.c mds.exported=7 2024-05-09T06:03:59.458 INFO:tasks.check_counter:Daemon mds.c mds.imported=7 2024-05-09T06:03:59.458 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=623 2024-05-09T06:03:59.458 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=1182 2024-05-09T06:03:59.458 DEBUG:tasks.check_counter:Getting stats from f 2024-05-09T06:03:59.458 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph daemon mds.f perf dump 2024-05-09T06:03:59.711 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.c/config 2024-05-09T06:04:00.008 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:03:59 smithi100 ceph-mon[34353]: pgmap v1168: 97 pgs: 97 active+clean; 487 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 3.5 MiB/s wr, 125 op/s 2024-05-09T06:04:00.038 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:03:59 smithi060 ceph-mon[34555]: pgmap v1168: 97 pgs: 97 active+clean; 487 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 3.5 MiB/s wr, 125 op/s 2024-05-09T06:04:00.102 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:03:59 smithi039 ceph-mon[30439]: pgmap v1168: 97 pgs: 97 active+clean; 487 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 3.5 MiB/s wr, 125 op/s 2024-05-09T06:04:01.771 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:04:01 smithi100 ceph-mon[34353]: pgmap v1169: 97 pgs: 97 active+clean; 480 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 2.7 MiB/s wr, 115 op/s 2024-05-09T06:04:01.817 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-05-09T06:04:01.818 INFO:teuthology.orchestra.run.smithi100.stdout: "AsyncMessenger::Worker-0": { 2024-05-09T06:04:01.818 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_messages": 3844, 2024-05-09T06:04:01.818 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages": 3812, 2024-05-09T06:04:01.818 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_bytes": 329158376, 2024-05-09T06:04:01.818 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_bytes": 1353196, 2024-05-09T06:04:01.818 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_created_connections": 7, 2024-05-09T06:04:01.818 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_active_connections": 3, 2024-05-09T06:04:01.818 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_total_time": 0.501779414, 2024-05-09T06:04:01.818 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_send_time": 0.100541289, 2024-05-09T06:04:01.818 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_recv_time": 0.280758365, 2024-05-09T06:04:01.818 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_fast_dispatch_time": 0.097928753, 2024-05-09T06:04:01.818 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T06:04:01.819 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 3811, 2024-05-09T06:04:01.819 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.109169299, 2024-05-09T06:04:01.819 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000028645 2024-05-09T06:04:01.819 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:01.819 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_handle_ack_lat": { 2024-05-09T06:04:01.819 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-05-09T06:04:01.819 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-05-09T06:04:01.819 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-05-09T06:04:01.819 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:01.819 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_encrypted_bytes": 1014016, 2024-05-09T06:04:01.819 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_encrypted_bytes": 293616 2024-05-09T06:04:01.819 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:01.819 INFO:teuthology.orchestra.run.smithi100.stdout: "AsyncMessenger::Worker-1": { 2024-05-09T06:04:01.819 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_messages": 1485, 2024-05-09T06:04:01.819 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages": 1844, 2024-05-09T06:04:01.820 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_bytes": 369479560, 2024-05-09T06:04:01.820 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_bytes": 1182394, 2024-05-09T06:04:01.820 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_created_connections": 7, 2024-05-09T06:04:01.820 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_active_connections": 6, 2024-05-09T06:04:01.820 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_total_time": 0.290683123, 2024-05-09T06:04:01.820 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_send_time": 0.041743272, 2024-05-09T06:04:01.820 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_recv_time": 0.205430237, 2024-05-09T06:04:01.820 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_fast_dispatch_time": 0.031995346, 2024-05-09T06:04:01.820 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T06:04:01.820 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 1842, 2024-05-09T06:04:01.820 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.062131025, 2024-05-09T06:04:01.820 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000033730 2024-05-09T06:04:01.821 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:01.821 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_handle_ack_lat": { 2024-05-09T06:04:01.821 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-05-09T06:04:01.821 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-05-09T06:04:01.821 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-05-09T06:04:01.821 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:01.821 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_encrypted_bytes": 160, 2024-05-09T06:04:01.821 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_encrypted_bytes": 710416 2024-05-09T06:04:01.821 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:01.821 INFO:teuthology.orchestra.run.smithi100.stdout: "AsyncMessenger::Worker-2": { 2024-05-09T06:04:01.821 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_messages": 2516, 2024-05-09T06:04:01.821 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages": 2516, 2024-05-09T06:04:01.821 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_bytes": 509424281, 2024-05-09T06:04:01.821 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_bytes": 799271, 2024-05-09T06:04:01.822 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_created_connections": 6, 2024-05-09T06:04:01.822 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_active_connections": 5, 2024-05-09T06:04:01.822 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_total_time": 0.405082332, 2024-05-09T06:04:01.822 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_send_time": 0.054602064, 2024-05-09T06:04:01.822 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_recv_time": 0.278358096, 2024-05-09T06:04:01.822 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_fast_dispatch_time": 0.057379714, 2024-05-09T06:04:01.822 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T06:04:01.822 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 2515, 2024-05-09T06:04:01.822 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.064021482, 2024-05-09T06:04:01.822 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000025455 2024-05-09T06:04:01.822 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:01.822 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_handle_ack_lat": { 2024-05-09T06:04:01.822 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-05-09T06:04:01.823 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-05-09T06:04:01.823 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-05-09T06:04:01.823 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:01.823 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_encrypted_bytes": 3040, 2024-05-09T06:04:01.823 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_encrypted_bytes": 448 2024-05-09T06:04:01.823 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:01.823 INFO:teuthology.orchestra.run.smithi100.stdout: "cct": { 2024-05-09T06:04:01.823 INFO:teuthology.orchestra.run.smithi100.stdout: "total_workers": 1, 2024-05-09T06:04:01.823 INFO:teuthology.orchestra.run.smithi100.stdout: "unhealthy_workers": 0 2024-05-09T06:04:01.823 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:01.823 INFO:teuthology.orchestra.run.smithi100.stdout: "finisher-MDSRank": { 2024-05-09T06:04:01.823 INFO:teuthology.orchestra.run.smithi100.stdout: "queue_len": 0, 2024-05-09T06:04:01.823 INFO:teuthology.orchestra.run.smithi100.stdout: "complete_latency": { 2024-05-09T06:04:01.823 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 11867, 2024-05-09T06:04:01.823 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.436169195, 2024-05-09T06:04:01.824 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000036754 2024-05-09T06:04:01.824 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-05-09T06:04:01.824 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:01.824 INFO:teuthology.orchestra.run.smithi100.stdout: "finisher-PurgeQueue": { 2024-05-09T06:04:01.824 INFO:teuthology.orchestra.run.smithi100.stdout: "queue_len": 0, 2024-05-09T06:04:01.824 INFO:teuthology.orchestra.run.smithi100.stdout: "complete_latency": { 2024-05-09T06:04:01.824 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-05-09T06:04:01.824 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-05-09T06:04:01.824 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-05-09T06:04:01.824 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-05-09T06:04:01.824 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:01.824 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": { 2024-05-09T06:04:01.824 INFO:teuthology.orchestra.run.smithi100.stdout: "request": 0, 2024-05-09T06:04:01.824 INFO:teuthology.orchestra.run.smithi100.stdout: "reply": 0, 2024-05-09T06:04:01.825 INFO:teuthology.orchestra.run.smithi100.stdout: "reply_latency": { 2024-05-09T06:04:01.825 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-05-09T06:04:01.825 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-05-09T06:04:01.825 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-05-09T06:04:01.825 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:01.825 INFO:teuthology.orchestra.run.smithi100.stdout: "slow_reply": 0, 2024-05-09T06:04:01.825 INFO:teuthology.orchestra.run.smithi100.stdout: "forward": 0, 2024-05-09T06:04:01.825 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_fetch_complete": 0, 2024-05-09T06:04:01.825 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_fetch_keys": 0, 2024-05-09T06:04:01.825 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_commit": 0, 2024-05-09T06:04:01.825 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_split": 0, 2024-05-09T06:04:01.825 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_merge": 0, 2024-05-09T06:04:01.825 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes": 118804, 2024-05-09T06:04:01.825 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_top": 65307, 2024-05-09T06:04:01.826 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_bottom": 53497, 2024-05-09T06:04:01.826 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_pin_tail": 0, 2024-05-09T06:04:01.826 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_pinned": 25507, 2024-05-09T06:04:01.826 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_expired": 0, 2024-05-09T06:04:01.826 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_with_caps": 0, 2024-05-09T06:04:01.826 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": 0, 2024-05-09T06:04:01.826 INFO:teuthology.orchestra.run.smithi100.stdout: "subtrees": 2, 2024-05-09T06:04:01.826 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse": 0, 2024-05-09T06:04:01.826 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_hit": 0, 2024-05-09T06:04:01.826 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_forward": 0, 2024-05-09T06:04:01.826 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_discover": 0, 2024-05-09T06:04:01.826 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_dir_fetch": 0, 2024-05-09T06:04:01.826 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_remote_ino": 0, 2024-05-09T06:04:01.827 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_lock": 0, 2024-05-09T06:04:01.827 INFO:teuthology.orchestra.run.smithi100.stdout: "load_cent": 0, 2024-05-09T06:04:01.827 INFO:teuthology.orchestra.run.smithi100.stdout: "q": 0, 2024-05-09T06:04:01.827 INFO:teuthology.orchestra.run.smithi100.stdout: "exported": 0, 2024-05-09T06:04:01.827 INFO:teuthology.orchestra.run.smithi100.stdout: "exported_inodes": 0, 2024-05-09T06:04:01.827 INFO:teuthology.orchestra.run.smithi100.stdout: "imported": 0, 2024-05-09T06:04:01.827 INFO:teuthology.orchestra.run.smithi100.stdout: "imported_inodes": 0, 2024-05-09T06:04:01.827 INFO:teuthology.orchestra.run.smithi100.stdout: "openino_dir_fetch": 0, 2024-05-09T06:04:01.827 INFO:teuthology.orchestra.run.smithi100.stdout: "openino_backtrace_fetch": 0, 2024-05-09T06:04:01.827 INFO:teuthology.orchestra.run.smithi100.stdout: "openino_peer_discover": 0, 2024-05-09T06:04:01.827 INFO:teuthology.orchestra.run.smithi100.stdout: "root_rfiles": 4, 2024-05-09T06:04:01.827 INFO:teuthology.orchestra.run.smithi100.stdout: "root_rbytes": 234, 2024-05-09T06:04:01.827 INFO:teuthology.orchestra.run.smithi100.stdout: "root_rsnaps": 0, 2024-05-09T06:04:01.827 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_backtrace_fetch": 0, 2024-05-09T06:04:01.828 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_set_tag": 0, 2024-05-09T06:04:01.828 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_backtrace_repaired": 0, 2024-05-09T06:04:01.828 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_inotable_repaired": 0, 2024-05-09T06:04:01.828 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_dir_inodes": 0, 2024-05-09T06:04:01.828 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_dir_base_inodes": 0, 2024-05-09T06:04:01.828 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_dirfrag_rstats": 0, 2024-05-09T06:04:01.828 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_file_inodes": 0, 2024-05-09T06:04:01.828 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_inode_file_caps": 0, 2024-05-09T06:04:01.828 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_cap_op_revoke": 0, 2024-05-09T06:04:01.828 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_cap_op_grant": 0, 2024-05-09T06:04:01.828 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_cap_op_trunc": 0, 2024-05-09T06:04:01.828 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-09T06:04:01.828 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-09T06:04:01.828 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_client_caps": 0, 2024-05-09T06:04:01.829 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_client_caps_dirty": 0, 2024-05-09T06:04:01.829 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_client_cap_release": 0, 2024-05-09T06:04:01.829 INFO:teuthology.orchestra.run.smithi100.stdout: "process_request_cap_release": 0 2024-05-09T06:04:01.829 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:01.829 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_cache": { 2024-05-09T06:04:01.829 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_update": 0, 2024-05-09T06:04:01.829 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_update_receipt": 0, 2024-05-09T06:04:01.829 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_try_discover": 0, 2024-05-09T06:04:01.829 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_send_discover": 0, 2024-05-09T06:04:01.829 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_handle_discover": 0, 2024-05-09T06:04:01.829 INFO:teuthology.orchestra.run.smithi100.stdout: "num_strays": 0, 2024-05-09T06:04:01.829 INFO:teuthology.orchestra.run.smithi100.stdout: "num_strays_delayed": 0, 2024-05-09T06:04:01.829 INFO:teuthology.orchestra.run.smithi100.stdout: "num_strays_enqueuing": 0, 2024-05-09T06:04:01.829 INFO:teuthology.orchestra.run.smithi100.stdout: "strays_created": 0, 2024-05-09T06:04:01.830 INFO:teuthology.orchestra.run.smithi100.stdout: "strays_enqueued": 0, 2024-05-09T06:04:01.830 INFO:teuthology.orchestra.run.smithi100.stdout: "strays_reintegrated": 0, 2024-05-09T06:04:01.830 INFO:teuthology.orchestra.run.smithi100.stdout: "strays_migrated": 0, 2024-05-09T06:04:01.830 INFO:teuthology.orchestra.run.smithi100.stdout: "num_recovering_processing": 0, 2024-05-09T06:04:01.830 INFO:teuthology.orchestra.run.smithi100.stdout: "num_recovering_enqueued": 0, 2024-05-09T06:04:01.830 INFO:teuthology.orchestra.run.smithi100.stdout: "num_recovering_prioritized": 0, 2024-05-09T06:04:01.830 INFO:teuthology.orchestra.run.smithi100.stdout: "recovery_started": 0, 2024-05-09T06:04:01.830 INFO:teuthology.orchestra.run.smithi100.stdout: "recovery_completed": 0, 2024-05-09T06:04:01.830 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_quiesce_path": 0, 2024-05-09T06:04:01.830 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_quiesce_inode": 0, 2024-05-09T06:04:01.830 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_enqueue_scrub": 0, 2024-05-09T06:04:01.830 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_exportdir": 0, 2024-05-09T06:04:01.830 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_flush": 0, 2024-05-09T06:04:01.830 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_fragmentdir": 0, 2024-05-09T06:04:01.830 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_fragstats": 0, 2024-05-09T06:04:01.831 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_inodestats": 0 2024-05-09T06:04:01.831 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:01.831 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_log": { 2024-05-09T06:04:01.831 INFO:teuthology.orchestra.run.smithi100.stdout: "evlrg": 0, 2024-05-09T06:04:01.831 INFO:teuthology.orchestra.run.smithi100.stdout: "evadd": 0, 2024-05-09T06:04:01.831 INFO:teuthology.orchestra.run.smithi100.stdout: "evex": 0, 2024-05-09T06:04:01.831 INFO:teuthology.orchestra.run.smithi100.stdout: "evtrm": 0, 2024-05-09T06:04:01.831 INFO:teuthology.orchestra.run.smithi100.stdout: "ev": 572401, 2024-05-09T06:04:01.831 INFO:teuthology.orchestra.run.smithi100.stdout: "evexg": 0, 2024-05-09T06:04:01.831 INFO:teuthology.orchestra.run.smithi100.stdout: "evexd": 0, 2024-05-09T06:04:01.831 INFO:teuthology.orchestra.run.smithi100.stdout: "segadd": 0, 2024-05-09T06:04:01.831 INFO:teuthology.orchestra.run.smithi100.stdout: "segex": 0, 2024-05-09T06:04:01.831 INFO:teuthology.orchestra.run.smithi100.stdout: "segtrm": 0, 2024-05-09T06:04:01.831 INFO:teuthology.orchestra.run.smithi100.stdout: "seg": 138, 2024-05-09T06:04:01.832 INFO:teuthology.orchestra.run.smithi100.stdout: "segmjr": 48, 2024-05-09T06:04:01.832 INFO:teuthology.orchestra.run.smithi100.stdout: "segexg": 0, 2024-05-09T06:04:01.832 INFO:teuthology.orchestra.run.smithi100.stdout: "segexd": 0, 2024-05-09T06:04:01.832 INFO:teuthology.orchestra.run.smithi100.stdout: "expos": 963668934, 2024-05-09T06:04:01.832 INFO:teuthology.orchestra.run.smithi100.stdout: "wrpos": 1209225296, 2024-05-09T06:04:01.832 INFO:teuthology.orchestra.run.smithi100.stdout: "rdpos": 1209224158, 2024-05-09T06:04:01.832 INFO:teuthology.orchestra.run.smithi100.stdout: "jlat": { 2024-05-09T06:04:01.832 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-05-09T06:04:01.832 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-05-09T06:04:01.832 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-05-09T06:04:01.832 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:01.833 INFO:teuthology.orchestra.run.smithi100.stdout: "replayed": 572401 2024-05-09T06:04:01.833 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:01.833 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_mem": { 2024-05-09T06:04:01.833 INFO:teuthology.orchestra.run.smithi100.stdout: "ino": 53, 2024-05-09T06:04:01.833 INFO:teuthology.orchestra.run.smithi100.stdout: "ino+": 118629, 2024-05-09T06:04:01.833 INFO:teuthology.orchestra.run.smithi100.stdout: "ino-": 118576, 2024-05-09T06:04:01.833 INFO:teuthology.orchestra.run.smithi100.stdout: "dir": 99, 2024-05-09T06:04:01.833 INFO:teuthology.orchestra.run.smithi100.stdout: "dir+": 463, 2024-05-09T06:04:01.833 INFO:teuthology.orchestra.run.smithi100.stdout: "dir-": 364, 2024-05-09T06:04:01.833 INFO:teuthology.orchestra.run.smithi100.stdout: "dn": 118804, 2024-05-09T06:04:01.833 INFO:teuthology.orchestra.run.smithi100.stdout: "dn+": 120024, 2024-05-09T06:04:01.833 INFO:teuthology.orchestra.run.smithi100.stdout: "dn-": 1220, 2024-05-09T06:04:01.833 INFO:teuthology.orchestra.run.smithi100.stdout: "cap": 0, 2024-05-09T06:04:01.833 INFO:teuthology.orchestra.run.smithi100.stdout: "cap+": 0, 2024-05-09T06:04:01.833 INFO:teuthology.orchestra.run.smithi100.stdout: "cap-": 0, 2024-05-09T06:04:01.834 INFO:teuthology.orchestra.run.smithi100.stdout: "rss": 223820, 2024-05-09T06:04:01.834 INFO:teuthology.orchestra.run.smithi100.stdout: "heap": 215440 2024-05-09T06:04:01.834 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:01.834 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_server": { 2024-05-09T06:04:01.834 INFO:teuthology.orchestra.run.smithi100.stdout: "dispatch_client_request": 0, 2024-05-09T06:04:01.834 INFO:teuthology.orchestra.run.smithi100.stdout: "dispatch_server_request": 0, 2024-05-09T06:04:01.834 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_client_request": 0, 2024-05-09T06:04:01.834 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_client_session": 0, 2024-05-09T06:04:01.834 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_peer_request": 0, 2024-05-09T06:04:01.834 INFO:teuthology.orchestra.run.smithi100.stdout: "req_create_latency": { 2024-05-09T06:04:01.834 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-05-09T06:04:01.834 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-05-09T06:04:01.834 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-05-09T06:04:01.834 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:01.835 INFO:teuthology.orchestra.run.smithi100.stdout: "req_getattr_latency": { 2024-05-09T06:04:01.835 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-05-09T06:04:01.835 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-05-09T06:04:01.835 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-05-09T06:04:01.835 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:01.835 INFO:teuthology.orchestra.run.smithi100.stdout: "req_getfilelock_latency": { 2024-05-09T06:04:01.835 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-05-09T06:04:01.835 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-05-09T06:04:01.835 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-05-09T06:04:01.835 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:01.835 INFO:teuthology.orchestra.run.smithi100.stdout: "req_link_latency": { 2024-05-09T06:04:01.835 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-05-09T06:04:01.835 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-05-09T06:04:01.835 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-05-09T06:04:01.836 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:01.836 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookup_latency": { 2024-05-09T06:04:01.836 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-05-09T06:04:01.836 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-05-09T06:04:01.836 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-05-09T06:04:01.836 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:01.836 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookuphash_latency": { 2024-05-09T06:04:01.836 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-05-09T06:04:01.836 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-05-09T06:04:01.836 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-05-09T06:04:01.836 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:01.836 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookupino_latency": { 2024-05-09T06:04:01.836 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-05-09T06:04:01.836 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-05-09T06:04:01.836 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-05-09T06:04:01.837 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:01.837 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookupname_latency": { 2024-05-09T06:04:01.837 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-05-09T06:04:01.837 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-05-09T06:04:01.837 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-05-09T06:04:01.837 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:01.837 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookupparent_latency": { 2024-05-09T06:04:01.837 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-05-09T06:04:01.837 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-05-09T06:04:01.837 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-05-09T06:04:01.837 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:01.837 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookupsnap_latency": { 2024-05-09T06:04:01.837 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-05-09T06:04:01.837 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-05-09T06:04:01.837 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-05-09T06:04:01.838 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:01.838 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lssnap_latency": { 2024-05-09T06:04:01.838 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-05-09T06:04:01.838 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-05-09T06:04:01.838 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-05-09T06:04:01.839 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:01.839 INFO:teuthology.orchestra.run.smithi100.stdout: "req_mkdir_latency": { 2024-05-09T06:04:01.839 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-05-09T06:04:01.839 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-05-09T06:04:01.839 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-05-09T06:04:01.839 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:01.839 INFO:teuthology.orchestra.run.smithi100.stdout: "req_mknod_latency": { 2024-05-09T06:04:01.839 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-05-09T06:04:01.839 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-05-09T06:04:01.839 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-05-09T06:04:01.839 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:01.839 INFO:teuthology.orchestra.run.smithi100.stdout: "req_mksnap_latency": { 2024-05-09T06:04:01.839 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-05-09T06:04:01.839 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-05-09T06:04:01.839 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-05-09T06:04:01.840 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:01.840 INFO:teuthology.orchestra.run.smithi100.stdout: "req_open_latency": { 2024-05-09T06:04:01.840 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-05-09T06:04:01.840 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-05-09T06:04:01.840 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-05-09T06:04:01.840 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:01.840 INFO:teuthology.orchestra.run.smithi100.stdout: "req_readdir_latency": { 2024-05-09T06:04:01.840 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-05-09T06:04:01.840 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-05-09T06:04:01.840 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-05-09T06:04:01.840 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:01.840 INFO:teuthology.orchestra.run.smithi100.stdout: "req_rename_latency": { 2024-05-09T06:04:01.840 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-05-09T06:04:01.840 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-05-09T06:04:01.840 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-05-09T06:04:01.841 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:01.841 INFO:teuthology.orchestra.run.smithi100.stdout: "req_renamesnap_latency": { 2024-05-09T06:04:01.841 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-05-09T06:04:01.841 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-05-09T06:04:01.841 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-05-09T06:04:01.841 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:01.841 INFO:teuthology.orchestra.run.smithi100.stdout: "req_snapdiff_latency": { 2024-05-09T06:04:01.841 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-05-09T06:04:01.841 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-05-09T06:04:01.841 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-05-09T06:04:01.841 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:01.841 INFO:teuthology.orchestra.run.smithi100.stdout: "req_rmdir_latency": { 2024-05-09T06:04:01.841 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-05-09T06:04:01.842 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-05-09T06:04:01.842 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-05-09T06:04:01.842 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:01.842 INFO:teuthology.orchestra.run.smithi100.stdout: "req_rmsnap_latency": { 2024-05-09T06:04:01.842 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-05-09T06:04:01.842 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-05-09T06:04:01.842 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-05-09T06:04:01.842 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:01.842 INFO:teuthology.orchestra.run.smithi100.stdout: "req_rmxattr_latency": { 2024-05-09T06:04:01.842 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-05-09T06:04:01.842 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-05-09T06:04:01.842 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-05-09T06:04:01.842 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:01.843 INFO:teuthology.orchestra.run.smithi100.stdout: "req_setattr_latency": { 2024-05-09T06:04:01.843 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-05-09T06:04:01.843 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-05-09T06:04:01.843 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-05-09T06:04:01.843 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:01.843 INFO:teuthology.orchestra.run.smithi100.stdout: "req_setdirlayout_latency": { 2024-05-09T06:04:01.843 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-05-09T06:04:01.843 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-05-09T06:04:01.843 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-05-09T06:04:01.843 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:01.843 INFO:teuthology.orchestra.run.smithi100.stdout: "req_setfilelock_latency": { 2024-05-09T06:04:01.843 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-05-09T06:04:01.843 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-05-09T06:04:01.843 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-05-09T06:04:01.844 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:01.844 INFO:teuthology.orchestra.run.smithi100.stdout: "req_setlayout_latency": { 2024-05-09T06:04:01.844 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-05-09T06:04:01.844 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-05-09T06:04:01.844 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-05-09T06:04:01.844 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:01.844 INFO:teuthology.orchestra.run.smithi100.stdout: "req_setxattr_latency": { 2024-05-09T06:04:01.844 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-05-09T06:04:01.844 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-05-09T06:04:01.844 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-05-09T06:04:01.844 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:01.844 INFO:teuthology.orchestra.run.smithi100.stdout: "req_symlink_latency": { 2024-05-09T06:04:01.844 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-05-09T06:04:01.844 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-05-09T06:04:01.845 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-05-09T06:04:01.845 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:01.845 INFO:teuthology.orchestra.run.smithi100.stdout: "req_unlink_latency": { 2024-05-09T06:04:01.845 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-05-09T06:04:01.845 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-05-09T06:04:01.845 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-05-09T06:04:01.845 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:01.845 INFO:teuthology.orchestra.run.smithi100.stdout: "cap_revoke_eviction": 0, 2024-05-09T06:04:01.845 INFO:teuthology.orchestra.run.smithi100.stdout: "cap_acquisition_throttle": 0, 2024-05-09T06:04:01.845 INFO:teuthology.orchestra.run.smithi100.stdout: "req_getvxattr_latency": { 2024-05-09T06:04:01.845 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-05-09T06:04:01.845 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-05-09T06:04:01.845 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-05-09T06:04:01.845 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-05-09T06:04:01.845 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:01.846 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_sessions": { 2024-05-09T06:04:01.846 INFO:teuthology.orchestra.run.smithi100.stdout: "session_count": 1, 2024-05-09T06:04:01.846 INFO:teuthology.orchestra.run.smithi100.stdout: "session_add": 3, 2024-05-09T06:04:01.846 INFO:teuthology.orchestra.run.smithi100.stdout: "session_remove": 2, 2024-05-09T06:04:01.846 INFO:teuthology.orchestra.run.smithi100.stdout: "sessions_open": 2, 2024-05-09T06:04:01.846 INFO:teuthology.orchestra.run.smithi100.stdout: "sessions_stale": 0, 2024-05-09T06:04:01.846 INFO:teuthology.orchestra.run.smithi100.stdout: "total_load": 0, 2024-05-09T06:04:01.846 INFO:teuthology.orchestra.run.smithi100.stdout: "average_load": 0, 2024-05-09T06:04:01.846 INFO:teuthology.orchestra.run.smithi100.stdout: "avg_session_uptime": 4464, 2024-05-09T06:04:01.846 INFO:teuthology.orchestra.run.smithi100.stdout: "mdthresh_evicted": 0 2024-05-09T06:04:01.846 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:01.846 INFO:teuthology.orchestra.run.smithi100.stdout: "mempool": { 2024-05-09T06:04:01.846 INFO:teuthology.orchestra.run.smithi100.stdout: "bloom_filter_bytes": 0, 2024-05-09T06:04:01.846 INFO:teuthology.orchestra.run.smithi100.stdout: "bloom_filter_items": 0, 2024-05-09T06:04:01.847 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_alloc_bytes": 0, 2024-05-09T06:04:01.847 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_alloc_items": 0, 2024-05-09T06:04:01.847 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_data_bytes": 0, 2024-05-09T06:04:01.847 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_data_items": 0, 2024-05-09T06:04:01.847 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-09T06:04:01.847 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_onode_items": 0, 2024-05-09T06:04:01.847 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-09T06:04:01.847 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_meta_items": 0, 2024-05-09T06:04:01.847 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_other_bytes": 0, 2024-05-09T06:04:01.847 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_other_items": 0, 2024-05-09T06:04:01.847 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-09T06:04:01.847 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_buffer_items": 0, 2024-05-09T06:04:01.847 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_extent_bytes": 0, 2024-05-09T06:04:01.847 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_extent_items": 0, 2024-05-09T06:04:01.848 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_blob_bytes": 0, 2024-05-09T06:04:01.848 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_blob_items": 0, 2024-05-09T06:04:01.848 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-09T06:04:01.848 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_shared_blob_items": 0, 2024-05-09T06:04:01.848 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-09T06:04:01.848 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_inline_bl_items": 0, 2024-05-09T06:04:01.848 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_fsck_bytes": 0, 2024-05-09T06:04:01.848 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_fsck_items": 0, 2024-05-09T06:04:01.848 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_txc_bytes": 0, 2024-05-09T06:04:01.848 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_txc_items": 0, 2024-05-09T06:04:01.848 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-09T06:04:01.848 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_deferred_items": 0, 2024-05-09T06:04:01.848 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_bytes": 0, 2024-05-09T06:04:01.848 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_items": 0, 2024-05-09T06:04:01.849 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_bytes": 0, 2024-05-09T06:04:01.849 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_items": 0, 2024-05-09T06:04:01.849 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_reader_bytes": 0, 2024-05-09T06:04:01.849 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_reader_items": 0, 2024-05-09T06:04:01.849 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_writer_bytes": 0, 2024-05-09T06:04:01.849 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_writer_items": 0, 2024-05-09T06:04:01.849 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_anon_bytes": 240541, 2024-05-09T06:04:01.849 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_anon_items": 108, 2024-05-09T06:04:01.849 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_meta_bytes": 0, 2024-05-09T06:04:01.849 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_meta_items": 0, 2024-05-09T06:04:01.849 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_bytes": 0, 2024-05-09T06:04:01.849 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_items": 0, 2024-05-09T06:04:01.849 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_mapbl_bytes": 0, 2024-05-09T06:04:01.849 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_mapbl_items": 0, 2024-05-09T06:04:01.849 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_pglog_bytes": 0, 2024-05-09T06:04:01.850 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_pglog_items": 0, 2024-05-09T06:04:01.850 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_bytes": 7528, 2024-05-09T06:04:01.850 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_items": 158, 2024-05-09T06:04:01.850 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_mapping_bytes": 0, 2024-05-09T06:04:01.850 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_mapping_items": 0, 2024-05-09T06:04:01.850 INFO:teuthology.orchestra.run.smithi100.stdout: "pgmap_bytes": 0, 2024-05-09T06:04:01.850 INFO:teuthology.orchestra.run.smithi100.stdout: "pgmap_items": 0, 2024-05-09T06:04:01.850 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_co_bytes": 83897907, 2024-05-09T06:04:01.850 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_co_items": 479237, 2024-05-09T06:04:01.850 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_1_bytes": 0, 2024-05-09T06:04:01.850 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_1_items": 0, 2024-05-09T06:04:01.850 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_2_bytes": 0, 2024-05-09T06:04:01.851 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_2_items": 0 2024-05-09T06:04:01.851 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:01.851 INFO:teuthology.orchestra.run.smithi100.stdout: "objecter": { 2024-05-09T06:04:01.851 INFO:teuthology.orchestra.run.smithi100.stdout: "op_active": 0, 2024-05-09T06:04:01.851 INFO:teuthology.orchestra.run.smithi100.stdout: "op_laggy": 0, 2024-05-09T06:04:01.851 INFO:teuthology.orchestra.run.smithi100.stdout: "op_send": 7328, 2024-05-09T06:04:01.851 INFO:teuthology.orchestra.run.smithi100.stdout: "op_send_bytes": 26, 2024-05-09T06:04:01.851 INFO:teuthology.orchestra.run.smithi100.stdout: "op_resend": 4, 2024-05-09T06:04:01.851 INFO:teuthology.orchestra.run.smithi100.stdout: "op_reply": 7328, 2024-05-09T06:04:01.851 INFO:teuthology.orchestra.run.smithi100.stdout: "op_latency": { 2024-05-09T06:04:01.851 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 7328, 2024-05-09T06:04:01.851 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 9.900753840, 2024-05-09T06:04:01.851 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.001351085 2024-05-09T06:04:01.851 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:01.852 INFO:teuthology.orchestra.run.smithi100.stdout: "op_inflight": 0, 2024-05-09T06:04:01.852 INFO:teuthology.orchestra.run.smithi100.stdout: "oplen_avg": { 2024-05-09T06:04:01.852 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 7328, 2024-05-09T06:04:01.852 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 7329 2024-05-09T06:04:01.852 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:01.852 INFO:teuthology.orchestra.run.smithi100.stdout: "op": 7328, 2024-05-09T06:04:01.852 INFO:teuthology.orchestra.run.smithi100.stdout: "op_r": 7328, 2024-05-09T06:04:01.852 INFO:teuthology.orchestra.run.smithi100.stdout: "op_w": 0, 2024-05-09T06:04:01.852 INFO:teuthology.orchestra.run.smithi100.stdout: "op_rmw": 0, 2024-05-09T06:04:01.852 INFO:teuthology.orchestra.run.smithi100.stdout: "op_pg": 0, 2024-05-09T06:04:01.852 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_stat": 4040, 2024-05-09T06:04:01.852 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_create": 0, 2024-05-09T06:04:01.852 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_read": 3285, 2024-05-09T06:04:01.852 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_write": 0, 2024-05-09T06:04:01.852 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_writefull": 0, 2024-05-09T06:04:01.853 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_writesame": 0, 2024-05-09T06:04:01.853 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_append": 0, 2024-05-09T06:04:01.853 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_zero": 0, 2024-05-09T06:04:01.853 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_truncate": 0, 2024-05-09T06:04:01.853 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_delete": 0, 2024-05-09T06:04:01.853 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_mapext": 0, 2024-05-09T06:04:01.853 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_sparse_read": 0, 2024-05-09T06:04:01.853 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_clonerange": 0, 2024-05-09T06:04:01.853 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_getxattr": 2, 2024-05-09T06:04:01.853 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_setxattr": 0, 2024-05-09T06:04:01.853 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_cmpxattr": 0, 2024-05-09T06:04:01.853 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_rmxattr": 0, 2024-05-09T06:04:01.853 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_resetxattrs": 0, 2024-05-09T06:04:01.853 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_call": 0, 2024-05-09T06:04:01.853 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_watch": 0, 2024-05-09T06:04:01.854 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_notify": 0, 2024-05-09T06:04:01.854 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_src_cmpxattr": 0, 2024-05-09T06:04:01.854 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_pgls": 0, 2024-05-09T06:04:01.854 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_pgls_filter": 0, 2024-05-09T06:04:01.854 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_other": 0, 2024-05-09T06:04:01.854 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_active": 0, 2024-05-09T06:04:01.854 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_send": 0, 2024-05-09T06:04:01.854 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_resend": 0, 2024-05-09T06:04:01.854 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_ping": 0, 2024-05-09T06:04:01.854 INFO:teuthology.orchestra.run.smithi100.stdout: "poolop_active": 0, 2024-05-09T06:04:01.854 INFO:teuthology.orchestra.run.smithi100.stdout: "poolop_send": 0, 2024-05-09T06:04:01.854 INFO:teuthology.orchestra.run.smithi100.stdout: "poolop_resend": 0, 2024-05-09T06:04:01.854 INFO:teuthology.orchestra.run.smithi100.stdout: "poolstat_active": 0, 2024-05-09T06:04:01.854 INFO:teuthology.orchestra.run.smithi100.stdout: "poolstat_send": 0, 2024-05-09T06:04:01.855 INFO:teuthology.orchestra.run.smithi100.stdout: "poolstat_resend": 0, 2024-05-09T06:04:01.855 INFO:teuthology.orchestra.run.smithi100.stdout: "statfs_active": 0, 2024-05-09T06:04:01.855 INFO:teuthology.orchestra.run.smithi100.stdout: "statfs_send": 0, 2024-05-09T06:04:01.855 INFO:teuthology.orchestra.run.smithi100.stdout: "statfs_resend": 0, 2024-05-09T06:04:01.855 INFO:teuthology.orchestra.run.smithi100.stdout: "command_active": 0, 2024-05-09T06:04:01.855 INFO:teuthology.orchestra.run.smithi100.stdout: "command_send": 0, 2024-05-09T06:04:01.855 INFO:teuthology.orchestra.run.smithi100.stdout: "command_resend": 0, 2024-05-09T06:04:01.855 INFO:teuthology.orchestra.run.smithi100.stdout: "map_epoch": 83, 2024-05-09T06:04:01.855 INFO:teuthology.orchestra.run.smithi100.stdout: "map_full": 0, 2024-05-09T06:04:01.855 INFO:teuthology.orchestra.run.smithi100.stdout: "map_inc": 2, 2024-05-09T06:04:01.855 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_sessions": 11, 2024-05-09T06:04:01.855 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_session_open": 11, 2024-05-09T06:04:01.855 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_session_close": 0, 2024-05-09T06:04:01.855 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_laggy": 0, 2024-05-09T06:04:01.856 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_wr": 0, 2024-05-09T06:04:01.856 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_rd": 2, 2024-05-09T06:04:01.856 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_del": 0 2024-05-09T06:04:01.856 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:01.856 INFO:teuthology.orchestra.run.smithi100.stdout: "oft": { 2024-05-09T06:04:01.856 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_total_objs": 0, 2024-05-09T06:04:01.856 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_total_kv_pairs": 0, 2024-05-09T06:04:01.856 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_total_updates": 0, 2024-05-09T06:04:01.856 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_total_removes": 0 2024-05-09T06:04:01.856 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:01.856 INFO:teuthology.orchestra.run.smithi100.stdout: "osd-slow-ops": { 2024-05-09T06:04:01.856 INFO:teuthology.orchestra.run.smithi100.stdout: "slow_ops_count": 0 2024-05-09T06:04:01.856 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:01.856 INFO:teuthology.orchestra.run.smithi100.stdout: "purge_queue": { 2024-05-09T06:04:01.856 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executing_ops": 0, 2024-05-09T06:04:01.856 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executing_ops_high_water": 0, 2024-05-09T06:04:01.857 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executing": 0, 2024-05-09T06:04:01.857 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executing_high_water": 0, 2024-05-09T06:04:01.857 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executed_ops": 0, 2024-05-09T06:04:01.857 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executed": 0, 2024-05-09T06:04:01.857 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_item_in_journal": 0 2024-05-09T06:04:01.857 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:01.857 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-09T06:04:01.857 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-05-09T06:04:01.857 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 104857600, 2024-05-09T06:04:01.857 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-05-09T06:04:01.857 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 7841, 2024-05-09T06:04:01.857 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 1207327211, 2024-05-09T06:04:01.857 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-05-09T06:04:01.857 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 7841, 2024-05-09T06:04:01.857 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 0, 2024-05-09T06:04:01.857 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 0, 2024-05-09T06:04:01.858 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 7841, 2024-05-09T06:04:01.858 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 1207327211, 2024-05-09T06:04:01.858 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-05-09T06:04:01.858 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-05-09T06:04:01.858 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-05-09T06:04:01.858 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-05-09T06:04:01.858 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-05-09T06:04:01.858 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:01.858 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-objecter_bytes": { 2024-05-09T06:04:01.858 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-05-09T06:04:01.858 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 104857600, 2024-05-09T06:04:01.858 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-05-09T06:04:01.858 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 0, 2024-05-09T06:04:01.858 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 0, 2024-05-09T06:04:01.859 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-05-09T06:04:01.859 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 0, 2024-05-09T06:04:01.859 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 7328, 2024-05-09T06:04:01.859 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 1205036009, 2024-05-09T06:04:01.859 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 7328, 2024-05-09T06:04:01.859 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 1205036009, 2024-05-09T06:04:01.859 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-05-09T06:04:01.859 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-05-09T06:04:01.859 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-05-09T06:04:01.859 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-05-09T06:04:01.859 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-05-09T06:04:01.859 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:01.859 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-objecter_ops": { 2024-05-09T06:04:01.859 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-05-09T06:04:01.860 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 1024, 2024-05-09T06:04:01.860 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-05-09T06:04:01.860 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 0, 2024-05-09T06:04:01.860 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 0, 2024-05-09T06:04:01.860 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-05-09T06:04:01.860 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 0, 2024-05-09T06:04:01.860 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 7328, 2024-05-09T06:04:01.860 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 7328, 2024-05-09T06:04:01.860 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 7328, 2024-05-09T06:04:01.860 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 7328, 2024-05-09T06:04:01.860 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-05-09T06:04:01.860 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-05-09T06:04:01.860 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-05-09T06:04:01.861 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-05-09T06:04:01.861 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-05-09T06:04:01.861 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:01.861 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-write_buf_throttle": { 2024-05-09T06:04:01.861 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-05-09T06:04:01.861 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 3758096384, 2024-05-09T06:04:01.861 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-05-09T06:04:01.861 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 0, 2024-05-09T06:04:01.861 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 0, 2024-05-09T06:04:01.861 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-05-09T06:04:01.861 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 0, 2024-05-09T06:04:01.861 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 0, 2024-05-09T06:04:01.861 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 0, 2024-05-09T06:04:01.861 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 0, 2024-05-09T06:04:01.862 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 0, 2024-05-09T06:04:01.862 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-05-09T06:04:01.862 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-05-09T06:04:01.862 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-05-09T06:04:01.862 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-05-09T06:04:01.862 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-05-09T06:04:01.862 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:01.862 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-write_buf_throttle-0x562c3cec28f0": { 2024-05-09T06:04:01.862 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-05-09T06:04:01.862 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 3758096384, 2024-05-09T06:04:01.862 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-05-09T06:04:01.862 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 0, 2024-05-09T06:04:01.862 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 0, 2024-05-09T06:04:01.863 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-05-09T06:04:01.863 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 0, 2024-05-09T06:04:01.863 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 0, 2024-05-09T06:04:01.863 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 0, 2024-05-09T06:04:01.863 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 0, 2024-05-09T06:04:01.863 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 0, 2024-05-09T06:04:01.863 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-05-09T06:04:01.863 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-05-09T06:04:01.863 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-05-09T06:04:01.863 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-05-09T06:04:01.863 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-05-09T06:04:01.863 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-05-09T06:04:01.863 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-05-09T06:04:02.038 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:04:01 smithi060 ceph-mon[34555]: pgmap v1169: 97 pgs: 97 active+clean; 480 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 2.7 MiB/s wr, 115 op/s 2024-05-09T06:04:02.102 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:04:01 smithi039 ceph-mon[30439]: pgmap v1169: 97 pgs: 97 active+clean; 480 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 2.7 MiB/s wr, 115 op/s 2024-05-09T06:04:02.762 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-05-09T06:04:02.762 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-05-09T06:04:02.762 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update=0 2024-05-09T06:04:02.762 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update_receipt=0 2024-05-09T06:04:02.762 DEBUG:tasks.check_counter:Getting stats from i 2024-05-09T06:04:02.762 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph daemon mds.i perf dump 2024-05-09T06:04:03.014 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.c/config 2024-05-09T06:04:04.038 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:04:03 smithi060 ceph-mon[34555]: pgmap v1170: 97 pgs: 97 active+clean; 479 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 2.0 MiB/s wr, 92 op/s 2024-05-09T06:04:04.102 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:04:03 smithi039 ceph-mon[30439]: pgmap v1170: 97 pgs: 97 active+clean; 479 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 2.0 MiB/s wr, 92 op/s 2024-05-09T06:04:04.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:04:03 smithi100 ceph-mon[34353]: pgmap v1170: 97 pgs: 97 active+clean; 479 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 2.0 MiB/s wr, 92 op/s 2024-05-09T06:04:04.790 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-05-09T06:04:04.790 INFO:teuthology.orchestra.run.smithi100.stdout: "AsyncMessenger::Worker-0": { 2024-05-09T06:04:04.790 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_messages": 264478, 2024-05-09T06:04:04.790 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages": 340643, 2024-05-09T06:04:04.790 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_bytes": 90184872, 2024-05-09T06:04:04.790 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_bytes": 303647847, 2024-05-09T06:04:04.790 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_created_connections": 15, 2024-05-09T06:04:04.790 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_active_connections": 7, 2024-05-09T06:04:04.791 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_total_time": 18.102520212, 2024-05-09T06:04:04.791 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_send_time": 7.841248993, 2024-05-09T06:04:04.791 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_recv_time": 12.557168193, 2024-05-09T06:04:04.791 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_fast_dispatch_time": 0.624806764, 2024-05-09T06:04:04.791 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T06:04:04.791 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 340638, 2024-05-09T06:04:04.791 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 8.393468313, 2024-05-09T06:04:04.791 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000024640 2024-05-09T06:04:04.791 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:04.791 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_handle_ack_lat": { 2024-05-09T06:04:04.791 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 542875, 2024-05-09T06:04:04.791 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.076754999, 2024-05-09T06:04:04.791 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000141 2024-05-09T06:04:04.791 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:04.792 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_encrypted_bytes": 86333440, 2024-05-09T06:04:04.792 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_encrypted_bytes": 248299024 2024-05-09T06:04:04.792 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:04.792 INFO:teuthology.orchestra.run.smithi100.stdout: "AsyncMessenger::Worker-1": { 2024-05-09T06:04:04.792 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_messages": 520149, 2024-05-09T06:04:04.792 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages": 323708, 2024-05-09T06:04:04.792 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_bytes": 137190948, 2024-05-09T06:04:04.792 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_bytes": 111501161, 2024-05-09T06:04:04.792 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_created_connections": 9, 2024-05-09T06:04:04.792 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_active_connections": 5, 2024-05-09T06:04:04.792 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_total_time": 24.647625097, 2024-05-09T06:04:04.792 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_send_time": 9.144034816, 2024-05-09T06:04:04.792 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_recv_time": 20.312673155, 2024-05-09T06:04:04.793 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_fast_dispatch_time": 0.526099796, 2024-05-09T06:04:04.793 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T06:04:04.793 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 323710, 2024-05-09T06:04:04.793 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 6.431932238, 2024-05-09T06:04:04.793 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000019869 2024-05-09T06:04:04.793 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:04.793 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_handle_ack_lat": { 2024-05-09T06:04:04.793 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 808626, 2024-05-09T06:04:04.793 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.123378174, 2024-05-09T06:04:04.793 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000152 2024-05-09T06:04:04.793 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:04.793 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_encrypted_bytes": 160, 2024-05-09T06:04:04.793 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_encrypted_bytes": 713472 2024-05-09T06:04:04.794 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:04.794 INFO:teuthology.orchestra.run.smithi100.stdout: "AsyncMessenger::Worker-2": { 2024-05-09T06:04:04.794 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_messages": 51643, 2024-05-09T06:04:04.794 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages": 80697, 2024-05-09T06:04:04.794 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_bytes": 13421882, 2024-05-09T06:04:04.794 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_bytes": 113465683, 2024-05-09T06:04:04.794 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_created_connections": 8, 2024-05-09T06:04:04.794 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_active_connections": 6, 2024-05-09T06:04:04.794 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_total_time": 4.902953908, 2024-05-09T06:04:04.794 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_send_time": 2.300384837, 2024-05-09T06:04:04.794 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_recv_time": 2.047840674, 2024-05-09T06:04:04.794 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_fast_dispatch_time": 0.598573713, 2024-05-09T06:04:04.794 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T06:04:04.795 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 80696, 2024-05-09T06:04:04.795 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 2.048100594, 2024-05-09T06:04:04.795 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000025380 2024-05-09T06:04:04.795 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:04.795 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_handle_ack_lat": { 2024-05-09T06:04:04.795 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 91006, 2024-05-09T06:04:04.795 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.017277932, 2024-05-09T06:04:04.795 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000189 2024-05-09T06:04:04.795 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:04.795 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_encrypted_bytes": 1026752, 2024-05-09T06:04:04.795 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_encrypted_bytes": 297168 2024-05-09T06:04:04.795 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:04.795 INFO:teuthology.orchestra.run.smithi100.stdout: "cct": { 2024-05-09T06:04:04.795 INFO:teuthology.orchestra.run.smithi100.stdout: "total_workers": 1, 2024-05-09T06:04:04.796 INFO:teuthology.orchestra.run.smithi100.stdout: "unhealthy_workers": 0 2024-05-09T06:04:04.796 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:04.796 INFO:teuthology.orchestra.run.smithi100.stdout: "finisher-MDSRank": { 2024-05-09T06:04:04.796 INFO:teuthology.orchestra.run.smithi100.stdout: "queue_len": 0, 2024-05-09T06:04:04.796 INFO:teuthology.orchestra.run.smithi100.stdout: "complete_latency": { 2024-05-09T06:04:04.796 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 57252, 2024-05-09T06:04:04.796 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 56.216558547, 2024-05-09T06:04:04.796 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000981914 2024-05-09T06:04:04.796 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-05-09T06:04:04.796 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:04.796 INFO:teuthology.orchestra.run.smithi100.stdout: "finisher-PurgeQueue": { 2024-05-09T06:04:04.796 INFO:teuthology.orchestra.run.smithi100.stdout: "queue_len": 0, 2024-05-09T06:04:04.796 INFO:teuthology.orchestra.run.smithi100.stdout: "complete_latency": { 2024-05-09T06:04:04.796 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 34169, 2024-05-09T06:04:04.797 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 2.506942629, 2024-05-09T06:04:04.797 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000073368 2024-05-09T06:04:04.797 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-05-09T06:04:04.797 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:04.797 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": { 2024-05-09T06:04:04.797 INFO:teuthology.orchestra.run.smithi100.stdout: "request": 200022, 2024-05-09T06:04:04.797 INFO:teuthology.orchestra.run.smithi100.stdout: "reply": 123656, 2024-05-09T06:04:04.797 INFO:teuthology.orchestra.run.smithi100.stdout: "reply_latency": { 2024-05-09T06:04:04.797 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 123656, 2024-05-09T06:04:04.797 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 458.248711958, 2024-05-09T06:04:04.797 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.003705834 2024-05-09T06:04:04.797 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:04.797 INFO:teuthology.orchestra.run.smithi100.stdout: "slow_reply": 0, 2024-05-09T06:04:04.797 INFO:teuthology.orchestra.run.smithi100.stdout: "forward": 76366, 2024-05-09T06:04:04.798 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_fetch_complete": 0, 2024-05-09T06:04:04.798 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_fetch_keys": 0, 2024-05-09T06:04:04.798 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_commit": 23, 2024-05-09T06:04:04.798 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_split": 0, 2024-05-09T06:04:04.798 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_merge": 0, 2024-05-09T06:04:04.798 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes": 36, 2024-05-09T06:04:04.798 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_top": 14, 2024-05-09T06:04:04.798 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_bottom": 10, 2024-05-09T06:04:04.798 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_pin_tail": 12, 2024-05-09T06:04:04.798 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_pinned": 15, 2024-05-09T06:04:04.798 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_expired": 324, 2024-05-09T06:04:04.798 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_with_caps": 0, 2024-05-09T06:04:04.798 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": 0, 2024-05-09T06:04:04.799 INFO:teuthology.orchestra.run.smithi100.stdout: "subtrees": 3, 2024-05-09T06:04:04.799 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse": 296092, 2024-05-09T06:04:04.799 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_hit": 121609, 2024-05-09T06:04:04.799 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_forward": 76363, 2024-05-09T06:04:04.799 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_discover": 203, 2024-05-09T06:04:04.799 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_dir_fetch": 0, 2024-05-09T06:04:04.799 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_remote_ino": 0, 2024-05-09T06:04:04.799 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_lock": 1419, 2024-05-09T06:04:04.799 INFO:teuthology.orchestra.run.smithi100.stdout: "load_cent": 0, 2024-05-09T06:04:04.799 INFO:teuthology.orchestra.run.smithi100.stdout: "q": 0, 2024-05-09T06:04:04.799 INFO:teuthology.orchestra.run.smithi100.stdout: "exported": 4, 2024-05-09T06:04:04.799 INFO:teuthology.orchestra.run.smithi100.stdout: "exported_inodes": 77, 2024-05-09T06:04:04.799 INFO:teuthology.orchestra.run.smithi100.stdout: "imported": 5, 2024-05-09T06:04:04.800 INFO:teuthology.orchestra.run.smithi100.stdout: "imported_inodes": 131, 2024-05-09T06:04:04.800 INFO:teuthology.orchestra.run.smithi100.stdout: "openino_dir_fetch": 0, 2024-05-09T06:04:04.800 INFO:teuthology.orchestra.run.smithi100.stdout: "openino_backtrace_fetch": 0, 2024-05-09T06:04:04.800 INFO:teuthology.orchestra.run.smithi100.stdout: "openino_peer_discover": 0, 2024-05-09T06:04:04.800 INFO:teuthology.orchestra.run.smithi100.stdout: "root_rfiles": 4, 2024-05-09T06:04:04.800 INFO:teuthology.orchestra.run.smithi100.stdout: "root_rbytes": 234, 2024-05-09T06:04:04.800 INFO:teuthology.orchestra.run.smithi100.stdout: "root_rsnaps": 0, 2024-05-09T06:04:04.800 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_backtrace_fetch": 0, 2024-05-09T06:04:04.800 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_set_tag": 0, 2024-05-09T06:04:04.800 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_backtrace_repaired": 0, 2024-05-09T06:04:04.800 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_inotable_repaired": 0, 2024-05-09T06:04:04.800 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_dir_inodes": 0, 2024-05-09T06:04:04.800 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_dir_base_inodes": 0, 2024-05-09T06:04:04.800 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_dirfrag_rstats": 0, 2024-05-09T06:04:04.801 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_file_inodes": 0, 2024-05-09T06:04:04.801 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_inode_file_caps": 8, 2024-05-09T06:04:04.801 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_cap_op_revoke": 5259, 2024-05-09T06:04:04.801 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_cap_op_grant": 58922, 2024-05-09T06:04:04.801 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_cap_op_trunc": 0, 2024-05-09T06:04:04.801 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-09T06:04:04.801 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-09T06:04:04.801 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_client_caps": 32180, 2024-05-09T06:04:04.801 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_client_caps_dirty": 12658, 2024-05-09T06:04:04.801 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_client_cap_release": 7993, 2024-05-09T06:04:04.801 INFO:teuthology.orchestra.run.smithi100.stdout: "process_request_cap_release": 87802 2024-05-09T06:04:04.801 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:04.801 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_cache": { 2024-05-09T06:04:04.801 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_update": 267, 2024-05-09T06:04:04.802 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_update_receipt": 1719, 2024-05-09T06:04:04.802 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_try_discover": 970, 2024-05-09T06:04:04.802 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_send_discover": 1625, 2024-05-09T06:04:04.802 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_handle_discover": 432, 2024-05-09T06:04:04.802 INFO:teuthology.orchestra.run.smithi100.stdout: "num_strays": 2, 2024-05-09T06:04:04.802 INFO:teuthology.orchestra.run.smithi100.stdout: "num_strays_delayed": 0, 2024-05-09T06:04:04.802 INFO:teuthology.orchestra.run.smithi100.stdout: "num_strays_enqueuing": 0, 2024-05-09T06:04:04.802 INFO:teuthology.orchestra.run.smithi100.stdout: "strays_created": 18960, 2024-05-09T06:04:04.802 INFO:teuthology.orchestra.run.smithi100.stdout: "strays_enqueued": 18958, 2024-05-09T06:04:04.802 INFO:teuthology.orchestra.run.smithi100.stdout: "strays_reintegrated": 0, 2024-05-09T06:04:04.802 INFO:teuthology.orchestra.run.smithi100.stdout: "strays_migrated": 0, 2024-05-09T06:04:04.802 INFO:teuthology.orchestra.run.smithi100.stdout: "num_recovering_processing": 0, 2024-05-09T06:04:04.802 INFO:teuthology.orchestra.run.smithi100.stdout: "num_recovering_enqueued": 0, 2024-05-09T06:04:04.803 INFO:teuthology.orchestra.run.smithi100.stdout: "num_recovering_prioritized": 0, 2024-05-09T06:04:04.803 INFO:teuthology.orchestra.run.smithi100.stdout: "recovery_started": 0, 2024-05-09T06:04:04.803 INFO:teuthology.orchestra.run.smithi100.stdout: "recovery_completed": 0, 2024-05-09T06:04:04.803 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_quiesce_path": 0, 2024-05-09T06:04:04.803 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_quiesce_inode": 0, 2024-05-09T06:04:04.803 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_enqueue_scrub": 0, 2024-05-09T06:04:04.803 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_exportdir": 4, 2024-05-09T06:04:04.803 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_flush": 0, 2024-05-09T06:04:04.803 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_fragmentdir": 0, 2024-05-09T06:04:04.803 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_fragstats": 0, 2024-05-09T06:04:04.803 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_inodestats": 0 2024-05-09T06:04:04.804 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:04.804 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_log": { 2024-05-09T06:04:04.804 INFO:teuthology.orchestra.run.smithi100.stdout: "evlrg": 0, 2024-05-09T06:04:04.804 INFO:teuthology.orchestra.run.smithi100.stdout: "evadd": 93909, 2024-05-09T06:04:04.804 INFO:teuthology.orchestra.run.smithi100.stdout: "evex": 1937, 2024-05-09T06:04:04.804 INFO:teuthology.orchestra.run.smithi100.stdout: "evtrm": 1, 2024-05-09T06:04:04.804 INFO:teuthology.orchestra.run.smithi100.stdout: "ev": 93908, 2024-05-09T06:04:04.804 INFO:teuthology.orchestra.run.smithi100.stdout: "evexg": 0, 2024-05-09T06:04:04.804 INFO:teuthology.orchestra.run.smithi100.stdout: "evexd": 1936, 2024-05-09T06:04:04.804 INFO:teuthology.orchestra.run.smithi100.stdout: "segadd": 131, 2024-05-09T06:04:04.804 INFO:teuthology.orchestra.run.smithi100.stdout: "segex": 3, 2024-05-09T06:04:04.804 INFO:teuthology.orchestra.run.smithi100.stdout: "segtrm": 1, 2024-05-09T06:04:04.804 INFO:teuthology.orchestra.run.smithi100.stdout: "seg": 130, 2024-05-09T06:04:04.804 INFO:teuthology.orchestra.run.smithi100.stdout: "segmjr": 8, 2024-05-09T06:04:04.805 INFO:teuthology.orchestra.run.smithi100.stdout: "segexg": 0, 2024-05-09T06:04:04.805 INFO:teuthology.orchestra.run.smithi100.stdout: "segexd": 2, 2024-05-09T06:04:04.805 INFO:teuthology.orchestra.run.smithi100.stdout: "expos": 4194352, 2024-05-09T06:04:04.805 INFO:teuthology.orchestra.run.smithi100.stdout: "wrpos": 187315859, 2024-05-09T06:04:04.805 INFO:teuthology.orchestra.run.smithi100.stdout: "rdpos": 0, 2024-05-09T06:04:04.805 INFO:teuthology.orchestra.run.smithi100.stdout: "jlat": { 2024-05-09T06:04:04.805 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 29026, 2024-05-09T06:04:04.805 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 148.357419820, 2024-05-09T06:04:04.805 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.005111190 2024-05-09T06:04:04.805 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:04.805 INFO:teuthology.orchestra.run.smithi100.stdout: "replayed": 0 2024-05-09T06:04:04.805 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:04.805 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_mem": { 2024-05-09T06:04:04.806 INFO:teuthology.orchestra.run.smithi100.stdout: "ino": 23, 2024-05-09T06:04:04.806 INFO:teuthology.orchestra.run.smithi100.stdout: "ino+": 19147, 2024-05-09T06:04:04.806 INFO:teuthology.orchestra.run.smithi100.stdout: "ino-": 19124, 2024-05-09T06:04:04.806 INFO:teuthology.orchestra.run.smithi100.stdout: "dir": 30, 2024-05-09T06:04:04.806 INFO:teuthology.orchestra.run.smithi100.stdout: "dir+": 852, 2024-05-09T06:04:04.806 INFO:teuthology.orchestra.run.smithi100.stdout: "dir-": 822, 2024-05-09T06:04:04.806 INFO:teuthology.orchestra.run.smithi100.stdout: "dn": 36, 2024-05-09T06:04:04.806 INFO:teuthology.orchestra.run.smithi100.stdout: "dn+": 37368, 2024-05-09T06:04:04.806 INFO:teuthology.orchestra.run.smithi100.stdout: "dn-": 37332, 2024-05-09T06:04:04.806 INFO:teuthology.orchestra.run.smithi100.stdout: "cap": 0, 2024-05-09T06:04:04.806 INFO:teuthology.orchestra.run.smithi100.stdout: "cap+": 21130, 2024-05-09T06:04:04.806 INFO:teuthology.orchestra.run.smithi100.stdout: "cap-": 21130, 2024-05-09T06:04:04.807 INFO:teuthology.orchestra.run.smithi100.stdout: "rss": 144864, 2024-05-09T06:04:04.807 INFO:teuthology.orchestra.run.smithi100.stdout: "heap": 223632 2024-05-09T06:04:04.807 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:04.807 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_server": { 2024-05-09T06:04:04.807 INFO:teuthology.orchestra.run.smithi100.stdout: "dispatch_client_request": 261549, 2024-05-09T06:04:04.807 INFO:teuthology.orchestra.run.smithi100.stdout: "dispatch_server_request": 4209, 2024-05-09T06:04:04.807 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_client_request": 200022, 2024-05-09T06:04:04.807 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_client_session": 2213, 2024-05-09T06:04:04.807 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_peer_request": 13493, 2024-05-09T06:04:04.807 INFO:teuthology.orchestra.run.smithi100.stdout: "req_create_latency": { 2024-05-09T06:04:04.807 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 18872, 2024-05-09T06:04:04.807 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 174.292839465, 2024-05-09T06:04:04.807 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.009235525 2024-05-09T06:04:04.807 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:04.808 INFO:teuthology.orchestra.run.smithi100.stdout: "req_getattr_latency": { 2024-05-09T06:04:04.808 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 8952, 2024-05-09T06:04:04.808 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 84.366870683, 2024-05-09T06:04:04.808 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.009424359 2024-05-09T06:04:04.808 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:04.808 INFO:teuthology.orchestra.run.smithi100.stdout: "req_getfilelock_latency": { 2024-05-09T06:04:04.808 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-05-09T06:04:04.808 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-05-09T06:04:04.808 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-05-09T06:04:04.808 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:04.808 INFO:teuthology.orchestra.run.smithi100.stdout: "req_link_latency": { 2024-05-09T06:04:04.808 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-05-09T06:04:04.808 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-05-09T06:04:04.809 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-05-09T06:04:04.809 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:04.809 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookup_latency": { 2024-05-09T06:04:04.809 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 39680, 2024-05-09T06:04:04.809 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 21.997978586, 2024-05-09T06:04:04.809 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000554384 2024-05-09T06:04:04.809 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:04.809 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookuphash_latency": { 2024-05-09T06:04:04.809 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-05-09T06:04:04.809 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-05-09T06:04:04.809 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-05-09T06:04:04.809 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:04.809 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookupino_latency": { 2024-05-09T06:04:04.809 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-05-09T06:04:04.810 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-05-09T06:04:04.810 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-05-09T06:04:04.810 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:04.810 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookupname_latency": { 2024-05-09T06:04:04.810 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-05-09T06:04:04.810 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-05-09T06:04:04.810 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-05-09T06:04:04.810 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:04.810 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookupparent_latency": { 2024-05-09T06:04:04.810 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-05-09T06:04:04.810 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-05-09T06:04:04.810 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-05-09T06:04:04.810 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:04.810 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookupsnap_latency": { 2024-05-09T06:04:04.811 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-05-09T06:04:04.811 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-05-09T06:04:04.811 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-05-09T06:04:04.811 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:04.812 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lssnap_latency": { 2024-05-09T06:04:04.812 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-05-09T06:04:04.812 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-05-09T06:04:04.812 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-05-09T06:04:04.812 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:04.812 INFO:teuthology.orchestra.run.smithi100.stdout: "req_mkdir_latency": { 2024-05-09T06:04:04.812 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-05-09T06:04:04.812 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-05-09T06:04:04.812 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-05-09T06:04:04.812 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:04.812 INFO:teuthology.orchestra.run.smithi100.stdout: "req_mknod_latency": { 2024-05-09T06:04:04.812 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-05-09T06:04:04.812 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-05-09T06:04:04.813 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-05-09T06:04:04.813 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:04.813 INFO:teuthology.orchestra.run.smithi100.stdout: "req_mksnap_latency": { 2024-05-09T06:04:04.813 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-05-09T06:04:04.813 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-05-09T06:04:04.813 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-05-09T06:04:04.813 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:04.813 INFO:teuthology.orchestra.run.smithi100.stdout: "req_open_latency": { 2024-05-09T06:04:04.813 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-05-09T06:04:04.813 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-05-09T06:04:04.813 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-05-09T06:04:04.813 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:04.813 INFO:teuthology.orchestra.run.smithi100.stdout: "req_readdir_latency": { 2024-05-09T06:04:04.813 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 32848, 2024-05-09T06:04:04.814 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 90.728970307, 2024-05-09T06:04:04.814 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.002762085 2024-05-09T06:04:04.814 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:04.814 INFO:teuthology.orchestra.run.smithi100.stdout: "req_rename_latency": { 2024-05-09T06:04:04.814 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 3747, 2024-05-09T06:04:04.814 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 29.555525973, 2024-05-09T06:04:04.814 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.007887783 2024-05-09T06:04:04.814 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:04.814 INFO:teuthology.orchestra.run.smithi100.stdout: "req_renamesnap_latency": { 2024-05-09T06:04:04.814 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-05-09T06:04:04.814 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-05-09T06:04:04.814 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-05-09T06:04:04.814 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:04.815 INFO:teuthology.orchestra.run.smithi100.stdout: "req_snapdiff_latency": { 2024-05-09T06:04:04.815 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-05-09T06:04:04.815 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-05-09T06:04:04.815 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-05-09T06:04:04.815 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:04.815 INFO:teuthology.orchestra.run.smithi100.stdout: "req_rmdir_latency": { 2024-05-09T06:04:04.815 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 10, 2024-05-09T06:04:04.815 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.054946175, 2024-05-09T06:04:04.815 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.005494617 2024-05-09T06:04:04.815 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:04.815 INFO:teuthology.orchestra.run.smithi100.stdout: "req_rmsnap_latency": { 2024-05-09T06:04:04.815 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-05-09T06:04:04.815 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-05-09T06:04:04.815 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-05-09T06:04:04.816 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:04.816 INFO:teuthology.orchestra.run.smithi100.stdout: "req_rmxattr_latency": { 2024-05-09T06:04:04.816 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-05-09T06:04:04.816 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-05-09T06:04:04.816 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-05-09T06:04:04.816 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:04.816 INFO:teuthology.orchestra.run.smithi100.stdout: "req_setattr_latency": { 2024-05-09T06:04:04.816 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 5, 2024-05-09T06:04:04.816 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.045499855, 2024-05-09T06:04:04.816 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.009099971 2024-05-09T06:04:04.816 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:04.816 INFO:teuthology.orchestra.run.smithi100.stdout: "req_setdirlayout_latency": { 2024-05-09T06:04:04.816 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-05-09T06:04:04.816 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-05-09T06:04:04.817 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-05-09T06:04:04.817 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:04.817 INFO:teuthology.orchestra.run.smithi100.stdout: "req_setfilelock_latency": { 2024-05-09T06:04:04.817 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 592, 2024-05-09T06:04:04.817 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.490469542, 2024-05-09T06:04:04.817 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000828495 2024-05-09T06:04:04.817 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:04.817 INFO:teuthology.orchestra.run.smithi100.stdout: "req_setlayout_latency": { 2024-05-09T06:04:04.817 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-05-09T06:04:04.818 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-05-09T06:04:04.818 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-05-09T06:04:04.818 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:04.818 INFO:teuthology.orchestra.run.smithi100.stdout: "req_setxattr_latency": { 2024-05-09T06:04:04.818 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-05-09T06:04:04.818 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-05-09T06:04:04.818 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-05-09T06:04:04.818 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:04.818 INFO:teuthology.orchestra.run.smithi100.stdout: "req_symlink_latency": { 2024-05-09T06:04:04.818 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-05-09T06:04:04.818 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-05-09T06:04:04.818 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-05-09T06:04:04.818 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:04.819 INFO:teuthology.orchestra.run.smithi100.stdout: "req_unlink_latency": { 2024-05-09T06:04:04.819 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 18950, 2024-05-09T06:04:04.819 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 56.715611372, 2024-05-09T06:04:04.819 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.002992908 2024-05-09T06:04:04.819 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:04.819 INFO:teuthology.orchestra.run.smithi100.stdout: "cap_revoke_eviction": 0, 2024-05-09T06:04:04.819 INFO:teuthology.orchestra.run.smithi100.stdout: "cap_acquisition_throttle": 0, 2024-05-09T06:04:04.819 INFO:teuthology.orchestra.run.smithi100.stdout: "req_getvxattr_latency": { 2024-05-09T06:04:04.819 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-05-09T06:04:04.819 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-05-09T06:04:04.819 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-05-09T06:04:04.819 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-05-09T06:04:04.819 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:04.819 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_sessions": { 2024-05-09T06:04:04.820 INFO:teuthology.orchestra.run.smithi100.stdout: "session_count": 1, 2024-05-09T06:04:04.820 INFO:teuthology.orchestra.run.smithi100.stdout: "session_add": 1, 2024-05-09T06:04:04.820 INFO:teuthology.orchestra.run.smithi100.stdout: "session_remove": 0, 2024-05-09T06:04:04.820 INFO:teuthology.orchestra.run.smithi100.stdout: "sessions_open": 1, 2024-05-09T06:04:04.820 INFO:teuthology.orchestra.run.smithi100.stdout: "sessions_stale": 0, 2024-05-09T06:04:04.820 INFO:teuthology.orchestra.run.smithi100.stdout: "total_load": 13484, 2024-05-09T06:04:04.820 INFO:teuthology.orchestra.run.smithi100.stdout: "average_load": 13484, 2024-05-09T06:04:04.820 INFO:teuthology.orchestra.run.smithi100.stdout: "avg_session_uptime": 1480, 2024-05-09T06:04:04.820 INFO:teuthology.orchestra.run.smithi100.stdout: "mdthresh_evicted": 0 2024-05-09T06:04:04.820 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:04.820 INFO:teuthology.orchestra.run.smithi100.stdout: "mempool": { 2024-05-09T06:04:04.820 INFO:teuthology.orchestra.run.smithi100.stdout: "bloom_filter_bytes": 0, 2024-05-09T06:04:04.820 INFO:teuthology.orchestra.run.smithi100.stdout: "bloom_filter_items": 0, 2024-05-09T06:04:04.821 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_alloc_bytes": 0, 2024-05-09T06:04:04.821 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_alloc_items": 0, 2024-05-09T06:04:04.821 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_data_bytes": 0, 2024-05-09T06:04:04.821 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_data_items": 0, 2024-05-09T06:04:04.821 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-09T06:04:04.821 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_onode_items": 0, 2024-05-09T06:04:04.821 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-09T06:04:04.821 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_meta_items": 0, 2024-05-09T06:04:04.821 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_other_bytes": 0, 2024-05-09T06:04:04.821 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_other_items": 0, 2024-05-09T06:04:04.821 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-09T06:04:04.821 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_buffer_items": 0, 2024-05-09T06:04:04.821 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_extent_bytes": 0, 2024-05-09T06:04:04.822 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_extent_items": 0, 2024-05-09T06:04:04.822 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_blob_bytes": 0, 2024-05-09T06:04:04.822 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_blob_items": 0, 2024-05-09T06:04:04.822 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-09T06:04:04.822 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_shared_blob_items": 0, 2024-05-09T06:04:04.822 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-09T06:04:04.822 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_inline_bl_items": 0, 2024-05-09T06:04:04.822 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_fsck_bytes": 0, 2024-05-09T06:04:04.822 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_fsck_items": 0, 2024-05-09T06:04:04.822 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_txc_bytes": 0, 2024-05-09T06:04:04.822 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_txc_items": 0, 2024-05-09T06:04:04.822 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-09T06:04:04.822 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_deferred_items": 0, 2024-05-09T06:04:04.822 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_bytes": 0, 2024-05-09T06:04:04.823 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_items": 0, 2024-05-09T06:04:04.823 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_bytes": 0, 2024-05-09T06:04:04.823 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_items": 0, 2024-05-09T06:04:04.823 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_reader_bytes": 0, 2024-05-09T06:04:04.823 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_reader_items": 0, 2024-05-09T06:04:04.823 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_writer_bytes": 0, 2024-05-09T06:04:04.823 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_writer_items": 0, 2024-05-09T06:04:04.823 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_anon_bytes": 293857, 2024-05-09T06:04:04.823 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_anon_items": 123, 2024-05-09T06:04:04.823 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_meta_bytes": 176, 2024-05-09T06:04:04.823 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_meta_items": 2, 2024-05-09T06:04:04.823 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_bytes": 0, 2024-05-09T06:04:04.823 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_items": 0, 2024-05-09T06:04:04.823 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_mapbl_bytes": 0, 2024-05-09T06:04:04.824 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_mapbl_items": 0, 2024-05-09T06:04:04.824 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_pglog_bytes": 0, 2024-05-09T06:04:04.824 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_pglog_items": 0, 2024-05-09T06:04:04.824 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_bytes": 7528, 2024-05-09T06:04:04.824 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_items": 158, 2024-05-09T06:04:04.824 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_mapping_bytes": 0, 2024-05-09T06:04:04.824 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_mapping_items": 0, 2024-05-09T06:04:04.824 INFO:teuthology.orchestra.run.smithi100.stdout: "pgmap_bytes": 0, 2024-05-09T06:04:04.824 INFO:teuthology.orchestra.run.smithi100.stdout: "pgmap_items": 0, 2024-05-09T06:04:04.824 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_co_bytes": 119346, 2024-05-09T06:04:04.824 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_co_items": 889, 2024-05-09T06:04:04.824 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_1_bytes": 0, 2024-05-09T06:04:04.824 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_1_items": 0, 2024-05-09T06:04:04.824 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_2_bytes": 0, 2024-05-09T06:04:04.825 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_2_items": 0 2024-05-09T06:04:04.825 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:04.825 INFO:teuthology.orchestra.run.smithi100.stdout: "objecter": { 2024-05-09T06:04:04.825 INFO:teuthology.orchestra.run.smithi100.stdout: "op_active": 0, 2024-05-09T06:04:04.825 INFO:teuthology.orchestra.run.smithi100.stdout: "op_laggy": 0, 2024-05-09T06:04:04.825 INFO:teuthology.orchestra.run.smithi100.stdout: "op_send": 50533, 2024-05-09T06:04:04.825 INFO:teuthology.orchestra.run.smithi100.stdout: "op_send_bytes": 187181787, 2024-05-09T06:04:04.825 INFO:teuthology.orchestra.run.smithi100.stdout: "op_resend": 28, 2024-05-09T06:04:04.825 INFO:teuthology.orchestra.run.smithi100.stdout: "op_reply": 50533, 2024-05-09T06:04:04.825 INFO:teuthology.orchestra.run.smithi100.stdout: "op_latency": { 2024-05-09T06:04:04.825 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 50533, 2024-05-09T06:04:04.825 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 274.830266345, 2024-05-09T06:04:04.825 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.005438629 2024-05-09T06:04:04.825 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:04.825 INFO:teuthology.orchestra.run.smithi100.stdout: "op_inflight": 0, 2024-05-09T06:04:04.826 INFO:teuthology.orchestra.run.smithi100.stdout: "oplen_avg": { 2024-05-09T06:04:04.826 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 50533, 2024-05-09T06:04:04.826 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 51698 2024-05-09T06:04:04.826 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:04.826 INFO:teuthology.orchestra.run.smithi100.stdout: "op": 50533, 2024-05-09T06:04:04.826 INFO:teuthology.orchestra.run.smithi100.stdout: "op_r": 672, 2024-05-09T06:04:04.826 INFO:teuthology.orchestra.run.smithi100.stdout: "op_w": 49861, 2024-05-09T06:04:04.826 INFO:teuthology.orchestra.run.smithi100.stdout: "op_rmw": 0, 2024-05-09T06:04:04.826 INFO:teuthology.orchestra.run.smithi100.stdout: "op_pg": 0, 2024-05-09T06:04:04.826 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_stat": 0, 2024-05-09T06:04:04.826 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_create": 45, 2024-05-09T06:04:04.826 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_read": 672, 2024-05-09T06:04:04.826 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_write": 29698, 2024-05-09T06:04:04.826 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_writefull": 365, 2024-05-09T06:04:04.827 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_writesame": 0, 2024-05-09T06:04:04.827 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_append": 0, 2024-05-09T06:04:04.827 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_zero": 0, 2024-05-09T06:04:04.827 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_truncate": 0, 2024-05-09T06:04:04.827 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_delete": 19013, 2024-05-09T06:04:04.827 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_mapext": 0, 2024-05-09T06:04:04.827 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_sparse_read": 0, 2024-05-09T06:04:04.827 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_clonerange": 0, 2024-05-09T06:04:04.827 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_getxattr": 0, 2024-05-09T06:04:04.827 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_setxattr": 90, 2024-05-09T06:04:04.827 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_cmpxattr": 0, 2024-05-09T06:04:04.827 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_rmxattr": 0, 2024-05-09T06:04:04.827 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_resetxattrs": 0, 2024-05-09T06:04:04.827 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_call": 0, 2024-05-09T06:04:04.827 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_watch": 0, 2024-05-09T06:04:04.828 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_notify": 0, 2024-05-09T06:04:04.828 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_src_cmpxattr": 0, 2024-05-09T06:04:04.828 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_pgls": 0, 2024-05-09T06:04:04.828 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_pgls_filter": 0, 2024-05-09T06:04:04.828 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_other": 0, 2024-05-09T06:04:04.828 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_active": 0, 2024-05-09T06:04:04.828 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_send": 0, 2024-05-09T06:04:04.828 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_resend": 0, 2024-05-09T06:04:04.828 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_ping": 0, 2024-05-09T06:04:04.828 INFO:teuthology.orchestra.run.smithi100.stdout: "poolop_active": 0, 2024-05-09T06:04:04.828 INFO:teuthology.orchestra.run.smithi100.stdout: "poolop_send": 0, 2024-05-09T06:04:04.828 INFO:teuthology.orchestra.run.smithi100.stdout: "poolop_resend": 0, 2024-05-09T06:04:04.828 INFO:teuthology.orchestra.run.smithi100.stdout: "poolstat_active": 0, 2024-05-09T06:04:04.828 INFO:teuthology.orchestra.run.smithi100.stdout: "poolstat_send": 0, 2024-05-09T06:04:04.828 INFO:teuthology.orchestra.run.smithi100.stdout: "poolstat_resend": 0, 2024-05-09T06:04:04.829 INFO:teuthology.orchestra.run.smithi100.stdout: "statfs_active": 0, 2024-05-09T06:04:04.829 INFO:teuthology.orchestra.run.smithi100.stdout: "statfs_send": 0, 2024-05-09T06:04:04.829 INFO:teuthology.orchestra.run.smithi100.stdout: "statfs_resend": 0, 2024-05-09T06:04:04.829 INFO:teuthology.orchestra.run.smithi100.stdout: "command_active": 0, 2024-05-09T06:04:04.829 INFO:teuthology.orchestra.run.smithi100.stdout: "command_send": 0, 2024-05-09T06:04:04.829 INFO:teuthology.orchestra.run.smithi100.stdout: "command_resend": 0, 2024-05-09T06:04:04.829 INFO:teuthology.orchestra.run.smithi100.stdout: "map_epoch": 83, 2024-05-09T06:04:04.829 INFO:teuthology.orchestra.run.smithi100.stdout: "map_full": 0, 2024-05-09T06:04:04.829 INFO:teuthology.orchestra.run.smithi100.stdout: "map_inc": 2, 2024-05-09T06:04:04.829 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_sessions": 12, 2024-05-09T06:04:04.829 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_session_open": 15, 2024-05-09T06:04:04.829 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_session_close": 3, 2024-05-09T06:04:04.829 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_laggy": 0, 2024-05-09T06:04:04.829 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_wr": 1436, 2024-05-09T06:04:04.830 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_rd": 0, 2024-05-09T06:04:04.830 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_del": 379 2024-05-09T06:04:04.830 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:04.830 INFO:teuthology.orchestra.run.smithi100.stdout: "oft": { 2024-05-09T06:04:04.830 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_total_objs": 1, 2024-05-09T06:04:04.830 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_total_kv_pairs": 0, 2024-05-09T06:04:04.830 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_total_updates": 0, 2024-05-09T06:04:04.830 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_total_removes": 0 2024-05-09T06:04:04.830 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:04.830 INFO:teuthology.orchestra.run.smithi100.stdout: "osd-slow-ops": { 2024-05-09T06:04:04.830 INFO:teuthology.orchestra.run.smithi100.stdout: "slow_ops_count": 0 2024-05-09T06:04:04.830 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:04.831 INFO:teuthology.orchestra.run.smithi100.stdout: "purge_queue": { 2024-05-09T06:04:04.831 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executing_ops": 0, 2024-05-09T06:04:04.831 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executing_ops_high_water": 10, 2024-05-09T06:04:04.831 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executing": 0, 2024-05-09T06:04:04.831 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executing_high_water": 10, 2024-05-09T06:04:04.831 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executed_ops": 18958, 2024-05-09T06:04:04.831 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executed": 18958, 2024-05-09T06:04:04.831 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_item_in_journal": 0 2024-05-09T06:04:04.831 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:04.831 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-09T06:04:04.831 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-05-09T06:04:04.831 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 104857600, 2024-05-09T06:04:04.831 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-05-09T06:04:04.831 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 836266, 2024-05-09T06:04:04.831 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 154518431, 2024-05-09T06:04:04.831 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-05-09T06:04:04.832 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 836266, 2024-05-09T06:04:04.832 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 0, 2024-05-09T06:04:04.832 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 0, 2024-05-09T06:04:04.832 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 836266, 2024-05-09T06:04:04.832 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 154518431, 2024-05-09T06:04:04.832 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-05-09T06:04:04.832 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-05-09T06:04:04.832 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-05-09T06:04:04.832 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-05-09T06:04:04.832 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-05-09T06:04:04.832 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:04.832 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-objecter_bytes": { 2024-05-09T06:04:04.832 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-05-09T06:04:04.832 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 104857600, 2024-05-09T06:04:04.833 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-05-09T06:04:04.833 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 0, 2024-05-09T06:04:04.833 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 0, 2024-05-09T06:04:04.833 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-05-09T06:04:04.833 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 0, 2024-05-09T06:04:04.833 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 50533, 2024-05-09T06:04:04.833 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 189096545, 2024-05-09T06:04:04.833 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 50533, 2024-05-09T06:04:04.833 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 189096545, 2024-05-09T06:04:04.833 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-05-09T06:04:04.833 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-05-09T06:04:04.833 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-05-09T06:04:04.833 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-05-09T06:04:04.833 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-05-09T06:04:04.834 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:04.834 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-objecter_ops": { 2024-05-09T06:04:04.834 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-05-09T06:04:04.834 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 1024, 2024-05-09T06:04:04.834 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-05-09T06:04:04.834 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 0, 2024-05-09T06:04:04.834 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 0, 2024-05-09T06:04:04.834 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-05-09T06:04:04.834 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 0, 2024-05-09T06:04:04.834 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 50533, 2024-05-09T06:04:04.834 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 50533, 2024-05-09T06:04:04.834 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 50533, 2024-05-09T06:04:04.834 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 50533, 2024-05-09T06:04:04.834 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-05-09T06:04:04.835 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-05-09T06:04:04.835 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-05-09T06:04:04.835 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-05-09T06:04:04.835 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-05-09T06:04:04.835 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:04.835 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-write_buf_throttle": { 2024-05-09T06:04:04.835 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-05-09T06:04:04.835 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 3758096384, 2024-05-09T06:04:04.835 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-05-09T06:04:04.835 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 18958, 2024-05-09T06:04:04.835 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 1914758, 2024-05-09T06:04:04.835 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-05-09T06:04:04.835 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 18958, 2024-05-09T06:04:04.835 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 0, 2024-05-09T06:04:04.835 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 0, 2024-05-09T06:04:04.836 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 672, 2024-05-09T06:04:04.836 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 1914758, 2024-05-09T06:04:04.836 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-05-09T06:04:04.836 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-05-09T06:04:04.836 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-05-09T06:04:04.836 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-05-09T06:04:04.836 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-05-09T06:04:04.836 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:04.836 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-write_buf_throttle-0x55c234a6c680": { 2024-05-09T06:04:04.836 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-05-09T06:04:04.836 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 3758096384, 2024-05-09T06:04:04.836 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-05-09T06:04:04.836 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 93909, 2024-05-09T06:04:04.836 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 183121555, 2024-05-09T06:04:04.836 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-05-09T06:04:04.837 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 93909, 2024-05-09T06:04:04.837 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 0, 2024-05-09T06:04:04.837 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 0, 2024-05-09T06:04:04.837 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 29026, 2024-05-09T06:04:04.837 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 183121555, 2024-05-09T06:04:04.837 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-05-09T06:04:04.837 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-05-09T06:04:04.837 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-05-09T06:04:04.837 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-05-09T06:04:04.837 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-05-09T06:04:04.837 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-05-09T06:04:04.837 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-05-09T06:04:05.538 INFO:tasks.check_counter:Daemon mds.i mds.exported=4 2024-05-09T06:04:05.538 INFO:tasks.check_counter:Daemon mds.i mds.imported=5 2024-05-09T06:04:05.538 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=267 2024-05-09T06:04:05.538 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=1719 2024-05-09T06:04:05.538 DEBUG:tasks.check_counter:Getting stats from l 2024-05-09T06:04:05.538 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph daemon mds.l perf dump 2024-05-09T06:04:05.778 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.c/config 2024-05-09T06:04:06.038 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:04:05 smithi060 ceph-mon[34555]: pgmap v1171: 97 pgs: 97 active+clean; 479 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 1.5 MiB/s wr, 71 op/s 2024-05-09T06:04:06.067 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:04:05 smithi100 ceph-mon[34353]: pgmap v1171: 97 pgs: 97 active+clean; 479 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 1.5 MiB/s wr, 71 op/s 2024-05-09T06:04:06.102 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:04:05 smithi039 ceph-mon[30439]: pgmap v1171: 97 pgs: 97 active+clean; 479 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 1.5 MiB/s wr, 71 op/s 2024-05-09T06:04:07.588 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-05-09T06:04:07.588 INFO:teuthology.orchestra.run.smithi100.stdout: "AsyncMessenger::Worker-0": { 2024-05-09T06:04:07.588 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_messages": 487, 2024-05-09T06:04:07.588 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages": 480, 2024-05-09T06:04:07.588 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_bytes": 891888, 2024-05-09T06:04:07.588 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_bytes": 296256, 2024-05-09T06:04:07.588 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_created_connections": 4, 2024-05-09T06:04:07.588 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_active_connections": 0, 2024-05-09T06:04:07.589 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_total_time": 0.063834660, 2024-05-09T06:04:07.589 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_send_time": 0.023067076, 2024-05-09T06:04:07.589 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_recv_time": 0.030706041, 2024-05-09T06:04:07.589 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_fast_dispatch_time": 0.009867047, 2024-05-09T06:04:07.589 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T06:04:07.589 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 480, 2024-05-09T06:04:07.589 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.019479845, 2024-05-09T06:04:07.589 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000040583 2024-05-09T06:04:07.589 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:07.589 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_handle_ack_lat": { 2024-05-09T06:04:07.589 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-05-09T06:04:07.589 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-05-09T06:04:07.589 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-05-09T06:04:07.589 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:07.590 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_encrypted_bytes": 891888, 2024-05-09T06:04:07.590 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_encrypted_bytes": 296256 2024-05-09T06:04:07.590 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:07.590 INFO:teuthology.orchestra.run.smithi100.stdout: "AsyncMessenger::Worker-1": { 2024-05-09T06:04:07.590 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_messages": 3, 2024-05-09T06:04:07.590 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages": 366, 2024-05-09T06:04:07.590 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_bytes": 480, 2024-05-09T06:04:07.590 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_bytes": 301040, 2024-05-09T06:04:07.590 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_created_connections": 5, 2024-05-09T06:04:07.590 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_active_connections": 2, 2024-05-09T06:04:07.590 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_total_time": 0.016359176, 2024-05-09T06:04:07.590 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_send_time": 0.012092002, 2024-05-09T06:04:07.590 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_recv_time": 0.001480418, 2024-05-09T06:04:07.591 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-09T06:04:07.591 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T06:04:07.591 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 364, 2024-05-09T06:04:07.591 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.015370805, 2024-05-09T06:04:07.591 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000042227 2024-05-09T06:04:07.591 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:07.591 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_handle_ack_lat": { 2024-05-09T06:04:07.591 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-05-09T06:04:07.591 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-05-09T06:04:07.591 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-05-09T06:04:07.591 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:07.591 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_encrypted_bytes": 480, 2024-05-09T06:04:07.591 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_encrypted_bytes": 301040 2024-05-09T06:04:07.591 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:07.591 INFO:teuthology.orchestra.run.smithi100.stdout: "AsyncMessenger::Worker-2": { 2024-05-09T06:04:07.592 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_messages": 0, 2024-05-09T06:04:07.592 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages": 2, 2024-05-09T06:04:07.592 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_bytes": 0, 2024-05-09T06:04:07.592 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_bytes": 0, 2024-05-09T06:04:07.592 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_created_connections": 2, 2024-05-09T06:04:07.592 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_active_connections": 1, 2024-05-09T06:04:07.592 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_total_time": 0.000407172, 2024-05-09T06:04:07.592 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_send_time": 0.000000000, 2024-05-09T06:04:07.592 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_recv_time": 0.000323151, 2024-05-09T06:04:07.592 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-09T06:04:07.592 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T06:04:07.592 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-05-09T06:04:07.592 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-05-09T06:04:07.592 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-05-09T06:04:07.592 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:07.593 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_handle_ack_lat": { 2024-05-09T06:04:07.593 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-05-09T06:04:07.593 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-05-09T06:04:07.593 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-05-09T06:04:07.593 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:07.593 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-09T06:04:07.593 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_encrypted_bytes": 0 2024-05-09T06:04:07.593 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:07.593 INFO:teuthology.orchestra.run.smithi100.stdout: "cct": { 2024-05-09T06:04:07.593 INFO:teuthology.orchestra.run.smithi100.stdout: "total_workers": 0, 2024-05-09T06:04:07.593 INFO:teuthology.orchestra.run.smithi100.stdout: "unhealthy_workers": 0 2024-05-09T06:04:07.593 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:07.593 INFO:teuthology.orchestra.run.smithi100.stdout: "mempool": { 2024-05-09T06:04:07.593 INFO:teuthology.orchestra.run.smithi100.stdout: "bloom_filter_bytes": 0, 2024-05-09T06:04:07.594 INFO:teuthology.orchestra.run.smithi100.stdout: "bloom_filter_items": 0, 2024-05-09T06:04:07.594 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_alloc_bytes": 0, 2024-05-09T06:04:07.594 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_alloc_items": 0, 2024-05-09T06:04:07.594 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_data_bytes": 0, 2024-05-09T06:04:07.594 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_data_items": 0, 2024-05-09T06:04:07.594 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-09T06:04:07.594 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_onode_items": 0, 2024-05-09T06:04:07.594 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-09T06:04:07.594 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_meta_items": 0, 2024-05-09T06:04:07.594 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_other_bytes": 0, 2024-05-09T06:04:07.594 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_other_items": 0, 2024-05-09T06:04:07.594 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-09T06:04:07.594 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_buffer_items": 0, 2024-05-09T06:04:07.595 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_extent_bytes": 0, 2024-05-09T06:04:07.595 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_extent_items": 0, 2024-05-09T06:04:07.595 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_blob_bytes": 0, 2024-05-09T06:04:07.595 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_blob_items": 0, 2024-05-09T06:04:07.595 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-09T06:04:07.595 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_shared_blob_items": 0, 2024-05-09T06:04:07.595 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-09T06:04:07.595 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_inline_bl_items": 0, 2024-05-09T06:04:07.595 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_fsck_bytes": 0, 2024-05-09T06:04:07.595 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_fsck_items": 0, 2024-05-09T06:04:07.595 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_txc_bytes": 0, 2024-05-09T06:04:07.595 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_txc_items": 0, 2024-05-09T06:04:07.595 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-09T06:04:07.596 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_deferred_items": 0, 2024-05-09T06:04:07.596 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_bytes": 0, 2024-05-09T06:04:07.596 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_items": 0, 2024-05-09T06:04:07.596 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_bytes": 0, 2024-05-09T06:04:07.596 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_items": 0, 2024-05-09T06:04:07.596 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_reader_bytes": 0, 2024-05-09T06:04:07.596 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_reader_items": 0, 2024-05-09T06:04:07.596 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_writer_bytes": 0, 2024-05-09T06:04:07.596 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_writer_items": 0, 2024-05-09T06:04:07.596 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_anon_bytes": 148951, 2024-05-09T06:04:07.596 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_anon_items": 28, 2024-05-09T06:04:07.596 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_meta_bytes": 0, 2024-05-09T06:04:07.596 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_meta_items": 0, 2024-05-09T06:04:07.596 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_bytes": 0, 2024-05-09T06:04:07.597 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_items": 0, 2024-05-09T06:04:07.597 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_mapbl_bytes": 0, 2024-05-09T06:04:07.597 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_mapbl_items": 0, 2024-05-09T06:04:07.597 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_pglog_bytes": 0, 2024-05-09T06:04:07.597 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_pglog_items": 0, 2024-05-09T06:04:07.597 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_bytes": 0, 2024-05-09T06:04:07.597 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_items": 0, 2024-05-09T06:04:07.597 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_mapping_bytes": 0, 2024-05-09T06:04:07.597 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_mapping_items": 0, 2024-05-09T06:04:07.597 INFO:teuthology.orchestra.run.smithi100.stdout: "pgmap_bytes": 0, 2024-05-09T06:04:07.597 INFO:teuthology.orchestra.run.smithi100.stdout: "pgmap_items": 0, 2024-05-09T06:04:07.597 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_co_bytes": 928, 2024-05-09T06:04:07.598 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_co_items": 2, 2024-05-09T06:04:07.598 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_1_bytes": 0, 2024-05-09T06:04:07.598 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_1_items": 0, 2024-05-09T06:04:07.598 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_2_bytes": 0, 2024-05-09T06:04:07.598 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_2_items": 0 2024-05-09T06:04:07.598 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-05-09T06:04:07.598 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-09T06:04:07.598 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-05-09T06:04:07.598 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 104857600, 2024-05-09T06:04:07.598 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-05-09T06:04:07.598 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 486, 2024-05-09T06:04:07.598 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 820549, 2024-05-09T06:04:07.599 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-05-09T06:04:07.599 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 486, 2024-05-09T06:04:07.599 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 0, 2024-05-09T06:04:07.599 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 0, 2024-05-09T06:04:07.599 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 486, 2024-05-09T06:04:07.599 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 820549, 2024-05-09T06:04:07.599 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-05-09T06:04:07.599 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-05-09T06:04:07.599 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-05-09T06:04:07.599 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-05-09T06:04:07.599 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-05-09T06:04:07.599 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-05-09T06:04:07.599 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-05-09T06:04:07.916 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:04:07 smithi100 ceph-mon[34353]: pgmap v1172: 97 pgs: 97 active+clean; 479 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 1010 KiB/s wr, 50 op/s 2024-05-09T06:04:08.038 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:04:07 smithi060 ceph-mon[34555]: pgmap v1172: 97 pgs: 97 active+clean; 479 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 1010 KiB/s wr, 50 op/s 2024-05-09T06:04:08.102 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:04:07 smithi039 ceph-mon[30439]: pgmap v1172: 97 pgs: 97 active+clean; 479 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 1010 KiB/s wr, 50 op/s 2024-05-09T06:04:08.259 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.l 2024-05-09T06:04:08.260 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.l 2024-05-09T06:04:08.260 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.l 2024-05-09T06:04:08.260 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.l 2024-05-09T06:04:08.260 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-05-09T06:04:08.269 INFO:tasks.kclient:Unmounting kernel clients... 2024-05-09T06:04:08.270 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-05-09T06:04:08.270 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-09T06:04:08.293 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-05-09T06:04:08.293 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-09T06:04:08.356 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph osd blocklist ls 2024-05-09T06:04:08.663 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T06:04:09.878 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:04:09 smithi039 ceph-mon[30439]: pgmap v1173: 97 pgs: 97 active+clean; 479 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 470 KiB/s wr, 28 op/s 2024-05-09T06:04:10.038 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:04:09 smithi060 ceph-mon[34555]: pgmap v1173: 97 pgs: 97 active+clean; 479 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 470 KiB/s wr, 28 op/s 2024-05-09T06:04:10.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:10.122+0000 7fb72dd11700 1 -- 172.21.15.39:0/1957393038 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb728108740 msgr2=0x7fb7281100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:04:10.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:10.122+0000 7fb72dd11700 1 --2- 172.21.15.39:0/1957393038 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb728108740 0x7fb7281100a0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fb72000b0d0 tx=0x7fb72000b3e0 comp rx=0 tx=0).stop 2024-05-09T06:04:10.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:10.122+0000 7fb72dd11700 1 -- 172.21.15.39:0/1957393038 shutdown_connections 2024-05-09T06:04:10.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:10.122+0000 7fb72dd11700 1 --2- 172.21.15.39:0/1957393038 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb728108740 0x7fb7281100a0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:04:10.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:10.122+0000 7fb72dd11700 1 --2- 172.21.15.39:0/1957393038 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7281034c0 0x7fb7281038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:04:10.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:10.122+0000 7fb72dd11700 1 --2- 172.21.15.39:0/1957393038 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb728107df0 0x7fb728108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:04:10.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:10.122+0000 7fb72dd11700 1 -- 172.21.15.39:0/1957393038 >> 172.21.15.39:0/1957393038 conn(0x7fb7280fedf0 msgr2=0x7fb728101210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:04:10.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:10.122+0000 7fb72dd11700 1 -- 172.21.15.39:0/1957393038 shutdown_connections 2024-05-09T06:04:10.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:10.122+0000 7fb72dd11700 1 -- 172.21.15.39:0/1957393038 wait complete. 2024-05-09T06:04:10.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:10.123+0000 7fb72dd11700 1 Processor -- start 2024-05-09T06:04:10.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:10.123+0000 7fb72dd11700 1 -- start start 2024-05-09T06:04:10.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:10.123+0000 7fb72dd11700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7281034c0 0x7fb72819ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:04:10.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:10.124+0000 7fb72dd11700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb728107df0 0x7fb72819b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:04:10.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:10.124+0000 7fb72dd11700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb728108740 0x7fb72819f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:04:10.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:10.124+0000 7fb72dd11700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fb7281144c0 con 0x7fb728108740 2024-05-09T06:04:10.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:10.124+0000 7fb72dd11700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb728114340 con 0x7fb728107df0 2024-05-09T06:04:10.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:10.124+0000 7fb72dd11700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb728114640 con 0x7fb7281034c0 2024-05-09T06:04:10.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:10.124+0000 7fb727fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb728108740 0x7fb72819f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:04:10.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:10.124+0000 7fb727fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb728108740 0x7fb72819f5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43148/0 (socket says 172.21.15.39:43148) 2024-05-09T06:04:10.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:10.124+0000 7fb727fff700 1 -- 172.21.15.39:0/404735703 learned_addr learned my addr 172.21.15.39:0/404735703 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T06:04:10.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:10.124+0000 7fb726ffd700 1 --2- 172.21.15.39:0/404735703 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb728107df0 0x7fb72819b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:04:10.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:10.124+0000 7fb7277fe700 1 --2- 172.21.15.39:0/404735703 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7281034c0 0x7fb72819ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:04:10.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:10.124+0000 7fb727fff700 1 -- 172.21.15.39:0/404735703 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7281034c0 msgr2=0x7fb72819ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:04:10.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:10.124+0000 7fb727fff700 1 --2- 172.21.15.39:0/404735703 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7281034c0 0x7fb72819ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:04:10.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:10.124+0000 7fb727fff700 1 -- 172.21.15.39:0/404735703 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb728107df0 msgr2=0x7fb72819b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:04:10.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:10.124+0000 7fb727fff700 1 --2- 172.21.15.39:0/404735703 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb728107df0 0x7fb72819b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:04:10.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:10.124+0000 7fb727fff700 1 -- 172.21.15.39:0/404735703 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb72819fc60 con 0x7fb728108740 2024-05-09T06:04:10.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:10.124+0000 7fb727fff700 1 --2- 172.21.15.39:0/404735703 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb728108740 0x7fb72819f5c0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fb7200095c0 tx=0x7fb720007a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:04:10.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:10.124+0000 7fb724ff9700 1 -- 172.21.15.39:0/404735703 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb72001f070 con 0x7fb728108740 2024-05-09T06:04:10.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:10.125+0000 7fb72dd11700 1 -- 172.21.15.39:0/404735703 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb72819fef0 con 0x7fb728108740 2024-05-09T06:04:10.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:10.125+0000 7fb724ff9700 1 -- 172.21.15.39:0/404735703 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb720007e20 con 0x7fb728108740 2024-05-09T06:04:10.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:10.125+0000 7fb724ff9700 1 -- 172.21.15.39:0/404735703 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb72001b4a0 con 0x7fb728108740 2024-05-09T06:04:10.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:10.125+0000 7fb72dd11700 1 -- 172.21.15.39:0/404735703 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7281a03d0 con 0x7fb728108740 2024-05-09T06:04:10.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:10.126+0000 7fb72dd11700 1 -- 172.21.15.39:0/404735703 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7280512c0 con 0x7fb728108740 2024-05-09T06:04:10.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:10.127+0000 7fb724ff9700 1 -- 172.21.15.39:0/404735703 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7fb720022070 con 0x7fb728108740 2024-05-09T06:04:10.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:10.128+0000 7fb724ff9700 1 --2- 172.21.15.39:0/404735703 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fb7100b2880 0x7fb7100b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:04:10.115 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:10.129+0000 7fb7277fe700 1 --2- 172.21.15.39:0/404735703 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fb7100b2880 0x7fb7100b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:04:10.115 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:10.129+0000 7fb724ff9700 1 -- 172.21.15.39:0/404735703 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7fb72000f020 con 0x7fb728108740 2024-05-09T06:04:10.115 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:10.129+0000 7fb7277fe700 1 --2- 172.21.15.39:0/404735703 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fb7100b2880 0x7fb7100b4d90 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fb718005950 tx=0x7fb71800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:04:10.118 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:10.132+0000 7fb724ff9700 1 -- 172.21.15.39:0/404735703 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fb720029020 con 0x7fb728108740 2024-05-09T06:04:10.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:04:09 smithi100 ceph-mon[34353]: pgmap v1173: 97 pgs: 97 active+clean; 479 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 470 KiB/s wr, 28 op/s 2024-05-09T06:04:10.349 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:10.363+0000 7fb72dd11700 1 -- 172.21.15.39:0/404735703 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fb72802e5f0 con 0x7fb728108740 2024-05-09T06:04:10.349 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:10.363+0000 7fb724ff9700 1 -- 172.21.15.39:0/404735703 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v83) ==== 81+0+588 (secure 0 0 0) 0x7fb7200ab590 con 0x7fb728108740 2024-05-09T06:04:10.350 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.15.39:6801/4091500272 2024-05-10T05:27:28.034010+0000 2024-05-09T06:04:10.350 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.15.39:6800/4091500272 2024-05-10T05:27:28.034010+0000 2024-05-09T06:04:10.350 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.15.39:0/782312916 2024-05-10T05:27:28.034010+0000 2024-05-09T06:04:10.350 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.15.39:0/1899316433 2024-05-10T05:27:28.034010+0000 2024-05-09T06:04:10.350 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.15.39:0/1613215795 2024-05-10T05:27:00.650123+0000 2024-05-09T06:04:10.350 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.15.39:0/2870431271 2024-05-10T05:27:00.650123+0000 2024-05-09T06:04:10.350 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.15.39:0/438945726 2024-05-10T05:27:00.650123+0000 2024-05-09T06:04:10.350 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.15.39:6800/499609328 2024-05-10T05:27:00.650123+0000 2024-05-09T06:04:10.350 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.15.39:6801/499609328 2024-05-10T05:27:00.650123+0000 2024-05-09T06:04:10.350 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.15.39:0/1698165886 2024-05-10T05:27:28.034010+0000 2024-05-09T06:04:10.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:10.367+0000 7fb72dd11700 1 -- 172.21.15.39:0/404735703 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fb7100b2880 msgr2=0x7fb7100b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:04:10.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:10.367+0000 7fb72dd11700 1 --2- 172.21.15.39:0/404735703 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fb7100b2880 0x7fb7100b4d90 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fb718005950 tx=0x7fb71800b410 comp rx=0 tx=0).stop 2024-05-09T06:04:10.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:10.367+0000 7fb72dd11700 1 -- 172.21.15.39:0/404735703 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb728108740 msgr2=0x7fb72819f5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:04:10.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:10.367+0000 7fb72dd11700 1 --2- 172.21.15.39:0/404735703 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb728108740 0x7fb72819f5c0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fb7200095c0 tx=0x7fb720007a20 comp rx=0 tx=0).stop 2024-05-09T06:04:10.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:10.367+0000 7fb72dd11700 1 -- 172.21.15.39:0/404735703 shutdown_connections 2024-05-09T06:04:10.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:10.367+0000 7fb72dd11700 1 --2- 172.21.15.39:0/404735703 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fb7100b2880 0x7fb7100b4d90 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:04:10.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:10.367+0000 7fb72dd11700 1 --2- 172.21.15.39:0/404735703 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb728108740 0x7fb72819f5c0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:04:10.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:10.367+0000 7fb72dd11700 1 --2- 172.21.15.39:0/404735703 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7281034c0 0x7fb72819ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:04:10.353 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:10.367+0000 7fb72dd11700 1 --2- 172.21.15.39:0/404735703 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb728107df0 0x7fb72819b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:04:10.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:10.367+0000 7fb72dd11700 1 -- 172.21.15.39:0/404735703 >> 172.21.15.39:0/404735703 conn(0x7fb7280fedf0 msgr2=0x7fb7281096a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:04:10.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:10.367+0000 7fb72dd11700 1 -- 172.21.15.39:0/404735703 shutdown_connections 2024-05-09T06:04:10.354 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:10.367+0000 7fb72dd11700 1 -- 172.21.15.39:0/404735703 wait complete. 2024-05-09T06:04:10.354 INFO:teuthology.orchestra.run.smithi039.stderr:listed 10 entries 2024-05-09T06:04:10.953 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:04:10 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/404735703' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-09T06:04:10.983 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-09T06:04:10.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T06:04:10.983 DEBUG:teuthology.orchestra.run.smithi039:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-05-09T06:04:11.038 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:04:10 smithi060 ceph-mon[34555]: from='client.? 172.21.15.39:0/404735703' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-09T06:04:11.162 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi039.front.sepia.ceph.com 2024-05-09T06:04:11.162 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T06:04:11.163 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-09T06:04:11.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:04:10 smithi100 ceph-mon[34353]: from='client.? 172.21.15.39:0/404735703' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-09T06:04:11.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T06:04:11.221 DEBUG:teuthology.orchestra.run.smithi039:> ip netns list 2024-05-09T06:04:11.279 INFO:teuthology.orchestra.run.smithi039.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-09T06:04:11.279 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T06:04:11.279 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-09T06:04:11.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T06:04:11.361 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link delete ceph-brx 2024-05-09T06:04:11.472 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-05-09T06:04:11.483 INFO:tasks.cephadm:Teardown begin 2024-05-09T06:04:11.483 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-09T06:04:11.483 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-09T06:04:11.847 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T06:04:11.971 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:04:11 smithi039 ceph-mon[30439]: pgmap v1174: 97 pgs: 97 active+clean; 479 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 15 op/s 2024-05-09T06:04:12.038 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:04:11 smithi060 ceph-mon[34555]: pgmap v1174: 97 pgs: 97 active+clean; 479 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 15 op/s 2024-05-09T06:04:12.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:04:11 smithi100 ceph-mon[34353]: pgmap v1174: 97 pgs: 97 active+clean; 479 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 15 op/s 2024-05-09T06:04:13.383 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:13.395+0000 7f417f0ec700 1 -- 172.21.15.39:0/2027859292 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4178108740 msgr2=0x7f41781100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:04:13.383 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:13.395+0000 7f417f0ec700 1 --2- 172.21.15.39:0/2027859292 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4178108740 0x7f41781100a0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f417000b0d0 tx=0x7f417000b3e0 comp rx=0 tx=0).stop 2024-05-09T06:04:13.383 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:13.395+0000 7f417f0ec700 1 -- 172.21.15.39:0/2027859292 shutdown_connections 2024-05-09T06:04:13.383 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:13.395+0000 7f417f0ec700 1 --2- 172.21.15.39:0/2027859292 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4178108740 0x7f41781100a0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:04:13.383 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:13.395+0000 7f417f0ec700 1 --2- 172.21.15.39:0/2027859292 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41781034c0 0x7f41781038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:04:13.383 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:13.395+0000 7f417f0ec700 1 --2- 172.21.15.39:0/2027859292 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4178107df0 0x7f4178108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:04:13.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:13.395+0000 7f417f0ec700 1 -- 172.21.15.39:0/2027859292 >> 172.21.15.39:0/2027859292 conn(0x7f41780fedc0 msgr2=0x7f41781011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:04:13.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:13.395+0000 7f417f0ec700 1 -- 172.21.15.39:0/2027859292 shutdown_connections 2024-05-09T06:04:13.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:13.395+0000 7f417f0ec700 1 -- 172.21.15.39:0/2027859292 wait complete. 2024-05-09T06:04:13.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:13.395+0000 7f417f0ec700 1 Processor -- start 2024-05-09T06:04:13.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:13.396+0000 7f417f0ec700 1 -- start start 2024-05-09T06:04:13.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:13.396+0000 7f417f0ec700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41781034c0 0x7f41780ff2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:04:13.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:13.396+0000 7f417f0ec700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4178107df0 0x7f41780ff7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:04:13.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:13.396+0000 7f417f0ec700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4178108740 0x7f41780ffd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:04:13.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:13.396+0000 7f417f0ec700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f4178113370 con 0x7f4178107df0 2024-05-09T06:04:13.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:13.396+0000 7f417f0ec700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f41781131f0 con 0x7f4178108740 2024-05-09T06:04:13.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:13.396+0000 7f417f0ec700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f41781134f0 con 0x7f41781034c0 2024-05-09T06:04:13.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:13.396+0000 7f4177fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4178107df0 0x7f41780ff7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:04:13.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:13.396+0000 7f4177fff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4178107df0 0x7f41780ff7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43170/0 (socket says 172.21.15.39:43170) 2024-05-09T06:04:13.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:13.396+0000 7f4177fff700 1 -- 172.21.15.39:0/352659836 learned_addr learned my addr 172.21.15.39:0/352659836 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T06:04:13.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:13.396+0000 7f417ce88700 1 --2- 172.21.15.39:0/352659836 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41781034c0 0x7f41780ff2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:04:13.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:13.396+0000 7f417d689700 1 --2- 172.21.15.39:0/352659836 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4178108740 0x7f41780ffd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:04:13.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:13.396+0000 7f4177fff700 1 -- 172.21.15.39:0/352659836 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41781034c0 msgr2=0x7f41780ff2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:04:13.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:13.396+0000 7f4177fff700 1 --2- 172.21.15.39:0/352659836 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41781034c0 0x7f41780ff2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:04:13.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:13.396+0000 7f4177fff700 1 -- 172.21.15.39:0/352659836 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4178108740 msgr2=0x7f41780ffd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:04:13.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:13.396+0000 7f4177fff700 1 --2- 172.21.15.39:0/352659836 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4178108740 0x7f41780ffd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:04:13.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:13.396+0000 7f4177fff700 1 -- 172.21.15.39:0/352659836 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41781a9150 con 0x7f4178107df0 2024-05-09T06:04:13.386 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:13.397+0000 7f4177fff700 1 --2- 172.21.15.39:0/352659836 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4178107df0 0x7f41780ff7e0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f416400d950 tx=0x7f416400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:04:13.386 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:13.397+0000 7f4175ffb700 1 -- 172.21.15.39:0/352659836 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4164016070 con 0x7f4178107df0 2024-05-09T06:04:13.386 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:13.397+0000 7f4175ffb700 1 -- 172.21.15.39:0/352659836 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4164004830 con 0x7f4178107df0 2024-05-09T06:04:13.386 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:13.397+0000 7f417f0ec700 1 -- 172.21.15.39:0/352659836 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41781a9440 con 0x7f4178107df0 2024-05-09T06:04:13.386 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:13.397+0000 7f4175ffb700 1 -- 172.21.15.39:0/352659836 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4164005440 con 0x7f4178107df0 2024-05-09T06:04:13.386 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:13.397+0000 7f417f0ec700 1 -- 172.21.15.39:0/352659836 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41781a9980 con 0x7f4178107df0 2024-05-09T06:04:13.387 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:13.398+0000 7f417f0ec700 1 -- 172.21.15.39:0/352659836 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41780512c0 con 0x7f4178107df0 2024-05-09T06:04:13.387 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:13.399+0000 7f4175ffb700 1 -- 172.21.15.39:0/352659836 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f4164004220 con 0x7f4178107df0 2024-05-09T06:04:13.387 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:13.401+0000 7f4175ffb700 1 --2- 172.21.15.39:0/352659836 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f41680b2880 0x7f41680b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:04:13.388 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:13.401+0000 7f417ce88700 1 --2- 172.21.15.39:0/352659836 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f41680b2880 0x7f41680b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:04:13.388 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:13.401+0000 7f4175ffb700 1 -- 172.21.15.39:0/352659836 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f41640e2430 con 0x7f4178107df0 2024-05-09T06:04:13.388 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:13.401+0000 7f417ce88700 1 --2- 172.21.15.39:0/352659836 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f41680b2880 0x7f41680b4d90 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f416c005950 tx=0x7f416c00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:04:13.390 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:13.404+0000 7f4175ffb700 1 -- 172.21.15.39:0/352659836 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f416401f020 con 0x7f4178107df0 2024-05-09T06:04:13.653 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:13.667+0000 7f417f0ec700 1 -- 172.21.15.39:0/352659836 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f41781a9be0 con 0x7f4178107df0 2024-05-09T06:04:13.654 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:13.668+0000 7f4175ffb700 1 -- 172.21.15.39:0/352659836 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) ==== 94+0+11870 (secure 0 0 0) 0x7f41640aa160 con 0x7f4178107df0 2024-05-09T06:04:13.655 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-09T06:04:13.655 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":49,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/1997969267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":1997969267},{"type":"v1","addr":"172.21.15.39:6835","nonce":1997969267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/283022063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":283022063},{"type":"v1","addr":"172.21.15.39:6837","nonce":283022063}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14604,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6839/669632573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":669632573},{"type":"v1","addr":"172.21.15.39:6839","nonce":669632573}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14616,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6841/2202260395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6840","nonce":2202260395},{"type":"v1","addr":"172.21.15.39:6841","nonce":2202260395}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24433,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/1308189973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":1308189973},{"type":"v1","addr":"172.21.15.100:6833","nonce":1308189973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24434,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/2789974692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2789974692},{"type":"v1","addr":"172.21.15.60:6833","nonce":2789974692}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":49,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-09T05:34:56.202280+0000","modified":"2024-05-09T06:03:28.635134+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24502,"mds_2":24487},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24461":{"gid":24461,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6835/924472374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":924472374},{"type":"v1","addr":"172.21.15.60:6835","nonce":924472374}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24479":{"gid":24479,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6837/3588840930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":3588840930},{"type":"v1","addr":"172.21.15.60:6837","nonce":3588840930}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.100:6835/2595255386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2595255386},{"type":"v1","addr":"172.21.15.100:6835","nonce":2595255386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":13,"addr":"172.21.15.100:6837/3676209932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":3676209932},{"type":"v1","addr":"172.21.15.100:6837","nonce":3676209932}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":12,"addr":"172.21.15.100:6839/1395178742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1395178742},{"type":"v1","addr":"172.21.15.100:6839","nonce":1395178742}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.60:6839/1418956667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":1418956667},{"type":"v1","addr":"172.21.15.60:6839","nonce":1418956667}]},"join_fscid":-1,"export_targets":[1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24487,24509,24502]},"id":1}]} 2024-05-09T06:04:13.657 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:13.670+0000 7f417f0ec700 1 -- 172.21.15.39:0/352659836 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f41680b2880 msgr2=0x7f41680b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:04:13.657 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:13.670+0000 7f417f0ec700 1 --2- 172.21.15.39:0/352659836 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f41680b2880 0x7f41680b4d90 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f416c005950 tx=0x7f416c00b410 comp rx=0 tx=0).stop 2024-05-09T06:04:13.657 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:13.670+0000 7f417f0ec700 1 -- 172.21.15.39:0/352659836 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4178107df0 msgr2=0x7f41780ff7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:04:13.657 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:13.670+0000 7f417f0ec700 1 --2- 172.21.15.39:0/352659836 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4178107df0 0x7f41780ff7e0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f416400d950 tx=0x7f416400dc60 comp rx=0 tx=0).stop 2024-05-09T06:04:13.657 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:13.671+0000 7f417f0ec700 1 -- 172.21.15.39:0/352659836 shutdown_connections 2024-05-09T06:04:13.657 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:13.671+0000 7f417f0ec700 1 --2- 172.21.15.39:0/352659836 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f41680b2880 0x7f41680b4d90 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:04:13.657 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:13.671+0000 7f417f0ec700 1 --2- 172.21.15.39:0/352659836 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4178108740 0x7f41780ffd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:04:13.657 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:13.671+0000 7f417f0ec700 1 --2- 172.21.15.39:0/352659836 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41781034c0 0x7f41780ff2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:04:13.657 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:13.671+0000 7f417f0ec700 1 --2- 172.21.15.39:0/352659836 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4178107df0 0x7f41780ff7e0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:04:13.657 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:13.671+0000 7f417f0ec700 1 -- 172.21.15.39:0/352659836 >> 172.21.15.39:0/352659836 conn(0x7f41780fedc0 msgr2=0x7f4178107560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:04:13.657 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:13.671+0000 7f417f0ec700 1 -- 172.21.15.39:0/352659836 shutdown_connections 2024-05-09T06:04:13.657 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:13.671+0000 7f417f0ec700 1 -- 172.21.15.39:0/352659836 wait complete. 2024-05-09T06:04:13.658 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 49 2024-05-09T06:04:14.038 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:04:13 smithi060 ceph-mon[34555]: pgmap v1175: 97 pgs: 97 active+clean; 479 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.3 KiB/s wr, 7 op/s 2024-05-09T06:04:14.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:04:13 smithi060 ceph-mon[34555]: from='client.? 172.21.15.39:0/352659836' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T06:04:14.073 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:04:13 smithi039 ceph-mon[30439]: pgmap v1175: 97 pgs: 97 active+clean; 479 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.3 KiB/s wr, 7 op/s 2024-05-09T06:04:14.073 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:04:13 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/352659836' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T06:04:14.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:04:13 smithi100 ceph-mon[34353]: pgmap v1175: 97 pgs: 97 active+clean; 479 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.3 KiB/s wr, 7 op/s 2024-05-09T06:04:14.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:04:13 smithi100 ceph-mon[34353]: from='client.? 172.21.15.39:0/352659836' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T06:04:14.233 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-09T06:04:14.490 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T06:04:15.907 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:04:15 smithi039 ceph-mon[30439]: pgmap v1176: 97 pgs: 97 active+clean; 479 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.5 KiB/s wr, 8 op/s 2024-05-09T06:04:16.038 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:04:15 smithi060 ceph-mon[34555]: pgmap v1176: 97 pgs: 97 active+clean; 479 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.5 KiB/s wr, 8 op/s 2024-05-09T06:04:16.148 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:16.163+0000 7f1e33b59700 1 -- 172.21.15.39:0/1777265378 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1e2c103080 msgr2=0x7f1e2c103490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:04:16.149 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:16.163+0000 7f1e33b59700 1 --2- 172.21.15.39:0/1777265378 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1e2c103080 0x7f1e2c103490 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f1e28009990 tx=0x7f1e28009ca0 comp rx=0 tx=0).stop 2024-05-09T06:04:16.149 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:16.163+0000 7f1e33b59700 1 -- 172.21.15.39:0/1777265378 shutdown_connections 2024-05-09T06:04:16.149 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:16.163+0000 7f1e33b59700 1 --2- 172.21.15.39:0/1777265378 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e2c110c30 0x7f1e2c113050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:04:16.149 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:16.163+0000 7f1e33b59700 1 --2- 172.21.15.39:0/1777265378 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1e2c103080 0x7f1e2c103490 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:04:16.149 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:16.163+0000 7f1e33b59700 1 --2- 172.21.15.39:0/1777265378 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e2c1039d0 0x7f1e2c1106f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:04:16.149 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:16.163+0000 7f1e33b59700 1 -- 172.21.15.39:0/1777265378 >> 172.21.15.39:0/1777265378 conn(0x7f1e2c0fedf0 msgr2=0x7f1e2c101210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:04:16.150 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:16.163+0000 7f1e33b59700 1 -- 172.21.15.39:0/1777265378 shutdown_connections 2024-05-09T06:04:16.150 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:16.163+0000 7f1e33b59700 1 -- 172.21.15.39:0/1777265378 wait complete. 2024-05-09T06:04:16.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:16.164+0000 7f1e33b59700 1 Processor -- start 2024-05-09T06:04:16.156 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:16.164+0000 7f1e33b59700 1 -- start start 2024-05-09T06:04:16.156 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:16.164+0000 7f1e33b59700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1e2c103080 0x7f1e2c19d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:04:16.156 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:16.164+0000 7f1e33b59700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e2c1039d0 0x7f1e2c19d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:04:16.156 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:16.164+0000 7f1e33b59700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e2c110c30 0x7f1e2c1a1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:04:16.156 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:16.164+0000 7f1e33b59700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f1e2c1166a0 con 0x7f1e2c103080 2024-05-09T06:04:16.156 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:16.164+0000 7f1e33b59700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f1e2c116520 con 0x7f1e2c1039d0 2024-05-09T06:04:16.156 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:16.164+0000 7f1e33b59700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1e2c116820 con 0x7f1e2c110c30 2024-05-09T06:04:16.157 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:16.164+0000 7f1e318f5700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1e2c103080 0x7f1e2c19d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:04:16.157 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:16.164+0000 7f1e318f5700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1e2c103080 0x7f1e2c19d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:43196/0 (socket says 172.21.15.39:43196) 2024-05-09T06:04:16.157 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:16.164+0000 7f1e318f5700 1 -- 172.21.15.39:0/2798067153 learned_addr learned my addr 172.21.15.39:0/2798067153 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T06:04:16.157 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:16.164+0000 7f1e310f4700 1 --2- 172.21.15.39:0/2798067153 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e2c1039d0 0x7f1e2c19d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:04:16.157 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:16.165+0000 7f1e320f6700 1 --2- 172.21.15.39:0/2798067153 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e2c110c30 0x7f1e2c1a1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:04:16.157 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:16.165+0000 7f1e318f5700 1 -- 172.21.15.39:0/2798067153 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e2c110c30 msgr2=0x7f1e2c1a1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:04:16.157 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:16.165+0000 7f1e318f5700 1 --2- 172.21.15.39:0/2798067153 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e2c110c30 0x7f1e2c1a1860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:04:16.158 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:16.165+0000 7f1e318f5700 1 -- 172.21.15.39:0/2798067153 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e2c1039d0 msgr2=0x7f1e2c19d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:04:16.158 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:16.165+0000 7f1e318f5700 1 --2- 172.21.15.39:0/2798067153 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e2c1039d0 0x7f1e2c19d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:04:16.158 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:16.165+0000 7f1e318f5700 1 -- 172.21.15.39:0/2798067153 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e2c1a1e50 con 0x7f1e2c103080 2024-05-09T06:04:16.158 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:16.165+0000 7f1e310f4700 1 --2- 172.21.15.39:0/2798067153 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e2c1039d0 0x7f1e2c19d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T06:04:16.158 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:16.165+0000 7f1e318f5700 1 --2- 172.21.15.39:0/2798067153 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1e2c103080 0x7f1e2c19d030 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f1e280057c0 tx=0x7f1e28009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:04:16.158 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:16.165+0000 7f1e1effd700 1 -- 172.21.15.39:0/2798067153 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e28026070 con 0x7f1e2c103080 2024-05-09T06:04:16.158 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:16.165+0000 7f1e33b59700 1 -- 172.21.15.39:0/2798067153 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e2c1a20e0 con 0x7f1e2c103080 2024-05-09T06:04:16.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:16.165+0000 7f1e1effd700 1 -- 172.21.15.39:0/2798067153 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1e28021410 con 0x7f1e2c103080 2024-05-09T06:04:16.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:16.165+0000 7f1e1effd700 1 -- 172.21.15.39:0/2798067153 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e28017650 con 0x7f1e2c103080 2024-05-09T06:04:16.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:16.165+0000 7f1e33b59700 1 -- 172.21.15.39:0/2798067153 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e2c1a25c0 con 0x7f1e2c103080 2024-05-09T06:04:16.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:16.166+0000 7f1e33b59700 1 -- 172.21.15.39:0/2798067153 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e2c0512c0 con 0x7f1e2c103080 2024-05-09T06:04:16.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:16.168+0000 7f1e1effd700 1 -- 172.21.15.39:0/2798067153 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f1e28029070 con 0x7f1e2c103080 2024-05-09T06:04:16.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:16.169+0000 7f1e1effd700 1 --2- 172.21.15.39:0/2798067153 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f1e180b2880 0x7f1e180b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:04:16.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:16.169+0000 7f1e310f4700 1 --2- 172.21.15.39:0/2798067153 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f1e180b2880 0x7f1e180b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:04:16.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:16.169+0000 7f1e1effd700 1 -- 172.21.15.39:0/2798067153 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f1e280e3230 con 0x7f1e2c103080 2024-05-09T06:04:16.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:16.169+0000 7f1e310f4700 1 --2- 172.21.15.39:0/2798067153 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f1e180b2880 0x7f1e180b4d90 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c112390 tx=0x7f1e20009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:04:16.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:16.172+0000 7f1e1effd700 1 -- 172.21.15.39:0/2798067153 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f1e2805edf0 con 0x7f1e2c103080 2024-05-09T06:04:16.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:04:15 smithi100 ceph-mon[34353]: pgmap v1176: 97 pgs: 97 active+clean; 479 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.5 KiB/s wr, 8 op/s 2024-05-09T06:04:16.418 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:16.433+0000 7f1e33b59700 1 -- 172.21.15.39:0/2798067153 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1e2c02e5f0 con 0x7f1e2c103080 2024-05-09T06:04:16.418 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:16.433+0000 7f1e1effd700 1 -- 172.21.15.39:0/2798067153 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) ==== 94+0+11870 (secure 0 0 0) 0x7f1e28013070 con 0x7f1e2c103080 2024-05-09T06:04:16.419 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-09T06:04:16.419 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":49,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6835/1997969267","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":1997969267},{"type":"v1","addr":"172.21.15.39:6835","nonce":1997969267}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/283022063","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6836","nonce":283022063},{"type":"v1","addr":"172.21.15.39:6837","nonce":283022063}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14604,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6839/669632573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6838","nonce":669632573},{"type":"v1","addr":"172.21.15.39:6839","nonce":669632573}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14616,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6841/2202260395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6840","nonce":2202260395},{"type":"v1","addr":"172.21.15.39:6841","nonce":2202260395}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24433,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/1308189973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":1308189973},{"type":"v1","addr":"172.21.15.100:6833","nonce":1308189973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24434,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/2789974692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2789974692},{"type":"v1","addr":"172.21.15.60:6833","nonce":2789974692}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":49,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-09T05:34:56.202280+0000","modified":"2024-05-09T06:03:28.635134+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24502,"mds_2":24487},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24461":{"gid":24461,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6835/924472374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":924472374},{"type":"v1","addr":"172.21.15.60:6835","nonce":924472374}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24479":{"gid":24479,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6837/3588840930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":3588840930},{"type":"v1","addr":"172.21.15.60:6837","nonce":3588840930}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24481":{"gid":24481,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.100:6835/2595255386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2595255386},{"type":"v1","addr":"172.21.15.100:6835","nonce":2595255386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":13,"addr":"172.21.15.100:6837/3676209932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":3676209932},{"type":"v1","addr":"172.21.15.100:6837","nonce":3676209932}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24502":{"gid":24502,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":12,"addr":"172.21.15.100:6839/1395178742","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1395178742},{"type":"v1","addr":"172.21.15.100:6839","nonce":1395178742}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.60:6839/1418956667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":1418956667},{"type":"v1","addr":"172.21.15.60:6839","nonce":1418956667}]},"join_fscid":-1,"export_targets":[1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24509,"qdb_cluster":[24487,24509,24502]},"id":1}]} 2024-05-09T06:04:16.421 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:16.436+0000 7f1e33b59700 1 -- 172.21.15.39:0/2798067153 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f1e180b2880 msgr2=0x7f1e180b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:04:16.421 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:16.436+0000 7f1e33b59700 1 --2- 172.21.15.39:0/2798067153 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f1e180b2880 0x7f1e180b4d90 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c112390 tx=0x7f1e20009260 comp rx=0 tx=0).stop 2024-05-09T06:04:16.421 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:16.436+0000 7f1e33b59700 1 -- 172.21.15.39:0/2798067153 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1e2c103080 msgr2=0x7f1e2c19d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:04:16.421 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:16.436+0000 7f1e33b59700 1 --2- 172.21.15.39:0/2798067153 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1e2c103080 0x7f1e2c19d030 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f1e280057c0 tx=0x7f1e28009580 comp rx=0 tx=0).stop 2024-05-09T06:04:16.421 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:16.436+0000 7f1e33b59700 1 -- 172.21.15.39:0/2798067153 shutdown_connections 2024-05-09T06:04:16.421 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:16.436+0000 7f1e33b59700 1 --2- 172.21.15.39:0/2798067153 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f1e180b2880 0x7f1e180b4d90 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:04:16.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:16.436+0000 7f1e33b59700 1 --2- 172.21.15.39:0/2798067153 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e2c110c30 0x7f1e2c1a1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:04:16.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:16.436+0000 7f1e33b59700 1 --2- 172.21.15.39:0/2798067153 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1e2c103080 0x7f1e2c19d030 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:04:16.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:16.436+0000 7f1e33b59700 1 --2- 172.21.15.39:0/2798067153 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e2c1039d0 0x7f1e2c19d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:04:16.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:16.436+0000 7f1e33b59700 1 -- 172.21.15.39:0/2798067153 >> 172.21.15.39:0/2798067153 conn(0x7f1e2c0fedf0 msgr2=0x7f1e2c1127c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:04:16.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:16.436+0000 7f1e33b59700 1 -- 172.21.15.39:0/2798067153 shutdown_connections 2024-05-09T06:04:16.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:16.436+0000 7f1e33b59700 1 -- 172.21.15.39:0/2798067153 wait complete. 2024-05-09T06:04:16.422 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 49 2024-05-09T06:04:16.931 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-09T06:04:16.955 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:04:16 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/2798067153' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T06:04:17.038 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:04:16 smithi060 ceph-mon[34555]: from='client.? 172.21.15.39:0/2798067153' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T06:04:17.165 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:04:16 smithi100 ceph-mon[34353]: from='client.? 172.21.15.39:0/2798067153' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T06:04:17.183 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T06:04:17.852 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:04:17 smithi039 ceph-mon[30439]: pgmap v1177: 97 pgs: 97 active+clean; 479 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2024-05-09T06:04:18.038 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:04:17 smithi060 ceph-mon[34555]: pgmap v1177: 97 pgs: 97 active+clean; 479 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2024-05-09T06:04:18.165 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:04:17 smithi100 ceph-mon[34353]: pgmap v1177: 97 pgs: 97 active+clean; 479 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2024-05-09T06:04:18.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:18.771+0000 7fd712bfa700 1 -- 172.21.15.39:0/1632786609 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd70c10b700 msgr2=0x7fd70c10bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:04:18.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:18.771+0000 7fd712bfa700 1 --2- 172.21.15.39:0/1632786609 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd70c10b700 0x7fd70c10bb10 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fd70000aad0 tx=0x7fd70000ade0 comp rx=0 tx=0).stop 2024-05-09T06:04:18.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:18.771+0000 7fd712bfa700 1 -- 172.21.15.39:0/1632786609 shutdown_connections 2024-05-09T06:04:18.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:18.771+0000 7fd712bfa700 1 --2- 172.21.15.39:0/1632786609 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd70c110700 0x7fd70c118040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:04:18.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:18.771+0000 7fd712bfa700 1 --2- 172.21.15.39:0/1632786609 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd70c10b700 0x7fd70c10bb10 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:04:18.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:18.771+0000 7fd712bfa700 1 --2- 172.21.15.39:0/1632786609 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd70c10fdb0 0x7fd70c1101c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:04:18.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:18.771+0000 7fd712bfa700 1 -- 172.21.15.39:0/1632786609 >> 172.21.15.39:0/1632786609 conn(0x7fd70c06f990 msgr2=0x7fd70c06fda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:04:18.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:18.771+0000 7fd712bfa700 1 -- 172.21.15.39:0/1632786609 shutdown_connections 2024-05-09T06:04:18.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:18.771+0000 7fd712bfa700 1 -- 172.21.15.39:0/1632786609 wait complete. 2024-05-09T06:04:18.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:18.772+0000 7fd712bfa700 1 Processor -- start 2024-05-09T06:04:18.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:18.772+0000 7fd712bfa700 1 -- start start 2024-05-09T06:04:18.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:18.773+0000 7fd712bfa700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd70c10b700 0x7fd70c1a1490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:04:18.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:18.773+0000 7fd712bfa700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd70c10fdb0 0x7fd70c1a1a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:04:18.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:18.773+0000 7fd712bfa700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd70c110700 0x7fd70c1a5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:04:18.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:18.773+0000 7fd712bfa700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fd70c11ab00 con 0x7fd70c110700 2024-05-09T06:04:18.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:18.773+0000 7fd712bfa700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd70c11a980 con 0x7fd70c10b700 2024-05-09T06:04:18.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:18.773+0000 7fd712bfa700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd70c11ac80 con 0x7fd70c10fdb0 2024-05-09T06:04:18.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:18.773+0000 7fd711197700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd70c110700 0x7fd70c1a5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:04:18.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:18.773+0000 7fd711197700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd70c110700 0x7fd70c1a5cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:41604/0 (socket says 172.21.15.39:41604) 2024-05-09T06:04:18.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:18.773+0000 7fd711197700 1 -- 172.21.15.39:0/3226303786 learned_addr learned my addr 172.21.15.39:0/3226303786 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T06:04:18.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:18.773+0000 7fd710996700 1 --2- 172.21.15.39:0/3226303786 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd70c10b700 0x7fd70c1a1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:04:18.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:18.773+0000 7fd70bfff700 1 --2- 172.21.15.39:0/3226303786 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd70c10fdb0 0x7fd70c1a1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:04:18.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:18.773+0000 7fd711197700 1 -- 172.21.15.39:0/3226303786 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd70c10fdb0 msgr2=0x7fd70c1a1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:04:18.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:18.773+0000 7fd711197700 1 --2- 172.21.15.39:0/3226303786 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd70c10fdb0 0x7fd70c1a1a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:04:18.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:18.773+0000 7fd711197700 1 -- 172.21.15.39:0/3226303786 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd70c10b700 msgr2=0x7fd70c1a1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:04:18.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:18.773+0000 7fd711197700 1 --2- 172.21.15.39:0/3226303786 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd70c10b700 0x7fd70c1a1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:04:18.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:18.773+0000 7fd711197700 1 -- 172.21.15.39:0/3226303786 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd70c1a62b0 con 0x7fd70c110700 2024-05-09T06:04:18.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:18.773+0000 7fd711197700 1 --2- 172.21.15.39:0/3226303786 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd70c110700 0x7fd70c1a5cc0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fd704007d70 tx=0x7fd70400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:04:18.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:18.774+0000 7fd709ffb700 1 -- 172.21.15.39:0/3226303786 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd704016020 con 0x7fd70c110700 2024-05-09T06:04:18.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:18.774+0000 7fd712bfa700 1 -- 172.21.15.39:0/3226303786 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd70c1a65a0 con 0x7fd70c110700 2024-05-09T06:04:18.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:18.774+0000 7fd709ffb700 1 -- 172.21.15.39:0/3226303786 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd70400ad40 con 0x7fd70c110700 2024-05-09T06:04:18.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:18.774+0000 7fd709ffb700 1 -- 172.21.15.39:0/3226303786 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7040115e0 con 0x7fd70c110700 2024-05-09T06:04:18.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:18.774+0000 7fd712bfa700 1 -- 172.21.15.39:0/3226303786 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd70c1a6ae0 con 0x7fd70c110700 2024-05-09T06:04:18.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:18.775+0000 7fd712bfa700 1 -- 172.21.15.39:0/3226303786 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd70c113730 con 0x7fd70c110700 2024-05-09T06:04:18.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:18.776+0000 7fd709ffb700 1 -- 172.21.15.39:0/3226303786 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7fd704019020 con 0x7fd70c110700 2024-05-09T06:04:18.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:18.777+0000 7fd709ffb700 1 --2- 172.21.15.39:0/3226303786 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fd6fc0b2880 0x7fd6fc0b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:04:18.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:18.777+0000 7fd710996700 1 --2- 172.21.15.39:0/3226303786 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fd6fc0b2880 0x7fd6fc0b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:04:18.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:18.777+0000 7fd709ffb700 1 -- 172.21.15.39:0/3226303786 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7fd7040e21a0 con 0x7fd70c110700 2024-05-09T06:04:18.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:18.778+0000 7fd710996700 1 --2- 172.21.15.39:0/3226303786 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fd6fc0b2880 0x7fd6fc0b4d90 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fd700000c00 tx=0x7fd700005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:04:18.768 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:18.782+0000 7fd709ffb700 1 -- 172.21.15.39:0/3226303786 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fd704020020 con 0x7fd70c110700 2024-05-09T06:04:18.982 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:18.996+0000 7fd712bfa700 1 -- 172.21.15.39:0/3226303786 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd70c1a27f0 con 0x7fd70c110700 2024-05-09T06:04:18.984 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:18.998+0000 7fd709ffb700 1 -- 172.21.15.39:0/3226303786 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+22602 (secure 0 0 0) 0x7fd7040a9ed0 con 0x7fd70c110700 2024-05-09T06:04:18.984 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-09T06:04:18.985 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":83,"fsid":"86d4cc60-0dc4-11ef-bc97-c7b262605968","created":"2024-05-09T05:26:33.514203+0000","modified":"2024-05-09T05:35:29.485823+0000","last_up_change":"2024-05-09T05:33:48.776015+0000","last_in_change":"2024-05-09T05:33:28.117875+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-09T05:29:56.122407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-09T05:34:49.964521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-09T05:34:52.915301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3491bbda-3a9b-40d2-8627-87d15660f864","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":1056276932},{"type":"v1","addr":"172.21.15.39:6803","nonce":1056276932}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":1056276932},{"type":"v1","addr":"172.21.15.39:6805","nonce":1056276932}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":1056276932},{"type":"v1","addr":"172.21.15.39:6809","nonce":1056276932}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":1056276932},{"type":"v1","addr":"172.21.15.39:6807","nonce":1056276932}]},"public_addr":"172.21.15.39:6803/1056276932","cluster_addr":"172.21.15.39:6805/1056276932","heartbeat_back_addr":"172.21.15.39:6809/1056276932","heartbeat_front_addr":"172.21.15.39:6807/1056276932","state":["exists","up"]},{"osd":1,"uuid":"ec2bd2d0-2975-402c-9df8-3469dfd6070f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":4245630636},{"type":"v1","addr":"172.21.15.60:6801","nonce":4245630636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":4245630636},{"type":"v1","addr":"172.21.15.60:6803","nonce":4245630636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":4245630636},{"type":"v1","addr":"172.21.15.60:6807","nonce":4245630636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":4245630636},{"type":"v1","addr":"172.21.15.60:6805","nonce":4245630636}]},"public_addr":"172.21.15.60:6801/4245630636","cluster_addr":"172.21.15.60:6803/4245630636","heartbeat_back_addr":"172.21.15.60:6807/4245630636","heartbeat_front_addr":"172.21.15.60:6805/4245630636","state":["exists","up"]},{"osd":2,"uuid":"9efaf6dd-086e-4095-b92e-cbbecf738523","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":4141597693},{"type":"v1","addr":"172.21.15.100:6801","nonce":4141597693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":4141597693},{"type":"v1","addr":"172.21.15.100:6803","nonce":4141597693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":4141597693},{"type":"v1","addr":"172.21.15.100:6807","nonce":4141597693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":4141597693},{"type":"v1","addr":"172.21.15.100:6805","nonce":4141597693}]},"public_addr":"172.21.15.100:6801/4141597693","cluster_addr":"172.21.15.100:6803/4141597693","heartbeat_back_addr":"172.21.15.100:6807/4141597693","heartbeat_front_addr":"172.21.15.100:6805/4141597693","state":["exists","up"]},{"osd":3,"uuid":"1ebe1a25-541d-4b54-bed8-4f0ec51b2432","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":2254197543},{"type":"v1","addr":"172.21.15.39:6811","nonce":2254197543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":2254197543},{"type":"v1","addr":"172.21.15.39:6813","nonce":2254197543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":2254197543},{"type":"v1","addr":"172.21.15.39:6817","nonce":2254197543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":2254197543},{"type":"v1","addr":"172.21.15.39:6815","nonce":2254197543}]},"public_addr":"172.21.15.39:6811/2254197543","cluster_addr":"172.21.15.39:6813/2254197543","heartbeat_back_addr":"172.21.15.39:6817/2254197543","heartbeat_front_addr":"172.21.15.39:6815/2254197543","state":["exists","up"]},{"osd":4,"uuid":"d52450a3-8a97-4746-a857-35aec69aac44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":649037162},{"type":"v1","addr":"172.21.15.60:6809","nonce":649037162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":649037162},{"type":"v1","addr":"172.21.15.60:6811","nonce":649037162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":649037162},{"type":"v1","addr":"172.21.15.60:6815","nonce":649037162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":649037162},{"type":"v1","addr":"172.21.15.60:6813","nonce":649037162}]},"public_addr":"172.21.15.60:6809/649037162","cluster_addr":"172.21.15.60:6811/649037162","heartbeat_back_addr":"172.21.15.60:6815/649037162","heartbeat_front_addr":"172.21.15.60:6813/649037162","state":["exists","up"]},{"osd":5,"uuid":"b35bf704-898d-40f7-b575-90267764a5b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":658409226},{"type":"v1","addr":"172.21.15.100:6809","nonce":658409226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":658409226},{"type":"v1","addr":"172.21.15.100:6811","nonce":658409226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":658409226},{"type":"v1","addr":"172.21.15.100:6815","nonce":658409226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":658409226},{"type":"v1","addr":"172.21.15.100:6813","nonce":658409226}]},"public_addr":"172.21.15.100:6809/658409226","cluster_addr":"172.21.15.100:6811/658409226","heartbeat_back_addr":"172.21.15.100:6815/658409226","heartbeat_front_addr":"172.21.15.100:6813/658409226","state":["exists","up"]},{"osd":6,"uuid":"49eae2f5-1dad-4c2c-89f4-efa1dd1faefb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":237628491},{"type":"v1","addr":"172.21.15.39:6819","nonce":237628491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":237628491},{"type":"v1","addr":"172.21.15.39:6821","nonce":237628491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":237628491},{"type":"v1","addr":"172.21.15.39:6825","nonce":237628491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":237628491},{"type":"v1","addr":"172.21.15.39:6823","nonce":237628491}]},"public_addr":"172.21.15.39:6819/237628491","cluster_addr":"172.21.15.39:6821/237628491","heartbeat_back_addr":"172.21.15.39:6825/237628491","heartbeat_front_addr":"172.21.15.39:6823/237628491","state":["exists","up"]},{"osd":7,"uuid":"60ccae54-535c-4a13-98d0-881c00b5e870","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":2718201647},{"type":"v1","addr":"172.21.15.60:6817","nonce":2718201647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":2718201647},{"type":"v1","addr":"172.21.15.60:6819","nonce":2718201647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":2718201647},{"type":"v1","addr":"172.21.15.60:6823","nonce":2718201647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":2718201647},{"type":"v1","addr":"172.21.15.60:6821","nonce":2718201647}]},"public_addr":"172.21.15.60:6817/2718201647","cluster_addr":"172.21.15.60:6819/2718201647","heartbeat_back_addr":"172.21.15.60:6823/2718201647","heartbeat_front_addr":"172.21.15.60:6821/2718201647","state":["exists","up"]},{"osd":8,"uuid":"edd52a21-0066-429f-9e98-15d1a74c53b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":1757558317},{"type":"v1","addr":"172.21.15.100:6817","nonce":1757558317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":1757558317},{"type":"v1","addr":"172.21.15.100:6819","nonce":1757558317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":1757558317},{"type":"v1","addr":"172.21.15.100:6823","nonce":1757558317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":1757558317},{"type":"v1","addr":"172.21.15.100:6821","nonce":1757558317}]},"public_addr":"172.21.15.100:6817/1757558317","cluster_addr":"172.21.15.100:6819/1757558317","heartbeat_back_addr":"172.21.15.100:6823/1757558317","heartbeat_front_addr":"172.21.15.100:6821/1757558317","state":["exists","up"]},{"osd":9,"uuid":"03fb7543-3386-49a4-b165-1007f07d88d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":2944584368},{"type":"v1","addr":"172.21.15.39:6827","nonce":2944584368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":2944584368},{"type":"v1","addr":"172.21.15.39:6829","nonce":2944584368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":2944584368},{"type":"v1","addr":"172.21.15.39:6833","nonce":2944584368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":2944584368},{"type":"v1","addr":"172.21.15.39:6831","nonce":2944584368}]},"public_addr":"172.21.15.39:6827/2944584368","cluster_addr":"172.21.15.39:6829/2944584368","heartbeat_back_addr":"172.21.15.39:6833/2944584368","heartbeat_front_addr":"172.21.15.39:6831/2944584368","state":["exists","up"]},{"osd":10,"uuid":"c1cadd6c-fcc4-4d76-b07e-0f392066a8d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1940670367},{"type":"v1","addr":"172.21.15.60:6825","nonce":1940670367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":1940670367},{"type":"v1","addr":"172.21.15.60:6827","nonce":1940670367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":1940670367},{"type":"v1","addr":"172.21.15.60:6831","nonce":1940670367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":1940670367},{"type":"v1","addr":"172.21.15.60:6829","nonce":1940670367}]},"public_addr":"172.21.15.60:6825/1940670367","cluster_addr":"172.21.15.60:6827/1940670367","heartbeat_back_addr":"172.21.15.60:6831/1940670367","heartbeat_front_addr":"172.21.15.60:6829/1940670367","state":["exists","up"]},{"osd":11,"uuid":"56806877-9ce2-41e2-9506-ce67897fa09b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":3318561029},{"type":"v1","addr":"172.21.15.100:6825","nonce":3318561029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":3318561029},{"type":"v1","addr":"172.21.15.100:6827","nonce":3318561029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":3318561029},{"type":"v1","addr":"172.21.15.100:6831","nonce":3318561029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":3318561029},{"type":"v1","addr":"172.21.15.100:6829","nonce":3318561029}]},"public_addr":"172.21.15.100:6825/3318561029","cluster_addr":"172.21.15.100:6827/3318561029","heartbeat_back_addr":"172.21.15.100:6831/3318561029","heartbeat_front_addr":"172.21.15.100:6829/3318561029","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:29:03.565705+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:29:28.380764+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:29:53.300224+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:30:20.046517+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:30:45.557983+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:31:10.397933+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:31:37.644428+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:32:02.325329+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:32:27.699044+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:32:54.436305+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:33:20.691300+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T05:33:46.806146+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.11","mappings":[{"from":5,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.39:6801/4091500272":"2024-05-10T05:27:28.034010+0000","172.21.15.39:6800/4091500272":"2024-05-10T05:27:28.034010+0000","172.21.15.39:0/782312916":"2024-05-10T05:27:28.034010+0000","172.21.15.39:0/1899316433":"2024-05-10T05:27:28.034010+0000","172.21.15.39:0/1613215795":"2024-05-10T05:27:00.650123+0000","172.21.15.39:0/2870431271":"2024-05-10T05:27:00.650123+0000","172.21.15.39:0/438945726":"2024-05-10T05:27:00.650123+0000","172.21.15.39:6800/499609328":"2024-05-10T05:27:00.650123+0000","172.21.15.39:6801/499609328":"2024-05-10T05:27:00.650123+0000","172.21.15.39:0/1698165886":"2024-05-10T05:27:28.034010+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T06:04:18.987 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:19.001+0000 7fd712bfa700 1 -- 172.21.15.39:0/3226303786 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fd6fc0b2880 msgr2=0x7fd6fc0b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:04:18.987 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:19.001+0000 7fd712bfa700 1 --2- 172.21.15.39:0/3226303786 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fd6fc0b2880 0x7fd6fc0b4d90 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fd700000c00 tx=0x7fd700005fb0 comp rx=0 tx=0).stop 2024-05-09T06:04:18.987 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:19.001+0000 7fd712bfa700 1 -- 172.21.15.39:0/3226303786 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd70c110700 msgr2=0x7fd70c1a5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:04:18.987 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:19.001+0000 7fd712bfa700 1 --2- 172.21.15.39:0/3226303786 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd70c110700 0x7fd70c1a5cc0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fd704007d70 tx=0x7fd70400a340 comp rx=0 tx=0).stop 2024-05-09T06:04:18.987 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:19.001+0000 7fd712bfa700 1 -- 172.21.15.39:0/3226303786 shutdown_connections 2024-05-09T06:04:18.987 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:19.001+0000 7fd712bfa700 1 --2- 172.21.15.39:0/3226303786 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fd6fc0b2880 0x7fd6fc0b4d90 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:04:18.987 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:19.001+0000 7fd712bfa700 1 --2- 172.21.15.39:0/3226303786 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd70c110700 0x7fd70c1a5cc0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:04:18.987 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:19.001+0000 7fd712bfa700 1 --2- 172.21.15.39:0/3226303786 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd70c10b700 0x7fd70c1a1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:04:18.987 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:19.001+0000 7fd712bfa700 1 --2- 172.21.15.39:0/3226303786 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd70c10fdb0 0x7fd70c1a1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:04:18.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:19.001+0000 7fd712bfa700 1 -- 172.21.15.39:0/3226303786 >> 172.21.15.39:0/3226303786 conn(0x7fd70c06f990 msgr2=0x7fd70c10d8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:04:18.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:19.001+0000 7fd712bfa700 1 -- 172.21.15.39:0/3226303786 shutdown_connections 2024-05-09T06:04:18.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:19.001+0000 7fd712bfa700 1 -- 172.21.15.39:0/3226303786 wait complete. 2024-05-09T06:04:19.604 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph fs fail cephfs 2024-05-09T06:04:19.852 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:04:19 smithi039 ceph-mon[30439]: pgmap v1178: 97 pgs: 97 active+clean; 479 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 767 B/s wr, 6 op/s 2024-05-09T06:04:19.852 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:04:19 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/3226303786' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T06:04:19.896 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T06:04:20.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:04:19 smithi060 ceph-mon[34555]: pgmap v1178: 97 pgs: 97 active+clean; 479 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 767 B/s wr, 6 op/s 2024-05-09T06:04:20.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:04:19 smithi060 ceph-mon[34555]: from='client.? 172.21.15.39:0/3226303786' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T06:04:20.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:04:19 smithi100 ceph-mon[34353]: pgmap v1178: 97 pgs: 97 active+clean; 479 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 767 B/s wr, 6 op/s 2024-05-09T06:04:20.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:04:19 smithi100 ceph-mon[34353]: from='client.? 172.21.15.39:0/3226303786' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T06:04:21.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:21.582+0000 7fd8a6bd1700 1 -- 172.21.15.39:0/954761823 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd8a0107df0 msgr2=0x7fd8a0108200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:04:21.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:21.582+0000 7fd8a6bd1700 1 --2- 172.21.15.39:0/954761823 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd8a0107df0 0x7fd8a0108200 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fd88c0099c0 tx=0x7fd88c009cd0 comp rx=0 tx=0).stop 2024-05-09T06:04:21.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:21.582+0000 7fd8a6bd1700 1 -- 172.21.15.39:0/954761823 shutdown_connections 2024-05-09T06:04:21.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:21.582+0000 7fd8a6bd1700 1 --2- 172.21.15.39:0/954761823 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8a0108740 0x7fd8a01100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:04:21.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:21.582+0000 7fd8a6bd1700 1 --2- 172.21.15.39:0/954761823 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8a01034c0 0x7fd8a01038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:04:21.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:21.582+0000 7fd8a6bd1700 1 --2- 172.21.15.39:0/954761823 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd8a0107df0 0x7fd8a0108200 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:04:21.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:21.582+0000 7fd8a6bd1700 1 -- 172.21.15.39:0/954761823 >> 172.21.15.39:0/954761823 conn(0x7fd8a00fedc0 msgr2=0x7fd8a01011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:04:21.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:21.582+0000 7fd8a6bd1700 1 -- 172.21.15.39:0/954761823 shutdown_connections 2024-05-09T06:04:21.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:21.582+0000 7fd8a6bd1700 1 -- 172.21.15.39:0/954761823 wait complete. 2024-05-09T06:04:21.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:21.583+0000 7fd8a6bd1700 1 Processor -- start 2024-05-09T06:04:21.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:21.583+0000 7fd8a6bd1700 1 -- start start 2024-05-09T06:04:21.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:21.583+0000 7fd8a6bd1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8a01034c0 0x7fd8a019f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:04:21.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:21.583+0000 7fd8a6bd1700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8a0107df0 0x7fd8a019fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:04:21.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:21.583+0000 7fd8a6bd1700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd8a0108740 0x7fd8a0199b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:04:21.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:21.583+0000 7fd8a6bd1700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fd8a0113350 con 0x7fd8a0108740 2024-05-09T06:04:21.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:21.583+0000 7fd8a6bd1700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd8a01131d0 con 0x7fd8a01034c0 2024-05-09T06:04:21.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:21.583+0000 7fd8a6bd1700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd8a01134d0 con 0x7fd8a0107df0 2024-05-09T06:04:21.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:21.583+0000 7fd8a516e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd8a0108740 0x7fd8a0199b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:04:21.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:21.583+0000 7fd8a516e700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd8a0108740 0x7fd8a0199b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:41620/0 (socket says 172.21.15.39:41620) 2024-05-09T06:04:21.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:21.583+0000 7fd8a516e700 1 -- 172.21.15.39:0/711631126 learned_addr learned my addr 172.21.15.39:0/711631126 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T06:04:21.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:21.584+0000 7fd8a496d700 1 --2- 172.21.15.39:0/711631126 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8a01034c0 0x7fd8a019f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:04:21.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:21.584+0000 7fd89ffff700 1 --2- 172.21.15.39:0/711631126 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8a0107df0 0x7fd8a019fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:04:21.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:21.584+0000 7fd8a516e700 1 -- 172.21.15.39:0/711631126 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8a0107df0 msgr2=0x7fd8a019fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:04:21.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:21.584+0000 7fd8a516e700 1 --2- 172.21.15.39:0/711631126 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8a0107df0 0x7fd8a019fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:04:21.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:21.584+0000 7fd8a516e700 1 -- 172.21.15.39:0/711631126 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8a01034c0 msgr2=0x7fd8a019f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:04:21.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:21.584+0000 7fd8a516e700 1 --2- 172.21.15.39:0/711631126 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8a01034c0 0x7fd8a019f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:04:21.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:21.584+0000 7fd8a516e700 1 -- 172.21.15.39:0/711631126 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8a019a260 con 0x7fd8a0108740 2024-05-09T06:04:21.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:21.584+0000 7fd8a496d700 1 --2- 172.21.15.39:0/711631126 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8a01034c0 0x7fd8a019f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T06:04:21.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:21.584+0000 7fd8a516e700 1 --2- 172.21.15.39:0/711631126 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd8a0108740 0x7fd8a0199b30 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fd89800ef30 tx=0x7fd89800c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:04:21.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:21.584+0000 7fd89dffb700 1 -- 172.21.15.39:0/711631126 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8980092e0 con 0x7fd8a0108740 2024-05-09T06:04:21.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:21.584+0000 7fd89dffb700 1 -- 172.21.15.39:0/711631126 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd898004bb0 con 0x7fd8a0108740 2024-05-09T06:04:21.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:21.584+0000 7fd8a6bd1700 1 -- 172.21.15.39:0/711631126 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8a019a4f0 con 0x7fd8a0108740 2024-05-09T06:04:21.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:21.584+0000 7fd89dffb700 1 -- 172.21.15.39:0/711631126 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd898004280 con 0x7fd8a0108740 2024-05-09T06:04:21.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:21.584+0000 7fd8a6bd1700 1 -- 172.21.15.39:0/711631126 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8a006b610 con 0x7fd8a0108740 2024-05-09T06:04:21.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:21.585+0000 7fd8a6bd1700 1 -- 172.21.15.39:0/711631126 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8a0104970 con 0x7fd8a0108740 2024-05-09T06:04:21.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:21.587+0000 7fd89dffb700 1 -- 172.21.15.39:0/711631126 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7fd89801b030 con 0x7fd8a0108740 2024-05-09T06:04:21.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:21.588+0000 7fd89dffb700 1 --2- 172.21.15.39:0/711631126 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fd8900b2880 0x7fd8900b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:04:21.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:21.588+0000 7fd8a496d700 1 --2- 172.21.15.39:0/711631126 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fd8900b2880 0x7fd8900b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:04:21.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:21.588+0000 7fd89dffb700 1 -- 172.21.15.39:0/711631126 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7fd8980e27c0 con 0x7fd8a0108740 2024-05-09T06:04:21.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:21.588+0000 7fd8a496d700 1 --2- 172.21.15.39:0/711631126 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fd8900b2880 0x7fd8900b4d90 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fd89400bc10 tx=0x7fd89400b5f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:04:21.577 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:21.591+0000 7fd89dffb700 1 -- 172.21.15.39:0/711631126 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fd898022020 con 0x7fd8a0108740 2024-05-09T06:04:21.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:21.853+0000 7fd8a6bd1700 1 -- 172.21.15.39:0/711631126 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fd8a006c040 con 0x7fd8a0108740 2024-05-09T06:04:21.840 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:04:21 smithi039 ceph-mon[30439]: pgmap v1179: 97 pgs: 97 active+clean; 479 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 8 op/s 2024-05-09T06:04:21.842 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:21.856+0000 7fd89dffb700 1 -- 172.21.15.39:0/711631126 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v50) ==== 161+0+0 (secure 0 0 0) 0x7fd898010040 con 0x7fd8a0108740 2024-05-09T06:04:21.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:21.859+0000 7fd8a6bd1700 1 -- 172.21.15.39:0/711631126 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fd8900b2880 msgr2=0x7fd8900b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:04:21.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:21.859+0000 7fd8a6bd1700 1 --2- 172.21.15.39:0/711631126 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fd8900b2880 0x7fd8900b4d90 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fd89400bc10 tx=0x7fd89400b5f0 comp rx=0 tx=0).stop 2024-05-09T06:04:21.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:21.859+0000 7fd8a6bd1700 1 -- 172.21.15.39:0/711631126 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd8a0108740 msgr2=0x7fd8a0199b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:04:21.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:21.859+0000 7fd8a6bd1700 1 --2- 172.21.15.39:0/711631126 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd8a0108740 0x7fd8a0199b30 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fd89800ef30 tx=0x7fd89800c450 comp rx=0 tx=0).stop 2024-05-09T06:04:21.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:21.859+0000 7fd8a6bd1700 1 -- 172.21.15.39:0/711631126 shutdown_connections 2024-05-09T06:04:21.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:21.859+0000 7fd8a6bd1700 1 --2- 172.21.15.39:0/711631126 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fd8900b2880 0x7fd8900b4d90 secure :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fd89400bc10 tx=0x7fd89400b5f0 comp rx=0 tx=0).stop 2024-05-09T06:04:21.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:21.859+0000 7fd8a6bd1700 1 --2- 172.21.15.39:0/711631126 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd8a0108740 0x7fd8a0199b30 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:04:21.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:21.859+0000 7fd8a6bd1700 1 --2- 172.21.15.39:0/711631126 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8a01034c0 0x7fd8a019f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:04:21.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:21.859+0000 7fd8a6bd1700 1 --2- 172.21.15.39:0/711631126 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8a0107df0 0x7fd8a019fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:04:21.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:21.859+0000 7fd8a6bd1700 1 -- 172.21.15.39:0/711631126 >> 172.21.15.39:0/711631126 conn(0x7fd8a00fedc0 msgr2=0x7fd8a01096a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:04:21.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:21.860+0000 7fd8a6bd1700 1 -- 172.21.15.39:0/711631126 shutdown_connections 2024-05-09T06:04:21.847 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:21.860+0000 7fd8a6bd1700 1 -- 172.21.15.39:0/711631126 wait complete. 2024-05-09T06:04:21.847 INFO:teuthology.orchestra.run.smithi039.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-09T06:04:22.038 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:04:21 smithi060 ceph-mon[34555]: pgmap v1179: 97 pgs: 97 active+clean; 479 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 8 op/s 2024-05-09T06:04:22.039 INFO:journalctl@ceph.mds.h.smithi060.stdout:May 09 06:04:21 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-h[64484]: ignoring --setuser ceph since I am not root 2024-05-09T06:04:22.039 INFO:journalctl@ceph.mds.h.smithi060.stdout:May 09 06:04:21 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-h[64484]: ignoring --setgroup ceph since I am not root 2024-05-09T06:04:22.039 INFO:journalctl@ceph.mds.h.smithi060.stdout:May 09 06:04:21 smithi060 ceph-mds[64488]: -- 172.21.15.60:0/2347137250 <== mon.0 v2:172.21.15.39:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55579143ba40 con 0x555791483180 2024-05-09T06:04:22.039 INFO:journalctl@ceph.mds.h.smithi060.stdout:May 09 06:04:21 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-h[64484]: starting mds.h at 2024-05-09T06:04:22.039 INFO:journalctl@ceph.mds.e.smithi060.stdout:May 09 06:04:21 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-e[64178]: ignoring --setuser ceph since I am not root 2024-05-09T06:04:22.040 INFO:journalctl@ceph.mds.e.smithi060.stdout:May 09 06:04:21 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-e[64178]: ignoring --setgroup ceph since I am not root 2024-05-09T06:04:22.040 INFO:journalctl@ceph.mds.e.smithi060.stdout:May 09 06:04:21 smithi060 ceph-mds[64183]: -- 172.21.15.60:0/854985719 <== mon.2 v2:172.21.15.60:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55689a631a40 con 0x55689a679180 2024-05-09T06:04:22.040 INFO:journalctl@ceph.mds.e.smithi060.stdout:May 09 06:04:21 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-e[64178]: starting mds.e at 2024-05-09T06:04:22.040 INFO:journalctl@ceph.mds.b.smithi060.stdout:May 09 06:04:21 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-b[64794]: ignoring --setuser ceph since I am not root 2024-05-09T06:04:22.040 INFO:journalctl@ceph.mds.b.smithi060.stdout:May 09 06:04:21 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-b[64794]: ignoring --setgroup ceph since I am not root 2024-05-09T06:04:22.040 INFO:journalctl@ceph.mds.b.smithi060.stdout:May 09 06:04:21 smithi060 ceph-mds[64798]: -- 172.21.15.60:0/2866959158 <== mon.0 v2:172.21.15.39:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5640fb32fa40 con 0x5640fb377180 2024-05-09T06:04:22.040 INFO:journalctl@ceph.mds.b.smithi060.stdout:May 09 06:04:21 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-b[64794]: starting mds.b at 2024-05-09T06:04:22.102 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:04:21 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mon-a[30434]: 2024-05-09T06:04:21.854+0000 7f67722b9700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-09T06:04:22.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:04:21 smithi100 ceph-mon[34353]: pgmap v1179: 97 pgs: 97 active+clean; 479 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 682 B/s wr, 8 op/s 2024-05-09T06:04:22.166 INFO:journalctl@ceph.mds.c.smithi100.stdout:May 09 06:04:21 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-c[65236]: ignoring --setuser ceph since I am not root 2024-05-09T06:04:22.166 INFO:journalctl@ceph.mds.c.smithi100.stdout:May 09 06:04:21 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-c[65236]: ignoring --setgroup ceph since I am not root 2024-05-09T06:04:22.166 INFO:journalctl@ceph.mds.c.smithi100.stdout:May 09 06:04:21 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-c[65236]: starting mds.c at 2024-05-09T06:04:22.167 INFO:journalctl@ceph.mds.f.smithi100.stdout:May 09 06:04:21 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-f[64933]: ignoring --setuser ceph since I am not root 2024-05-09T06:04:22.167 INFO:journalctl@ceph.mds.f.smithi100.stdout:May 09 06:04:21 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-f[64933]: ignoring --setgroup ceph since I am not root 2024-05-09T06:04:22.167 INFO:journalctl@ceph.mds.f.smithi100.stdout:May 09 06:04:21 smithi100 ceph-mds[64937]: -- 172.21.15.100:0/3177037452 <== mon.0 v2:172.21.15.39:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5572e380ba40 con 0x5572e3853180 2024-05-09T06:04:22.167 INFO:journalctl@ceph.mds.f.smithi100.stdout:May 09 06:04:21 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-f[64933]: starting mds.f at 2024-05-09T06:04:22.167 INFO:journalctl@ceph.mds.i.smithi100.stdout:May 09 06:04:21 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-i[65548]: ignoring --setuser ceph since I am not root 2024-05-09T06:04:22.167 INFO:journalctl@ceph.mds.i.smithi100.stdout:May 09 06:04:21 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-i[65548]: ignoring --setgroup ceph since I am not root 2024-05-09T06:04:22.167 INFO:journalctl@ceph.mds.i.smithi100.stdout:May 09 06:04:21 smithi100 ceph-mds[65552]: -- 172.21.15.100:0/1819927906 <== mon.1 v2:172.21.15.100:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e89b995a40 con 0x55e89b9dda80 2024-05-09T06:04:22.167 INFO:journalctl@ceph.mds.i.smithi100.stdout:May 09 06:04:21 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-i[65548]: starting mds.i at 2024-05-09T06:04:22.481 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-05-09T06:04:22.735 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T06:04:23.038 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:04:22 smithi060 ceph-mon[34555]: from='client.? 172.21.15.39:0/711631126' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-05-09T06:04:23.038 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:04:22 smithi060 ceph-mon[34555]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-05-09T06:04:23.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:04:22 smithi060 ceph-mon[34555]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-09T06:04:23.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:04:22 smithi060 ceph-mon[34555]: from='client.? 172.21.15.39:0/711631126' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-05-09T06:04:23.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:04:22 smithi060 ceph-mon[34555]: osdmap e84: 12 total, 12 up, 12 in 2024-05-09T06:04:23.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:04:22 smithi060 ceph-mon[34555]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-05-09T06:04:23.063 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:04:22 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/711631126' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-05-09T06:04:23.063 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:04:22 smithi039 ceph-mon[30439]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-05-09T06:04:23.063 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:04:22 smithi039 ceph-mon[30439]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-09T06:04:23.063 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:04:22 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/711631126' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-05-09T06:04:23.063 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:04:22 smithi039 ceph-mon[30439]: osdmap e84: 12 total, 12 up, 12 in 2024-05-09T06:04:23.063 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:04:22 smithi039 ceph-mon[30439]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-05-09T06:04:23.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:04:22 smithi100 ceph-mon[34353]: from='client.? 172.21.15.39:0/711631126' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-05-09T06:04:23.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:04:22 smithi100 ceph-mon[34353]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-05-09T06:04:23.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:04:22 smithi100 ceph-mon[34353]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-09T06:04:23.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:04:22 smithi100 ceph-mon[34353]: from='client.? 172.21.15.39:0/711631126' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-05-09T06:04:23.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:04:22 smithi100 ceph-mon[34353]: osdmap e84: 12 total, 12 up, 12 in 2024-05-09T06:04:23.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:04:22 smithi100 ceph-mon[34353]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-05-09T06:04:24.025 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:04:23 smithi039 ceph-mon[30439]: pgmap v1181: 97 pgs: 97 active+clean; 479 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 818 B/s wr, 7 op/s 2024-05-09T06:04:24.025 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:04:23 smithi039 ceph-mon[30439]: mds.? [v2:172.21.15.100:6835/932621361,v1:172.21.15.100:6838/932621361] up:boot 2024-05-09T06:04:24.026 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:04:23 smithi039 ceph-mon[30439]: mds.? [v2:172.21.15.100:6834/1064346348,v1:172.21.15.100:6837/1064346348] up:boot 2024-05-09T06:04:24.026 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:04:23 smithi039 ceph-mon[30439]: mds.? [v2:172.21.15.100:6836/595564755,v1:172.21.15.100:6839/595564755] up:boot 2024-05-09T06:04:24.026 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:04:23 smithi039 ceph-mon[30439]: mds.? [v2:172.21.15.60:6835/4126479646,v1:172.21.15.60:6837/4126479646] up:boot 2024-05-09T06:04:24.026 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:04:23 smithi039 ceph-mon[30439]: mds.? [v2:172.21.15.60:6834/3196706194,v1:172.21.15.60:6836/3196706194] up:boot 2024-05-09T06:04:24.026 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:04:23 smithi039 ceph-mon[30439]: mds.? [v2:172.21.15.60:6838/2543856184,v1:172.21.15.60:6839/2543856184] up:boot 2024-05-09T06:04:24.026 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:04:23 smithi039 ceph-mon[30439]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-05-09T06:04:24.026 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:04:23 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-09T06:04:24.026 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:04:23 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-09T06:04:24.026 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:04:23 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-09T06:04:24.026 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:04:23 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-09T06:04:24.026 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:04:23 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-09T06:04:24.026 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:04:23 smithi039 ceph-mon[30439]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-09T06:04:24.038 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:04:23 smithi060 ceph-mon[34555]: pgmap v1181: 97 pgs: 97 active+clean; 479 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 818 B/s wr, 7 op/s 2024-05-09T06:04:24.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:04:23 smithi060 ceph-mon[34555]: mds.? [v2:172.21.15.100:6835/932621361,v1:172.21.15.100:6838/932621361] up:boot 2024-05-09T06:04:24.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:04:23 smithi060 ceph-mon[34555]: mds.? [v2:172.21.15.100:6834/1064346348,v1:172.21.15.100:6837/1064346348] up:boot 2024-05-09T06:04:24.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:04:23 smithi060 ceph-mon[34555]: mds.? [v2:172.21.15.100:6836/595564755,v1:172.21.15.100:6839/595564755] up:boot 2024-05-09T06:04:24.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:04:23 smithi060 ceph-mon[34555]: mds.? [v2:172.21.15.60:6835/4126479646,v1:172.21.15.60:6837/4126479646] up:boot 2024-05-09T06:04:24.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:04:23 smithi060 ceph-mon[34555]: mds.? [v2:172.21.15.60:6834/3196706194,v1:172.21.15.60:6836/3196706194] up:boot 2024-05-09T06:04:24.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:04:23 smithi060 ceph-mon[34555]: mds.? [v2:172.21.15.60:6838/2543856184,v1:172.21.15.60:6839/2543856184] up:boot 2024-05-09T06:04:24.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:04:23 smithi060 ceph-mon[34555]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-05-09T06:04:24.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:04:23 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-09T06:04:24.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:04:23 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-09T06:04:24.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:04:23 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-09T06:04:24.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:04:23 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-09T06:04:24.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:04:23 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-09T06:04:24.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:04:23 smithi060 ceph-mon[34555]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-09T06:04:24.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:04:23 smithi100 ceph-mon[34353]: pgmap v1181: 97 pgs: 97 active+clean; 479 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 818 B/s wr, 7 op/s 2024-05-09T06:04:24.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:04:23 smithi100 ceph-mon[34353]: mds.? [v2:172.21.15.100:6835/932621361,v1:172.21.15.100:6838/932621361] up:boot 2024-05-09T06:04:24.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:04:23 smithi100 ceph-mon[34353]: mds.? [v2:172.21.15.100:6834/1064346348,v1:172.21.15.100:6837/1064346348] up:boot 2024-05-09T06:04:24.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:04:23 smithi100 ceph-mon[34353]: mds.? [v2:172.21.15.100:6836/595564755,v1:172.21.15.100:6839/595564755] up:boot 2024-05-09T06:04:24.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:04:23 smithi100 ceph-mon[34353]: mds.? [v2:172.21.15.60:6835/4126479646,v1:172.21.15.60:6837/4126479646] up:boot 2024-05-09T06:04:24.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:04:23 smithi100 ceph-mon[34353]: mds.? [v2:172.21.15.60:6834/3196706194,v1:172.21.15.60:6836/3196706194] up:boot 2024-05-09T06:04:24.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:04:23 smithi100 ceph-mon[34353]: mds.? [v2:172.21.15.60:6838/2543856184,v1:172.21.15.60:6839/2543856184] up:boot 2024-05-09T06:04:24.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:04:23 smithi100 ceph-mon[34353]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-05-09T06:04:24.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:04:23 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-09T06:04:24.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:04:23 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-09T06:04:24.167 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:04:23 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-09T06:04:24.167 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:04:23 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-09T06:04:24.167 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:04:23 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-09T06:04:24.167 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:04:23 smithi100 ceph-mon[34353]: from='mgr.14152 172.21.15.39:0/3002320112' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-09T06:04:24.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:24.263+0000 7fc4e53a1700 1 -- 172.21.15.39:0/4143076587 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc4e01045e0 msgr2=0x7fc4e01049f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:04:24.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:24.263+0000 7fc4e53a1700 1 --2- 172.21.15.39:0/4143076587 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc4e01045e0 0x7fc4e01049f0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fc4d000b0d0 tx=0x7fc4d000b3e0 comp rx=0 tx=0).stop 2024-05-09T06:04:24.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:24.263+0000 7fc4e53a1700 1 -- 172.21.15.39:0/4143076587 shutdown_connections 2024-05-09T06:04:24.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:24.263+0000 7fc4e53a1700 1 --2- 172.21.15.39:0/4143076587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc4e0109860 0x7fc4e01111c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:04:24.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:24.263+0000 7fc4e53a1700 1 --2- 172.21.15.39:0/4143076587 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc4e01045e0 0x7fc4e01049f0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:04:24.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:24.263+0000 7fc4e53a1700 1 --2- 172.21.15.39:0/4143076587 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc4e0108f10 0x7fc4e0109320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:04:24.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:24.263+0000 7fc4e53a1700 1 -- 172.21.15.39:0/4143076587 >> 172.21.15.39:0/4143076587 conn(0x7fc4e00ffef0 msgr2=0x7fc4e0102340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:04:24.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:24.263+0000 7fc4e53a1700 1 -- 172.21.15.39:0/4143076587 shutdown_connections 2024-05-09T06:04:24.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:24.263+0000 7fc4e53a1700 1 -- 172.21.15.39:0/4143076587 wait complete. 2024-05-09T06:04:24.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:24.264+0000 7fc4e53a1700 1 Processor -- start 2024-05-09T06:04:24.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:24.264+0000 7fc4e53a1700 1 -- start start 2024-05-09T06:04:24.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:24.264+0000 7fc4e53a1700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc4e01045e0 0x7fc4e0076b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:04:24.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:24.264+0000 7fc4e53a1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc4e0108f10 0x7fc4e00770d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:04:24.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:24.264+0000 7fc4e53a1700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc4e0109860 0x7fc4e0077610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:04:24.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:24.264+0000 7fc4e53a1700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e0114500 con 0x7fc4e0109860 2024-05-09T06:04:24.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:24.264+0000 7fc4e53a1700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e0114380 con 0x7fc4e0108f10 2024-05-09T06:04:24.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:24.264+0000 7fc4e53a1700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e0114680 con 0x7fc4e01045e0 2024-05-09T06:04:24.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:24.264+0000 7fc4df7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc4e0109860 0x7fc4e0077610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:04:24.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:24.265+0000 7fc4df7fe700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc4e0109860 0x7fc4e0077610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:41644/0 (socket says 172.21.15.39:41644) 2024-05-09T06:04:24.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:24.265+0000 7fc4df7fe700 1 -- 172.21.15.39:0/663891268 learned_addr learned my addr 172.21.15.39:0/663891268 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T06:04:24.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:24.265+0000 7fc4de7fc700 1 --2- 172.21.15.39:0/663891268 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc4e0108f10 0x7fc4e00770d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:04:24.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:24.265+0000 7fc4deffd700 1 --2- 172.21.15.39:0/663891268 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc4e01045e0 0x7fc4e0076b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:04:24.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:24.265+0000 7fc4df7fe700 1 -- 172.21.15.39:0/663891268 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc4e01045e0 msgr2=0x7fc4e0076b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:04:24.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:24.265+0000 7fc4df7fe700 1 --2- 172.21.15.39:0/663891268 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc4e01045e0 0x7fc4e0076b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:04:24.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:24.265+0000 7fc4df7fe700 1 -- 172.21.15.39:0/663891268 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc4e0108f10 msgr2=0x7fc4e00770d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:04:24.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:24.265+0000 7fc4df7fe700 1 --2- 172.21.15.39:0/663891268 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc4e0108f10 0x7fc4e00770d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:04:24.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:24.265+0000 7fc4df7fe700 1 -- 172.21.15.39:0/663891268 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4e01a91e0 con 0x7fc4e0109860 2024-05-09T06:04:24.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:24.265+0000 7fc4df7fe700 1 --2- 172.21.15.39:0/663891268 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc4e0109860 0x7fc4e0077610 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fc4d800c900 tx=0x7fc4d800cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:04:24.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:24.265+0000 7fc4d7fff700 1 -- 172.21.15.39:0/663891268 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d8007aa0 con 0x7fc4e0109860 2024-05-09T06:04:24.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:24.265+0000 7fc4d7fff700 1 -- 172.21.15.39:0/663891268 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc4d800ce50 con 0x7fc4e0109860 2024-05-09T06:04:24.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:24.265+0000 7fc4e53a1700 1 -- 172.21.15.39:0/663891268 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4e01a94d0 con 0x7fc4e0109860 2024-05-09T06:04:24.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:24.265+0000 7fc4d7fff700 1 -- 172.21.15.39:0/663891268 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d800fe60 con 0x7fc4e0109860 2024-05-09T06:04:24.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:24.265+0000 7fc4e53a1700 1 -- 172.21.15.39:0/663891268 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4e01a9a10 con 0x7fc4e0109860 2024-05-09T06:04:24.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:24.266+0000 7fc4e53a1700 1 -- 172.21.15.39:0/663891268 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4e00512c0 con 0x7fc4e0109860 2024-05-09T06:04:24.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:24.269+0000 7fc4d7fff700 1 -- 172.21.15.39:0/663891268 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7fc4d800f450 con 0x7fc4e0109860 2024-05-09T06:04:24.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:24.270+0000 7fc4d7fff700 1 --2- 172.21.15.39:0/663891268 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fc4cc0b2900 0x7fc4cc0b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:04:24.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:24.270+0000 7fc4deffd700 1 --2- 172.21.15.39:0/663891268 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fc4cc0b2900 0x7fc4cc0b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:04:24.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:24.270+0000 7fc4d7fff700 1 -- 172.21.15.39:0/663891268 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7fc4d80e21e0 con 0x7fc4e0109860 2024-05-09T06:04:24.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:24.271+0000 7fc4deffd700 1 --2- 172.21.15.39:0/663891268 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fc4cc0b2900 0x7fc4cc0b4e10 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fc4d000d010 tx=0x7fc4d000b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:04:24.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:24.274+0000 7fc4d7fff700 1 -- 172.21.15.39:0/663891268 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fc4d8014030 con 0x7fc4e0109860 2024-05-09T06:04:24.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:24.534+0000 7fc4e53a1700 1 -- 172.21.15.39:0/663891268 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fc4e002e5f0 con 0x7fc4e0109860 2024-05-09T06:04:24.747 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:24.761+0000 7fc4d7fff700 1 -- 172.21.15.39:0/663891268 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v52) ==== 104+0+0 (secure 0 0 0) 0x7fc4d80a9e90 con 0x7fc4e0109860 2024-05-09T06:04:24.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:24.765+0000 7fc4e53a1700 1 -- 172.21.15.39:0/663891268 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fc4cc0b2900 msgr2=0x7fc4cc0b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:04:24.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:24.765+0000 7fc4e53a1700 1 --2- 172.21.15.39:0/663891268 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fc4cc0b2900 0x7fc4cc0b4e10 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fc4d000d010 tx=0x7fc4d000b040 comp rx=0 tx=0).stop 2024-05-09T06:04:24.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:24.765+0000 7fc4e53a1700 1 -- 172.21.15.39:0/663891268 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc4e0109860 msgr2=0x7fc4e0077610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:04:24.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:24.765+0000 7fc4e53a1700 1 --2- 172.21.15.39:0/663891268 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc4e0109860 0x7fc4e0077610 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fc4d800c900 tx=0x7fc4d800cc10 comp rx=0 tx=0).stop 2024-05-09T06:04:24.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:24.765+0000 7fc4e53a1700 1 -- 172.21.15.39:0/663891268 shutdown_connections 2024-05-09T06:04:24.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:24.765+0000 7fc4e53a1700 1 --2- 172.21.15.39:0/663891268 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7fc4cc0b2900 0x7fc4cc0b4e10 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:04:24.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:24.765+0000 7fc4e53a1700 1 --2- 172.21.15.39:0/663891268 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc4e0109860 0x7fc4e0077610 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:04:24.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:24.765+0000 7fc4e53a1700 1 --2- 172.21.15.39:0/663891268 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc4e01045e0 0x7fc4e0076b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:04:24.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:24.765+0000 7fc4e53a1700 1 --2- 172.21.15.39:0/663891268 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc4e0108f10 0x7fc4e00770d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:04:24.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:24.765+0000 7fc4e53a1700 1 -- 172.21.15.39:0/663891268 >> 172.21.15.39:0/663891268 conn(0x7fc4e00ffef0 msgr2=0x7fc4e0102310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:04:24.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:24.765+0000 7fc4e53a1700 1 -- 172.21.15.39:0/663891268 shutdown_connections 2024-05-09T06:04:24.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:24.765+0000 7fc4e53a1700 1 -- 172.21.15.39:0/663891268 wait complete. 2024-05-09T06:04:24.852 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:04:24 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/663891268' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-05-09T06:04:25.038 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:04:24 smithi060 ceph-mon[34555]: from='client.? 172.21.15.39:0/663891268' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-05-09T06:04:25.165 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:04:24 smithi100 ceph-mon[34353]: from='client.? 172.21.15.39:0/663891268' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-05-09T06:04:25.381 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-09T06:04:25.636 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T06:04:26.003 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:04:25 smithi039 ceph-mon[30439]: pgmap v1182: 97 pgs: 97 active+clean; 479 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 511 B/s wr, 6 op/s 2024-05-09T06:04:26.004 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:04:25 smithi039 ceph-mon[30439]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-05-09T06:04:26.004 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:04:25 smithi039 ceph-mon[30439]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-05-09T06:04:26.004 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:04:25 smithi039 ceph-mon[30439]: Cluster is now healthy 2024-05-09T06:04:26.004 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:04:25 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/663891268' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-05-09T06:04:26.004 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:04:25 smithi039 ceph-mon[30439]: fsmap 12 up:standby 2024-05-09T06:04:26.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:04:25 smithi060 ceph-mon[34555]: pgmap v1182: 97 pgs: 97 active+clean; 479 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 511 B/s wr, 6 op/s 2024-05-09T06:04:26.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:04:25 smithi060 ceph-mon[34555]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-05-09T06:04:26.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:04:25 smithi060 ceph-mon[34555]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-05-09T06:04:26.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:04:25 smithi060 ceph-mon[34555]: Cluster is now healthy 2024-05-09T06:04:26.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:04:25 smithi060 ceph-mon[34555]: from='client.? 172.21.15.39:0/663891268' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-05-09T06:04:26.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:04:25 smithi060 ceph-mon[34555]: fsmap 12 up:standby 2024-05-09T06:04:26.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:04:25 smithi100 ceph-mon[34353]: pgmap v1182: 97 pgs: 97 active+clean; 479 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 511 B/s wr, 6 op/s 2024-05-09T06:04:26.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:04:25 smithi100 ceph-mon[34353]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-05-09T06:04:26.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:04:25 smithi100 ceph-mon[34353]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-05-09T06:04:26.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:04:25 smithi100 ceph-mon[34353]: Cluster is now healthy 2024-05-09T06:04:26.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:04:25 smithi100 ceph-mon[34353]: from='client.? 172.21.15.39:0/663891268' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-05-09T06:04:26.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:04:25 smithi100 ceph-mon[34353]: fsmap 12 up:standby 2024-05-09T06:04:27.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:27.264+0000 7f1d1620b700 1 -- 172.21.15.39:0/3116223620 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1d10108f10 msgr2=0x7f1d10109320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:04:27.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:27.264+0000 7f1d1620b700 1 --2- 172.21.15.39:0/3116223620 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1d10108f10 0x7f1d10109320 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f1cf80099c0 tx=0x7f1cf8009cd0 comp rx=0 tx=0).stop 2024-05-09T06:04:27.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:27.264+0000 7f1d1620b700 1 -- 172.21.15.39:0/3116223620 shutdown_connections 2024-05-09T06:04:27.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:27.264+0000 7f1d1620b700 1 --2- 172.21.15.39:0/3116223620 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d10109860 0x7f1d101111c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:04:27.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:27.264+0000 7f1d1620b700 1 --2- 172.21.15.39:0/3116223620 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d101045e0 0x7f1d101049f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:04:27.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:27.264+0000 7f1d1620b700 1 --2- 172.21.15.39:0/3116223620 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1d10108f10 0x7f1d10109320 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:04:27.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:27.264+0000 7f1d1620b700 1 -- 172.21.15.39:0/3116223620 >> 172.21.15.39:0/3116223620 conn(0x7f1d100ffe70 msgr2=0x7f1d101022c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:04:27.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:27.264+0000 7f1d1620b700 1 -- 172.21.15.39:0/3116223620 shutdown_connections 2024-05-09T06:04:27.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:27.264+0000 7f1d1620b700 1 -- 172.21.15.39:0/3116223620 wait complete. 2024-05-09T06:04:27.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:27.265+0000 7f1d1620b700 1 Processor -- start 2024-05-09T06:04:27.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:27.266+0000 7f1d1620b700 1 -- start start 2024-05-09T06:04:27.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:27.266+0000 7f1d1620b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d101045e0 0x7f1d1019ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:04:27.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:27.266+0000 7f1d1620b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d10108f10 0x7f1d1019b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:04:27.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:27.266+0000 7f1d1620b700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1d10109860 0x7f1d1019f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:04:27.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:27.266+0000 7f1d1620b700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f1d10114470 con 0x7f1d10109860 2024-05-09T06:04:27.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:27.266+0000 7f1d1620b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f1d101142f0 con 0x7f1d101045e0 2024-05-09T06:04:27.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:27.266+0000 7f1d1620b700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1d101145f0 con 0x7f1d10108f10 2024-05-09T06:04:27.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:27.266+0000 7f1d0ffff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1d10109860 0x7f1d1019f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:04:27.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:27.266+0000 7f1d0ffff700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1d10109860 0x7f1d1019f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:39120/0 (socket says 172.21.15.39:39120) 2024-05-09T06:04:27.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:27.266+0000 7f1d0ffff700 1 -- 172.21.15.39:0/332981992 learned_addr learned my addr 172.21.15.39:0/332981992 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T06:04:27.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:27.266+0000 7f1d0f7fe700 1 --2- 172.21.15.39:0/332981992 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d101045e0 0x7f1d1019ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:04:27.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:27.266+0000 7f1d0effd700 1 --2- 172.21.15.39:0/332981992 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d10108f10 0x7f1d1019b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:04:27.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:27.267+0000 7f1d0ffff700 1 -- 172.21.15.39:0/332981992 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d10108f10 msgr2=0x7f1d1019b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:04:27.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:27.267+0000 7f1d0ffff700 1 --2- 172.21.15.39:0/332981992 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d10108f10 0x7f1d1019b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:04:27.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:27.267+0000 7f1d0ffff700 1 -- 172.21.15.39:0/332981992 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d101045e0 msgr2=0x7f1d1019ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:04:27.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:27.267+0000 7f1d0ffff700 1 --2- 172.21.15.39:0/332981992 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d101045e0 0x7f1d1019ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:04:27.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:27.267+0000 7f1d0ffff700 1 -- 172.21.15.39:0/332981992 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d1019fd10 con 0x7f1d10109860 2024-05-09T06:04:27.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:27.267+0000 7f1d0f7fe700 1 --2- 172.21.15.39:0/332981992 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d101045e0 0x7f1d1019ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T06:04:27.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:27.267+0000 7f1d0ffff700 1 --2- 172.21.15.39:0/332981992 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1d10109860 0x7f1d1019f670 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f1d0800d980 tx=0x7f1d0800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:04:27.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:27.267+0000 7f1d0cff9700 1 -- 172.21.15.39:0/332981992 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d08017070 con 0x7f1d10109860 2024-05-09T06:04:27.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:27.267+0000 7f1d1620b700 1 -- 172.21.15.39:0/332981992 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d101a0000 con 0x7f1d10109860 2024-05-09T06:04:27.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:27.267+0000 7f1d0cff9700 1 -- 172.21.15.39:0/332981992 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1d08005020 con 0x7f1d10109860 2024-05-09T06:04:27.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:27.267+0000 7f1d0cff9700 1 -- 172.21.15.39:0/332981992 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d08009990 con 0x7f1d10109860 2024-05-09T06:04:27.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:27.267+0000 7f1d1620b700 1 -- 172.21.15.39:0/332981992 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d101a7920 con 0x7f1d10109860 2024-05-09T06:04:27.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:27.268+0000 7f1d1620b700 1 -- 172.21.15.39:0/332981992 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d100512c0 con 0x7f1d10109860 2024-05-09T06:04:27.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:27.270+0000 7f1d0cff9700 1 -- 172.21.15.39:0/332981992 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f1d08004a30 con 0x7f1d10109860 2024-05-09T06:04:27.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:27.270+0000 7f1d0cff9700 1 --2- 172.21.15.39:0/332981992 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f1cfc0b2880 0x7f1cfc0b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:04:27.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:27.271+0000 7f1d0f7fe700 1 --2- 172.21.15.39:0/332981992 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f1cfc0b2880 0x7f1cfc0b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:04:27.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:27.271+0000 7f1d0cff9700 1 -- 172.21.15.39:0/332981992 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8469+0+0 (secure 0 0 0) 0x7f1d080e2090 con 0x7f1d10109860 2024-05-09T06:04:27.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:27.271+0000 7f1d0f7fe700 1 --2- 172.21.15.39:0/332981992 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f1cfc0b2880 0x7f1cfc0b4d90 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f1d00009dd0 tx=0x7f1d00009040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:04:27.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:27.275+0000 7f1d0cff9700 1 -- 172.21.15.39:0/332981992 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f1d08020020 con 0x7f1d10109860 2024-05-09T06:04:27.476 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:27.490+0000 7f1d1620b700 1 -- 172.21.15.39:0/332981992 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f1d1002e5f0 con 0x7f1d10109860 2024-05-09T06:04:27.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:27.762+0000 7f1d0cff9700 1 -- 172.21.15.39:0/332981992 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v85) ==== 181+0+0 (secure 0 0 0) 0x7f1d080a9d60 con 0x7f1d10109860 2024-05-09T06:04:27.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:27.765+0000 7f1d1620b700 1 -- 172.21.15.39:0/332981992 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f1cfc0b2880 msgr2=0x7f1cfc0b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:04:27.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:27.765+0000 7f1d1620b700 1 --2- 172.21.15.39:0/332981992 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f1cfc0b2880 0x7f1cfc0b4d90 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f1d00009dd0 tx=0x7f1d00009040 comp rx=0 tx=0).stop 2024-05-09T06:04:27.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:27.765+0000 7f1d1620b700 1 -- 172.21.15.39:0/332981992 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1d10109860 msgr2=0x7f1d1019f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:04:27.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:27.765+0000 7f1d1620b700 1 --2- 172.21.15.39:0/332981992 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1d10109860 0x7f1d1019f670 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f1d0800d980 tx=0x7f1d0800dc90 comp rx=0 tx=0).stop 2024-05-09T06:04:27.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:27.766+0000 7f1d1620b700 1 -- 172.21.15.39:0/332981992 shutdown_connections 2024-05-09T06:04:27.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:27.766+0000 7f1d1620b700 1 --2- 172.21.15.39:0/332981992 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f1cfc0b2880 0x7f1cfc0b4d90 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:04:27.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:27.766+0000 7f1d1620b700 1 --2- 172.21.15.39:0/332981992 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1d10109860 0x7f1d1019f670 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:04:27.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:27.766+0000 7f1d1620b700 1 --2- 172.21.15.39:0/332981992 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d101045e0 0x7f1d1019ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:04:27.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:27.766+0000 7f1d1620b700 1 --2- 172.21.15.39:0/332981992 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d10108f10 0x7f1d1019b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:04:27.753 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:27.766+0000 7f1d1620b700 1 -- 172.21.15.39:0/332981992 >> 172.21.15.39:0/332981992 conn(0x7f1d100ffe70 msgr2=0x7f1d101086b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:04:27.753 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:27.767+0000 7f1d1620b700 1 -- 172.21.15.39:0/332981992 shutdown_connections 2024-05-09T06:04:27.753 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:27.767+0000 7f1d1620b700 1 -- 172.21.15.39:0/332981992 wait complete. 2024-05-09T06:04:27.756 INFO:teuthology.orchestra.run.smithi039.stderr:pool 'cephfs_metadata' removed 2024-05-09T06:04:28.038 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:04:27 smithi060 ceph-mon[34555]: pgmap v1183: 97 pgs: 97 active+clean; 479 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-05-09T06:04:28.039 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:04:27 smithi060 ceph-mon[34555]: from='client.? 172.21.15.39:0/332981992' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-09T06:04:28.082 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:04:27 smithi039 ceph-mon[30439]: pgmap v1183: 97 pgs: 97 active+clean; 479 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-05-09T06:04:28.082 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:04:27 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/332981992' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-09T06:04:28.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:04:27 smithi100 ceph-mon[34353]: pgmap v1183: 97 pgs: 97 active+clean; 479 MiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-05-09T06:04:28.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:04:27 smithi100 ceph-mon[34353]: from='client.? 172.21.15.39:0/332981992' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-09T06:04:28.428 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554 shell --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-09T06:04:28.682 INFO:teuthology.orchestra.run.smithi039.stderr:Inferring config /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T06:04:29.038 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:04:28 smithi060 ceph-mon[34555]: from='client.? 172.21.15.39:0/332981992' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-05-09T06:04:29.038 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:04:28 smithi060 ceph-mon[34555]: osdmap e85: 12 total, 12 up, 12 in 2024-05-09T06:04:29.087 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:04:28 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/332981992' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-05-09T06:04:29.087 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:04:28 smithi039 ceph-mon[30439]: osdmap e85: 12 total, 12 up, 12 in 2024-05-09T06:04:29.165 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:04:28 smithi100 ceph-mon[34353]: from='client.? 172.21.15.39:0/332981992' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-05-09T06:04:29.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:04:28 smithi100 ceph-mon[34353]: osdmap e85: 12 total, 12 up, 12 in 2024-05-09T06:04:30.038 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:04:29 smithi060 ceph-mon[34555]: pgmap v1185: 65 pgs: 65 active+clean; 577 KiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T06:04:30.048 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:04:29 smithi039 ceph-mon[30439]: pgmap v1185: 65 pgs: 65 active+clean; 577 KiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T06:04:30.165 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:04:29 smithi100 ceph-mon[34353]: pgmap v1185: 65 pgs: 65 active+clean; 577 KiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T06:04:30.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:30.457+0000 7f4257049700 1 -- 172.21.15.39:0/1685814511 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f42501034c0 msgr2=0x7f42501038d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:04:30.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:30.457+0000 7f4257049700 1 --2- 172.21.15.39:0/1685814511 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f42501034c0 0x7f42501038d0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f42440099c0 tx=0x7f4244009cd0 comp rx=0 tx=0).stop 2024-05-09T06:04:30.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:30.457+0000 7f4257049700 1 -- 172.21.15.39:0/1685814511 shutdown_connections 2024-05-09T06:04:30.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:30.457+0000 7f4257049700 1 --2- 172.21.15.39:0/1685814511 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4250108740 0x7f42501100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:04:30.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:30.457+0000 7f4257049700 1 --2- 172.21.15.39:0/1685814511 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f42501034c0 0x7f42501038d0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:04:30.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:30.457+0000 7f4257049700 1 --2- 172.21.15.39:0/1685814511 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4250107df0 0x7f4250108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:04:30.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:30.457+0000 7f4257049700 1 -- 172.21.15.39:0/1685814511 >> 172.21.15.39:0/1685814511 conn(0x7f42500fedc0 msgr2=0x7f42501011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:04:30.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:30.457+0000 7f4257049700 1 -- 172.21.15.39:0/1685814511 shutdown_connections 2024-05-09T06:04:30.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:30.457+0000 7f4257049700 1 -- 172.21.15.39:0/1685814511 wait complete. 2024-05-09T06:04:30.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:30.458+0000 7f4257049700 1 Processor -- start 2024-05-09T06:04:30.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:30.458+0000 7f4257049700 1 -- start start 2024-05-09T06:04:30.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:30.458+0000 7f4257049700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f42501034c0 0x7f425019bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:04:30.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:30.458+0000 7f4257049700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4250107df0 0x7f425019c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:04:30.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:30.458+0000 7f4257049700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4250108740 0x7f425019c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:04:30.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:30.458+0000 7f4257049700 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f4250113370 con 0x7f4250108740 2024-05-09T06:04:30.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:30.458+0000 7f4257049700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f42501131f0 con 0x7f4250107df0 2024-05-09T06:04:30.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:30.458+0000 7f4257049700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f42501134f0 con 0x7f42501034c0 2024-05-09T06:04:30.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:30.458+0000 7f42555e6700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4250108740 0x7f425019c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:04:30.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:30.458+0000 7f42555e6700 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4250108740 0x7f425019c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:39136/0 (socket says 172.21.15.39:39136) 2024-05-09T06:04:30.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:30.458+0000 7f42555e6700 1 -- 172.21.15.39:0/502525657 learned_addr learned my addr 172.21.15.39:0/502525657 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-09T06:04:30.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:30.458+0000 7f4254de5700 1 --2- 172.21.15.39:0/502525657 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f42501034c0 0x7f425019bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:04:30.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:30.458+0000 7f424ffff700 1 --2- 172.21.15.39:0/502525657 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4250107df0 0x7f425019c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:04:30.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:30.459+0000 7f42555e6700 1 -- 172.21.15.39:0/502525657 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f42501034c0 msgr2=0x7f425019bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:04:30.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:30.459+0000 7f42555e6700 1 --2- 172.21.15.39:0/502525657 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f42501034c0 0x7f425019bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:04:30.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:30.459+0000 7f42555e6700 1 -- 172.21.15.39:0/502525657 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4250107df0 msgr2=0x7f425019c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:04:30.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:30.459+0000 7f42555e6700 1 --2- 172.21.15.39:0/502525657 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4250107df0 0x7f425019c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:04:30.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:30.459+0000 7f42555e6700 1 -- 172.21.15.39:0/502525657 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42501a6fc0 con 0x7f4250108740 2024-05-09T06:04:30.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:30.459+0000 7f42555e6700 1 --2- 172.21.15.39:0/502525657 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4250108740 0x7f425019c710 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f424800ef30 tx=0x7f424800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:04:30.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:30.459+0000 7f424dffb700 1 -- 172.21.15.39:0/502525657 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42480092e0 con 0x7f4250108740 2024-05-09T06:04:30.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:30.459+0000 7f424dffb700 1 -- 172.21.15.39:0/502525657 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4248004bb0 con 0x7f4250108740 2024-05-09T06:04:30.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:30.459+0000 7f424dffb700 1 -- 172.21.15.39:0/502525657 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4248004020 con 0x7f4250108740 2024-05-09T06:04:30.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:30.459+0000 7f4257049700 1 -- 172.21.15.39:0/502525657 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42501a7250 con 0x7f4250108740 2024-05-09T06:04:30.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:30.459+0000 7f4257049700 1 -- 172.21.15.39:0/502525657 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42501a7740 con 0x7f4250108740 2024-05-09T06:04:30.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:30.460+0000 7f4257049700 1 -- 172.21.15.39:0/502525657 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42500512c0 con 0x7f4250108740 2024-05-09T06:04:30.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:30.462+0000 7f424dffb700 1 -- 172.21.15.39:0/502525657 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f424801b030 con 0x7f4250108740 2024-05-09T06:04:30.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:30.463+0000 7f424dffb700 1 --2- 172.21.15.39:0/502525657 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f42400b2880 0x7f42400b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T06:04:30.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:30.463+0000 7f4254de5700 1 --2- 172.21.15.39:0/502525657 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f42400b2880 0x7f42400b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T06:04:30.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:30.463+0000 7f424dffb700 1 -- 172.21.15.39:0/502525657 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7915+0+0 (secure 0 0 0) 0x7f42480e1ad0 con 0x7f4250108740 2024-05-09T06:04:30.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:30.463+0000 7f4254de5700 1 --2- 172.21.15.39:0/502525657 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f42400b2880 0x7f42400b4d90 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f4244000c00 tx=0x7f424401a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T06:04:30.454 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:30.468+0000 7f424dffb700 1 -- 172.21.15.39:0/502525657 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f4248022020 con 0x7f4250108740 2024-05-09T06:04:30.667 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:30.680+0000 7f4257049700 1 -- 172.21.15.39:0/502525657 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f425002e830 con 0x7f4250108740 2024-05-09T06:04:30.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:30.789+0000 7f424dffb700 1 -- 172.21.15.39:0/502525657 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v86) ==== 169+0+0 (secure 0 0 0) 0x7f4248010040 con 0x7f4250108740 2024-05-09T06:04:30.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:30.792+0000 7f4257049700 1 -- 172.21.15.39:0/502525657 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f42400b2880 msgr2=0x7f42400b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:04:30.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:30.792+0000 7f4257049700 1 --2- 172.21.15.39:0/502525657 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f42400b2880 0x7f42400b4d90 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f4244000c00 tx=0x7f424401a040 comp rx=0 tx=0).stop 2024-05-09T06:04:30.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:30.792+0000 7f4257049700 1 -- 172.21.15.39:0/502525657 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4250108740 msgr2=0x7f425019c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T06:04:30.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:30.792+0000 7f4257049700 1 --2- 172.21.15.39:0/502525657 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4250108740 0x7f425019c710 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f424800ef30 tx=0x7f424800c3a0 comp rx=0 tx=0).stop 2024-05-09T06:04:30.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:30.793+0000 7f4257049700 1 -- 172.21.15.39:0/502525657 shutdown_connections 2024-05-09T06:04:30.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:30.793+0000 7f4257049700 1 --2- 172.21.15.39:0/502525657 >> [v2:172.21.15.39:6800/3184189003,v1:172.21.15.39:6801/3184189003] conn(0x7f42400b2880 0x7f42400b4d90 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:04:30.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:30.793+0000 7f4257049700 1 --2- 172.21.15.39:0/502525657 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4250108740 0x7f425019c710 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:04:30.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:30.793+0000 7f4257049700 1 --2- 172.21.15.39:0/502525657 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f42501034c0 0x7f425019bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:04:30.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:30.793+0000 7f4257049700 1 --2- 172.21.15.39:0/502525657 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4250107df0 0x7f425019c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T06:04:30.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:30.793+0000 7f4257049700 1 -- 172.21.15.39:0/502525657 >> 172.21.15.39:0/502525657 conn(0x7f42500fedc0 msgr2=0x7f42501096a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T06:04:30.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:30.795+0000 7f4257049700 1 -- 172.21.15.39:0/502525657 shutdown_connections 2024-05-09T06:04:30.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-09T06:04:30.795+0000 7f4257049700 1 -- 172.21.15.39:0/502525657 wait complete. 2024-05-09T06:04:30.782 INFO:teuthology.orchestra.run.smithi039.stderr:pool 'cephfs_data' removed 2024-05-09T06:04:31.038 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:04:30 smithi060 ceph-mon[34555]: from='client.? 172.21.15.39:0/502525657' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-09T06:04:31.091 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:04:30 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/502525657' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-09T06:04:31.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:04:30 smithi100 ceph-mon[34353]: from='client.? 172.21.15.39:0/502525657' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-09T06:04:31.521 DEBUG:teuthology.orchestra.run.smithi039:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-09T06:04:31.551 DEBUG:teuthology.orchestra.run.smithi060:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-09T06:04:31.595 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-09T06:04:31.638 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-05-09T06:04:31.639 DEBUG:teuthology.orchestra.run.smithi039:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-05-09T06:04:31.655 DEBUG:teuthology.orchestra.run.smithi060:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-05-09T06:04:31.672 DEBUG:teuthology.orchestra.run.smithi100:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-05-09T06:04:31.693 INFO:tasks.cephadm:Stopping all daemons... 2024-05-09T06:04:31.693 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-05-09T06:04:31.693 DEBUG:teuthology.orchestra.run.smithi039:> sudo systemctl stop ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@mon.a 2024-05-09T06:04:31.776 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:04:31 smithi039 systemd[1]: Stopping Ceph mon.a for 86d4cc60-0dc4-11ef-bc97-c7b262605968... 2024-05-09T06:04:31.915 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:04:31 smithi100 ceph-mon[34353]: pgmap v1186: 65 pgs: 65 active+clean; 577 KiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T06:04:31.916 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:04:31 smithi100 ceph-mon[34353]: from='client.? 172.21.15.39:0/502525657' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-05-09T06:04:31.916 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:04:31 smithi100 ceph-mon[34353]: osdmap e86: 12 total, 12 up, 12 in 2024-05-09T06:04:32.035 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:04:31 smithi039 ceph-mon[30439]: pgmap v1186: 65 pgs: 65 active+clean; 577 KiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T06:04:32.035 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:04:31 smithi039 ceph-mon[30439]: from='client.? 172.21.15.39:0/502525657' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-05-09T06:04:32.035 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:04:31 smithi039 ceph-mon[30439]: osdmap e86: 12 total, 12 up, 12 in 2024-05-09T06:04:32.035 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:04:32 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mon-a[30434]: 2024-05-09T06:04:32.018+0000 7f6777ac4700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T06:04:32.035 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:04:32 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mon-a[30434]: 2024-05-09T06:04:32.018+0000 7f6777ac4700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-05-09T06:04:32.038 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:04:31 smithi060 ceph-mon[34555]: pgmap v1186: 65 pgs: 65 active+clean; 577 KiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T06:04:32.038 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:04:31 smithi060 ceph-mon[34555]: from='client.? 172.21.15.39:0/502525657' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-05-09T06:04:32.038 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:04:31 smithi060 ceph-mon[34555]: osdmap e86: 12 total, 12 up, 12 in 2024-05-09T06:04:32.305 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:04:32 smithi039 podman[94263]: 2024-05-09 06:04:32.049868895 +0000 UTC m=+0.143423437 container died 002b60ced19b6c6879908e6e269f303837c19fb98a3ba0be01bf5c952f65f192 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mon-a, org.label-schema.build-date=20240507, ceph=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-09T06:04:32.590 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:04:32 smithi039 podman[94263]: 2024-05-09 06:04:32.393973178 +0000 UTC m=+0.487527719 container cleanup 002b60ced19b6c6879908e6e269f303837c19fb98a3ba0be01bf5c952f65f192 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mon-a, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.33.5, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.build-date=20240507) 2024-05-09T06:04:32.590 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:04:32 smithi039 bash[94263]: ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mon-a 2024-05-09T06:04:32.811 DEBUG:teuthology.orchestra.run.smithi039:> sudo pkill -f 'journalctl -f -n 0 -u ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@mon.a.service' 2024-05-09T06:04:32.852 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:04:32 smithi039 podman[94277]: 2024-05-09 06:04:32.603759134 +0000 UTC m=+0.551141397 container remove 002b60ced19b6c6879908e6e269f303837c19fb98a3ba0be01bf5c952f65f192 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mon-a, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD) 2024-05-09T06:04:32.852 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:04:32 smithi039 systemd[1]: ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@mon.a.service: Deactivated successfully. 2024-05-09T06:04:32.852 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:04:32 smithi039 systemd[1]: Stopped Ceph mon.a for 86d4cc60-0dc4-11ef-bc97-c7b262605968. 2024-05-09T06:04:32.852 INFO:journalctl@ceph.mon.a.smithi039.stdout:May 09 06:04:32 smithi039 systemd[1]: ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@mon.a.service: Consumed 29.560s CPU time. 2024-05-09T06:04:32.857 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T06:04:32.857 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-05-09T06:04:32.857 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-05-09T06:04:32.857 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@mon.b 2024-05-09T06:04:33.221 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:04:32 smithi060 systemd[1]: Stopping Ceph mon.b for 86d4cc60-0dc4-11ef-bc97-c7b262605968... 2024-05-09T06:04:33.538 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:04:33 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mon-b[34551]: 2024-05-09T06:04:33.235+0000 7f0c891ab700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T06:04:33.538 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:04:33 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mon-b[34551]: 2024-05-09T06:04:33.235+0000 7f0c891ab700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-05-09T06:04:33.539 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:04:33 smithi060 podman[76366]: 2024-05-09 06:04:33.307691712 +0000 UTC m=+0.176776876 container died 2d6b6454a11041ed3c797fde4e492d7da66fca80b79011b5fa1c7fcbcd5430a9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mon-b, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404) 2024-05-09T06:04:33.955 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:04:33 smithi060 podman[76366]: 2024-05-09 06:04:33.677348388 +0000 UTC m=+0.546433558 container cleanup 2d6b6454a11041ed3c797fde4e492d7da66fca80b79011b5fa1c7fcbcd5430a9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mon-b, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-05-09T06:04:33.955 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 09 06:04:33 smithi060 bash[76366]: ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mon-b 2024-05-09T06:04:34.099 DEBUG:teuthology.orchestra.run.smithi060:> sudo pkill -f 'journalctl -f -n 0 -u ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@mon.b.service' 2024-05-09T06:04:34.144 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T06:04:34.144 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-05-09T06:04:34.144 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-05-09T06:04:34.145 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@mon.c 2024-05-09T06:04:34.335 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:04:34 smithi100 systemd[1]: Stopping Ceph mon.c for 86d4cc60-0dc4-11ef-bc97-c7b262605968... 2024-05-09T06:04:35.108 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:04:34 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mon-c[34349]: 2024-05-09T06:04:34.685+0000 7fdb3c262700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T06:04:35.108 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:04:34 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mon-c[34349]: 2024-05-09T06:04:34.685+0000 7fdb3c262700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-05-09T06:04:35.108 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:04:34 smithi100 podman[74036]: 2024-05-09 06:04:34.889759121 +0000 UTC m=+0.406691567 container died 636febe0454da429ec5373253ab41d70cacabddae44ba9b1afb81862bda15c65 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mon-c, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-09T06:04:36.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:04:36 smithi100 podman[74036]: 2024-05-09 06:04:36.024226109 +0000 UTC m=+1.541158551 container cleanup 636febe0454da429ec5373253ab41d70cacabddae44ba9b1afb81862bda15c65 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mon-c, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, ceph=True) 2024-05-09T06:04:36.166 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:04:36 smithi100 bash[74036]: ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mon-c 2024-05-09T06:04:36.449 DEBUG:teuthology.orchestra.run.smithi100:> sudo pkill -f 'journalctl -f -n 0 -u ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@mon.c.service' 2024-05-09T06:04:36.471 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:04:36 smithi100 podman[74075]: 2024-05-09 06:04:36.234122713 +0000 UTC m=+1.341380868 container remove 636febe0454da429ec5373253ab41d70cacabddae44ba9b1afb81862bda15c65 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mon-c, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-09T06:04:36.471 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:04:36 smithi100 systemd[1]: ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@mon.c.service: Deactivated successfully. 2024-05-09T06:04:36.471 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:04:36 smithi100 systemd[1]: Stopped Ceph mon.c for 86d4cc60-0dc4-11ef-bc97-c7b262605968. 2024-05-09T06:04:36.471 INFO:journalctl@ceph.mon.c.smithi100.stdout:May 09 06:04:36 smithi100 systemd[1]: ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@mon.c.service: Consumed 19.543s CPU time. 2024-05-09T06:04:36.492 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T06:04:36.493 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-05-09T06:04:36.493 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-05-09T06:04:36.493 DEBUG:teuthology.orchestra.run.smithi039:> sudo systemctl stop ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@mgr.x 2024-05-09T06:04:36.852 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 06:04:36 smithi039 systemd[1]: Stopping Ceph mgr.x for 86d4cc60-0dc4-11ef-bc97-c7b262605968... 2024-05-09T06:04:37.206 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 06:04:36 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x[30667]: 2024-05-09T06:04:36.898+0000 7fcb85a49700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T06:04:37.206 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 06:04:36 smithi039 podman[94383]: 2024-05-09 06:04:36.9300264 +0000 UTC m=+0.223161444 container died 07c07c8c5306c643b5732e7117e01ebe4a6f0a594c2ec46236eab9f0148ef1ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, CEPH_POINT_RELEASE=) 2024-05-09T06:04:37.602 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 06:04:37 smithi039 podman[94383]: 2024-05-09 06:04:37.29905555 +0000 UTC m=+0.592190591 container cleanup 07c07c8c5306c643b5732e7117e01ebe4a6f0a594c2ec46236eab9f0148ef1ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:c9da4049f638c0f84bdd9b4e33c42e86046ac554, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-05-09T06:04:37.602 INFO:journalctl@ceph.mgr.x.smithi039.stdout:May 09 06:04:37 smithi039 bash[94383]: ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-x 2024-05-09T06:04:37.765 DEBUG:teuthology.orchestra.run.smithi039:> sudo pkill -f 'journalctl -f -n 0 -u ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@mgr.x.service' 2024-05-09T06:04:37.802 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T06:04:37.802 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-05-09T06:04:37.802 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-05-09T06:04:37.803 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@mgr.y 2024-05-09T06:04:38.121 INFO:journalctl@ceph.mgr.y.smithi060.stdout:May 09 06:04:37 smithi060 systemd[1]: Stopping Ceph mgr.y for 86d4cc60-0dc4-11ef-bc97-c7b262605968... 2024-05-09T06:04:38.417 INFO:journalctl@ceph.mgr.y.smithi060.stdout:May 09 06:04:38 smithi060 podman[76488]: 2024-05-09 06:04:38.135801336 +0000 UTC m=+0.118714921 container died e4c3c25c4dab69148bbadb67616fe4bfdafe7d242c19a5aa7c7cc08be96b6937 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-y, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-09T06:04:38.752 INFO:journalctl@ceph.mgr.y.smithi060.stdout:May 09 06:04:38 smithi060 podman[76488]: 2024-05-09 06:04:38.556934207 +0000 UTC m=+0.539847785 container cleanup e4c3c25c4dab69148bbadb67616fe4bfdafe7d242c19a5aa7c7cc08be96b6937 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-y, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404) 2024-05-09T06:04:38.752 INFO:journalctl@ceph.mgr.y.smithi060.stdout:May 09 06:04:38 smithi060 bash[76488]: ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-y 2024-05-09T06:04:38.975 DEBUG:teuthology.orchestra.run.smithi060:> sudo pkill -f 'journalctl -f -n 0 -u ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@mgr.y.service' 2024-05-09T06:04:39.010 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T06:04:39.011 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-05-09T06:04:39.011 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-05-09T06:04:39.011 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@mgr.z 2024-05-09T06:04:39.335 INFO:journalctl@ceph.mgr.z.smithi100.stdout:May 09 06:04:39 smithi100 systemd[1]: Stopping Ceph mgr.z for 86d4cc60-0dc4-11ef-bc97-c7b262605968... 2024-05-09T06:04:39.590 INFO:journalctl@ceph.mgr.z.smithi100.stdout:May 09 06:04:39 smithi100 podman[76441]: 2024-05-09 06:04:39.349838637 +0000 UTC m=+0.134917974 container died 0e88cf8e9140934292872bbf3014b969eadc3e74932fe0695ee75e6054b41733 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-z, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-05-09T06:04:39.882 INFO:journalctl@ceph.mgr.z.smithi100.stdout:May 09 06:04:39 smithi100 podman[76441]: 2024-05-09 06:04:39.679337688 +0000 UTC m=+0.464417059 container cleanup 0e88cf8e9140934292872bbf3014b969eadc3e74932fe0695ee75e6054b41733 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-z, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-05-09T06:04:39.883 INFO:journalctl@ceph.mgr.z.smithi100.stdout:May 09 06:04:39 smithi100 bash[76441]: ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-z 2024-05-09T06:04:40.131 DEBUG:teuthology.orchestra.run.smithi100:> sudo pkill -f 'journalctl -f -n 0 -u ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@mgr.z.service' 2024-05-09T06:04:40.151 INFO:journalctl@ceph.mgr.z.smithi100.stdout:May 09 06:04:39 smithi100 podman[76455]: 2024-05-09 06:04:39.897423238 +0000 UTC m=+0.543456472 container remove 0e88cf8e9140934292872bbf3014b969eadc3e74932fe0695ee75e6054b41733 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mgr-z, GIT_CLEAN=True, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-05-09T06:04:40.151 INFO:journalctl@ceph.mgr.z.smithi100.stdout:May 09 06:04:39 smithi100 systemd[1]: ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@mgr.z.service: Main process exited, code=exited, status=143/n/a 2024-05-09T06:04:40.151 INFO:journalctl@ceph.mgr.z.smithi100.stdout:May 09 06:04:40 smithi100 systemd[1]: ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@mgr.z.service: Failed with result 'exit-code'. 2024-05-09T06:04:40.151 INFO:journalctl@ceph.mgr.z.smithi100.stdout:May 09 06:04:40 smithi100 systemd[1]: Stopped Ceph mgr.z for 86d4cc60-0dc4-11ef-bc97-c7b262605968. 2024-05-09T06:04:40.151 INFO:journalctl@ceph.mgr.z.smithi100.stdout:May 09 06:04:40 smithi100 systemd[1]: ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@mgr.z.service: Consumed 16.210s CPU time. 2024-05-09T06:04:40.165 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T06:04:40.165 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-05-09T06:04:40.165 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-05-09T06:04:40.165 DEBUG:teuthology.orchestra.run.smithi039:> sudo systemctl stop ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@osd.0 2024-05-09T06:04:40.489 INFO:journalctl@ceph.osd.0.smithi039.stdout:May 09 06:04:40 smithi039 systemd[1]: Stopping Ceph osd.0 for 86d4cc60-0dc4-11ef-bc97-c7b262605968... 2024-05-09T06:04:40.852 INFO:journalctl@ceph.osd.0.smithi039.stdout:May 09 06:04:40 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-0[42469]: 2024-05-09T06:04:40.503+0000 7f5da0a99700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T06:04:40.852 INFO:journalctl@ceph.osd.0.smithi039.stdout:May 09 06:04:40 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-0[42469]: 2024-05-09T06:04:40.503+0000 7f5da0a99700 -1 osd.0 86 *** Got signal Terminated *** 2024-05-09T06:04:40.852 INFO:journalctl@ceph.osd.0.smithi039.stdout:May 09 06:04:40 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-0[42469]: 2024-05-09T06:04:40.503+0000 7f5da0a99700 -1 osd.0 86 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-09T06:04:46.282 INFO:journalctl@ceph.osd.0.smithi039.stdout:May 09 06:04:46 smithi039 podman[94503]: 2024-05-09 06:04:46.023260131 +0000 UTC m=+5.639849565 container died 6891dc8e55ed5b74db47a3478347a60d8e70d6b615d2fb9369556fef8c12982c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-0, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-09T06:04:46.602 INFO:journalctl@ceph.osd.0.smithi039.stdout:May 09 06:04:46 smithi039 podman[94503]: 2024-05-09 06:04:46.379147015 +0000 UTC m=+5.995736438 container cleanup 6891dc8e55ed5b74db47a3478347a60d8e70d6b615d2fb9369556fef8c12982c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-0, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-05-09T06:04:46.602 INFO:journalctl@ceph.osd.0.smithi039.stdout:May 09 06:04:46 smithi039 bash[94503]: ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-0 2024-05-09T06:04:46.987 INFO:journalctl@ceph.osd.0.smithi039.stdout:May 09 06:04:46 smithi039 podman[94521]: 2024-05-09 06:04:46.652207103 +0000 UTC m=+0.623167745 container remove 6891dc8e55ed5b74db47a3478347a60d8e70d6b615d2fb9369556fef8c12982c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-09T06:04:47.302 INFO:journalctl@ceph.osd.0.smithi039.stdout:May 09 06:04:47 smithi039 podman[94609]: 2024-05-09 06:04:46.90560423 +0000 UTC m=+0.018534819 image pull db794d706f492c144ccc8f2c5bbc1870e116f5c4f3309dfab4416b39d099f8d7 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584 2024-05-09T06:04:47.303 INFO:journalctl@ceph.osd.0.smithi039.stdout:May 09 06:04:47 smithi039 podman[94609]: 2024-05-09 06:04:47.014698945 +0000 UTC m=+0.127629536 container create c34d9212ee91d651b704894956409fb5f7e0b26e9a911649671776c2d802f9e0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-0-deactivate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.schema-version=1.0) 2024-05-09T06:04:47.303 INFO:journalctl@ceph.osd.0.smithi039.stdout:May 09 06:04:47 smithi039 podman[94609]: 2024-05-09 06:04:47.234486064 +0000 UTC m=+0.347416666 container init c34d9212ee91d651b704894956409fb5f7e0b26e9a911649671776c2d802f9e0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-0-deactivate, org.label-schema.build-date=20240507, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-05-09T06:04:47.303 INFO:journalctl@ceph.osd.0.smithi039.stdout:May 09 06:04:47 smithi039 podman[94609]: 2024-05-09 06:04:47.238321407 +0000 UTC m=+0.351252005 container start c34d9212ee91d651b704894956409fb5f7e0b26e9a911649671776c2d802f9e0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-0-deactivate, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507) 2024-05-09T06:04:47.303 INFO:journalctl@ceph.osd.0.smithi039.stdout:May 09 06:04:47 smithi039 podman[94609]: 2024-05-09 06:04:47.317353377 +0000 UTC m=+0.430283984 container attach c34d9212ee91d651b704894956409fb5f7e0b26e9a911649671776c2d802f9e0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-0-deactivate, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-09T06:04:47.602 INFO:journalctl@ceph.osd.0.smithi039.stdout:May 09 06:04:47 smithi039 podman[94609]: 2024-05-09 06:04:47.54902283 +0000 UTC m=+0.661953427 container died c34d9212ee91d651b704894956409fb5f7e0b26e9a911649671776c2d802f9e0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-0-deactivate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5) 2024-05-09T06:04:48.108 DEBUG:teuthology.orchestra.run.smithi039:> sudo pkill -f 'journalctl -f -n 0 -u ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@osd.0.service' 2024-05-09T06:04:48.150 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T06:04:48.151 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-05-09T06:04:48.151 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-05-09T06:04:48.151 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@osd.1 2024-05-09T06:04:48.455 INFO:journalctl@ceph.osd.1.smithi060.stdout:May 09 06:04:48 smithi060 systemd[1]: Stopping Ceph osd.1 for 86d4cc60-0dc4-11ef-bc97-c7b262605968... 2024-05-09T06:04:48.788 INFO:journalctl@ceph.osd.1.smithi060.stdout:May 09 06:04:48 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-1[39153]: 2024-05-09T06:04:48.468+0000 7efe9cbfa700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T06:04:48.789 INFO:journalctl@ceph.osd.1.smithi060.stdout:May 09 06:04:48 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-1[39153]: 2024-05-09T06:04:48.468+0000 7efe9cbfa700 -1 osd.1 86 *** Got signal Terminated *** 2024-05-09T06:04:48.789 INFO:journalctl@ceph.osd.1.smithi060.stdout:May 09 06:04:48 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-1[39153]: 2024-05-09T06:04:48.468+0000 7efe9cbfa700 -1 osd.1 86 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-09T06:04:54.264 INFO:journalctl@ceph.osd.1.smithi060.stdout:May 09 06:04:53 smithi060 podman[76611]: 2024-05-09 06:04:53.98884374 +0000 UTC m=+5.623872342 container died 2aee270eb360f39892faca11c766fb34c6c196bc1967e8aa620f2fb350b961a9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-1, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux ) 2024-05-09T06:04:54.538 INFO:journalctl@ceph.osd.1.smithi060.stdout:May 09 06:04:54 smithi060 podman[76611]: 2024-05-09 06:04:54.377686525 +0000 UTC m=+6.012715126 container cleanup 2aee270eb360f39892faca11c766fb34c6c196bc1967e8aa620f2fb350b961a9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-1, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.33.5) 2024-05-09T06:04:54.539 INFO:journalctl@ceph.osd.1.smithi060.stdout:May 09 06:04:54 smithi060 bash[76611]: ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-1 2024-05-09T06:04:54.998 INFO:journalctl@ceph.osd.1.smithi060.stdout:May 09 06:04:54 smithi060 podman[76640]: 2024-05-09 06:04:54.671141658 +0000 UTC m=+0.677298812 container remove 2aee270eb360f39892faca11c766fb34c6c196bc1967e8aa620f2fb350b961a9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-1, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-05-09T06:04:55.289 INFO:journalctl@ceph.osd.1.smithi060.stdout:May 09 06:04:55 smithi060 podman[76732]: 2024-05-09 06:04:55.013791477 +0000 UTC m=+0.114642536 container create 8bde2b2f0393e8fb54d072ca4496865cbb085164db48df4ca3f4877ab5872425 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-1-deactivate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-05-09T06:04:55.289 INFO:journalctl@ceph.osd.1.smithi060.stdout:May 09 06:04:55 smithi060 podman[76732]: 2024-05-09 06:04:54.917788017 +0000 UTC m=+0.018639048 image pull db794d706f492c144ccc8f2c5bbc1870e116f5c4f3309dfab4416b39d099f8d7 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584 2024-05-09T06:04:55.289 INFO:journalctl@ceph.osd.1.smithi060.stdout:May 09 06:04:55 smithi060 podman[76732]: 2024-05-09 06:04:55.224786899 +0000 UTC m=+0.325637930 container init 8bde2b2f0393e8fb54d072ca4496865cbb085164db48df4ca3f4877ab5872425 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-1-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD) 2024-05-09T06:04:55.290 INFO:journalctl@ceph.osd.1.smithi060.stdout:May 09 06:04:55 smithi060 podman[76732]: 2024-05-09 06:04:55.228203855 +0000 UTC m=+0.329054873 container start 8bde2b2f0393e8fb54d072ca4496865cbb085164db48df4ca3f4877ab5872425 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-1-deactivate, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-09T06:04:55.789 INFO:journalctl@ceph.osd.1.smithi060.stdout:May 09 06:04:55 smithi060 podman[76732]: 2024-05-09 06:04:55.332766494 +0000 UTC m=+0.433617516 container attach 8bde2b2f0393e8fb54d072ca4496865cbb085164db48df4ca3f4877ab5872425 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.33.5, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404) 2024-05-09T06:04:55.789 INFO:journalctl@ceph.osd.1.smithi060.stdout:May 09 06:04:55 smithi060 podman[76732]: 2024-05-09 06:04:55.547813221 +0000 UTC m=+0.648664241 container died 8bde2b2f0393e8fb54d072ca4496865cbb085164db48df4ca3f4877ab5872425 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-09T06:04:56.135 DEBUG:teuthology.orchestra.run.smithi060:> sudo pkill -f 'journalctl -f -n 0 -u ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@osd.1.service' 2024-05-09T06:04:56.179 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T06:04:56.179 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-05-09T06:04:56.179 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-05-09T06:04:56.179 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@osd.2 2024-05-09T06:04:56.485 INFO:journalctl@ceph.osd.2.smithi100.stdout:May 09 06:04:56 smithi100 systemd[1]: Stopping Ceph osd.2 for 86d4cc60-0dc4-11ef-bc97-c7b262605968... 2024-05-09T06:04:56.916 INFO:journalctl@ceph.osd.2.smithi100.stdout:May 09 06:04:56 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-2[39491]: 2024-05-09T06:04:56.499+0000 7f77b21bc700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T06:04:56.916 INFO:journalctl@ceph.osd.2.smithi100.stdout:May 09 06:04:56 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-2[39491]: 2024-05-09T06:04:56.499+0000 7f77b21bc700 -1 osd.2 86 *** Got signal Terminated *** 2024-05-09T06:04:56.916 INFO:journalctl@ceph.osd.2.smithi100.stdout:May 09 06:04:56 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-2[39491]: 2024-05-09T06:04:56.499+0000 7f77b21bc700 -1 osd.2 86 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-09T06:05:02.211 INFO:journalctl@ceph.osd.2.smithi100.stdout:May 09 06:05:01 smithi100 podman[76568]: 2024-05-09 06:05:01.954259146 +0000 UTC m=+5.565577450 container died c6c20dac1167fa66fdaf388db030e3711237bb74d299aafff7f42a74327cac27 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-05-09T06:05:02.587 INFO:journalctl@ceph.osd.2.smithi100.stdout:May 09 06:05:02 smithi100 podman[76568]: 2024-05-09 06:05:02.316668168 +0000 UTC m=+5.927986510 container cleanup c6c20dac1167fa66fdaf388db030e3711237bb74d299aafff7f42a74327cac27 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404) 2024-05-09T06:05:02.587 INFO:journalctl@ceph.osd.2.smithi100.stdout:May 09 06:05:02 smithi100 bash[76568]: ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-2 2024-05-09T06:05:02.912 INFO:journalctl@ceph.osd.2.smithi100.stdout:May 09 06:05:02 smithi100 podman[76585]: 2024-05-09 06:05:02.601677445 +0000 UTC m=+0.650436249 container remove c6c20dac1167fa66fdaf388db030e3711237bb74d299aafff7f42a74327cac27 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS) 2024-05-09T06:05:03.165 INFO:journalctl@ceph.osd.2.smithi100.stdout:May 09 06:05:02 smithi100 podman[76675]: 2024-05-09 06:05:02.830517194 +0000 UTC m=+0.018030448 image pull db794d706f492c144ccc8f2c5bbc1870e116f5c4f3309dfab4416b39d099f8d7 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584 2024-05-09T06:05:03.166 INFO:journalctl@ceph.osd.2.smithi100.stdout:May 09 06:05:02 smithi100 podman[76675]: 2024-05-09 06:05:02.95245262 +0000 UTC m=+0.139965851 container create 9ae895410bbd4addc1415ee5c00a344ecbf539cdd915858eb57cd9bdb2c64d8a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-2-deactivate, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-05-09T06:05:03.166 INFO:journalctl@ceph.osd.2.smithi100.stdout:May 09 06:05:03 smithi100 podman[76675]: 2024-05-09 06:05:03.171878477 +0000 UTC m=+0.359391712 container init 9ae895410bbd4addc1415ee5c00a344ecbf539cdd915858eb57cd9bdb2c64d8a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-2-deactivate, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-05-09T06:05:03.166 INFO:journalctl@ceph.osd.2.smithi100.stdout:May 09 06:05:03 smithi100 podman[76675]: 2024-05-09 06:05:03.174883006 +0000 UTC m=+0.362396237 container start 9ae895410bbd4addc1415ee5c00a344ecbf539cdd915858eb57cd9bdb2c64d8a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-2-deactivate, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507) 2024-05-09T06:05:03.665 INFO:journalctl@ceph.osd.2.smithi100.stdout:May 09 06:05:03 smithi100 podman[76675]: 2024-05-09 06:05:03.271656531 +0000 UTC m=+0.459169774 container attach 9ae895410bbd4addc1415ee5c00a344ecbf539cdd915858eb57cd9bdb2c64d8a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-2-deactivate, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.33.5) 2024-05-09T06:05:03.666 INFO:journalctl@ceph.osd.2.smithi100.stdout:May 09 06:05:03 smithi100 podman[76675]: 2024-05-09 06:05:03.465244109 +0000 UTC m=+0.652757345 container died 9ae895410bbd4addc1415ee5c00a344ecbf539cdd915858eb57cd9bdb2c64d8a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-2-deactivate, ceph=True, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, io.buildah.version=1.33.5) 2024-05-09T06:05:04.015 INFO:journalctl@ceph.osd.2.smithi100.stdout:May 09 06:05:04 smithi100 podman[76701]: 2024-05-09 06:05:04.00855719 +0000 UTC m=+0.538233141 container remove 9ae895410bbd4addc1415ee5c00a344ecbf539cdd915858eb57cd9bdb2c64d8a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404) 2024-05-09T06:05:04.020 DEBUG:teuthology.orchestra.run.smithi100:> sudo pkill -f 'journalctl -f -n 0 -u ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@osd.2.service' 2024-05-09T06:05:04.058 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T06:05:04.058 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-05-09T06:05:04.058 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-05-09T06:05:04.058 DEBUG:teuthology.orchestra.run.smithi039:> sudo systemctl stop ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@osd.3 2024-05-09T06:05:04.352 INFO:journalctl@ceph.osd.3.smithi039.stdout:May 09 06:05:04 smithi039 systemd[1]: Stopping Ceph osd.3 for 86d4cc60-0dc4-11ef-bc97-c7b262605968... 2024-05-09T06:05:04.852 INFO:journalctl@ceph.osd.3.smithi039.stdout:May 09 06:05:04 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-3[49390]: 2024-05-09T06:05:04.390+0000 7fc7719d2700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T06:05:04.852 INFO:journalctl@ceph.osd.3.smithi039.stdout:May 09 06:05:04 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-3[49390]: 2024-05-09T06:05:04.390+0000 7fc7719d2700 -1 osd.3 86 *** Got signal Terminated *** 2024-05-09T06:05:04.852 INFO:journalctl@ceph.osd.3.smithi039.stdout:May 09 06:05:04 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-3[49390]: 2024-05-09T06:05:04.390+0000 7fc7719d2700 -1 osd.3 86 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-09T06:05:06.415 INFO:journalctl@ceph.osd.5.smithi100.stdout:May 09 06:05:06 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-5[46447]: 2024-05-09T06:05:06.142+0000 7f9c82a12700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:40.759657+0000 front 2024-05-09T06:04:40.759565+0000 (oldest deadline 2024-05-09T06:05:06.059465+0000) 2024-05-09T06:05:07.352 INFO:journalctl@ceph.osd.6.smithi039.stdout:May 09 06:05:06 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-6[56339]: 2024-05-09T06:05:06.927+0000 7fc2c9f4a700 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:42.778856+0000 front 2024-05-09T06:04:42.778818+0000 (oldest deadline 2024-05-09T06:05:06.279108+0000) 2024-05-09T06:05:07.415 INFO:journalctl@ceph.osd.5.smithi100.stdout:May 09 06:05:07 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-5[46447]: 2024-05-09T06:05:07.107+0000 7f9c82a12700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:40.759657+0000 front 2024-05-09T06:04:40.759565+0000 (oldest deadline 2024-05-09T06:05:06.059465+0000) 2024-05-09T06:05:07.416 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:07 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:07.055+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:40.939354+0000 front 2024-05-09T06:04:40.939391+0000 (oldest deadline 2024-05-09T06:05:06.239561+0000) 2024-05-09T06:05:08.352 INFO:journalctl@ceph.osd.6.smithi039.stdout:May 09 06:05:07 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-6[56339]: 2024-05-09T06:05:07.954+0000 7fc2c9f4a700 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:42.778856+0000 front 2024-05-09T06:04:42.778818+0000 (oldest deadline 2024-05-09T06:05:06.279108+0000) 2024-05-09T06:05:08.416 INFO:journalctl@ceph.osd.5.smithi100.stdout:May 09 06:05:08 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-5[46447]: 2024-05-09T06:05:08.093+0000 7f9c82a12700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:40.759657+0000 front 2024-05-09T06:04:40.759565+0000 (oldest deadline 2024-05-09T06:05:06.059465+0000) 2024-05-09T06:05:08.416 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:08 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:08.042+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:40.939354+0000 front 2024-05-09T06:04:40.939391+0000 (oldest deadline 2024-05-09T06:05:06.239561+0000) 2024-05-09T06:05:08.852 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:08 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:08.408+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:43.538761+0000 front 2024-05-09T06:04:43.538885+0000 (oldest deadline 2024-05-09T06:05:08.239002+0000) 2024-05-09T06:05:09.352 INFO:journalctl@ceph.osd.6.smithi039.stdout:May 09 06:05:09 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-6[56339]: 2024-05-09T06:05:09.000+0000 7fc2c9f4a700 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:42.778856+0000 front 2024-05-09T06:04:42.778818+0000 (oldest deadline 2024-05-09T06:05:06.279108+0000) 2024-05-09T06:05:09.415 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:09 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:09.064+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:40.939354+0000 front 2024-05-09T06:04:40.939391+0000 (oldest deadline 2024-05-09T06:05:06.239561+0000) 2024-05-09T06:05:09.416 INFO:journalctl@ceph.osd.5.smithi100.stdout:May 09 06:05:09 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-5[46447]: 2024-05-09T06:05:09.128+0000 7f9c82a12700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:40.759657+0000 front 2024-05-09T06:04:40.759565+0000 (oldest deadline 2024-05-09T06:05:06.059465+0000) 2024-05-09T06:05:09.852 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:09 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:09.448+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:43.538761+0000 front 2024-05-09T06:04:43.538885+0000 (oldest deadline 2024-05-09T06:05:08.239002+0000) 2024-05-09T06:05:10.242 INFO:journalctl@ceph.osd.6.smithi039.stdout:May 09 06:05:10 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-6[56339]: 2024-05-09T06:05:10.024+0000 7fc2c9f4a700 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:42.778856+0000 front 2024-05-09T06:04:42.778818+0000 (oldest deadline 2024-05-09T06:05:06.279108+0000) 2024-05-09T06:05:10.242 INFO:journalctl@ceph.osd.3.smithi039.stdout:May 09 06:05:09 smithi039 podman[94738]: 2024-05-09 06:05:09.944475476 +0000 UTC m=+5.667809345 container stop ac281d2fb91347d29497244040eacdc094a370d55852e52a0b8f19f15e695959 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-3, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-05-09T06:05:10.242 INFO:journalctl@ceph.osd.3.smithi039.stdout:May 09 06:05:09 smithi039 podman[94738]: 2024-05-09 06:05:09.969953592 +0000 UTC m=+5.693287461 container died ac281d2fb91347d29497244040eacdc094a370d55852e52a0b8f19f15e695959 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-3, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD) 2024-05-09T06:05:10.243 INFO:journalctl@ceph.osd.3.smithi039.stdout:May 09 06:05:10 smithi039 podman[94738]: 2024-05-09 06:05:10.25737466 +0000 UTC m=+5.980708528 container cleanup ac281d2fb91347d29497244040eacdc094a370d55852e52a0b8f19f15e695959 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-3, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-05-09T06:05:10.317 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:10 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:10.016+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:40.939354+0000 front 2024-05-09T06:04:40.939391+0000 (oldest deadline 2024-05-09T06:05:06.239561+0000) 2024-05-09T06:05:10.317 INFO:journalctl@ceph.osd.5.smithi100.stdout:May 09 06:05:10 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-5[46447]: 2024-05-09T06:05:10.158+0000 7f9c82a12700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:40.759657+0000 front 2024-05-09T06:04:40.759565+0000 (oldest deadline 2024-05-09T06:05:06.059465+0000) 2024-05-09T06:05:10.602 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:10 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:10.451+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:43.538761+0000 front 2024-05-09T06:04:43.538885+0000 (oldest deadline 2024-05-09T06:05:08.239002+0000) 2024-05-09T06:05:10.602 INFO:journalctl@ceph.osd.3.smithi039.stdout:May 09 06:05:10 smithi039 bash[94738]: ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-3 2024-05-09T06:05:10.602 INFO:journalctl@ceph.osd.3.smithi039.stdout:May 09 06:05:10 smithi039 podman[94756]: 2024-05-09 06:05:10.425293034 +0000 UTC m=+0.473042381 container remove ac281d2fb91347d29497244040eacdc094a370d55852e52a0b8f19f15e695959 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-3, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-05-09T06:05:11.179 INFO:journalctl@ceph.osd.6.smithi039.stdout:May 09 06:05:11 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-6[56339]: 2024-05-09T06:05:11.007+0000 7fc2c9f4a700 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:42.778856+0000 front 2024-05-09T06:04:42.778818+0000 (oldest deadline 2024-05-09T06:05:06.279108+0000) 2024-05-09T06:05:11.180 INFO:journalctl@ceph.osd.3.smithi039.stdout:May 09 06:05:10 smithi039 podman[94850]: 2024-05-09 06:05:10.892840549 +0000 UTC m=+0.111848015 container create b97e99dceed182c28e2b3b4c4b95f1e9fa01f016291b30c8c632789da79a0fea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-3-deactivate, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS) 2024-05-09T06:05:11.180 INFO:journalctl@ceph.osd.3.smithi039.stdout:May 09 06:05:10 smithi039 podman[94850]: 2024-05-09 06:05:10.799696733 +0000 UTC m=+0.018704199 image pull db794d706f492c144ccc8f2c5bbc1870e116f5c4f3309dfab4416b39d099f8d7 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584 2024-05-09T06:05:11.180 INFO:journalctl@ceph.osd.3.smithi039.stdout:May 09 06:05:11 smithi039 podman[94850]: 2024-05-09 06:05:11.111965262 +0000 UTC m=+0.330972728 container init b97e99dceed182c28e2b3b4c4b95f1e9fa01f016291b30c8c632789da79a0fea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-3-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, ceph=True) 2024-05-09T06:05:11.180 INFO:journalctl@ceph.osd.3.smithi039.stdout:May 09 06:05:11 smithi039 podman[94850]: 2024-05-09 06:05:11.115509708 +0000 UTC m=+0.334517174 container start b97e99dceed182c28e2b3b4c4b95f1e9fa01f016291b30c8c632789da79a0fea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-3-deactivate, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5) 2024-05-09T06:05:11.180 INFO:journalctl@ceph.osd.3.smithi039.stdout:May 09 06:05:11 smithi039 podman[94850]: 2024-05-09 06:05:11.194664917 +0000 UTC m=+0.413672384 container attach b97e99dceed182c28e2b3b4c4b95f1e9fa01f016291b30c8c632789da79a0fea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-05-09T06:05:11.334 INFO:journalctl@ceph.osd.5.smithi100.stdout:May 09 06:05:11 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-5[46447]: 2024-05-09T06:05:11.184+0000 7f9c82a12700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:40.759657+0000 front 2024-05-09T06:04:40.759565+0000 (oldest deadline 2024-05-09T06:05:06.059465+0000) 2024-05-09T06:05:11.335 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:11 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:11.065+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:40.939354+0000 front 2024-05-09T06:04:40.939391+0000 (oldest deadline 2024-05-09T06:05:06.239561+0000) 2024-05-09T06:05:11.465 INFO:journalctl@ceph.osd.3.smithi039.stdout:May 09 06:05:11 smithi039 podman[94850]: 2024-05-09 06:05:11.422790073 +0000 UTC m=+0.641797541 container died b97e99dceed182c28e2b3b4c4b95f1e9fa01f016291b30c8c632789da79a0fea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-3-deactivate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS) 2024-05-09T06:05:11.788 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:11 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:11.458+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:44.474482+0000 front 2024-05-09T06:04:44.474540+0000 (oldest deadline 2024-05-09T06:05:10.875240+0000) 2024-05-09T06:05:11.852 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:11 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:11.479+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:43.538761+0000 front 2024-05-09T06:04:43.538885+0000 (oldest deadline 2024-05-09T06:05:08.239002+0000) 2024-05-09T06:05:11.961 DEBUG:teuthology.orchestra.run.smithi039:> sudo pkill -f 'journalctl -f -n 0 -u ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@osd.3.service' 2024-05-09T06:05:12.005 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T06:05:12.005 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-05-09T06:05:12.005 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-05-09T06:05:12.006 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@osd.4 2024-05-09T06:05:12.288 INFO:journalctl@ceph.osd.4.smithi060.stdout:May 09 06:05:12 smithi060 systemd[1]: Stopping Ceph osd.4 for 86d4cc60-0dc4-11ef-bc97-c7b262605968... 2024-05-09T06:05:12.352 INFO:journalctl@ceph.osd.6.smithi039.stdout:May 09 06:05:12 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-6[56339]: 2024-05-09T06:05:12.050+0000 7fc2c9f4a700 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:42.778856+0000 front 2024-05-09T06:04:42.778818+0000 (oldest deadline 2024-05-09T06:05:06.279108+0000) 2024-05-09T06:05:12.416 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:12 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:12.085+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:40.939354+0000 front 2024-05-09T06:04:40.939391+0000 (oldest deadline 2024-05-09T06:05:06.239561+0000) 2024-05-09T06:05:12.416 INFO:journalctl@ceph.osd.5.smithi100.stdout:May 09 06:05:12 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-5[46447]: 2024-05-09T06:05:12.144+0000 7f9c82a12700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:40.759657+0000 front 2024-05-09T06:04:40.759565+0000 (oldest deadline 2024-05-09T06:05:06.059465+0000) 2024-05-09T06:05:12.788 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:12 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:12.460+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:44.474482+0000 front 2024-05-09T06:04:44.474540+0000 (oldest deadline 2024-05-09T06:05:10.875240+0000) 2024-05-09T06:05:12.789 INFO:journalctl@ceph.osd.4.smithi060.stdout:May 09 06:05:12 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-4[45677]: 2024-05-09T06:05:12.422+0000 7fb15e473700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T06:05:12.789 INFO:journalctl@ceph.osd.4.smithi060.stdout:May 09 06:05:12 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-4[45677]: 2024-05-09T06:05:12.422+0000 7fb15e473700 -1 osd.4 86 *** Got signal Terminated *** 2024-05-09T06:05:12.789 INFO:journalctl@ceph.osd.4.smithi060.stdout:May 09 06:05:12 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-4[45677]: 2024-05-09T06:05:12.422+0000 7fb15e473700 -1 osd.4 86 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-09T06:05:12.852 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:12 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:12.488+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:43.538761+0000 front 2024-05-09T06:04:43.538885+0000 (oldest deadline 2024-05-09T06:05:08.239002+0000) 2024-05-09T06:05:13.352 INFO:journalctl@ceph.osd.6.smithi039.stdout:May 09 06:05:13 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-6[56339]: 2024-05-09T06:05:13.032+0000 7fc2c9f4a700 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:42.778856+0000 front 2024-05-09T06:04:42.778818+0000 (oldest deadline 2024-05-09T06:05:06.279108+0000) 2024-05-09T06:05:13.416 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:13 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:13.110+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:40.939354+0000 front 2024-05-09T06:04:40.939391+0000 (oldest deadline 2024-05-09T06:05:06.239561+0000) 2024-05-09T06:05:13.416 INFO:journalctl@ceph.osd.5.smithi100.stdout:May 09 06:05:13 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-5[46447]: 2024-05-09T06:05:13.155+0000 7f9c82a12700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:40.759657+0000 front 2024-05-09T06:04:40.759565+0000 (oldest deadline 2024-05-09T06:05:06.059465+0000) 2024-05-09T06:05:13.789 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:13 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:13.417+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:44.474482+0000 front 2024-05-09T06:04:44.474540+0000 (oldest deadline 2024-05-09T06:05:10.875240+0000) 2024-05-09T06:05:13.852 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:13 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:13.487+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:43.538761+0000 front 2024-05-09T06:04:43.538885+0000 (oldest deadline 2024-05-09T06:05:08.239002+0000) 2024-05-09T06:05:14.352 INFO:journalctl@ceph.osd.6.smithi039.stdout:May 09 06:05:14 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-6[56339]: 2024-05-09T06:05:14.013+0000 7fc2c9f4a700 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:42.778856+0000 front 2024-05-09T06:04:42.778818+0000 (oldest deadline 2024-05-09T06:05:06.279108+0000) 2024-05-09T06:05:14.415 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:14 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:14.097+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:40.939354+0000 front 2024-05-09T06:04:40.939391+0000 (oldest deadline 2024-05-09T06:05:06.239561+0000) 2024-05-09T06:05:14.416 INFO:journalctl@ceph.osd.5.smithi100.stdout:May 09 06:05:14 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-5[46447]: 2024-05-09T06:05:14.142+0000 7f9c82a12700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:40.759657+0000 front 2024-05-09T06:04:40.759565+0000 (oldest deadline 2024-05-09T06:05:06.059465+0000) 2024-05-09T06:05:14.788 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:14 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:14.399+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:44.474482+0000 front 2024-05-09T06:04:44.474540+0000 (oldest deadline 2024-05-09T06:05:10.875240+0000) 2024-05-09T06:05:14.788 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:14 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:14.399+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:50.875869+0000 front 2024-05-09T06:04:50.875902+0000 (oldest deadline 2024-05-09T06:05:14.376145+0000) 2024-05-09T06:05:14.852 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:14 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:14.461+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:43.538761+0000 front 2024-05-09T06:04:43.538885+0000 (oldest deadline 2024-05-09T06:05:08.239002+0000) 2024-05-09T06:05:15.352 INFO:journalctl@ceph.osd.6.smithi039.stdout:May 09 06:05:15 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-6[56339]: 2024-05-09T06:05:15.032+0000 7fc2c9f4a700 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:42.778856+0000 front 2024-05-09T06:04:42.778818+0000 (oldest deadline 2024-05-09T06:05:06.279108+0000) 2024-05-09T06:05:15.352 INFO:journalctl@ceph.osd.6.smithi039.stdout:May 09 06:05:15 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-6[56339]: 2024-05-09T06:05:15.032+0000 7fc2c9f4a700 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:52.581582+0000 front 2024-05-09T06:04:52.581599+0000 (oldest deadline 2024-05-09T06:05:14.182091+0000) 2024-05-09T06:05:15.415 INFO:journalctl@ceph.osd.5.smithi100.stdout:May 09 06:05:15 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-5[46447]: 2024-05-09T06:05:15.170+0000 7f9c82a12700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:40.759657+0000 front 2024-05-09T06:04:40.759565+0000 (oldest deadline 2024-05-09T06:05:06.059465+0000) 2024-05-09T06:05:15.416 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:15 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:15.058+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:40.939354+0000 front 2024-05-09T06:04:40.939391+0000 (oldest deadline 2024-05-09T06:05:06.239561+0000) 2024-05-09T06:05:15.416 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:15 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:15.058+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:49.140745+0000 front 2024-05-09T06:04:49.140702+0000 (oldest deadline 2024-05-09T06:05:15.040838+0000) 2024-05-09T06:05:15.788 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:15 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:15.366+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:44.474482+0000 front 2024-05-09T06:04:44.474540+0000 (oldest deadline 2024-05-09T06:05:10.875240+0000) 2024-05-09T06:05:15.789 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:15 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:15.366+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:50.875869+0000 front 2024-05-09T06:04:50.875902+0000 (oldest deadline 2024-05-09T06:05:14.376145+0000) 2024-05-09T06:05:15.852 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:15 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:15.474+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:43.538761+0000 front 2024-05-09T06:04:43.538885+0000 (oldest deadline 2024-05-09T06:05:08.239002+0000) 2024-05-09T06:05:16.352 INFO:journalctl@ceph.osd.6.smithi039.stdout:May 09 06:05:16 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-6[56339]: 2024-05-09T06:05:16.065+0000 7fc2c9f4a700 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:42.778856+0000 front 2024-05-09T06:04:42.778818+0000 (oldest deadline 2024-05-09T06:05:06.279108+0000) 2024-05-09T06:05:16.352 INFO:journalctl@ceph.osd.6.smithi039.stdout:May 09 06:05:16 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-6[56339]: 2024-05-09T06:05:16.065+0000 7fc2c9f4a700 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:52.581582+0000 front 2024-05-09T06:04:52.581599+0000 (oldest deadline 2024-05-09T06:05:14.182091+0000) 2024-05-09T06:05:16.415 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:16 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:16.018+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:40.939354+0000 front 2024-05-09T06:04:40.939391+0000 (oldest deadline 2024-05-09T06:05:06.239561+0000) 2024-05-09T06:05:16.416 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:16 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:16.018+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:49.140745+0000 front 2024-05-09T06:04:49.140702+0000 (oldest deadline 2024-05-09T06:05:15.040838+0000) 2024-05-09T06:05:16.416 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 06:05:16 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-8[53004]: 2024-05-09T06:05:16.079+0000 7f47f389b700 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:52.888379+0000 front 2024-05-09T06:04:52.888427+0000 (oldest deadline 2024-05-09T06:05:15.788423+0000) 2024-05-09T06:05:16.416 INFO:journalctl@ceph.osd.5.smithi100.stdout:May 09 06:05:16 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-5[46447]: 2024-05-09T06:05:16.175+0000 7f9c82a12700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:40.759657+0000 front 2024-05-09T06:04:40.759565+0000 (oldest deadline 2024-05-09T06:05:06.059465+0000) 2024-05-09T06:05:16.416 INFO:journalctl@ceph.osd.5.smithi100.stdout:May 09 06:05:16 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-5[46447]: 2024-05-09T06:05:16.175+0000 7f9c82a12700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:50.661112+0000 front 2024-05-09T06:04:50.661365+0000 (oldest deadline 2024-05-09T06:05:15.360971+0000) 2024-05-09T06:05:16.788 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:16 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:16.397+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:44.474482+0000 front 2024-05-09T06:04:44.474540+0000 (oldest deadline 2024-05-09T06:05:10.875240+0000) 2024-05-09T06:05:16.788 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:16 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:16.397+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:50.875869+0000 front 2024-05-09T06:04:50.875902+0000 (oldest deadline 2024-05-09T06:05:14.376145+0000) 2024-05-09T06:05:16.852 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:16 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:16.467+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:43.538761+0000 front 2024-05-09T06:04:43.538885+0000 (oldest deadline 2024-05-09T06:05:08.239002+0000) 2024-05-09T06:05:16.852 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:16 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:16.467+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:48.239500+0000 front 2024-05-09T06:04:48.239770+0000 (oldest deadline 2024-05-09T06:05:15.840152+0000) 2024-05-09T06:05:17.352 INFO:journalctl@ceph.osd.6.smithi039.stdout:May 09 06:05:17 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-6[56339]: 2024-05-09T06:05:17.084+0000 7fc2c9f4a700 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:42.778856+0000 front 2024-05-09T06:04:42.778818+0000 (oldest deadline 2024-05-09T06:05:06.279108+0000) 2024-05-09T06:05:17.352 INFO:journalctl@ceph.osd.6.smithi039.stdout:May 09 06:05:17 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-6[56339]: 2024-05-09T06:05:17.084+0000 7fc2c9f4a700 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:52.581582+0000 front 2024-05-09T06:04:52.581599+0000 (oldest deadline 2024-05-09T06:05:14.182091+0000) 2024-05-09T06:05:17.415 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 06:05:17 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-8[53004]: 2024-05-09T06:05:17.101+0000 7f47f389b700 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:52.888379+0000 front 2024-05-09T06:04:52.888427+0000 (oldest deadline 2024-05-09T06:05:15.788423+0000) 2024-05-09T06:05:17.416 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:17 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:17.064+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:40.939354+0000 front 2024-05-09T06:04:40.939391+0000 (oldest deadline 2024-05-09T06:05:06.239561+0000) 2024-05-09T06:05:17.416 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:17 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:17.064+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:49.140745+0000 front 2024-05-09T06:04:49.140702+0000 (oldest deadline 2024-05-09T06:05:15.040838+0000) 2024-05-09T06:05:17.416 INFO:journalctl@ceph.osd.5.smithi100.stdout:May 09 06:05:17 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-5[46447]: 2024-05-09T06:05:17.149+0000 7f9c82a12700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:40.759657+0000 front 2024-05-09T06:04:40.759565+0000 (oldest deadline 2024-05-09T06:05:06.059465+0000) 2024-05-09T06:05:17.416 INFO:journalctl@ceph.osd.5.smithi100.stdout:May 09 06:05:17 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-5[46447]: 2024-05-09T06:05:17.149+0000 7f9c82a12700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:50.661112+0000 front 2024-05-09T06:04:50.661365+0000 (oldest deadline 2024-05-09T06:05:15.360971+0000) 2024-05-09T06:05:17.689 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:17 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:17.390+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:44.474482+0000 front 2024-05-09T06:04:44.474540+0000 (oldest deadline 2024-05-09T06:05:10.875240+0000) 2024-05-09T06:05:17.689 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:17 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:17.390+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:50.875869+0000 front 2024-05-09T06:04:50.875902+0000 (oldest deadline 2024-05-09T06:05:14.376145+0000) 2024-05-09T06:05:17.852 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:17 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:17.504+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:43.538761+0000 front 2024-05-09T06:04:43.538885+0000 (oldest deadline 2024-05-09T06:05:08.239002+0000) 2024-05-09T06:05:17.852 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:17 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:17.504+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:48.239500+0000 front 2024-05-09T06:04:48.239770+0000 (oldest deadline 2024-05-09T06:05:15.840152+0000) 2024-05-09T06:05:18.283 INFO:journalctl@ceph.osd.4.smithi060.stdout:May 09 06:05:18 smithi060 podman[76838]: 2024-05-09 06:05:18.012431829 +0000 UTC m=+5.781253683 container died 24b84316a5ef05888a513ebabd61eb867901a0d19feab121170c249aa51afcda (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-4, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-09T06:05:18.284 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 09 06:05:18 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-7[52683]: 2024-05-09T06:05:18.173+0000 7f467195a700 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:51.932284+0000 front 2024-05-09T06:04:51.932310+0000 (oldest deadline 2024-05-09T06:05:17.232472+0000) 2024-05-09T06:05:18.352 INFO:journalctl@ceph.osd.6.smithi039.stdout:May 09 06:05:18 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-6[56339]: 2024-05-09T06:05:18.064+0000 7fc2c9f4a700 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:42.778856+0000 front 2024-05-09T06:04:42.778818+0000 (oldest deadline 2024-05-09T06:05:06.279108+0000) 2024-05-09T06:05:18.352 INFO:journalctl@ceph.osd.6.smithi039.stdout:May 09 06:05:18 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-6[56339]: 2024-05-09T06:05:18.064+0000 7fc2c9f4a700 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:52.581582+0000 front 2024-05-09T06:04:52.581599+0000 (oldest deadline 2024-05-09T06:05:14.182091+0000) 2024-05-09T06:05:18.416 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 06:05:18 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-8[53004]: 2024-05-09T06:05:18.116+0000 7f47f389b700 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:52.888379+0000 front 2024-05-09T06:04:52.888427+0000 (oldest deadline 2024-05-09T06:05:15.788423+0000) 2024-05-09T06:05:18.416 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:18 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:18.075+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:40.939354+0000 front 2024-05-09T06:04:40.939391+0000 (oldest deadline 2024-05-09T06:05:06.239561+0000) 2024-05-09T06:05:18.416 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:18 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:18.075+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:49.140745+0000 front 2024-05-09T06:04:49.140702+0000 (oldest deadline 2024-05-09T06:05:15.040838+0000) 2024-05-09T06:05:18.416 INFO:journalctl@ceph.osd.5.smithi100.stdout:May 09 06:05:18 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-5[46447]: 2024-05-09T06:05:18.175+0000 7f9c82a12700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:40.759657+0000 front 2024-05-09T06:04:40.759565+0000 (oldest deadline 2024-05-09T06:05:06.059465+0000) 2024-05-09T06:05:18.416 INFO:journalctl@ceph.osd.5.smithi100.stdout:May 09 06:05:18 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-5[46447]: 2024-05-09T06:05:18.175+0000 7f9c82a12700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:50.661112+0000 front 2024-05-09T06:04:50.661365+0000 (oldest deadline 2024-05-09T06:05:15.360971+0000) 2024-05-09T06:05:18.538 INFO:journalctl@ceph.osd.4.smithi060.stdout:May 09 06:05:18 smithi060 podman[76838]: 2024-05-09 06:05:18.38916392 +0000 UTC m=+6.157985774 container cleanup 24b84316a5ef05888a513ebabd61eb867901a0d19feab121170c249aa51afcda (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-4, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=) 2024-05-09T06:05:18.538 INFO:journalctl@ceph.osd.4.smithi060.stdout:May 09 06:05:18 smithi060 bash[76838]: ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-4 2024-05-09T06:05:18.539 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:18 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:18.400+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:44.474482+0000 front 2024-05-09T06:04:44.474540+0000 (oldest deadline 2024-05-09T06:05:10.875240+0000) 2024-05-09T06:05:18.539 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:18 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:18.400+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:50.875869+0000 front 2024-05-09T06:04:50.875902+0000 (oldest deadline 2024-05-09T06:05:14.376145+0000) 2024-05-09T06:05:18.852 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:18 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:18.503+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:43.538761+0000 front 2024-05-09T06:04:43.538885+0000 (oldest deadline 2024-05-09T06:05:08.239002+0000) 2024-05-09T06:05:18.852 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:18 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:18.503+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:48.239500+0000 front 2024-05-09T06:04:48.239770+0000 (oldest deadline 2024-05-09T06:05:15.840152+0000) 2024-05-09T06:05:18.958 INFO:journalctl@ceph.osd.4.smithi060.stdout:May 09 06:05:18 smithi060 podman[76855]: 2024-05-09 06:05:18.648993717 +0000 UTC m=+0.633564501 container remove 24b84316a5ef05888a513ebabd61eb867901a0d19feab121170c249aa51afcda (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-4, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5) 2024-05-09T06:05:19.288 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 09 06:05:19 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-7[52683]: 2024-05-09T06:05:19.211+0000 7f467195a700 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:51.932284+0000 front 2024-05-09T06:04:51.932310+0000 (oldest deadline 2024-05-09T06:05:17.232472+0000) 2024-05-09T06:05:19.288 INFO:journalctl@ceph.osd.4.smithi060.stdout:May 09 06:05:18 smithi060 podman[76944]: 2024-05-09 06:05:18.877230231 +0000 UTC m=+0.018274567 image pull db794d706f492c144ccc8f2c5bbc1870e116f5c4f3309dfab4416b39d099f8d7 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584 2024-05-09T06:05:19.289 INFO:journalctl@ceph.osd.4.smithi060.stdout:May 09 06:05:18 smithi060 podman[76944]: 2024-05-09 06:05:18.974676652 +0000 UTC m=+0.115720976 container create 98aac80344a6a925d649749d94a0b97d590c87ea7ae80a28858e3dd46fa7d8f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-4-deactivate, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507) 2024-05-09T06:05:19.289 INFO:journalctl@ceph.osd.4.smithi060.stdout:May 09 06:05:19 smithi060 podman[76944]: 2024-05-09 06:05:19.210618497 +0000 UTC m=+0.351662817 container init 98aac80344a6a925d649749d94a0b97d590c87ea7ae80a28858e3dd46fa7d8f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-4-deactivate, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True) 2024-05-09T06:05:19.289 INFO:journalctl@ceph.osd.4.smithi060.stdout:May 09 06:05:19 smithi060 podman[76944]: 2024-05-09 06:05:19.213827073 +0000 UTC m=+0.354871403 container start 98aac80344a6a925d649749d94a0b97d590c87ea7ae80a28858e3dd46fa7d8f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-4-deactivate, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-09T06:05:19.352 INFO:journalctl@ceph.osd.6.smithi039.stdout:May 09 06:05:19 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-6[56339]: 2024-05-09T06:05:19.089+0000 7fc2c9f4a700 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:42.778856+0000 front 2024-05-09T06:04:42.778818+0000 (oldest deadline 2024-05-09T06:05:06.279108+0000) 2024-05-09T06:05:19.352 INFO:journalctl@ceph.osd.6.smithi039.stdout:May 09 06:05:19 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-6[56339]: 2024-05-09T06:05:19.089+0000 7fc2c9f4a700 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:52.581582+0000 front 2024-05-09T06:04:52.581599+0000 (oldest deadline 2024-05-09T06:05:14.182091+0000) 2024-05-09T06:05:19.415 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 06:05:19 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-8[53004]: 2024-05-09T06:05:19.068+0000 7f47f389b700 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:52.888379+0000 front 2024-05-09T06:04:52.888427+0000 (oldest deadline 2024-05-09T06:05:15.788423+0000) 2024-05-09T06:05:19.416 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:19 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:19.039+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:40.939354+0000 front 2024-05-09T06:04:40.939391+0000 (oldest deadline 2024-05-09T06:05:06.239561+0000) 2024-05-09T06:05:19.416 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:19 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:19.039+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:49.140745+0000 front 2024-05-09T06:04:49.140702+0000 (oldest deadline 2024-05-09T06:05:15.040838+0000) 2024-05-09T06:05:19.416 INFO:journalctl@ceph.osd.5.smithi100.stdout:May 09 06:05:19 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-5[46447]: 2024-05-09T06:05:19.206+0000 7f9c82a12700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:40.759657+0000 front 2024-05-09T06:04:40.759565+0000 (oldest deadline 2024-05-09T06:05:06.059465+0000) 2024-05-09T06:05:19.416 INFO:journalctl@ceph.osd.5.smithi100.stdout:May 09 06:05:19 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-5[46447]: 2024-05-09T06:05:19.206+0000 7f9c82a12700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:50.661112+0000 front 2024-05-09T06:04:50.661365+0000 (oldest deadline 2024-05-09T06:05:15.360971+0000) 2024-05-09T06:05:19.782 INFO:journalctl@ceph.osd.4.smithi060.stdout:May 09 06:05:19 smithi060 podman[76944]: 2024-05-09 06:05:19.310537479 +0000 UTC m=+0.451581805 container attach 98aac80344a6a925d649749d94a0b97d590c87ea7ae80a28858e3dd46fa7d8f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-4-deactivate, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-05-09T06:05:19.783 INFO:journalctl@ceph.osd.4.smithi060.stdout:May 09 06:05:19 smithi060 podman[76944]: 2024-05-09 06:05:19.525356423 +0000 UTC m=+0.666400742 container died 98aac80344a6a925d649749d94a0b97d590c87ea7ae80a28858e3dd46fa7d8f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-4-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404) 2024-05-09T06:05:19.783 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:19 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:19.433+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:44.474482+0000 front 2024-05-09T06:04:44.474540+0000 (oldest deadline 2024-05-09T06:05:10.875240+0000) 2024-05-09T06:05:19.783 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:19 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:19.433+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:50.875869+0000 front 2024-05-09T06:04:50.875902+0000 (oldest deadline 2024-05-09T06:05:14.376145+0000) 2024-05-09T06:05:19.852 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:19 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:19.502+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:43.538761+0000 front 2024-05-09T06:04:43.538885+0000 (oldest deadline 2024-05-09T06:05:08.239002+0000) 2024-05-09T06:05:19.852 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:19 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:19.502+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:48.239500+0000 front 2024-05-09T06:04:48.239770+0000 (oldest deadline 2024-05-09T06:05:15.840152+0000) 2024-05-09T06:05:20.059 DEBUG:teuthology.orchestra.run.smithi060:> sudo pkill -f 'journalctl -f -n 0 -u ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@osd.4.service' 2024-05-09T06:05:20.099 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T06:05:20.099 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-05-09T06:05:20.100 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-05-09T06:05:20.100 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@osd.5 2024-05-09T06:05:20.352 INFO:journalctl@ceph.osd.6.smithi039.stdout:May 09 06:05:20 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-6[56339]: 2024-05-09T06:05:20.100+0000 7fc2c9f4a700 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:42.778856+0000 front 2024-05-09T06:04:42.778818+0000 (oldest deadline 2024-05-09T06:05:06.279108+0000) 2024-05-09T06:05:20.352 INFO:journalctl@ceph.osd.6.smithi039.stdout:May 09 06:05:20 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-6[56339]: 2024-05-09T06:05:20.100+0000 7fc2c9f4a700 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:52.581582+0000 front 2024-05-09T06:04:52.581599+0000 (oldest deadline 2024-05-09T06:05:14.182091+0000) 2024-05-09T06:05:20.407 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 09 06:05:20 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-7[52683]: 2024-05-09T06:05:20.207+0000 7f467195a700 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:51.932284+0000 front 2024-05-09T06:04:51.932310+0000 (oldest deadline 2024-05-09T06:05:17.232472+0000) 2024-05-09T06:05:20.407 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:20 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:20.420+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:44.474482+0000 front 2024-05-09T06:04:44.474540+0000 (oldest deadline 2024-05-09T06:05:10.875240+0000) 2024-05-09T06:05:20.407 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:20 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:20.420+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:50.875869+0000 front 2024-05-09T06:04:50.875902+0000 (oldest deadline 2024-05-09T06:05:14.376145+0000) 2024-05-09T06:05:20.415 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 06:05:20 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-8[53004]: 2024-05-09T06:05:20.102+0000 7f47f389b700 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:52.888379+0000 front 2024-05-09T06:04:52.888427+0000 (oldest deadline 2024-05-09T06:05:15.788423+0000) 2024-05-09T06:05:20.416 INFO:journalctl@ceph.osd.5.smithi100.stdout:May 09 06:05:20 smithi100 systemd[1]: Stopping Ceph osd.5 for 86d4cc60-0dc4-11ef-bc97-c7b262605968... 2024-05-09T06:05:20.416 INFO:journalctl@ceph.osd.5.smithi100.stdout:May 09 06:05:20 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-5[46447]: 2024-05-09T06:05:20.235+0000 7f9c82a12700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:40.759657+0000 front 2024-05-09T06:04:40.759565+0000 (oldest deadline 2024-05-09T06:05:06.059465+0000) 2024-05-09T06:05:20.416 INFO:journalctl@ceph.osd.5.smithi100.stdout:May 09 06:05:20 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-5[46447]: 2024-05-09T06:05:20.235+0000 7f9c82a12700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:50.661112+0000 front 2024-05-09T06:04:50.661365+0000 (oldest deadline 2024-05-09T06:05:15.360971+0000) 2024-05-09T06:05:20.416 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:20 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:20.089+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:40.939354+0000 front 2024-05-09T06:04:40.939391+0000 (oldest deadline 2024-05-09T06:05:06.239561+0000) 2024-05-09T06:05:20.416 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:20 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:20.089+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:49.140745+0000 front 2024-05-09T06:04:49.140702+0000 (oldest deadline 2024-05-09T06:05:15.040838+0000) 2024-05-09T06:05:20.852 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:20 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:20.520+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:43.538761+0000 front 2024-05-09T06:04:43.538885+0000 (oldest deadline 2024-05-09T06:05:08.239002+0000) 2024-05-09T06:05:20.852 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:20 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:20.520+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:48.239500+0000 front 2024-05-09T06:04:48.239770+0000 (oldest deadline 2024-05-09T06:05:15.840152+0000) 2024-05-09T06:05:20.916 INFO:journalctl@ceph.osd.5.smithi100.stdout:May 09 06:05:20 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-5[46447]: 2024-05-09T06:05:20.435+0000 7f9c8a464700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T06:05:20.916 INFO:journalctl@ceph.osd.5.smithi100.stdout:May 09 06:05:20 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-5[46447]: 2024-05-09T06:05:20.435+0000 7f9c8a464700 -1 osd.5 86 *** Got signal Terminated *** 2024-05-09T06:05:20.916 INFO:journalctl@ceph.osd.5.smithi100.stdout:May 09 06:05:20 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-5[46447]: 2024-05-09T06:05:20.435+0000 7f9c8a464700 -1 osd.5 86 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-09T06:05:21.416 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 06:05:21 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-8[53004]: 2024-05-09T06:05:21.094+0000 7f47f389b700 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:52.888379+0000 front 2024-05-09T06:04:52.888427+0000 (oldest deadline 2024-05-09T06:05:15.788423+0000) 2024-05-09T06:05:21.416 INFO:journalctl@ceph.osd.5.smithi100.stdout:May 09 06:05:21 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-5[46447]: 2024-05-09T06:05:21.249+0000 7f9c82a12700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:40.759657+0000 front 2024-05-09T06:04:40.759565+0000 (oldest deadline 2024-05-09T06:05:06.059465+0000) 2024-05-09T06:05:21.416 INFO:journalctl@ceph.osd.5.smithi100.stdout:May 09 06:05:21 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-5[46447]: 2024-05-09T06:05:21.249+0000 7f9c82a12700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:50.661112+0000 front 2024-05-09T06:04:50.661365+0000 (oldest deadline 2024-05-09T06:05:15.360971+0000) 2024-05-09T06:05:21.416 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:21 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:21.075+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:40.939354+0000 front 2024-05-09T06:04:40.939391+0000 (oldest deadline 2024-05-09T06:05:06.239561+0000) 2024-05-09T06:05:21.416 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:21 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:21.075+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:49.140745+0000 front 2024-05-09T06:04:49.140702+0000 (oldest deadline 2024-05-09T06:05:15.040838+0000) 2024-05-09T06:05:21.520 INFO:journalctl@ceph.osd.6.smithi039.stdout:May 09 06:05:21 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-6[56339]: 2024-05-09T06:05:21.129+0000 7fc2c9f4a700 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:42.778856+0000 front 2024-05-09T06:04:42.778818+0000 (oldest deadline 2024-05-09T06:05:06.279108+0000) 2024-05-09T06:05:21.520 INFO:journalctl@ceph.osd.6.smithi039.stdout:May 09 06:05:21 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-6[56339]: 2024-05-09T06:05:21.129+0000 7fc2c9f4a700 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:52.581582+0000 front 2024-05-09T06:04:52.581599+0000 (oldest deadline 2024-05-09T06:05:14.182091+0000) 2024-05-09T06:05:21.538 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 09 06:05:21 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-7[52683]: 2024-05-09T06:05:21.228+0000 7f467195a700 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:51.932284+0000 front 2024-05-09T06:04:51.932310+0000 (oldest deadline 2024-05-09T06:05:17.232472+0000) 2024-05-09T06:05:21.538 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:21 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:21.418+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:44.474482+0000 front 2024-05-09T06:04:44.474540+0000 (oldest deadline 2024-05-09T06:05:10.875240+0000) 2024-05-09T06:05:21.539 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:21 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:21.418+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:50.875869+0000 front 2024-05-09T06:04:50.875902+0000 (oldest deadline 2024-05-09T06:05:14.376145+0000) 2024-05-09T06:05:21.852 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:21 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:21.534+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:43.538761+0000 front 2024-05-09T06:04:43.538885+0000 (oldest deadline 2024-05-09T06:05:08.239002+0000) 2024-05-09T06:05:21.852 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:21 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:21.534+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:48.239500+0000 front 2024-05-09T06:04:48.239770+0000 (oldest deadline 2024-05-09T06:05:15.840152+0000) 2024-05-09T06:05:22.416 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 06:05:22 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-8[53004]: 2024-05-09T06:05:22.120+0000 7f47f389b700 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:52.888379+0000 front 2024-05-09T06:04:52.888427+0000 (oldest deadline 2024-05-09T06:05:15.788423+0000) 2024-05-09T06:05:22.416 INFO:journalctl@ceph.osd.5.smithi100.stdout:May 09 06:05:22 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-5[46447]: 2024-05-09T06:05:22.215+0000 7f9c82a12700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:40.759657+0000 front 2024-05-09T06:04:40.759565+0000 (oldest deadline 2024-05-09T06:05:06.059465+0000) 2024-05-09T06:05:22.416 INFO:journalctl@ceph.osd.5.smithi100.stdout:May 09 06:05:22 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-5[46447]: 2024-05-09T06:05:22.215+0000 7f9c82a12700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:50.661112+0000 front 2024-05-09T06:04:50.661365+0000 (oldest deadline 2024-05-09T06:05:15.360971+0000) 2024-05-09T06:05:22.416 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:22 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:22.053+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:40.939354+0000 front 2024-05-09T06:04:40.939391+0000 (oldest deadline 2024-05-09T06:05:06.239561+0000) 2024-05-09T06:05:22.416 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:22 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:22.053+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:49.140745+0000 front 2024-05-09T06:04:49.140702+0000 (oldest deadline 2024-05-09T06:05:15.040838+0000) 2024-05-09T06:05:22.416 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:22 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:22.053+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:04:58.542017+0000 front 2024-05-09T06:04:58.542182+0000 (oldest deadline 2024-05-09T06:05:22.042178+0000) 2024-05-09T06:05:22.533 INFO:journalctl@ceph.osd.6.smithi039.stdout:May 09 06:05:22 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-6[56339]: 2024-05-09T06:05:22.140+0000 7fc2c9f4a700 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:42.778856+0000 front 2024-05-09T06:04:42.778818+0000 (oldest deadline 2024-05-09T06:05:06.279108+0000) 2024-05-09T06:05:22.534 INFO:journalctl@ceph.osd.6.smithi039.stdout:May 09 06:05:22 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-6[56339]: 2024-05-09T06:05:22.140+0000 7fc2c9f4a700 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:52.581582+0000 front 2024-05-09T06:04:52.581599+0000 (oldest deadline 2024-05-09T06:05:14.182091+0000) 2024-05-09T06:05:22.538 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 09 06:05:22 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-7[52683]: 2024-05-09T06:05:22.242+0000 7f467195a700 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:51.932284+0000 front 2024-05-09T06:04:51.932310+0000 (oldest deadline 2024-05-09T06:05:17.232472+0000) 2024-05-09T06:05:22.539 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:22 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:22.463+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:44.474482+0000 front 2024-05-09T06:04:44.474540+0000 (oldest deadline 2024-05-09T06:05:10.875240+0000) 2024-05-09T06:05:22.539 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:22 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:22.463+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:50.875869+0000 front 2024-05-09T06:04:50.875902+0000 (oldest deadline 2024-05-09T06:05:14.376145+0000) 2024-05-09T06:05:22.539 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:22 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:22.463+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:05:01.278886+0000 front 2024-05-09T06:05:01.278763+0000 (oldest deadline 2024-05-09T06:05:22.279679+0000) 2024-05-09T06:05:22.852 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:22 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:22.548+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:43.538761+0000 front 2024-05-09T06:04:43.538885+0000 (oldest deadline 2024-05-09T06:05:08.239002+0000) 2024-05-09T06:05:22.852 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:22 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:22.548+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:48.239500+0000 front 2024-05-09T06:04:48.239770+0000 (oldest deadline 2024-05-09T06:05:15.840152+0000) 2024-05-09T06:05:23.416 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 06:05:23 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-8[53004]: 2024-05-09T06:05:23.095+0000 7f47f389b700 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:52.888379+0000 front 2024-05-09T06:04:52.888427+0000 (oldest deadline 2024-05-09T06:05:15.788423+0000) 2024-05-09T06:05:23.416 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 06:05:23 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-8[53004]: 2024-05-09T06:05:23.095+0000 7f47f389b700 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:04:59.889459+0000 front 2024-05-09T06:04:59.889691+0000 (oldest deadline 2024-05-09T06:05:22.789604+0000) 2024-05-09T06:05:23.416 INFO:journalctl@ceph.osd.5.smithi100.stdout:May 09 06:05:23 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-5[46447]: 2024-05-09T06:05:23.211+0000 7f9c82a12700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:40.759657+0000 front 2024-05-09T06:04:40.759565+0000 (oldest deadline 2024-05-09T06:05:06.059465+0000) 2024-05-09T06:05:23.416 INFO:journalctl@ceph.osd.5.smithi100.stdout:May 09 06:05:23 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-5[46447]: 2024-05-09T06:05:23.211+0000 7f9c82a12700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:50.661112+0000 front 2024-05-09T06:04:50.661365+0000 (oldest deadline 2024-05-09T06:05:15.360971+0000) 2024-05-09T06:05:23.416 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:23 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:23.089+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:40.939354+0000 front 2024-05-09T06:04:40.939391+0000 (oldest deadline 2024-05-09T06:05:06.239561+0000) 2024-05-09T06:05:23.417 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:23 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:23.089+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:49.140745+0000 front 2024-05-09T06:04:49.140702+0000 (oldest deadline 2024-05-09T06:05:15.040838+0000) 2024-05-09T06:05:23.417 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:23 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:23.089+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:04:58.542017+0000 front 2024-05-09T06:04:58.542182+0000 (oldest deadline 2024-05-09T06:05:22.042178+0000) 2024-05-09T06:05:23.538 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 09 06:05:23 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-7[52683]: 2024-05-09T06:05:23.217+0000 7f467195a700 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:51.932284+0000 front 2024-05-09T06:04:51.932310+0000 (oldest deadline 2024-05-09T06:05:17.232472+0000) 2024-05-09T06:05:23.539 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:23 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:23.441+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:44.474482+0000 front 2024-05-09T06:04:44.474540+0000 (oldest deadline 2024-05-09T06:05:10.875240+0000) 2024-05-09T06:05:23.539 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:23 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:23.441+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:50.875869+0000 front 2024-05-09T06:04:50.875902+0000 (oldest deadline 2024-05-09T06:05:14.376145+0000) 2024-05-09T06:05:23.539 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:23 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:23.441+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:05:01.278886+0000 front 2024-05-09T06:05:01.278763+0000 (oldest deadline 2024-05-09T06:05:22.279679+0000) 2024-05-09T06:05:23.567 INFO:journalctl@ceph.osd.6.smithi039.stdout:May 09 06:05:23 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-6[56339]: 2024-05-09T06:05:23.161+0000 7fc2c9f4a700 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:42.778856+0000 front 2024-05-09T06:04:42.778818+0000 (oldest deadline 2024-05-09T06:05:06.279108+0000) 2024-05-09T06:05:23.567 INFO:journalctl@ceph.osd.6.smithi039.stdout:May 09 06:05:23 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-6[56339]: 2024-05-09T06:05:23.161+0000 7fc2c9f4a700 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:52.581582+0000 front 2024-05-09T06:04:52.581599+0000 (oldest deadline 2024-05-09T06:05:14.182091+0000) 2024-05-09T06:05:23.852 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:23 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:23.581+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:43.538761+0000 front 2024-05-09T06:04:43.538885+0000 (oldest deadline 2024-05-09T06:05:08.239002+0000) 2024-05-09T06:05:23.852 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:23 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:23.581+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:48.239500+0000 front 2024-05-09T06:04:48.239770+0000 (oldest deadline 2024-05-09T06:05:15.840152+0000) 2024-05-09T06:05:24.415 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:24 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:24.055+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:40.939354+0000 front 2024-05-09T06:04:40.939391+0000 (oldest deadline 2024-05-09T06:05:06.239561+0000) 2024-05-09T06:05:24.416 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:24 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:24.055+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:49.140745+0000 front 2024-05-09T06:04:49.140702+0000 (oldest deadline 2024-05-09T06:05:15.040838+0000) 2024-05-09T06:05:24.416 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:24 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:24.055+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:04:58.542017+0000 front 2024-05-09T06:04:58.542182+0000 (oldest deadline 2024-05-09T06:05:22.042178+0000) 2024-05-09T06:05:24.416 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 06:05:24 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-8[53004]: 2024-05-09T06:05:24.107+0000 7f47f389b700 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:52.888379+0000 front 2024-05-09T06:04:52.888427+0000 (oldest deadline 2024-05-09T06:05:15.788423+0000) 2024-05-09T06:05:24.416 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 06:05:24 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-8[53004]: 2024-05-09T06:05:24.107+0000 7f47f389b700 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:04:59.889459+0000 front 2024-05-09T06:04:59.889691+0000 (oldest deadline 2024-05-09T06:05:22.789604+0000) 2024-05-09T06:05:24.416 INFO:journalctl@ceph.osd.5.smithi100.stdout:May 09 06:05:24 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-5[46447]: 2024-05-09T06:05:24.181+0000 7f9c82a12700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:40.759657+0000 front 2024-05-09T06:04:40.759565+0000 (oldest deadline 2024-05-09T06:05:06.059465+0000) 2024-05-09T06:05:24.416 INFO:journalctl@ceph.osd.5.smithi100.stdout:May 09 06:05:24 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-5[46447]: 2024-05-09T06:05:24.181+0000 7f9c82a12700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:50.661112+0000 front 2024-05-09T06:04:50.661365+0000 (oldest deadline 2024-05-09T06:05:15.360971+0000) 2024-05-09T06:05:24.416 INFO:journalctl@ceph.osd.5.smithi100.stdout:May 09 06:05:24 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-5[46447]: 2024-05-09T06:05:24.181+0000 7f9c82a12700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:05:00.661944+0000 front 2024-05-09T06:05:00.661992+0000 (oldest deadline 2024-05-09T06:05:24.162113+0000) 2024-05-09T06:05:24.435 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 09 06:05:24 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-7[52683]: 2024-05-09T06:05:24.178+0000 7f467195a700 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:51.932284+0000 front 2024-05-09T06:04:51.932310+0000 (oldest deadline 2024-05-09T06:05:17.232472+0000) 2024-05-09T06:05:24.524 INFO:journalctl@ceph.osd.6.smithi039.stdout:May 09 06:05:24 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-6[56339]: 2024-05-09T06:05:24.162+0000 7fc2c9f4a700 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:42.778856+0000 front 2024-05-09T06:04:42.778818+0000 (oldest deadline 2024-05-09T06:05:06.279108+0000) 2024-05-09T06:05:24.525 INFO:journalctl@ceph.osd.6.smithi039.stdout:May 09 06:05:24 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-6[56339]: 2024-05-09T06:05:24.162+0000 7fc2c9f4a700 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:52.581582+0000 front 2024-05-09T06:04:52.581599+0000 (oldest deadline 2024-05-09T06:05:14.182091+0000) 2024-05-09T06:05:24.788 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:24 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:24.448+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:44.474482+0000 front 2024-05-09T06:04:44.474540+0000 (oldest deadline 2024-05-09T06:05:10.875240+0000) 2024-05-09T06:05:24.788 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:24 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:24.448+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:50.875869+0000 front 2024-05-09T06:04:50.875902+0000 (oldest deadline 2024-05-09T06:05:14.376145+0000) 2024-05-09T06:05:24.789 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:24 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:24.448+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:05:01.278886+0000 front 2024-05-09T06:05:01.278763+0000 (oldest deadline 2024-05-09T06:05:22.279679+0000) 2024-05-09T06:05:24.852 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:24 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:24.539+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:43.538761+0000 front 2024-05-09T06:04:43.538885+0000 (oldest deadline 2024-05-09T06:05:08.239002+0000) 2024-05-09T06:05:24.852 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:24 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:24.539+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:48.239500+0000 front 2024-05-09T06:04:48.239770+0000 (oldest deadline 2024-05-09T06:05:15.840152+0000) 2024-05-09T06:05:25.416 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 06:05:25 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-8[53004]: 2024-05-09T06:05:25.128+0000 7f47f389b700 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:52.888379+0000 front 2024-05-09T06:04:52.888427+0000 (oldest deadline 2024-05-09T06:05:15.788423+0000) 2024-05-09T06:05:25.416 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 06:05:25 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-8[53004]: 2024-05-09T06:05:25.128+0000 7f47f389b700 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:04:59.889459+0000 front 2024-05-09T06:04:59.889691+0000 (oldest deadline 2024-05-09T06:05:22.789604+0000) 2024-05-09T06:05:25.416 INFO:journalctl@ceph.osd.5.smithi100.stdout:May 09 06:05:25 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-5[46447]: 2024-05-09T06:05:25.218+0000 7f9c82a12700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:40.759657+0000 front 2024-05-09T06:04:40.759565+0000 (oldest deadline 2024-05-09T06:05:06.059465+0000) 2024-05-09T06:05:25.416 INFO:journalctl@ceph.osd.5.smithi100.stdout:May 09 06:05:25 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-5[46447]: 2024-05-09T06:05:25.218+0000 7f9c82a12700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:50.661112+0000 front 2024-05-09T06:04:50.661365+0000 (oldest deadline 2024-05-09T06:05:15.360971+0000) 2024-05-09T06:05:25.417 INFO:journalctl@ceph.osd.5.smithi100.stdout:May 09 06:05:25 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-5[46447]: 2024-05-09T06:05:25.218+0000 7f9c82a12700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:05:00.661944+0000 front 2024-05-09T06:05:00.661992+0000 (oldest deadline 2024-05-09T06:05:24.162113+0000) 2024-05-09T06:05:25.417 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:25 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:25.080+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:40.939354+0000 front 2024-05-09T06:04:40.939391+0000 (oldest deadline 2024-05-09T06:05:06.239561+0000) 2024-05-09T06:05:25.417 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:25 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:25.080+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:49.140745+0000 front 2024-05-09T06:04:49.140702+0000 (oldest deadline 2024-05-09T06:05:15.040838+0000) 2024-05-09T06:05:25.417 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:25 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:25.080+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:04:58.542017+0000 front 2024-05-09T06:04:58.542182+0000 (oldest deadline 2024-05-09T06:05:22.042178+0000) 2024-05-09T06:05:25.438 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 09 06:05:25 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-7[52683]: 2024-05-09T06:05:25.164+0000 7f467195a700 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:51.932284+0000 front 2024-05-09T06:04:51.932310+0000 (oldest deadline 2024-05-09T06:05:17.232472+0000) 2024-05-09T06:05:25.567 INFO:journalctl@ceph.osd.6.smithi039.stdout:May 09 06:05:25 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-6[56339]: 2024-05-09T06:05:25.204+0000 7fc2c9f4a700 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:42.778856+0000 front 2024-05-09T06:04:42.778818+0000 (oldest deadline 2024-05-09T06:05:06.279108+0000) 2024-05-09T06:05:25.568 INFO:journalctl@ceph.osd.6.smithi039.stdout:May 09 06:05:25 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-6[56339]: 2024-05-09T06:05:25.204+0000 7fc2c9f4a700 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:52.581582+0000 front 2024-05-09T06:04:52.581599+0000 (oldest deadline 2024-05-09T06:05:14.182091+0000) 2024-05-09T06:05:25.568 INFO:journalctl@ceph.osd.6.smithi039.stdout:May 09 06:05:25 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-6[56339]: 2024-05-09T06:05:25.204+0000 7fc2c9f4a700 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:04:58.784387+0000 front 2024-05-09T06:04:58.784311+0000 (oldest deadline 2024-05-09T06:05:24.684274+0000) 2024-05-09T06:05:25.788 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:25 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:25.452+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:44.474482+0000 front 2024-05-09T06:04:44.474540+0000 (oldest deadline 2024-05-09T06:05:10.875240+0000) 2024-05-09T06:05:25.788 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:25 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:25.452+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:50.875869+0000 front 2024-05-09T06:04:50.875902+0000 (oldest deadline 2024-05-09T06:05:14.376145+0000) 2024-05-09T06:05:25.788 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:25 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:25.452+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:05:01.278886+0000 front 2024-05-09T06:05:01.278763+0000 (oldest deadline 2024-05-09T06:05:22.279679+0000) 2024-05-09T06:05:25.852 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:25 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:25.582+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:43.538761+0000 front 2024-05-09T06:04:43.538885+0000 (oldest deadline 2024-05-09T06:05:08.239002+0000) 2024-05-09T06:05:25.852 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:25 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:25.582+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:48.239500+0000 front 2024-05-09T06:04:48.239770+0000 (oldest deadline 2024-05-09T06:05:15.840152+0000) 2024-05-09T06:05:26.165 INFO:journalctl@ceph.osd.5.smithi100.stdout:May 09 06:05:25 smithi100 podman[76795]: 2024-05-09 06:05:25.9304685 +0000 UTC m=+5.614969202 container died 701757da8133514a3d82524974a6d76611e713f23527a10af4f53ac89bd7d509 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-5, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404) 2024-05-09T06:05:26.166 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 06:05:26 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-8[53004]: 2024-05-09T06:05:26.105+0000 7f47f389b700 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:52.888379+0000 front 2024-05-09T06:04:52.888427+0000 (oldest deadline 2024-05-09T06:05:15.788423+0000) 2024-05-09T06:05:26.166 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 06:05:26 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-8[53004]: 2024-05-09T06:05:26.105+0000 7f47f389b700 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:04:59.889459+0000 front 2024-05-09T06:04:59.889691+0000 (oldest deadline 2024-05-09T06:05:22.789604+0000) 2024-05-09T06:05:26.166 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:26 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:26.088+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:40.939354+0000 front 2024-05-09T06:04:40.939391+0000 (oldest deadline 2024-05-09T06:05:06.239561+0000) 2024-05-09T06:05:26.166 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:26 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:26.088+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:49.140745+0000 front 2024-05-09T06:04:49.140702+0000 (oldest deadline 2024-05-09T06:05:15.040838+0000) 2024-05-09T06:05:26.166 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:26 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:26.088+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:04:58.542017+0000 front 2024-05-09T06:04:58.542182+0000 (oldest deadline 2024-05-09T06:05:22.042178+0000) 2024-05-09T06:05:26.440 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 09 06:05:26 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-7[52683]: 2024-05-09T06:05:26.147+0000 7f467195a700 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:51.932284+0000 front 2024-05-09T06:04:51.932310+0000 (oldest deadline 2024-05-09T06:05:17.232472+0000) 2024-05-09T06:05:26.547 INFO:journalctl@ceph.osd.6.smithi039.stdout:May 09 06:05:26 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-6[56339]: 2024-05-09T06:05:26.244+0000 7fc2c9f4a700 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:42.778856+0000 front 2024-05-09T06:04:42.778818+0000 (oldest deadline 2024-05-09T06:05:06.279108+0000) 2024-05-09T06:05:26.548 INFO:journalctl@ceph.osd.6.smithi039.stdout:May 09 06:05:26 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-6[56339]: 2024-05-09T06:05:26.244+0000 7fc2c9f4a700 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:52.581582+0000 front 2024-05-09T06:04:52.581599+0000 (oldest deadline 2024-05-09T06:05:14.182091+0000) 2024-05-09T06:05:26.548 INFO:journalctl@ceph.osd.6.smithi039.stdout:May 09 06:05:26 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-6[56339]: 2024-05-09T06:05:26.244+0000 7fc2c9f4a700 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:04:58.784387+0000 front 2024-05-09T06:04:58.784311+0000 (oldest deadline 2024-05-09T06:05:24.684274+0000) 2024-05-09T06:05:26.666 INFO:journalctl@ceph.osd.5.smithi100.stdout:May 09 06:05:26 smithi100 podman[76795]: 2024-05-09 06:05:26.294583925 +0000 UTC m=+5.979084625 container cleanup 701757da8133514a3d82524974a6d76611e713f23527a10af4f53ac89bd7d509 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-5, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-05-09T06:05:26.669 INFO:journalctl@ceph.osd.5.smithi100.stdout:May 09 06:05:26 smithi100 bash[76795]: ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-5 2024-05-09T06:05:26.669 INFO:journalctl@ceph.osd.5.smithi100.stdout:May 09 06:05:26 smithi100 podman[76812]: 2024-05-09 06:05:26.462615336 +0000 UTC m=+0.535841464 container remove 701757da8133514a3d82524974a6d76611e713f23527a10af4f53ac89bd7d509 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-5, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, io.buildah.version=1.33.5, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-09T06:05:26.788 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:26 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:26.454+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:44.474482+0000 front 2024-05-09T06:04:44.474540+0000 (oldest deadline 2024-05-09T06:05:10.875240+0000) 2024-05-09T06:05:26.788 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:26 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:26.454+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:50.875869+0000 front 2024-05-09T06:04:50.875902+0000 (oldest deadline 2024-05-09T06:05:14.376145+0000) 2024-05-09T06:05:26.788 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:26 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:26.454+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:05:01.278886+0000 front 2024-05-09T06:05:01.278763+0000 (oldest deadline 2024-05-09T06:05:22.279679+0000) 2024-05-09T06:05:26.852 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:26 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:26.561+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:43.538761+0000 front 2024-05-09T06:04:43.538885+0000 (oldest deadline 2024-05-09T06:05:08.239002+0000) 2024-05-09T06:05:26.852 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:26 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:26.561+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:48.239500+0000 front 2024-05-09T06:04:48.239770+0000 (oldest deadline 2024-05-09T06:05:15.840152+0000) 2024-05-09T06:05:27.165 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 06:05:27 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-8[53004]: 2024-05-09T06:05:27.063+0000 7f47f389b700 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:52.888379+0000 front 2024-05-09T06:04:52.888427+0000 (oldest deadline 2024-05-09T06:05:15.788423+0000) 2024-05-09T06:05:27.165 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 06:05:27 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-8[53004]: 2024-05-09T06:05:27.063+0000 7f47f389b700 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:04:59.889459+0000 front 2024-05-09T06:04:59.889691+0000 (oldest deadline 2024-05-09T06:05:22.789604+0000) 2024-05-09T06:05:27.166 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:27 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:27.054+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:40.939354+0000 front 2024-05-09T06:04:40.939391+0000 (oldest deadline 2024-05-09T06:05:06.239561+0000) 2024-05-09T06:05:27.166 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:27 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:27.054+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:49.140745+0000 front 2024-05-09T06:04:49.140702+0000 (oldest deadline 2024-05-09T06:05:15.040838+0000) 2024-05-09T06:05:27.166 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:27 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:27.054+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:04:58.542017+0000 front 2024-05-09T06:04:58.542182+0000 (oldest deadline 2024-05-09T06:05:22.042178+0000) 2024-05-09T06:05:27.166 INFO:journalctl@ceph.osd.5.smithi100.stdout:May 09 06:05:26 smithi100 podman[76904]: 2024-05-09 06:05:26.783343019 +0000 UTC m=+0.018876976 image pull db794d706f492c144ccc8f2c5bbc1870e116f5c4f3309dfab4416b39d099f8d7 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584 2024-05-09T06:05:27.166 INFO:journalctl@ceph.osd.5.smithi100.stdout:May 09 06:05:26 smithi100 podman[76904]: 2024-05-09 06:05:26.888411829 +0000 UTC m=+0.123945780 container create b9ad58bea95ac7aa3eadb20d53a8fd4b66a3351098461b2ac275c36ff28af703 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-09T06:05:27.166 INFO:journalctl@ceph.osd.5.smithi100.stdout:May 09 06:05:27 smithi100 podman[76904]: 2024-05-09 06:05:27.099157127 +0000 UTC m=+0.334691079 container init b9ad58bea95ac7aa3eadb20d53a8fd4b66a3351098461b2ac275c36ff28af703 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-5-deactivate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, ceph=True, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, io.buildah.version=1.33.5) 2024-05-09T06:05:27.166 INFO:journalctl@ceph.osd.5.smithi100.stdout:May 09 06:05:27 smithi100 podman[76904]: 2024-05-09 06:05:27.102431385 +0000 UTC m=+0.337965343 container start b9ad58bea95ac7aa3eadb20d53a8fd4b66a3351098461b2ac275c36ff28af703 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507) 2024-05-09T06:05:27.446 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 09 06:05:27 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-7[52683]: 2024-05-09T06:05:27.109+0000 7f467195a700 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:51.932284+0000 front 2024-05-09T06:04:51.932310+0000 (oldest deadline 2024-05-09T06:05:17.232472+0000) 2024-05-09T06:05:27.580 INFO:journalctl@ceph.osd.6.smithi039.stdout:May 09 06:05:27 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-6[56339]: 2024-05-09T06:05:27.225+0000 7fc2c9f4a700 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:42.778856+0000 front 2024-05-09T06:04:42.778818+0000 (oldest deadline 2024-05-09T06:05:06.279108+0000) 2024-05-09T06:05:27.580 INFO:journalctl@ceph.osd.6.smithi039.stdout:May 09 06:05:27 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-6[56339]: 2024-05-09T06:05:27.225+0000 7fc2c9f4a700 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:52.581582+0000 front 2024-05-09T06:04:52.581599+0000 (oldest deadline 2024-05-09T06:05:14.182091+0000) 2024-05-09T06:05:27.580 INFO:journalctl@ceph.osd.6.smithi039.stdout:May 09 06:05:27 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-6[56339]: 2024-05-09T06:05:27.225+0000 7fc2c9f4a700 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:04:58.784387+0000 front 2024-05-09T06:04:58.784311+0000 (oldest deadline 2024-05-09T06:05:24.684274+0000) 2024-05-09T06:05:27.666 INFO:journalctl@ceph.osd.5.smithi100.stdout:May 09 06:05:27 smithi100 podman[76904]: 2024-05-09 06:05:27.182456063 +0000 UTC m=+0.417990014 container attach b9ad58bea95ac7aa3eadb20d53a8fd4b66a3351098461b2ac275c36ff28af703 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-5-deactivate, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, ceph=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-05-09T06:05:27.666 INFO:journalctl@ceph.osd.5.smithi100.stdout:May 09 06:05:27 smithi100 podman[76904]: 2024-05-09 06:05:27.397999427 +0000 UTC m=+0.633533369 container died b9ad58bea95ac7aa3eadb20d53a8fd4b66a3351098461b2ac275c36ff28af703 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-5-deactivate, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-05-09T06:05:27.788 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:27 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:27.460+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:44.474482+0000 front 2024-05-09T06:04:44.474540+0000 (oldest deadline 2024-05-09T06:05:10.875240+0000) 2024-05-09T06:05:27.788 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:27 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:27.460+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:50.875869+0000 front 2024-05-09T06:04:50.875902+0000 (oldest deadline 2024-05-09T06:05:14.376145+0000) 2024-05-09T06:05:27.789 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:27 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:27.460+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:05:01.278886+0000 front 2024-05-09T06:05:01.278763+0000 (oldest deadline 2024-05-09T06:05:22.279679+0000) 2024-05-09T06:05:27.852 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:27 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:27.594+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:43.538761+0000 front 2024-05-09T06:04:43.538885+0000 (oldest deadline 2024-05-09T06:05:08.239002+0000) 2024-05-09T06:05:27.852 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:27 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:27.594+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:48.239500+0000 front 2024-05-09T06:04:48.239770+0000 (oldest deadline 2024-05-09T06:05:15.840152+0000) 2024-05-09T06:05:27.852 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:27 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:27.594+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:05:01.041844+0000 front 2024-05-09T06:05:01.042028+0000 (oldest deadline 2024-05-09T06:05:26.941838+0000) 2024-05-09T06:05:27.982 DEBUG:teuthology.orchestra.run.smithi100:> sudo pkill -f 'journalctl -f -n 0 -u ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@osd.5.service' 2024-05-09T06:05:28.021 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T06:05:28.021 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-05-09T06:05:28.021 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-05-09T06:05:28.021 DEBUG:teuthology.orchestra.run.smithi039:> sudo systemctl stop ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@osd.6 2024-05-09T06:05:28.265 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 06:05:28 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-8[53004]: 2024-05-09T06:05:28.063+0000 7f47f389b700 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:52.888379+0000 front 2024-05-09T06:04:52.888427+0000 (oldest deadline 2024-05-09T06:05:15.788423+0000) 2024-05-09T06:05:28.265 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 06:05:28 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-8[53004]: 2024-05-09T06:05:28.063+0000 7f47f389b700 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:04:59.889459+0000 front 2024-05-09T06:04:59.889691+0000 (oldest deadline 2024-05-09T06:05:22.789604+0000) 2024-05-09T06:05:28.265 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:28 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:28.064+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:40.939354+0000 front 2024-05-09T06:04:40.939391+0000 (oldest deadline 2024-05-09T06:05:06.239561+0000) 2024-05-09T06:05:28.265 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:28 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:28.064+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:49.140745+0000 front 2024-05-09T06:04:49.140702+0000 (oldest deadline 2024-05-09T06:05:15.040838+0000) 2024-05-09T06:05:28.265 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:28 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:28.064+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:04:58.542017+0000 front 2024-05-09T06:04:58.542182+0000 (oldest deadline 2024-05-09T06:05:22.042178+0000) 2024-05-09T06:05:28.329 INFO:journalctl@ceph.osd.6.smithi039.stdout:May 09 06:05:28 smithi039 systemd[1]: Stopping Ceph osd.6 for 86d4cc60-0dc4-11ef-bc97-c7b262605968... 2024-05-09T06:05:28.329 INFO:journalctl@ceph.osd.6.smithi039.stdout:May 09 06:05:28 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-6[56339]: 2024-05-09T06:05:28.230+0000 7fc2c9f4a700 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:42.778856+0000 front 2024-05-09T06:04:42.778818+0000 (oldest deadline 2024-05-09T06:05:06.279108+0000) 2024-05-09T06:05:28.329 INFO:journalctl@ceph.osd.6.smithi039.stdout:May 09 06:05:28 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-6[56339]: 2024-05-09T06:05:28.230+0000 7fc2c9f4a700 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:52.581582+0000 front 2024-05-09T06:04:52.581599+0000 (oldest deadline 2024-05-09T06:05:14.182091+0000) 2024-05-09T06:05:28.329 INFO:journalctl@ceph.osd.6.smithi039.stdout:May 09 06:05:28 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-6[56339]: 2024-05-09T06:05:28.230+0000 7fc2c9f4a700 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:04:58.784387+0000 front 2024-05-09T06:04:58.784311+0000 (oldest deadline 2024-05-09T06:05:24.684274+0000) 2024-05-09T06:05:28.329 INFO:journalctl@ceph.osd.6.smithi039.stdout:May 09 06:05:28 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-6[56339]: 2024-05-09T06:05:28.343+0000 7fc2cd994700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T06:05:28.329 INFO:journalctl@ceph.osd.6.smithi039.stdout:May 09 06:05:28 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-6[56339]: 2024-05-09T06:05:28.343+0000 7fc2cd994700 -1 osd.6 86 *** Got signal Terminated *** 2024-05-09T06:05:28.329 INFO:journalctl@ceph.osd.6.smithi039.stdout:May 09 06:05:28 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-6[56339]: 2024-05-09T06:05:28.343+0000 7fc2cd994700 -1 osd.6 86 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-09T06:05:28.496 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 09 06:05:28 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-7[52683]: 2024-05-09T06:05:28.149+0000 7f467195a700 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:51.932284+0000 front 2024-05-09T06:04:51.932310+0000 (oldest deadline 2024-05-09T06:05:17.232472+0000) 2024-05-09T06:05:28.496 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 09 06:05:28 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-7[52683]: 2024-05-09T06:05:28.149+0000 7f467195a700 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:05:01.334043+0000 front 2024-05-09T06:05:01.333967+0000 (oldest deadline 2024-05-09T06:05:27.234063+0000) 2024-05-09T06:05:28.602 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:28 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:28.583+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:43.538761+0000 front 2024-05-09T06:04:43.538885+0000 (oldest deadline 2024-05-09T06:05:08.239002+0000) 2024-05-09T06:05:28.602 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:28 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:28.583+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:48.239500+0000 front 2024-05-09T06:04:48.239770+0000 (oldest deadline 2024-05-09T06:05:15.840152+0000) 2024-05-09T06:05:28.602 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:28 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:28.583+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:05:01.041844+0000 front 2024-05-09T06:05:01.042028+0000 (oldest deadline 2024-05-09T06:05:26.941838+0000) 2024-05-09T06:05:28.788 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:28 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:28.510+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:44.474482+0000 front 2024-05-09T06:04:44.474540+0000 (oldest deadline 2024-05-09T06:05:10.875240+0000) 2024-05-09T06:05:28.788 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:28 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:28.510+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:50.875869+0000 front 2024-05-09T06:04:50.875902+0000 (oldest deadline 2024-05-09T06:05:14.376145+0000) 2024-05-09T06:05:28.788 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:28 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:28.510+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:05:01.278886+0000 front 2024-05-09T06:05:01.278763+0000 (oldest deadline 2024-05-09T06:05:22.279679+0000) 2024-05-09T06:05:29.415 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 06:05:29 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-8[53004]: 2024-05-09T06:05:29.086+0000 7f47f389b700 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:52.888379+0000 front 2024-05-09T06:04:52.888427+0000 (oldest deadline 2024-05-09T06:05:15.788423+0000) 2024-05-09T06:05:29.416 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 06:05:29 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-8[53004]: 2024-05-09T06:05:29.086+0000 7f47f389b700 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:04:59.889459+0000 front 2024-05-09T06:04:59.889691+0000 (oldest deadline 2024-05-09T06:05:22.789604+0000) 2024-05-09T06:05:29.416 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:29 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:29.019+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:40.939354+0000 front 2024-05-09T06:04:40.939391+0000 (oldest deadline 2024-05-09T06:05:06.239561+0000) 2024-05-09T06:05:29.416 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:29 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:29.019+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:49.140745+0000 front 2024-05-09T06:04:49.140702+0000 (oldest deadline 2024-05-09T06:05:15.040838+0000) 2024-05-09T06:05:29.416 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:29 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:29.019+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:04:58.542017+0000 front 2024-05-09T06:04:58.542182+0000 (oldest deadline 2024-05-09T06:05:22.042178+0000) 2024-05-09T06:05:29.465 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 09 06:05:29 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-7[52683]: 2024-05-09T06:05:29.126+0000 7f467195a700 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:51.932284+0000 front 2024-05-09T06:04:51.932310+0000 (oldest deadline 2024-05-09T06:05:17.232472+0000) 2024-05-09T06:05:29.465 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 09 06:05:29 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-7[52683]: 2024-05-09T06:05:29.126+0000 7f467195a700 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:05:01.334043+0000 front 2024-05-09T06:05:01.333967+0000 (oldest deadline 2024-05-09T06:05:27.234063+0000) 2024-05-09T06:05:29.503 INFO:journalctl@ceph.osd.6.smithi039.stdout:May 09 06:05:29 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-6[56339]: 2024-05-09T06:05:29.250+0000 7fc2c9f4a700 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:42.778856+0000 front 2024-05-09T06:04:42.778818+0000 (oldest deadline 2024-05-09T06:05:06.279108+0000) 2024-05-09T06:05:29.503 INFO:journalctl@ceph.osd.6.smithi039.stdout:May 09 06:05:29 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-6[56339]: 2024-05-09T06:05:29.250+0000 7fc2c9f4a700 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:52.581582+0000 front 2024-05-09T06:04:52.581599+0000 (oldest deadline 2024-05-09T06:05:14.182091+0000) 2024-05-09T06:05:29.504 INFO:journalctl@ceph.osd.6.smithi039.stdout:May 09 06:05:29 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-6[56339]: 2024-05-09T06:05:29.250+0000 7fc2c9f4a700 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:04:58.784387+0000 front 2024-05-09T06:04:58.784311+0000 (oldest deadline 2024-05-09T06:05:24.684274+0000) 2024-05-09T06:05:29.788 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:29 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:29.479+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:44.474482+0000 front 2024-05-09T06:04:44.474540+0000 (oldest deadline 2024-05-09T06:05:10.875240+0000) 2024-05-09T06:05:29.788 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:29 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:29.479+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:50.875869+0000 front 2024-05-09T06:04:50.875902+0000 (oldest deadline 2024-05-09T06:05:14.376145+0000) 2024-05-09T06:05:29.788 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:29 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:29.479+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:05:01.278886+0000 front 2024-05-09T06:05:01.278763+0000 (oldest deadline 2024-05-09T06:05:22.279679+0000) 2024-05-09T06:05:29.852 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:29 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:29.577+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:43.538761+0000 front 2024-05-09T06:04:43.538885+0000 (oldest deadline 2024-05-09T06:05:08.239002+0000) 2024-05-09T06:05:29.852 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:29 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:29.577+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:48.239500+0000 front 2024-05-09T06:04:48.239770+0000 (oldest deadline 2024-05-09T06:05:15.840152+0000) 2024-05-09T06:05:29.852 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:29 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:29.577+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:05:01.041844+0000 front 2024-05-09T06:05:01.042028+0000 (oldest deadline 2024-05-09T06:05:26.941838+0000) 2024-05-09T06:05:30.415 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 06:05:30 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-8[53004]: 2024-05-09T06:05:30.067+0000 7f47f389b700 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:52.888379+0000 front 2024-05-09T06:04:52.888427+0000 (oldest deadline 2024-05-09T06:05:15.788423+0000) 2024-05-09T06:05:30.416 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 06:05:30 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-8[53004]: 2024-05-09T06:05:30.067+0000 7f47f389b700 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:04:59.889459+0000 front 2024-05-09T06:04:59.889691+0000 (oldest deadline 2024-05-09T06:05:22.789604+0000) 2024-05-09T06:05:30.416 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:30 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:30.010+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:40.939354+0000 front 2024-05-09T06:04:40.939391+0000 (oldest deadline 2024-05-09T06:05:06.239561+0000) 2024-05-09T06:05:30.416 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:30 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:30.010+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:49.140745+0000 front 2024-05-09T06:04:49.140702+0000 (oldest deadline 2024-05-09T06:05:15.040838+0000) 2024-05-09T06:05:30.416 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:30 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:30.010+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:04:58.542017+0000 front 2024-05-09T06:04:58.542182+0000 (oldest deadline 2024-05-09T06:05:22.042178+0000) 2024-05-09T06:05:30.503 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 09 06:05:30 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-7[52683]: 2024-05-09T06:05:30.092+0000 7f467195a700 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:51.932284+0000 front 2024-05-09T06:04:51.932310+0000 (oldest deadline 2024-05-09T06:05:17.232472+0000) 2024-05-09T06:05:30.503 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 09 06:05:30 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-7[52683]: 2024-05-09T06:05:30.092+0000 7f467195a700 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:05:01.334043+0000 front 2024-05-09T06:05:01.333967+0000 (oldest deadline 2024-05-09T06:05:27.234063+0000) 2024-05-09T06:05:30.517 INFO:journalctl@ceph.osd.6.smithi039.stdout:May 09 06:05:30 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-6[56339]: 2024-05-09T06:05:30.217+0000 7fc2c9f4a700 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:42.778856+0000 front 2024-05-09T06:04:42.778818+0000 (oldest deadline 2024-05-09T06:05:06.279108+0000) 2024-05-09T06:05:30.517 INFO:journalctl@ceph.osd.6.smithi039.stdout:May 09 06:05:30 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-6[56339]: 2024-05-09T06:05:30.217+0000 7fc2c9f4a700 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:52.581582+0000 front 2024-05-09T06:04:52.581599+0000 (oldest deadline 2024-05-09T06:05:14.182091+0000) 2024-05-09T06:05:30.518 INFO:journalctl@ceph.osd.6.smithi039.stdout:May 09 06:05:30 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-6[56339]: 2024-05-09T06:05:30.217+0000 7fc2c9f4a700 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:04:58.784387+0000 front 2024-05-09T06:04:58.784311+0000 (oldest deadline 2024-05-09T06:05:24.684274+0000) 2024-05-09T06:05:30.788 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:30 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:30.517+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:44.474482+0000 front 2024-05-09T06:04:44.474540+0000 (oldest deadline 2024-05-09T06:05:10.875240+0000) 2024-05-09T06:05:30.788 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:30 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:30.517+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:50.875869+0000 front 2024-05-09T06:04:50.875902+0000 (oldest deadline 2024-05-09T06:05:14.376145+0000) 2024-05-09T06:05:30.789 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:30 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:30.517+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:05:01.278886+0000 front 2024-05-09T06:05:01.278763+0000 (oldest deadline 2024-05-09T06:05:22.279679+0000) 2024-05-09T06:05:30.795 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:30 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:30.531+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:43.538761+0000 front 2024-05-09T06:04:43.538885+0000 (oldest deadline 2024-05-09T06:05:08.239002+0000) 2024-05-09T06:05:30.795 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:30 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:30.531+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:48.239500+0000 front 2024-05-09T06:04:48.239770+0000 (oldest deadline 2024-05-09T06:05:15.840152+0000) 2024-05-09T06:05:30.796 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:30 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:30.531+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:05:01.041844+0000 front 2024-05-09T06:05:01.042028+0000 (oldest deadline 2024-05-09T06:05:26.941838+0000) 2024-05-09T06:05:31.288 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 09 06:05:31 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-7[52683]: 2024-05-09T06:05:31.048+0000 7f467195a700 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:51.932284+0000 front 2024-05-09T06:04:51.932310+0000 (oldest deadline 2024-05-09T06:05:17.232472+0000) 2024-05-09T06:05:31.288 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 09 06:05:31 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-7[52683]: 2024-05-09T06:05:31.048+0000 7f467195a700 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:05:01.334043+0000 front 2024-05-09T06:05:01.333967+0000 (oldest deadline 2024-05-09T06:05:27.234063+0000) 2024-05-09T06:05:31.416 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 06:05:31 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-8[53004]: 2024-05-09T06:05:31.030+0000 7f47f389b700 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:52.888379+0000 front 2024-05-09T06:04:52.888427+0000 (oldest deadline 2024-05-09T06:05:15.788423+0000) 2024-05-09T06:05:31.416 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 06:05:31 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-8[53004]: 2024-05-09T06:05:31.030+0000 7f47f389b700 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:04:59.889459+0000 front 2024-05-09T06:04:59.889691+0000 (oldest deadline 2024-05-09T06:05:22.789604+0000) 2024-05-09T06:05:31.416 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:31 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:31.048+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:40.939354+0000 front 2024-05-09T06:04:40.939391+0000 (oldest deadline 2024-05-09T06:05:06.239561+0000) 2024-05-09T06:05:31.416 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:31 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:31.048+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:49.140745+0000 front 2024-05-09T06:04:49.140702+0000 (oldest deadline 2024-05-09T06:05:15.040838+0000) 2024-05-09T06:05:31.416 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:31 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:31.048+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:04:58.542017+0000 front 2024-05-09T06:04:58.542182+0000 (oldest deadline 2024-05-09T06:05:22.042178+0000) 2024-05-09T06:05:31.562 INFO:journalctl@ceph.osd.6.smithi039.stdout:May 09 06:05:31 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-6[56339]: 2024-05-09T06:05:31.178+0000 7fc2c9f4a700 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:42.778856+0000 front 2024-05-09T06:04:42.778818+0000 (oldest deadline 2024-05-09T06:05:06.279108+0000) 2024-05-09T06:05:31.562 INFO:journalctl@ceph.osd.6.smithi039.stdout:May 09 06:05:31 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-6[56339]: 2024-05-09T06:05:31.178+0000 7fc2c9f4a700 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:52.581582+0000 front 2024-05-09T06:04:52.581599+0000 (oldest deadline 2024-05-09T06:05:14.182091+0000) 2024-05-09T06:05:31.562 INFO:journalctl@ceph.osd.6.smithi039.stdout:May 09 06:05:31 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-6[56339]: 2024-05-09T06:05:31.178+0000 7fc2c9f4a700 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:04:58.784387+0000 front 2024-05-09T06:04:58.784311+0000 (oldest deadline 2024-05-09T06:05:24.684274+0000) 2024-05-09T06:05:31.788 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:31 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:31.531+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:44.474482+0000 front 2024-05-09T06:04:44.474540+0000 (oldest deadline 2024-05-09T06:05:10.875240+0000) 2024-05-09T06:05:31.788 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:31 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:31.531+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:50.875869+0000 front 2024-05-09T06:04:50.875902+0000 (oldest deadline 2024-05-09T06:05:14.376145+0000) 2024-05-09T06:05:31.788 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:31 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:31.531+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:05:01.278886+0000 front 2024-05-09T06:05:01.278763+0000 (oldest deadline 2024-05-09T06:05:22.279679+0000) 2024-05-09T06:05:31.788 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:31 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:31.531+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-05-09T06:05:08.180994+0000 front 2024-05-09T06:05:08.181056+0000 (oldest deadline 2024-05-09T06:05:31.081042+0000) 2024-05-09T06:05:31.852 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:31 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:31.575+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:43.538761+0000 front 2024-05-09T06:04:43.538885+0000 (oldest deadline 2024-05-09T06:05:08.239002+0000) 2024-05-09T06:05:31.852 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:31 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:31.575+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:48.239500+0000 front 2024-05-09T06:04:48.239770+0000 (oldest deadline 2024-05-09T06:05:15.840152+0000) 2024-05-09T06:05:31.852 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:31 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:31.575+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:05:01.041844+0000 front 2024-05-09T06:05:01.042028+0000 (oldest deadline 2024-05-09T06:05:26.941838+0000) 2024-05-09T06:05:32.415 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:32 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:32.092+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:40.939354+0000 front 2024-05-09T06:04:40.939391+0000 (oldest deadline 2024-05-09T06:05:06.239561+0000) 2024-05-09T06:05:32.415 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:32 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:32.092+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:49.140745+0000 front 2024-05-09T06:04:49.140702+0000 (oldest deadline 2024-05-09T06:05:15.040838+0000) 2024-05-09T06:05:32.416 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:32 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:32.092+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:04:58.542017+0000 front 2024-05-09T06:04:58.542182+0000 (oldest deadline 2024-05-09T06:05:22.042178+0000) 2024-05-09T06:05:32.416 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 06:05:31 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-8[53004]: 2024-05-09T06:05:31.993+0000 7f47f389b700 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:52.888379+0000 front 2024-05-09T06:04:52.888427+0000 (oldest deadline 2024-05-09T06:05:15.788423+0000) 2024-05-09T06:05:32.416 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 06:05:31 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-8[53004]: 2024-05-09T06:05:31.993+0000 7f47f389b700 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:04:59.889459+0000 front 2024-05-09T06:04:59.889691+0000 (oldest deadline 2024-05-09T06:05:22.789604+0000) 2024-05-09T06:05:32.516 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 09 06:05:32 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-7[52683]: 2024-05-09T06:05:32.095+0000 7f467195a700 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:51.932284+0000 front 2024-05-09T06:04:51.932310+0000 (oldest deadline 2024-05-09T06:05:17.232472+0000) 2024-05-09T06:05:32.516 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 09 06:05:32 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-7[52683]: 2024-05-09T06:05:32.095+0000 7f467195a700 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:05:01.334043+0000 front 2024-05-09T06:05:01.333967+0000 (oldest deadline 2024-05-09T06:05:27.234063+0000) 2024-05-09T06:05:32.516 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 09 06:05:32 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-7[52683]: 2024-05-09T06:05:32.095+0000 7f467195a700 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-05-09T06:05:07.234931+0000 front 2024-05-09T06:05:07.234775+0000 (oldest deadline 2024-05-09T06:05:31.934658+0000) 2024-05-09T06:05:32.598 INFO:journalctl@ceph.osd.6.smithi039.stdout:May 09 06:05:32 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-6[56339]: 2024-05-09T06:05:32.162+0000 7fc2c9f4a700 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:42.778856+0000 front 2024-05-09T06:04:42.778818+0000 (oldest deadline 2024-05-09T06:05:06.279108+0000) 2024-05-09T06:05:32.598 INFO:journalctl@ceph.osd.6.smithi039.stdout:May 09 06:05:32 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-6[56339]: 2024-05-09T06:05:32.162+0000 7fc2c9f4a700 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:52.581582+0000 front 2024-05-09T06:04:52.581599+0000 (oldest deadline 2024-05-09T06:05:14.182091+0000) 2024-05-09T06:05:32.598 INFO:journalctl@ceph.osd.6.smithi039.stdout:May 09 06:05:32 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-6[56339]: 2024-05-09T06:05:32.162+0000 7fc2c9f4a700 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:04:58.784387+0000 front 2024-05-09T06:04:58.784311+0000 (oldest deadline 2024-05-09T06:05:24.684274+0000) 2024-05-09T06:05:32.599 INFO:journalctl@ceph.osd.6.smithi039.stdout:May 09 06:05:32 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-6[56339]: 2024-05-09T06:05:32.162+0000 7fc2c9f4a700 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-05-09T06:05:09.385356+0000 front 2024-05-09T06:05:09.385382+0000 (oldest deadline 2024-05-09T06:05:31.685572+0000) 2024-05-09T06:05:32.788 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:32 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:32.530+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:44.474482+0000 front 2024-05-09T06:04:44.474540+0000 (oldest deadline 2024-05-09T06:05:10.875240+0000) 2024-05-09T06:05:32.788 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:32 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:32.530+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:50.875869+0000 front 2024-05-09T06:04:50.875902+0000 (oldest deadline 2024-05-09T06:05:14.376145+0000) 2024-05-09T06:05:32.788 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:32 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:32.530+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:05:01.278886+0000 front 2024-05-09T06:05:01.278763+0000 (oldest deadline 2024-05-09T06:05:22.279679+0000) 2024-05-09T06:05:32.788 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:32 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:32.530+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-05-09T06:05:08.180994+0000 front 2024-05-09T06:05:08.181056+0000 (oldest deadline 2024-05-09T06:05:31.081042+0000) 2024-05-09T06:05:32.852 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:32 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:32.612+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:43.538761+0000 front 2024-05-09T06:04:43.538885+0000 (oldest deadline 2024-05-09T06:05:08.239002+0000) 2024-05-09T06:05:32.852 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:32 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:32.612+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:48.239500+0000 front 2024-05-09T06:04:48.239770+0000 (oldest deadline 2024-05-09T06:05:15.840152+0000) 2024-05-09T06:05:32.852 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:32 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:32.612+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:05:01.041844+0000 front 2024-05-09T06:05:01.042028+0000 (oldest deadline 2024-05-09T06:05:26.941838+0000) 2024-05-09T06:05:33.415 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:33 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:33.107+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:40.939354+0000 front 2024-05-09T06:04:40.939391+0000 (oldest deadline 2024-05-09T06:05:06.239561+0000) 2024-05-09T06:05:33.416 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:33 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:33.107+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:49.140745+0000 front 2024-05-09T06:04:49.140702+0000 (oldest deadline 2024-05-09T06:05:15.040838+0000) 2024-05-09T06:05:33.416 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:33 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:33.107+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:04:58.542017+0000 front 2024-05-09T06:04:58.542182+0000 (oldest deadline 2024-05-09T06:05:22.042178+0000) 2024-05-09T06:05:33.416 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 06:05:32 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-8[53004]: 2024-05-09T06:05:32.946+0000 7f47f389b700 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:52.888379+0000 front 2024-05-09T06:04:52.888427+0000 (oldest deadline 2024-05-09T06:05:15.788423+0000) 2024-05-09T06:05:33.416 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 06:05:32 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-8[53004]: 2024-05-09T06:05:32.946+0000 7f47f389b700 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:04:59.889459+0000 front 2024-05-09T06:04:59.889691+0000 (oldest deadline 2024-05-09T06:05:22.789604+0000) 2024-05-09T06:05:33.416 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 06:05:32 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-8[53004]: 2024-05-09T06:05:32.946+0000 7f47f389b700 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-05-09T06:05:08.690621+0000 front 2024-05-09T06:05:08.690467+0000 (oldest deadline 2024-05-09T06:05:32.190537+0000) 2024-05-09T06:05:33.497 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 09 06:05:33 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-7[52683]: 2024-05-09T06:05:33.136+0000 7f467195a700 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:51.932284+0000 front 2024-05-09T06:04:51.932310+0000 (oldest deadline 2024-05-09T06:05:17.232472+0000) 2024-05-09T06:05:33.497 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 09 06:05:33 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-7[52683]: 2024-05-09T06:05:33.136+0000 7f467195a700 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:05:01.334043+0000 front 2024-05-09T06:05:01.333967+0000 (oldest deadline 2024-05-09T06:05:27.234063+0000) 2024-05-09T06:05:33.497 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 09 06:05:33 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-7[52683]: 2024-05-09T06:05:33.136+0000 7f467195a700 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-05-09T06:05:07.234931+0000 front 2024-05-09T06:05:07.234775+0000 (oldest deadline 2024-05-09T06:05:31.934658+0000) 2024-05-09T06:05:33.602 INFO:journalctl@ceph.osd.6.smithi039.stdout:May 09 06:05:33 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-6[56339]: 2024-05-09T06:05:33.178+0000 7fc2c9f4a700 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:42.778856+0000 front 2024-05-09T06:04:42.778818+0000 (oldest deadline 2024-05-09T06:05:06.279108+0000) 2024-05-09T06:05:33.602 INFO:journalctl@ceph.osd.6.smithi039.stdout:May 09 06:05:33 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-6[56339]: 2024-05-09T06:05:33.178+0000 7fc2c9f4a700 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:52.581582+0000 front 2024-05-09T06:04:52.581599+0000 (oldest deadline 2024-05-09T06:05:14.182091+0000) 2024-05-09T06:05:33.602 INFO:journalctl@ceph.osd.6.smithi039.stdout:May 09 06:05:33 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-6[56339]: 2024-05-09T06:05:33.178+0000 7fc2c9f4a700 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:04:58.784387+0000 front 2024-05-09T06:04:58.784311+0000 (oldest deadline 2024-05-09T06:05:24.684274+0000) 2024-05-09T06:05:33.602 INFO:journalctl@ceph.osd.6.smithi039.stdout:May 09 06:05:33 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-6[56339]: 2024-05-09T06:05:33.178+0000 7fc2c9f4a700 -1 osd.6 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-05-09T06:05:09.385356+0000 front 2024-05-09T06:05:09.385382+0000 (oldest deadline 2024-05-09T06:05:31.685572+0000) 2024-05-09T06:05:33.788 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:33 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:33.510+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:44.474482+0000 front 2024-05-09T06:04:44.474540+0000 (oldest deadline 2024-05-09T06:05:10.875240+0000) 2024-05-09T06:05:33.788 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:33 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:33.510+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:50.875869+0000 front 2024-05-09T06:04:50.875902+0000 (oldest deadline 2024-05-09T06:05:14.376145+0000) 2024-05-09T06:05:33.788 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:33 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:33.510+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:05:01.278886+0000 front 2024-05-09T06:05:01.278763+0000 (oldest deadline 2024-05-09T06:05:22.279679+0000) 2024-05-09T06:05:33.789 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:33 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:33.511+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-05-09T06:05:08.180994+0000 front 2024-05-09T06:05:08.181056+0000 (oldest deadline 2024-05-09T06:05:31.081042+0000) 2024-05-09T06:05:33.943 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:33 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:33.634+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:43.538761+0000 front 2024-05-09T06:04:43.538885+0000 (oldest deadline 2024-05-09T06:05:08.239002+0000) 2024-05-09T06:05:33.943 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:33 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:33.634+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:48.239500+0000 front 2024-05-09T06:04:48.239770+0000 (oldest deadline 2024-05-09T06:05:15.840152+0000) 2024-05-09T06:05:33.944 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:33 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:33.634+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:05:01.041844+0000 front 2024-05-09T06:05:01.042028+0000 (oldest deadline 2024-05-09T06:05:26.941838+0000) 2024-05-09T06:05:34.165 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:34 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:34.153+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:40.939354+0000 front 2024-05-09T06:04:40.939391+0000 (oldest deadline 2024-05-09T06:05:06.239561+0000) 2024-05-09T06:05:34.166 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:34 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:34.153+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:49.140745+0000 front 2024-05-09T06:04:49.140702+0000 (oldest deadline 2024-05-09T06:05:15.040838+0000) 2024-05-09T06:05:34.166 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:34 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:34.153+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:04:58.542017+0000 front 2024-05-09T06:04:58.542182+0000 (oldest deadline 2024-05-09T06:05:22.042178+0000) 2024-05-09T06:05:34.166 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 06:05:33 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-8[53004]: 2024-05-09T06:05:33.908+0000 7f47f389b700 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:52.888379+0000 front 2024-05-09T06:04:52.888427+0000 (oldest deadline 2024-05-09T06:05:15.788423+0000) 2024-05-09T06:05:34.166 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 06:05:33 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-8[53004]: 2024-05-09T06:05:33.908+0000 7f47f389b700 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:04:59.889459+0000 front 2024-05-09T06:04:59.889691+0000 (oldest deadline 2024-05-09T06:05:22.789604+0000) 2024-05-09T06:05:34.166 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 06:05:33 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-8[53004]: 2024-05-09T06:05:33.908+0000 7f47f389b700 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-05-09T06:05:08.690621+0000 front 2024-05-09T06:05:08.690467+0000 (oldest deadline 2024-05-09T06:05:32.190537+0000) 2024-05-09T06:05:34.213 INFO:journalctl@ceph.osd.6.smithi039.stdout:May 09 06:05:33 smithi039 podman[94956]: 2024-05-09 06:05:33.958689981 +0000 UTC m=+5.721495003 container died e8a000e84d93ba0b2475b4993b7e3af9a15901c8ff6592ebebc6eda2998dedba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-6, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-05-09T06:05:34.482 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 09 06:05:34 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-7[52683]: 2024-05-09T06:05:34.098+0000 7f467195a700 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:51.932284+0000 front 2024-05-09T06:04:51.932310+0000 (oldest deadline 2024-05-09T06:05:17.232472+0000) 2024-05-09T06:05:34.482 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 09 06:05:34 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-7[52683]: 2024-05-09T06:05:34.098+0000 7f467195a700 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:05:01.334043+0000 front 2024-05-09T06:05:01.333967+0000 (oldest deadline 2024-05-09T06:05:27.234063+0000) 2024-05-09T06:05:34.483 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 09 06:05:34 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-7[52683]: 2024-05-09T06:05:34.098+0000 7f467195a700 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-05-09T06:05:07.234931+0000 front 2024-05-09T06:05:07.234775+0000 (oldest deadline 2024-05-09T06:05:31.934658+0000) 2024-05-09T06:05:34.581 INFO:journalctl@ceph.osd.6.smithi039.stdout:May 09 06:05:34 smithi039 podman[94956]: 2024-05-09 06:05:34.32663639 +0000 UTC m=+6.089441419 container cleanup e8a000e84d93ba0b2475b4993b7e3af9a15901c8ff6592ebebc6eda2998dedba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-6, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404) 2024-05-09T06:05:34.582 INFO:journalctl@ceph.osd.6.smithi039.stdout:May 09 06:05:34 smithi039 bash[94956]: ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-6 2024-05-09T06:05:34.788 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:34 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:34.496+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:44.474482+0000 front 2024-05-09T06:04:44.474540+0000 (oldest deadline 2024-05-09T06:05:10.875240+0000) 2024-05-09T06:05:34.788 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:34 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:34.496+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:50.875869+0000 front 2024-05-09T06:04:50.875902+0000 (oldest deadline 2024-05-09T06:05:14.376145+0000) 2024-05-09T06:05:34.788 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:34 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:34.496+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:05:01.278886+0000 front 2024-05-09T06:05:01.278763+0000 (oldest deadline 2024-05-09T06:05:22.279679+0000) 2024-05-09T06:05:34.789 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:34 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:34.496+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-05-09T06:05:08.180994+0000 front 2024-05-09T06:05:08.181056+0000 (oldest deadline 2024-05-09T06:05:31.081042+0000) 2024-05-09T06:05:34.852 INFO:journalctl@ceph.osd.6.smithi039.stdout:May 09 06:05:34 smithi039 podman[94986]: 2024-05-09 06:05:34.703031323 +0000 UTC m=+0.739053447 container remove e8a000e84d93ba0b2475b4993b7e3af9a15901c8ff6592ebebc6eda2998dedba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-6, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, ceph=True, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-09T06:05:34.852 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:34 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:34.595+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:43.538761+0000 front 2024-05-09T06:04:43.538885+0000 (oldest deadline 2024-05-09T06:05:08.239002+0000) 2024-05-09T06:05:34.852 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:34 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:34.595+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:48.239500+0000 front 2024-05-09T06:04:48.239770+0000 (oldest deadline 2024-05-09T06:05:15.840152+0000) 2024-05-09T06:05:34.852 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:34 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:34.595+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:05:01.041844+0000 front 2024-05-09T06:05:01.042028+0000 (oldest deadline 2024-05-09T06:05:26.941838+0000) 2024-05-09T06:05:34.852 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:34 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:34.595+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-05-09T06:05:06.942441+0000 front 2024-05-09T06:05:06.942467+0000 (oldest deadline 2024-05-09T06:05:34.543233+0000) 2024-05-09T06:05:35.165 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 06:05:34 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-8[53004]: 2024-05-09T06:05:34.888+0000 7f47f389b700 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:52.888379+0000 front 2024-05-09T06:04:52.888427+0000 (oldest deadline 2024-05-09T06:05:15.788423+0000) 2024-05-09T06:05:35.166 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 06:05:34 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-8[53004]: 2024-05-09T06:05:34.888+0000 7f47f389b700 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:04:59.889459+0000 front 2024-05-09T06:04:59.889691+0000 (oldest deadline 2024-05-09T06:05:22.789604+0000) 2024-05-09T06:05:35.166 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 06:05:34 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-8[53004]: 2024-05-09T06:05:34.888+0000 7f47f389b700 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-05-09T06:05:08.690621+0000 front 2024-05-09T06:05:08.690467+0000 (oldest deadline 2024-05-09T06:05:32.190537+0000) 2024-05-09T06:05:35.166 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:35 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:35.120+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:40.939354+0000 front 2024-05-09T06:04:40.939391+0000 (oldest deadline 2024-05-09T06:05:06.239561+0000) 2024-05-09T06:05:35.167 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:35 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:35.120+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:49.140745+0000 front 2024-05-09T06:04:49.140702+0000 (oldest deadline 2024-05-09T06:05:15.040838+0000) 2024-05-09T06:05:35.167 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:35 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:35.120+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:04:58.542017+0000 front 2024-05-09T06:04:58.542182+0000 (oldest deadline 2024-05-09T06:05:22.042178+0000) 2024-05-09T06:05:35.352 INFO:journalctl@ceph.osd.6.smithi039.stdout:May 09 06:05:35 smithi039 podman[95076]: 2024-05-09 06:05:35.112321082 +0000 UTC m=+0.114375048 container create 6afce1497301835f13c027fc3a3487a9c39000c51adef44a6b4fb1945a7ac83b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-6-deactivate, org.label-schema.build-date=20240507, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-09T06:05:35.352 INFO:journalctl@ceph.osd.6.smithi039.stdout:May 09 06:05:35 smithi039 podman[95076]: 2024-05-09 06:05:35.016802787 +0000 UTC m=+0.018856755 image pull db794d706f492c144ccc8f2c5bbc1870e116f5c4f3309dfab4416b39d099f8d7 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584 2024-05-09T06:05:35.352 INFO:journalctl@ceph.osd.6.smithi039.stdout:May 09 06:05:35 smithi039 podman[95076]: 2024-05-09 06:05:35.348236665 +0000 UTC m=+0.350290641 container init 6afce1497301835f13c027fc3a3487a9c39000c51adef44a6b4fb1945a7ac83b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-6-deactivate, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-05-09T06:05:35.352 INFO:journalctl@ceph.osd.6.smithi039.stdout:May 09 06:05:35 smithi039 podman[95076]: 2024-05-09 06:05:35.351705326 +0000 UTC m=+0.353759299 container start 6afce1497301835f13c027fc3a3487a9c39000c51adef44a6b4fb1945a7ac83b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-6-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-05-09T06:05:35.532 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 09 06:05:35 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-7[52683]: 2024-05-09T06:05:35.054+0000 7f467195a700 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:51.932284+0000 front 2024-05-09T06:04:51.932310+0000 (oldest deadline 2024-05-09T06:05:17.232472+0000) 2024-05-09T06:05:35.532 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 09 06:05:35 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-7[52683]: 2024-05-09T06:05:35.054+0000 7f467195a700 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:05:01.334043+0000 front 2024-05-09T06:05:01.333967+0000 (oldest deadline 2024-05-09T06:05:27.234063+0000) 2024-05-09T06:05:35.532 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 09 06:05:35 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-7[52683]: 2024-05-09T06:05:35.054+0000 7f467195a700 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-05-09T06:05:07.234931+0000 front 2024-05-09T06:05:07.234775+0000 (oldest deadline 2024-05-09T06:05:31.934658+0000) 2024-05-09T06:05:35.607 INFO:journalctl@ceph.osd.6.smithi039.stdout:May 09 06:05:35 smithi039 podman[95076]: 2024-05-09 06:05:35.456792528 +0000 UTC m=+0.458846511 container attach 6afce1497301835f13c027fc3a3487a9c39000c51adef44a6b4fb1945a7ac83b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-6-deactivate, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=) 2024-05-09T06:05:35.788 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:35 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:35.546+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:44.474482+0000 front 2024-05-09T06:04:44.474540+0000 (oldest deadline 2024-05-09T06:05:10.875240+0000) 2024-05-09T06:05:35.788 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:35 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:35.546+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:50.875869+0000 front 2024-05-09T06:04:50.875902+0000 (oldest deadline 2024-05-09T06:05:14.376145+0000) 2024-05-09T06:05:35.788 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:35 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:35.546+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:05:01.278886+0000 front 2024-05-09T06:05:01.278763+0000 (oldest deadline 2024-05-09T06:05:22.279679+0000) 2024-05-09T06:05:35.788 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:35 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:35.546+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-05-09T06:05:08.180994+0000 front 2024-05-09T06:05:08.181056+0000 (oldest deadline 2024-05-09T06:05:31.081042+0000) 2024-05-09T06:05:35.944 INFO:journalctl@ceph.osd.6.smithi039.stdout:May 09 06:05:35 smithi039 podman[95076]: 2024-05-09 06:05:35.671628194 +0000 UTC m=+0.673682164 container died 6afce1497301835f13c027fc3a3487a9c39000c51adef44a6b4fb1945a7ac83b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-6-deactivate, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-05-09T06:05:35.944 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:35 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:35.621+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:43.538761+0000 front 2024-05-09T06:04:43.538885+0000 (oldest deadline 2024-05-09T06:05:08.239002+0000) 2024-05-09T06:05:35.945 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:35 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:35.621+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:48.239500+0000 front 2024-05-09T06:04:48.239770+0000 (oldest deadline 2024-05-09T06:05:15.840152+0000) 2024-05-09T06:05:35.945 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:35 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:35.621+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:05:01.041844+0000 front 2024-05-09T06:05:01.042028+0000 (oldest deadline 2024-05-09T06:05:26.941838+0000) 2024-05-09T06:05:35.945 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:35 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:35.621+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-05-09T06:05:06.942441+0000 front 2024-05-09T06:05:06.942467+0000 (oldest deadline 2024-05-09T06:05:34.543233+0000) 2024-05-09T06:05:36.145 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 06:05:35 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-8[53004]: 2024-05-09T06:05:35.868+0000 7f47f389b700 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:52.888379+0000 front 2024-05-09T06:04:52.888427+0000 (oldest deadline 2024-05-09T06:05:15.788423+0000) 2024-05-09T06:05:36.145 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 06:05:35 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-8[53004]: 2024-05-09T06:05:35.868+0000 7f47f389b700 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:04:59.889459+0000 front 2024-05-09T06:04:59.889691+0000 (oldest deadline 2024-05-09T06:05:22.789604+0000) 2024-05-09T06:05:36.145 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 06:05:35 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-8[53004]: 2024-05-09T06:05:35.868+0000 7f47f389b700 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-05-09T06:05:08.690621+0000 front 2024-05-09T06:05:08.690467+0000 (oldest deadline 2024-05-09T06:05:32.190537+0000) 2024-05-09T06:05:36.224 DEBUG:teuthology.orchestra.run.smithi039:> sudo pkill -f 'journalctl -f -n 0 -u ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@osd.6.service' 2024-05-09T06:05:36.267 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T06:05:36.267 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-05-09T06:05:36.267 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-05-09T06:05:36.267 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@osd.7 2024-05-09T06:05:36.314 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 09 06:05:36 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-7[52683]: 2024-05-09T06:05:36.073+0000 7f467195a700 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:51.932284+0000 front 2024-05-09T06:04:51.932310+0000 (oldest deadline 2024-05-09T06:05:17.232472+0000) 2024-05-09T06:05:36.314 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 09 06:05:36 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-7[52683]: 2024-05-09T06:05:36.073+0000 7f467195a700 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:05:01.334043+0000 front 2024-05-09T06:05:01.333967+0000 (oldest deadline 2024-05-09T06:05:27.234063+0000) 2024-05-09T06:05:36.314 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 09 06:05:36 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-7[52683]: 2024-05-09T06:05:36.073+0000 7f467195a700 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-05-09T06:05:07.234931+0000 front 2024-05-09T06:05:07.234775+0000 (oldest deadline 2024-05-09T06:05:31.934658+0000) 2024-05-09T06:05:36.415 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:36 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:36.159+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:40.939354+0000 front 2024-05-09T06:04:40.939391+0000 (oldest deadline 2024-05-09T06:05:06.239561+0000) 2024-05-09T06:05:36.416 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:36 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:36.159+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:49.140745+0000 front 2024-05-09T06:04:49.140702+0000 (oldest deadline 2024-05-09T06:05:15.040838+0000) 2024-05-09T06:05:36.416 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:36 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:36.159+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:04:58.542017+0000 front 2024-05-09T06:04:58.542182+0000 (oldest deadline 2024-05-09T06:05:22.042178+0000) 2024-05-09T06:05:36.568 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 09 06:05:36 smithi060 systemd[1]: Stopping Ceph osd.7 for 86d4cc60-0dc4-11ef-bc97-c7b262605968... 2024-05-09T06:05:36.569 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:36 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:36.559+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:44.474482+0000 front 2024-05-09T06:04:44.474540+0000 (oldest deadline 2024-05-09T06:05:10.875240+0000) 2024-05-09T06:05:36.569 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:36 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:36.559+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:50.875869+0000 front 2024-05-09T06:04:50.875902+0000 (oldest deadline 2024-05-09T06:05:14.376145+0000) 2024-05-09T06:05:36.569 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:36 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:36.559+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:05:01.278886+0000 front 2024-05-09T06:05:01.278763+0000 (oldest deadline 2024-05-09T06:05:22.279679+0000) 2024-05-09T06:05:36.569 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:36 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:36.559+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-05-09T06:05:08.180994+0000 front 2024-05-09T06:05:08.181056+0000 (oldest deadline 2024-05-09T06:05:31.081042+0000) 2024-05-09T06:05:37.038 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 09 06:05:36 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-7[52683]: 2024-05-09T06:05:36.582+0000 7f46793ac700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T06:05:37.038 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 09 06:05:36 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-7[52683]: 2024-05-09T06:05:36.582+0000 7f46793ac700 -1 osd.7 86 *** Got signal Terminated *** 2024-05-09T06:05:37.038 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 09 06:05:36 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-7[52683]: 2024-05-09T06:05:36.582+0000 7f46793ac700 -1 osd.7 86 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-09T06:05:37.102 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:36 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:36.667+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:43.538761+0000 front 2024-05-09T06:04:43.538885+0000 (oldest deadline 2024-05-09T06:05:08.239002+0000) 2024-05-09T06:05:37.102 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:36 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:36.667+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:48.239500+0000 front 2024-05-09T06:04:48.239770+0000 (oldest deadline 2024-05-09T06:05:15.840152+0000) 2024-05-09T06:05:37.102 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:36 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:36.667+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:05:01.041844+0000 front 2024-05-09T06:05:01.042028+0000 (oldest deadline 2024-05-09T06:05:26.941838+0000) 2024-05-09T06:05:37.103 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:36 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:36.667+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-05-09T06:05:06.942441+0000 front 2024-05-09T06:05:06.942467+0000 (oldest deadline 2024-05-09T06:05:34.543233+0000) 2024-05-09T06:05:37.165 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 06:05:36 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-8[53004]: 2024-05-09T06:05:36.880+0000 7f47f389b700 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:52.888379+0000 front 2024-05-09T06:04:52.888427+0000 (oldest deadline 2024-05-09T06:05:15.788423+0000) 2024-05-09T06:05:37.166 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 06:05:36 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-8[53004]: 2024-05-09T06:05:36.880+0000 7f47f389b700 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:04:59.889459+0000 front 2024-05-09T06:04:59.889691+0000 (oldest deadline 2024-05-09T06:05:22.789604+0000) 2024-05-09T06:05:37.166 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 06:05:36 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-8[53004]: 2024-05-09T06:05:36.880+0000 7f47f389b700 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-05-09T06:05:08.690621+0000 front 2024-05-09T06:05:08.690467+0000 (oldest deadline 2024-05-09T06:05:32.190537+0000) 2024-05-09T06:05:37.538 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 09 06:05:37 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-7[52683]: 2024-05-09T06:05:37.118+0000 7f467195a700 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:51.932284+0000 front 2024-05-09T06:04:51.932310+0000 (oldest deadline 2024-05-09T06:05:17.232472+0000) 2024-05-09T06:05:37.538 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 09 06:05:37 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-7[52683]: 2024-05-09T06:05:37.118+0000 7f467195a700 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:05:01.334043+0000 front 2024-05-09T06:05:01.333967+0000 (oldest deadline 2024-05-09T06:05:27.234063+0000) 2024-05-09T06:05:37.538 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 09 06:05:37 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-7[52683]: 2024-05-09T06:05:37.118+0000 7f467195a700 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-05-09T06:05:07.234931+0000 front 2024-05-09T06:05:07.234775+0000 (oldest deadline 2024-05-09T06:05:31.934658+0000) 2024-05-09T06:05:37.665 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:37 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:37.187+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:40.939354+0000 front 2024-05-09T06:04:40.939391+0000 (oldest deadline 2024-05-09T06:05:06.239561+0000) 2024-05-09T06:05:37.666 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:37 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:37.187+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:49.140745+0000 front 2024-05-09T06:04:49.140702+0000 (oldest deadline 2024-05-09T06:05:15.040838+0000) 2024-05-09T06:05:37.666 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:37 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:37.187+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:04:58.542017+0000 front 2024-05-09T06:04:58.542182+0000 (oldest deadline 2024-05-09T06:05:22.042178+0000) 2024-05-09T06:05:38.038 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:37 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:37.590+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:44.474482+0000 front 2024-05-09T06:04:44.474540+0000 (oldest deadline 2024-05-09T06:05:10.875240+0000) 2024-05-09T06:05:38.038 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:37 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:37.590+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:50.875869+0000 front 2024-05-09T06:04:50.875902+0000 (oldest deadline 2024-05-09T06:05:14.376145+0000) 2024-05-09T06:05:38.038 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:37 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:37.590+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:05:01.278886+0000 front 2024-05-09T06:05:01.278763+0000 (oldest deadline 2024-05-09T06:05:22.279679+0000) 2024-05-09T06:05:38.039 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:37 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:37.590+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-05-09T06:05:08.180994+0000 front 2024-05-09T06:05:08.181056+0000 (oldest deadline 2024-05-09T06:05:31.081042+0000) 2024-05-09T06:05:38.102 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:37 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:37.701+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:43.538761+0000 front 2024-05-09T06:04:43.538885+0000 (oldest deadline 2024-05-09T06:05:08.239002+0000) 2024-05-09T06:05:38.102 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:37 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:37.701+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:48.239500+0000 front 2024-05-09T06:04:48.239770+0000 (oldest deadline 2024-05-09T06:05:15.840152+0000) 2024-05-09T06:05:38.102 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:37 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:37.701+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:05:01.041844+0000 front 2024-05-09T06:05:01.042028+0000 (oldest deadline 2024-05-09T06:05:26.941838+0000) 2024-05-09T06:05:38.102 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:37 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:37.701+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-05-09T06:05:06.942441+0000 front 2024-05-09T06:05:06.942467+0000 (oldest deadline 2024-05-09T06:05:34.543233+0000) 2024-05-09T06:05:38.165 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 06:05:37 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-8[53004]: 2024-05-09T06:05:37.885+0000 7f47f389b700 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:52.888379+0000 front 2024-05-09T06:04:52.888427+0000 (oldest deadline 2024-05-09T06:05:15.788423+0000) 2024-05-09T06:05:38.165 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 06:05:37 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-8[53004]: 2024-05-09T06:05:37.885+0000 7f47f389b700 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:04:59.889459+0000 front 2024-05-09T06:04:59.889691+0000 (oldest deadline 2024-05-09T06:05:22.789604+0000) 2024-05-09T06:05:38.165 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 06:05:37 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-8[53004]: 2024-05-09T06:05:37.885+0000 7f47f389b700 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-05-09T06:05:08.690621+0000 front 2024-05-09T06:05:08.690467+0000 (oldest deadline 2024-05-09T06:05:32.190537+0000) 2024-05-09T06:05:38.538 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 09 06:05:38 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-7[52683]: 2024-05-09T06:05:38.150+0000 7f467195a700 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:51.932284+0000 front 2024-05-09T06:04:51.932310+0000 (oldest deadline 2024-05-09T06:05:17.232472+0000) 2024-05-09T06:05:38.538 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 09 06:05:38 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-7[52683]: 2024-05-09T06:05:38.150+0000 7f467195a700 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:05:01.334043+0000 front 2024-05-09T06:05:01.333967+0000 (oldest deadline 2024-05-09T06:05:27.234063+0000) 2024-05-09T06:05:38.539 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 09 06:05:38 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-7[52683]: 2024-05-09T06:05:38.150+0000 7f467195a700 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-05-09T06:05:07.234931+0000 front 2024-05-09T06:05:07.234775+0000 (oldest deadline 2024-05-09T06:05:31.934658+0000) 2024-05-09T06:05:38.665 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:38 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:38.180+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:40.939354+0000 front 2024-05-09T06:04:40.939391+0000 (oldest deadline 2024-05-09T06:05:06.239561+0000) 2024-05-09T06:05:38.665 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:38 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:38.181+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:49.140745+0000 front 2024-05-09T06:04:49.140702+0000 (oldest deadline 2024-05-09T06:05:15.040838+0000) 2024-05-09T06:05:38.665 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:38 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:38.181+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:04:58.542017+0000 front 2024-05-09T06:04:58.542182+0000 (oldest deadline 2024-05-09T06:05:22.042178+0000) 2024-05-09T06:05:39.038 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:38 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:38.563+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:44.474482+0000 front 2024-05-09T06:04:44.474540+0000 (oldest deadline 2024-05-09T06:05:10.875240+0000) 2024-05-09T06:05:39.038 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:38 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:38.563+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:50.875869+0000 front 2024-05-09T06:04:50.875902+0000 (oldest deadline 2024-05-09T06:05:14.376145+0000) 2024-05-09T06:05:39.038 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:38 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:38.563+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:05:01.278886+0000 front 2024-05-09T06:05:01.278763+0000 (oldest deadline 2024-05-09T06:05:22.279679+0000) 2024-05-09T06:05:39.038 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:38 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:38.563+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-05-09T06:05:08.180994+0000 front 2024-05-09T06:05:08.181056+0000 (oldest deadline 2024-05-09T06:05:31.081042+0000) 2024-05-09T06:05:39.102 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:38 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:38.663+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:43.538761+0000 front 2024-05-09T06:04:43.538885+0000 (oldest deadline 2024-05-09T06:05:08.239002+0000) 2024-05-09T06:05:39.102 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:38 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:38.663+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:48.239500+0000 front 2024-05-09T06:04:48.239770+0000 (oldest deadline 2024-05-09T06:05:15.840152+0000) 2024-05-09T06:05:39.103 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:38 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:38.663+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:05:01.041844+0000 front 2024-05-09T06:05:01.042028+0000 (oldest deadline 2024-05-09T06:05:26.941838+0000) 2024-05-09T06:05:39.103 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:38 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:38.663+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-05-09T06:05:06.942441+0000 front 2024-05-09T06:05:06.942467+0000 (oldest deadline 2024-05-09T06:05:34.543233+0000) 2024-05-09T06:05:39.165 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 06:05:38 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-8[53004]: 2024-05-09T06:05:38.872+0000 7f47f389b700 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:52.888379+0000 front 2024-05-09T06:04:52.888427+0000 (oldest deadline 2024-05-09T06:05:15.788423+0000) 2024-05-09T06:05:39.165 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 06:05:38 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-8[53004]: 2024-05-09T06:05:38.872+0000 7f47f389b700 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:04:59.889459+0000 front 2024-05-09T06:04:59.889691+0000 (oldest deadline 2024-05-09T06:05:22.789604+0000) 2024-05-09T06:05:39.165 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 06:05:38 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-8[53004]: 2024-05-09T06:05:38.872+0000 7f47f389b700 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-05-09T06:05:08.690621+0000 front 2024-05-09T06:05:08.690467+0000 (oldest deadline 2024-05-09T06:05:32.190537+0000) 2024-05-09T06:05:39.538 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 09 06:05:39 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-7[52683]: 2024-05-09T06:05:39.143+0000 7f467195a700 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:51.932284+0000 front 2024-05-09T06:04:51.932310+0000 (oldest deadline 2024-05-09T06:05:17.232472+0000) 2024-05-09T06:05:39.538 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 09 06:05:39 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-7[52683]: 2024-05-09T06:05:39.143+0000 7f467195a700 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:05:01.334043+0000 front 2024-05-09T06:05:01.333967+0000 (oldest deadline 2024-05-09T06:05:27.234063+0000) 2024-05-09T06:05:39.538 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 09 06:05:39 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-7[52683]: 2024-05-09T06:05:39.143+0000 7f467195a700 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-05-09T06:05:07.234931+0000 front 2024-05-09T06:05:07.234775+0000 (oldest deadline 2024-05-09T06:05:31.934658+0000) 2024-05-09T06:05:39.665 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:39 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:39.217+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:40.939354+0000 front 2024-05-09T06:04:40.939391+0000 (oldest deadline 2024-05-09T06:05:06.239561+0000) 2024-05-09T06:05:39.666 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:39 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:39.217+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:49.140745+0000 front 2024-05-09T06:04:49.140702+0000 (oldest deadline 2024-05-09T06:05:15.040838+0000) 2024-05-09T06:05:39.666 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:39 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:39.217+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:04:58.542017+0000 front 2024-05-09T06:04:58.542182+0000 (oldest deadline 2024-05-09T06:05:22.042178+0000) 2024-05-09T06:05:39.666 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:39 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:39.217+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-09T06:05:13.045066+0000 front 2024-05-09T06:05:13.045200+0000 (oldest deadline 2024-05-09T06:05:38.345172+0000) 2024-05-09T06:05:40.038 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:39 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:39.604+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:44.474482+0000 front 2024-05-09T06:04:44.474540+0000 (oldest deadline 2024-05-09T06:05:10.875240+0000) 2024-05-09T06:05:40.039 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:39 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:39.604+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:50.875869+0000 front 2024-05-09T06:04:50.875902+0000 (oldest deadline 2024-05-09T06:05:14.376145+0000) 2024-05-09T06:05:40.039 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:39 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:39.604+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:05:01.278886+0000 front 2024-05-09T06:05:01.278763+0000 (oldest deadline 2024-05-09T06:05:22.279679+0000) 2024-05-09T06:05:40.039 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:39 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:39.604+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-05-09T06:05:08.180994+0000 front 2024-05-09T06:05:08.181056+0000 (oldest deadline 2024-05-09T06:05:31.081042+0000) 2024-05-09T06:05:40.102 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:39 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:39.667+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:43.538761+0000 front 2024-05-09T06:04:43.538885+0000 (oldest deadline 2024-05-09T06:05:08.239002+0000) 2024-05-09T06:05:40.102 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:39 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:39.667+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:48.239500+0000 front 2024-05-09T06:04:48.239770+0000 (oldest deadline 2024-05-09T06:05:15.840152+0000) 2024-05-09T06:05:40.102 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:39 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:39.667+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:05:01.041844+0000 front 2024-05-09T06:05:01.042028+0000 (oldest deadline 2024-05-09T06:05:26.941838+0000) 2024-05-09T06:05:40.102 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:39 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:39.667+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-05-09T06:05:06.942441+0000 front 2024-05-09T06:05:06.942467+0000 (oldest deadline 2024-05-09T06:05:34.543233+0000) 2024-05-09T06:05:40.165 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 06:05:39 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-8[53004]: 2024-05-09T06:05:39.881+0000 7f47f389b700 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:52.888379+0000 front 2024-05-09T06:04:52.888427+0000 (oldest deadline 2024-05-09T06:05:15.788423+0000) 2024-05-09T06:05:40.166 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 06:05:39 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-8[53004]: 2024-05-09T06:05:39.881+0000 7f47f389b700 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:04:59.889459+0000 front 2024-05-09T06:04:59.889691+0000 (oldest deadline 2024-05-09T06:05:22.789604+0000) 2024-05-09T06:05:40.166 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 06:05:39 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-8[53004]: 2024-05-09T06:05:39.881+0000 7f47f389b700 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-05-09T06:05:08.690621+0000 front 2024-05-09T06:05:08.690467+0000 (oldest deadline 2024-05-09T06:05:32.190537+0000) 2024-05-09T06:05:40.166 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 06:05:39 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-8[53004]: 2024-05-09T06:05:39.881+0000 7f47f389b700 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-09T06:05:17.392479+0000 front 2024-05-09T06:05:17.392391+0000 (oldest deadline 2024-05-09T06:05:39.692266+0000) 2024-05-09T06:05:40.538 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 09 06:05:40 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-7[52683]: 2024-05-09T06:05:40.140+0000 7f467195a700 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:51.932284+0000 front 2024-05-09T06:04:51.932310+0000 (oldest deadline 2024-05-09T06:05:17.232472+0000) 2024-05-09T06:05:40.538 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 09 06:05:40 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-7[52683]: 2024-05-09T06:05:40.140+0000 7f467195a700 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:05:01.334043+0000 front 2024-05-09T06:05:01.333967+0000 (oldest deadline 2024-05-09T06:05:27.234063+0000) 2024-05-09T06:05:40.539 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 09 06:05:40 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-7[52683]: 2024-05-09T06:05:40.140+0000 7f467195a700 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-05-09T06:05:07.234931+0000 front 2024-05-09T06:05:07.234775+0000 (oldest deadline 2024-05-09T06:05:31.934658+0000) 2024-05-09T06:05:40.539 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 09 06:05:40 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-7[52683]: 2024-05-09T06:05:40.140+0000 7f467195a700 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-09T06:05:13.636086+0000 front 2024-05-09T06:05:13.635725+0000 (oldest deadline 2024-05-09T06:05:39.535861+0000) 2024-05-09T06:05:40.666 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:40 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:40.206+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:40.939354+0000 front 2024-05-09T06:04:40.939391+0000 (oldest deadline 2024-05-09T06:05:06.239561+0000) 2024-05-09T06:05:40.666 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:40 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:40.206+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:49.140745+0000 front 2024-05-09T06:04:49.140702+0000 (oldest deadline 2024-05-09T06:05:15.040838+0000) 2024-05-09T06:05:40.666 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:40 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:40.206+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:04:58.542017+0000 front 2024-05-09T06:04:58.542182+0000 (oldest deadline 2024-05-09T06:05:22.042178+0000) 2024-05-09T06:05:40.666 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:40 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:40.206+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-09T06:05:13.045066+0000 front 2024-05-09T06:05:13.045200+0000 (oldest deadline 2024-05-09T06:05:38.345172+0000) 2024-05-09T06:05:41.038 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:40 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:40.582+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:44.474482+0000 front 2024-05-09T06:04:44.474540+0000 (oldest deadline 2024-05-09T06:05:10.875240+0000) 2024-05-09T06:05:41.038 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:40 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:40.582+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:50.875869+0000 front 2024-05-09T06:04:50.875902+0000 (oldest deadline 2024-05-09T06:05:14.376145+0000) 2024-05-09T06:05:41.038 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:40 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:40.582+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:05:01.278886+0000 front 2024-05-09T06:05:01.278763+0000 (oldest deadline 2024-05-09T06:05:22.279679+0000) 2024-05-09T06:05:41.039 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:40 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:40.582+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-05-09T06:05:08.180994+0000 front 2024-05-09T06:05:08.181056+0000 (oldest deadline 2024-05-09T06:05:31.081042+0000) 2024-05-09T06:05:41.102 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:40 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:40.704+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:43.538761+0000 front 2024-05-09T06:04:43.538885+0000 (oldest deadline 2024-05-09T06:05:08.239002+0000) 2024-05-09T06:05:41.102 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:40 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:40.704+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:48.239500+0000 front 2024-05-09T06:04:48.239770+0000 (oldest deadline 2024-05-09T06:05:15.840152+0000) 2024-05-09T06:05:41.102 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:40 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:40.704+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:05:01.041844+0000 front 2024-05-09T06:05:01.042028+0000 (oldest deadline 2024-05-09T06:05:26.941838+0000) 2024-05-09T06:05:41.102 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:40 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:40.704+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-05-09T06:05:06.942441+0000 front 2024-05-09T06:05:06.942467+0000 (oldest deadline 2024-05-09T06:05:34.543233+0000) 2024-05-09T06:05:41.102 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:40 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:40.704+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-09T06:05:16.844298+0000 front 2024-05-09T06:05:16.844561+0000 (oldest deadline 2024-05-09T06:05:39.744266+0000) 2024-05-09T06:05:41.166 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 06:05:40 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-8[53004]: 2024-05-09T06:05:40.923+0000 7f47f389b700 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:52.888379+0000 front 2024-05-09T06:04:52.888427+0000 (oldest deadline 2024-05-09T06:05:15.788423+0000) 2024-05-09T06:05:41.166 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 06:05:40 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-8[53004]: 2024-05-09T06:05:40.923+0000 7f47f389b700 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:04:59.889459+0000 front 2024-05-09T06:04:59.889691+0000 (oldest deadline 2024-05-09T06:05:22.789604+0000) 2024-05-09T06:05:41.166 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 06:05:40 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-8[53004]: 2024-05-09T06:05:40.923+0000 7f47f389b700 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-05-09T06:05:08.690621+0000 front 2024-05-09T06:05:08.690467+0000 (oldest deadline 2024-05-09T06:05:32.190537+0000) 2024-05-09T06:05:41.166 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 06:05:40 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-8[53004]: 2024-05-09T06:05:40.923+0000 7f47f389b700 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-09T06:05:17.392479+0000 front 2024-05-09T06:05:17.392391+0000 (oldest deadline 2024-05-09T06:05:39.692266+0000) 2024-05-09T06:05:41.523 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 09 06:05:41 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-7[52683]: 2024-05-09T06:05:41.148+0000 7f467195a700 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:51.932284+0000 front 2024-05-09T06:04:51.932310+0000 (oldest deadline 2024-05-09T06:05:17.232472+0000) 2024-05-09T06:05:41.523 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 09 06:05:41 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-7[52683]: 2024-05-09T06:05:41.148+0000 7f467195a700 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:05:01.334043+0000 front 2024-05-09T06:05:01.333967+0000 (oldest deadline 2024-05-09T06:05:27.234063+0000) 2024-05-09T06:05:41.523 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 09 06:05:41 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-7[52683]: 2024-05-09T06:05:41.148+0000 7f467195a700 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-05-09T06:05:07.234931+0000 front 2024-05-09T06:05:07.234775+0000 (oldest deadline 2024-05-09T06:05:31.934658+0000) 2024-05-09T06:05:41.523 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 09 06:05:41 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-7[52683]: 2024-05-09T06:05:41.148+0000 7f467195a700 -1 osd.7 86 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-09T06:05:13.636086+0000 front 2024-05-09T06:05:13.635725+0000 (oldest deadline 2024-05-09T06:05:39.535861+0000) 2024-05-09T06:05:41.666 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:41 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:41.244+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:40.939354+0000 front 2024-05-09T06:04:40.939391+0000 (oldest deadline 2024-05-09T06:05:06.239561+0000) 2024-05-09T06:05:41.666 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:41 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:41.244+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:49.140745+0000 front 2024-05-09T06:04:49.140702+0000 (oldest deadline 2024-05-09T06:05:15.040838+0000) 2024-05-09T06:05:41.666 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:41 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:41.244+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:04:58.542017+0000 front 2024-05-09T06:04:58.542182+0000 (oldest deadline 2024-05-09T06:05:22.042178+0000) 2024-05-09T06:05:41.666 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:41 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:41.244+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-09T06:05:13.045066+0000 front 2024-05-09T06:05:13.045200+0000 (oldest deadline 2024-05-09T06:05:38.345172+0000) 2024-05-09T06:05:41.790 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:41 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:41.537+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:44.474482+0000 front 2024-05-09T06:04:44.474540+0000 (oldest deadline 2024-05-09T06:05:10.875240+0000) 2024-05-09T06:05:41.790 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:41 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:41.537+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:50.875869+0000 front 2024-05-09T06:04:50.875902+0000 (oldest deadline 2024-05-09T06:05:14.376145+0000) 2024-05-09T06:05:41.790 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:41 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:41.537+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:05:01.278886+0000 front 2024-05-09T06:05:01.278763+0000 (oldest deadline 2024-05-09T06:05:22.279679+0000) 2024-05-09T06:05:41.791 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:41 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:41.537+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-05-09T06:05:08.180994+0000 front 2024-05-09T06:05:08.181056+0000 (oldest deadline 2024-05-09T06:05:31.081042+0000) 2024-05-09T06:05:42.102 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:41 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:41.654+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:43.538761+0000 front 2024-05-09T06:04:43.538885+0000 (oldest deadline 2024-05-09T06:05:08.239002+0000) 2024-05-09T06:05:42.102 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:41 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:41.654+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:48.239500+0000 front 2024-05-09T06:04:48.239770+0000 (oldest deadline 2024-05-09T06:05:15.840152+0000) 2024-05-09T06:05:42.102 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:41 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:41.654+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:05:01.041844+0000 front 2024-05-09T06:05:01.042028+0000 (oldest deadline 2024-05-09T06:05:26.941838+0000) 2024-05-09T06:05:42.102 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:41 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:41.654+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-05-09T06:05:06.942441+0000 front 2024-05-09T06:05:06.942467+0000 (oldest deadline 2024-05-09T06:05:34.543233+0000) 2024-05-09T06:05:42.102 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:41 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:41.654+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-09T06:05:16.844298+0000 front 2024-05-09T06:05:16.844561+0000 (oldest deadline 2024-05-09T06:05:39.744266+0000) 2024-05-09T06:05:42.195 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 06:05:41 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-8[53004]: 2024-05-09T06:05:41.934+0000 7f47f389b700 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:52.888379+0000 front 2024-05-09T06:04:52.888427+0000 (oldest deadline 2024-05-09T06:05:15.788423+0000) 2024-05-09T06:05:42.196 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 06:05:41 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-8[53004]: 2024-05-09T06:05:41.934+0000 7f47f389b700 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:04:59.889459+0000 front 2024-05-09T06:04:59.889691+0000 (oldest deadline 2024-05-09T06:05:22.789604+0000) 2024-05-09T06:05:42.196 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 06:05:41 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-8[53004]: 2024-05-09T06:05:41.934+0000 7f47f389b700 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-05-09T06:05:08.690621+0000 front 2024-05-09T06:05:08.690467+0000 (oldest deadline 2024-05-09T06:05:32.190537+0000) 2024-05-09T06:05:42.196 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 06:05:41 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-8[53004]: 2024-05-09T06:05:41.934+0000 7f47f389b700 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-09T06:05:17.392479+0000 front 2024-05-09T06:05:17.392391+0000 (oldest deadline 2024-05-09T06:05:39.692266+0000) 2024-05-09T06:05:42.288 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 09 06:05:41 smithi060 podman[77051]: 2024-05-09 06:05:41.988328401 +0000 UTC m=+5.508000436 container died 9d661cacb1b1e9a7e9cc116132120f132456e1fa048b7b0144a80d4061e4559a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-7, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-05-09T06:05:42.585 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 09 06:05:42 smithi060 podman[77051]: 2024-05-09 06:05:42.407963174 +0000 UTC m=+5.927635206 container cleanup 9d661cacb1b1e9a7e9cc116132120f132456e1fa048b7b0144a80d4061e4559a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-7, org.label-schema.build-date=20240507, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5) 2024-05-09T06:05:42.586 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 09 06:05:42 smithi060 bash[77051]: ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-7 2024-05-09T06:05:42.586 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:42 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:42.568+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:44.474482+0000 front 2024-05-09T06:04:44.474540+0000 (oldest deadline 2024-05-09T06:05:10.875240+0000) 2024-05-09T06:05:42.586 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:42 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:42.568+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:50.875869+0000 front 2024-05-09T06:04:50.875902+0000 (oldest deadline 2024-05-09T06:05:14.376145+0000) 2024-05-09T06:05:42.586 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:42 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:42.568+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:05:01.278886+0000 front 2024-05-09T06:05:01.278763+0000 (oldest deadline 2024-05-09T06:05:22.279679+0000) 2024-05-09T06:05:42.586 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:42 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:42.568+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-05-09T06:05:08.180994+0000 front 2024-05-09T06:05:08.181056+0000 (oldest deadline 2024-05-09T06:05:31.081042+0000) 2024-05-09T06:05:42.586 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:42 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:42.568+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-09T06:05:16.882926+0000 front 2024-05-09T06:05:16.882948+0000 (oldest deadline 2024-05-09T06:05:42.183104+0000) 2024-05-09T06:05:42.665 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:42 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:42.210+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:40.939354+0000 front 2024-05-09T06:04:40.939391+0000 (oldest deadline 2024-05-09T06:05:06.239561+0000) 2024-05-09T06:05:42.666 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:42 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:42.210+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:49.140745+0000 front 2024-05-09T06:04:49.140702+0000 (oldest deadline 2024-05-09T06:05:15.040838+0000) 2024-05-09T06:05:42.666 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:42 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:42.210+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:04:58.542017+0000 front 2024-05-09T06:04:58.542182+0000 (oldest deadline 2024-05-09T06:05:22.042178+0000) 2024-05-09T06:05:42.666 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:42 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:42.210+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-09T06:05:13.045066+0000 front 2024-05-09T06:05:13.045200+0000 (oldest deadline 2024-05-09T06:05:38.345172+0000) 2024-05-09T06:05:43.025 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 09 06:05:42 smithi060 podman[77066]: 2024-05-09 06:05:42.600788138 +0000 UTC m=+0.614894533 container remove 9d661cacb1b1e9a7e9cc116132120f132456e1fa048b7b0144a80d4061e4559a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-7, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=) 2024-05-09T06:05:43.102 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:42 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:42.672+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:43.538761+0000 front 2024-05-09T06:04:43.538885+0000 (oldest deadline 2024-05-09T06:05:08.239002+0000) 2024-05-09T06:05:43.102 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:42 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:42.672+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:48.239500+0000 front 2024-05-09T06:04:48.239770+0000 (oldest deadline 2024-05-09T06:05:15.840152+0000) 2024-05-09T06:05:43.102 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:42 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:42.672+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:05:01.041844+0000 front 2024-05-09T06:05:01.042028+0000 (oldest deadline 2024-05-09T06:05:26.941838+0000) 2024-05-09T06:05:43.102 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:42 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:42.672+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-05-09T06:05:06.942441+0000 front 2024-05-09T06:05:06.942467+0000 (oldest deadline 2024-05-09T06:05:34.543233+0000) 2024-05-09T06:05:43.102 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:42 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:42.672+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-09T06:05:16.844298+0000 front 2024-05-09T06:05:16.844561+0000 (oldest deadline 2024-05-09T06:05:39.744266+0000) 2024-05-09T06:05:43.288 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 09 06:05:43 smithi060 podman[77158]: 2024-05-09 06:05:42.94379633 +0000 UTC m=+0.018072733 image pull db794d706f492c144ccc8f2c5bbc1870e116f5c4f3309dfab4416b39d099f8d7 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584 2024-05-09T06:05:43.288 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 09 06:05:43 smithi060 podman[77158]: 2024-05-09 06:05:43.059968346 +0000 UTC m=+0.134244738 container create 53deb22b892ea7cc55ba1448769e0e8d64de5aaa2333b3a4ef875e8dab4f64ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-7-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-05-09T06:05:43.289 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 09 06:05:43 smithi060 podman[77158]: 2024-05-09 06:05:43.262418628 +0000 UTC m=+0.336695019 container init 53deb22b892ea7cc55ba1448769e0e8d64de5aaa2333b3a4ef875e8dab4f64ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-7-deactivate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507) 2024-05-09T06:05:43.289 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 09 06:05:43 smithi060 podman[77158]: 2024-05-09 06:05:43.265483962 +0000 UTC m=+0.339760354 container start 53deb22b892ea7cc55ba1448769e0e8d64de5aaa2333b3a4ef875e8dab4f64ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-7-deactivate, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-05-09T06:05:43.415 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 06:05:42 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-8[53004]: 2024-05-09T06:05:42.937+0000 7f47f389b700 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:52.888379+0000 front 2024-05-09T06:04:52.888427+0000 (oldest deadline 2024-05-09T06:05:15.788423+0000) 2024-05-09T06:05:43.416 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 06:05:42 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-8[53004]: 2024-05-09T06:05:42.937+0000 7f47f389b700 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:04:59.889459+0000 front 2024-05-09T06:04:59.889691+0000 (oldest deadline 2024-05-09T06:05:22.789604+0000) 2024-05-09T06:05:43.416 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 06:05:42 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-8[53004]: 2024-05-09T06:05:42.937+0000 7f47f389b700 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-05-09T06:05:08.690621+0000 front 2024-05-09T06:05:08.690467+0000 (oldest deadline 2024-05-09T06:05:32.190537+0000) 2024-05-09T06:05:43.416 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 06:05:42 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-8[53004]: 2024-05-09T06:05:42.937+0000 7f47f389b700 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-09T06:05:17.392479+0000 front 2024-05-09T06:05:17.392391+0000 (oldest deadline 2024-05-09T06:05:39.692266+0000) 2024-05-09T06:05:43.416 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:43 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:43.162+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:40.939354+0000 front 2024-05-09T06:04:40.939391+0000 (oldest deadline 2024-05-09T06:05:06.239561+0000) 2024-05-09T06:05:43.416 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:43 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:43.162+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:49.140745+0000 front 2024-05-09T06:04:49.140702+0000 (oldest deadline 2024-05-09T06:05:15.040838+0000) 2024-05-09T06:05:43.416 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:43 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:43.162+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:04:58.542017+0000 front 2024-05-09T06:04:58.542182+0000 (oldest deadline 2024-05-09T06:05:22.042178+0000) 2024-05-09T06:05:43.416 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:43 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:43.162+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-09T06:05:13.045066+0000 front 2024-05-09T06:05:13.045200+0000 (oldest deadline 2024-05-09T06:05:38.345172+0000) 2024-05-09T06:05:43.548 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 09 06:05:43 smithi060 podman[77158]: 2024-05-09 06:05:43.345605292 +0000 UTC m=+0.419881684 container attach 53deb22b892ea7cc55ba1448769e0e8d64de5aaa2333b3a4ef875e8dab4f64ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-7-deactivate, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-05-09T06:05:43.841 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 09 06:05:43 smithi060 podman[77158]: 2024-05-09 06:05:43.563904051 +0000 UTC m=+0.638180443 container died 53deb22b892ea7cc55ba1448769e0e8d64de5aaa2333b3a4ef875e8dab4f64ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-7-deactivate, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404) 2024-05-09T06:05:43.842 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:43 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:43.561+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:44.474482+0000 front 2024-05-09T06:04:44.474540+0000 (oldest deadline 2024-05-09T06:05:10.875240+0000) 2024-05-09T06:05:43.842 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:43 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:43.561+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:50.875869+0000 front 2024-05-09T06:04:50.875902+0000 (oldest deadline 2024-05-09T06:05:14.376145+0000) 2024-05-09T06:05:43.842 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:43 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:43.561+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:05:01.278886+0000 front 2024-05-09T06:05:01.278763+0000 (oldest deadline 2024-05-09T06:05:22.279679+0000) 2024-05-09T06:05:43.842 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:43 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:43.561+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-05-09T06:05:08.180994+0000 front 2024-05-09T06:05:08.181056+0000 (oldest deadline 2024-05-09T06:05:31.081042+0000) 2024-05-09T06:05:43.842 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:43 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:43.561+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-09T06:05:16.882926+0000 front 2024-05-09T06:05:16.882948+0000 (oldest deadline 2024-05-09T06:05:42.183104+0000) 2024-05-09T06:05:44.102 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:43 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:43.631+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:43.538761+0000 front 2024-05-09T06:04:43.538885+0000 (oldest deadline 2024-05-09T06:05:08.239002+0000) 2024-05-09T06:05:44.102 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:43 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:43.631+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:48.239500+0000 front 2024-05-09T06:04:48.239770+0000 (oldest deadline 2024-05-09T06:05:15.840152+0000) 2024-05-09T06:05:44.102 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:43 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:43.631+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:05:01.041844+0000 front 2024-05-09T06:05:01.042028+0000 (oldest deadline 2024-05-09T06:05:26.941838+0000) 2024-05-09T06:05:44.102 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:43 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:43.631+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-05-09T06:05:06.942441+0000 front 2024-05-09T06:05:06.942467+0000 (oldest deadline 2024-05-09T06:05:34.543233+0000) 2024-05-09T06:05:44.102 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:43 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:43.631+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-09T06:05:16.844298+0000 front 2024-05-09T06:05:16.844561+0000 (oldest deadline 2024-05-09T06:05:39.744266+0000) 2024-05-09T06:05:44.144 DEBUG:teuthology.orchestra.run.smithi060:> sudo pkill -f 'journalctl -f -n 0 -u ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@osd.7.service' 2024-05-09T06:05:44.186 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T06:05:44.187 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-05-09T06:05:44.187 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-05-09T06:05:44.187 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@osd.8 2024-05-09T06:05:44.213 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 06:05:43 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-8[53004]: 2024-05-09T06:05:43.950+0000 7f47f389b700 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:52.888379+0000 front 2024-05-09T06:04:52.888427+0000 (oldest deadline 2024-05-09T06:05:15.788423+0000) 2024-05-09T06:05:44.213 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 06:05:43 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-8[53004]: 2024-05-09T06:05:43.950+0000 7f47f389b700 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:04:59.889459+0000 front 2024-05-09T06:04:59.889691+0000 (oldest deadline 2024-05-09T06:05:22.789604+0000) 2024-05-09T06:05:44.214 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 06:05:43 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-8[53004]: 2024-05-09T06:05:43.950+0000 7f47f389b700 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-05-09T06:05:08.690621+0000 front 2024-05-09T06:05:08.690467+0000 (oldest deadline 2024-05-09T06:05:32.190537+0000) 2024-05-09T06:05:44.214 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 06:05:43 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-8[53004]: 2024-05-09T06:05:43.950+0000 7f47f389b700 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-09T06:05:17.392479+0000 front 2024-05-09T06:05:17.392391+0000 (oldest deadline 2024-05-09T06:05:39.692266+0000) 2024-05-09T06:05:44.214 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:44 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:44.115+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:40.939354+0000 front 2024-05-09T06:04:40.939391+0000 (oldest deadline 2024-05-09T06:05:06.239561+0000) 2024-05-09T06:05:44.214 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:44 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:44.115+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:49.140745+0000 front 2024-05-09T06:04:49.140702+0000 (oldest deadline 2024-05-09T06:05:15.040838+0000) 2024-05-09T06:05:44.214 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:44 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:44.115+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:04:58.542017+0000 front 2024-05-09T06:04:58.542182+0000 (oldest deadline 2024-05-09T06:05:22.042178+0000) 2024-05-09T06:05:44.214 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:44 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:44.115+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-09T06:05:13.045066+0000 front 2024-05-09T06:05:13.045200+0000 (oldest deadline 2024-05-09T06:05:38.345172+0000) 2024-05-09T06:05:44.482 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 06:05:44 smithi100 systemd[1]: Stopping Ceph osd.8 for 86d4cc60-0dc4-11ef-bc97-c7b262605968... 2024-05-09T06:05:44.788 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:44 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:44.574+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:44.474482+0000 front 2024-05-09T06:04:44.474540+0000 (oldest deadline 2024-05-09T06:05:10.875240+0000) 2024-05-09T06:05:44.788 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:44 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:44.574+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:50.875869+0000 front 2024-05-09T06:04:50.875902+0000 (oldest deadline 2024-05-09T06:05:14.376145+0000) 2024-05-09T06:05:44.788 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:44 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:44.574+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:05:01.278886+0000 front 2024-05-09T06:05:01.278763+0000 (oldest deadline 2024-05-09T06:05:22.279679+0000) 2024-05-09T06:05:44.788 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:44 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:44.574+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-05-09T06:05:08.180994+0000 front 2024-05-09T06:05:08.181056+0000 (oldest deadline 2024-05-09T06:05:31.081042+0000) 2024-05-09T06:05:44.788 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:44 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:44.574+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-09T06:05:16.882926+0000 front 2024-05-09T06:05:16.882948+0000 (oldest deadline 2024-05-09T06:05:42.183104+0000) 2024-05-09T06:05:44.915 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 06:05:44 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-8[53004]: 2024-05-09T06:05:44.496+0000 7f47fb2ed700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T06:05:44.915 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 06:05:44 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-8[53004]: 2024-05-09T06:05:44.496+0000 7f47fb2ed700 -1 osd.8 86 *** Got signal Terminated *** 2024-05-09T06:05:44.915 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 06:05:44 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-8[53004]: 2024-05-09T06:05:44.496+0000 7f47fb2ed700 -1 osd.8 86 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-09T06:05:45.102 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:44 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:44.633+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:43.538761+0000 front 2024-05-09T06:04:43.538885+0000 (oldest deadline 2024-05-09T06:05:08.239002+0000) 2024-05-09T06:05:45.102 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:44 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:44.633+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:48.239500+0000 front 2024-05-09T06:04:48.239770+0000 (oldest deadline 2024-05-09T06:05:15.840152+0000) 2024-05-09T06:05:45.102 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:44 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:44.633+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:05:01.041844+0000 front 2024-05-09T06:05:01.042028+0000 (oldest deadline 2024-05-09T06:05:26.941838+0000) 2024-05-09T06:05:45.102 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:44 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:44.633+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-05-09T06:05:06.942441+0000 front 2024-05-09T06:05:06.942467+0000 (oldest deadline 2024-05-09T06:05:34.543233+0000) 2024-05-09T06:05:45.102 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:44 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:44.633+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-09T06:05:16.844298+0000 front 2024-05-09T06:05:16.844561+0000 (oldest deadline 2024-05-09T06:05:39.744266+0000) 2024-05-09T06:05:45.416 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 06:05:44 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-8[53004]: 2024-05-09T06:05:44.959+0000 7f47f389b700 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:52.888379+0000 front 2024-05-09T06:04:52.888427+0000 (oldest deadline 2024-05-09T06:05:15.788423+0000) 2024-05-09T06:05:45.416 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 06:05:44 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-8[53004]: 2024-05-09T06:05:44.959+0000 7f47f389b700 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:04:59.889459+0000 front 2024-05-09T06:04:59.889691+0000 (oldest deadline 2024-05-09T06:05:22.789604+0000) 2024-05-09T06:05:45.416 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 06:05:44 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-8[53004]: 2024-05-09T06:05:44.959+0000 7f47f389b700 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-05-09T06:05:08.690621+0000 front 2024-05-09T06:05:08.690467+0000 (oldest deadline 2024-05-09T06:05:32.190537+0000) 2024-05-09T06:05:45.416 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 06:05:44 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-8[53004]: 2024-05-09T06:05:44.959+0000 7f47f389b700 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-09T06:05:17.392479+0000 front 2024-05-09T06:05:17.392391+0000 (oldest deadline 2024-05-09T06:05:39.692266+0000) 2024-05-09T06:05:45.416 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:45 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:45.100+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:40.939354+0000 front 2024-05-09T06:04:40.939391+0000 (oldest deadline 2024-05-09T06:05:06.239561+0000) 2024-05-09T06:05:45.416 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:45 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:45.100+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:49.140745+0000 front 2024-05-09T06:04:49.140702+0000 (oldest deadline 2024-05-09T06:05:15.040838+0000) 2024-05-09T06:05:45.416 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:45 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:45.100+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:04:58.542017+0000 front 2024-05-09T06:04:58.542182+0000 (oldest deadline 2024-05-09T06:05:22.042178+0000) 2024-05-09T06:05:45.416 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:45 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:45.100+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-09T06:05:13.045066+0000 front 2024-05-09T06:05:13.045200+0000 (oldest deadline 2024-05-09T06:05:38.345172+0000) 2024-05-09T06:05:45.788 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:45 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:45.594+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:44.474482+0000 front 2024-05-09T06:04:44.474540+0000 (oldest deadline 2024-05-09T06:05:10.875240+0000) 2024-05-09T06:05:45.788 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:45 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:45.594+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:50.875869+0000 front 2024-05-09T06:04:50.875902+0000 (oldest deadline 2024-05-09T06:05:14.376145+0000) 2024-05-09T06:05:45.789 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:45 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:45.594+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:05:01.278886+0000 front 2024-05-09T06:05:01.278763+0000 (oldest deadline 2024-05-09T06:05:22.279679+0000) 2024-05-09T06:05:45.789 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:45 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:45.594+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-05-09T06:05:08.180994+0000 front 2024-05-09T06:05:08.181056+0000 (oldest deadline 2024-05-09T06:05:31.081042+0000) 2024-05-09T06:05:45.789 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:45 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:45.594+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-09T06:05:16.882926+0000 front 2024-05-09T06:05:16.882948+0000 (oldest deadline 2024-05-09T06:05:42.183104+0000) 2024-05-09T06:05:46.102 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:45 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:45.650+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:43.538761+0000 front 2024-05-09T06:04:43.538885+0000 (oldest deadline 2024-05-09T06:05:08.239002+0000) 2024-05-09T06:05:46.102 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:45 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:45.650+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:48.239500+0000 front 2024-05-09T06:04:48.239770+0000 (oldest deadline 2024-05-09T06:05:15.840152+0000) 2024-05-09T06:05:46.102 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:45 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:45.650+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:05:01.041844+0000 front 2024-05-09T06:05:01.042028+0000 (oldest deadline 2024-05-09T06:05:26.941838+0000) 2024-05-09T06:05:46.102 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:45 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:45.650+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-05-09T06:05:06.942441+0000 front 2024-05-09T06:05:06.942467+0000 (oldest deadline 2024-05-09T06:05:34.543233+0000) 2024-05-09T06:05:46.102 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:45 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:45.650+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-09T06:05:16.844298+0000 front 2024-05-09T06:05:16.844561+0000 (oldest deadline 2024-05-09T06:05:39.744266+0000) 2024-05-09T06:05:46.415 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 06:05:46 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-8[53004]: 2024-05-09T06:05:46.007+0000 7f47f389b700 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:52.888379+0000 front 2024-05-09T06:04:52.888427+0000 (oldest deadline 2024-05-09T06:05:15.788423+0000) 2024-05-09T06:05:46.416 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 06:05:46 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-8[53004]: 2024-05-09T06:05:46.007+0000 7f47f389b700 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:04:59.889459+0000 front 2024-05-09T06:04:59.889691+0000 (oldest deadline 2024-05-09T06:05:22.789604+0000) 2024-05-09T06:05:46.416 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 06:05:46 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-8[53004]: 2024-05-09T06:05:46.007+0000 7f47f389b700 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-05-09T06:05:08.690621+0000 front 2024-05-09T06:05:08.690467+0000 (oldest deadline 2024-05-09T06:05:32.190537+0000) 2024-05-09T06:05:46.416 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 06:05:46 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-8[53004]: 2024-05-09T06:05:46.007+0000 7f47f389b700 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-09T06:05:17.392479+0000 front 2024-05-09T06:05:17.392391+0000 (oldest deadline 2024-05-09T06:05:39.692266+0000) 2024-05-09T06:05:46.416 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:46 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:46.051+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:40.939354+0000 front 2024-05-09T06:04:40.939391+0000 (oldest deadline 2024-05-09T06:05:06.239561+0000) 2024-05-09T06:05:46.416 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:46 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:46.051+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:49.140745+0000 front 2024-05-09T06:04:49.140702+0000 (oldest deadline 2024-05-09T06:05:15.040838+0000) 2024-05-09T06:05:46.416 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:46 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:46.051+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:04:58.542017+0000 front 2024-05-09T06:04:58.542182+0000 (oldest deadline 2024-05-09T06:05:22.042178+0000) 2024-05-09T06:05:46.416 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:46 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:46.051+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-09T06:05:13.045066+0000 front 2024-05-09T06:05:13.045200+0000 (oldest deadline 2024-05-09T06:05:38.345172+0000) 2024-05-09T06:05:47.038 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:46 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:46.603+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:44.474482+0000 front 2024-05-09T06:04:44.474540+0000 (oldest deadline 2024-05-09T06:05:10.875240+0000) 2024-05-09T06:05:47.038 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:46 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:46.603+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:50.875869+0000 front 2024-05-09T06:04:50.875902+0000 (oldest deadline 2024-05-09T06:05:14.376145+0000) 2024-05-09T06:05:47.038 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:46 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:46.603+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:05:01.278886+0000 front 2024-05-09T06:05:01.278763+0000 (oldest deadline 2024-05-09T06:05:22.279679+0000) 2024-05-09T06:05:47.039 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:46 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:46.603+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-05-09T06:05:08.180994+0000 front 2024-05-09T06:05:08.181056+0000 (oldest deadline 2024-05-09T06:05:31.081042+0000) 2024-05-09T06:05:47.039 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:46 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:46.603+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-09T06:05:16.882926+0000 front 2024-05-09T06:05:16.882948+0000 (oldest deadline 2024-05-09T06:05:42.183104+0000) 2024-05-09T06:05:47.039 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:46 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:46.603+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.100:6812 osd.5 since back 2024-05-09T06:05:22.183729+0000 front 2024-05-09T06:05:22.183822+0000 (oldest deadline 2024-05-09T06:05:46.283688+0000) 2024-05-09T06:05:47.102 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:46 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:46.674+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:43.538761+0000 front 2024-05-09T06:04:43.538885+0000 (oldest deadline 2024-05-09T06:05:08.239002+0000) 2024-05-09T06:05:47.102 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:46 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:46.674+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:48.239500+0000 front 2024-05-09T06:04:48.239770+0000 (oldest deadline 2024-05-09T06:05:15.840152+0000) 2024-05-09T06:05:47.102 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:46 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:46.674+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:05:01.041844+0000 front 2024-05-09T06:05:01.042028+0000 (oldest deadline 2024-05-09T06:05:26.941838+0000) 2024-05-09T06:05:47.103 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:46 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:46.674+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-05-09T06:05:06.942441+0000 front 2024-05-09T06:05:06.942467+0000 (oldest deadline 2024-05-09T06:05:34.543233+0000) 2024-05-09T06:05:47.103 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:46 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:46.674+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-09T06:05:16.844298+0000 front 2024-05-09T06:05:16.844561+0000 (oldest deadline 2024-05-09T06:05:39.744266+0000) 2024-05-09T06:05:47.415 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 06:05:47 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-8[53004]: 2024-05-09T06:05:47.000+0000 7f47f389b700 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:52.888379+0000 front 2024-05-09T06:04:52.888427+0000 (oldest deadline 2024-05-09T06:05:15.788423+0000) 2024-05-09T06:05:47.416 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 06:05:47 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-8[53004]: 2024-05-09T06:05:47.000+0000 7f47f389b700 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:04:59.889459+0000 front 2024-05-09T06:04:59.889691+0000 (oldest deadline 2024-05-09T06:05:22.789604+0000) 2024-05-09T06:05:47.416 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 06:05:47 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-8[53004]: 2024-05-09T06:05:47.000+0000 7f47f389b700 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-05-09T06:05:08.690621+0000 front 2024-05-09T06:05:08.690467+0000 (oldest deadline 2024-05-09T06:05:32.190537+0000) 2024-05-09T06:05:47.416 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 06:05:47 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-8[53004]: 2024-05-09T06:05:47.000+0000 7f47f389b700 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-09T06:05:17.392479+0000 front 2024-05-09T06:05:17.392391+0000 (oldest deadline 2024-05-09T06:05:39.692266+0000) 2024-05-09T06:05:47.416 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:47 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:47.071+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:40.939354+0000 front 2024-05-09T06:04:40.939391+0000 (oldest deadline 2024-05-09T06:05:06.239561+0000) 2024-05-09T06:05:47.416 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:47 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:47.071+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:49.140745+0000 front 2024-05-09T06:04:49.140702+0000 (oldest deadline 2024-05-09T06:05:15.040838+0000) 2024-05-09T06:05:47.416 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:47 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:47.071+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:04:58.542017+0000 front 2024-05-09T06:04:58.542182+0000 (oldest deadline 2024-05-09T06:05:22.042178+0000) 2024-05-09T06:05:47.416 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:47 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:47.071+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-09T06:05:13.045066+0000 front 2024-05-09T06:05:13.045200+0000 (oldest deadline 2024-05-09T06:05:38.345172+0000) 2024-05-09T06:05:47.940 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:47 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:47.577+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:44.474482+0000 front 2024-05-09T06:04:44.474540+0000 (oldest deadline 2024-05-09T06:05:10.875240+0000) 2024-05-09T06:05:47.940 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:47 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:47.577+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:50.875869+0000 front 2024-05-09T06:04:50.875902+0000 (oldest deadline 2024-05-09T06:05:14.376145+0000) 2024-05-09T06:05:47.940 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:47 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:47.577+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:05:01.278886+0000 front 2024-05-09T06:05:01.278763+0000 (oldest deadline 2024-05-09T06:05:22.279679+0000) 2024-05-09T06:05:47.940 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:47 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:47.577+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-05-09T06:05:08.180994+0000 front 2024-05-09T06:05:08.181056+0000 (oldest deadline 2024-05-09T06:05:31.081042+0000) 2024-05-09T06:05:47.940 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:47 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:47.577+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-09T06:05:16.882926+0000 front 2024-05-09T06:05:16.882948+0000 (oldest deadline 2024-05-09T06:05:42.183104+0000) 2024-05-09T06:05:47.940 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:47 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:47.577+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.100:6812 osd.5 since back 2024-05-09T06:05:22.183729+0000 front 2024-05-09T06:05:22.183822+0000 (oldest deadline 2024-05-09T06:05:46.283688+0000) 2024-05-09T06:05:48.102 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:47 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:47.668+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:43.538761+0000 front 2024-05-09T06:04:43.538885+0000 (oldest deadline 2024-05-09T06:05:08.239002+0000) 2024-05-09T06:05:48.102 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:47 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:47.668+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:48.239500+0000 front 2024-05-09T06:04:48.239770+0000 (oldest deadline 2024-05-09T06:05:15.840152+0000) 2024-05-09T06:05:48.102 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:47 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:47.668+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:05:01.041844+0000 front 2024-05-09T06:05:01.042028+0000 (oldest deadline 2024-05-09T06:05:26.941838+0000) 2024-05-09T06:05:48.102 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:47 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:47.668+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-05-09T06:05:06.942441+0000 front 2024-05-09T06:05:06.942467+0000 (oldest deadline 2024-05-09T06:05:34.543233+0000) 2024-05-09T06:05:48.102 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:47 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:47.668+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-09T06:05:16.844298+0000 front 2024-05-09T06:05:16.844561+0000 (oldest deadline 2024-05-09T06:05:39.744266+0000) 2024-05-09T06:05:48.415 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 06:05:47 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-8[53004]: 2024-05-09T06:05:47.969+0000 7f47f389b700 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:52.888379+0000 front 2024-05-09T06:04:52.888427+0000 (oldest deadline 2024-05-09T06:05:15.788423+0000) 2024-05-09T06:05:48.416 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 06:05:47 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-8[53004]: 2024-05-09T06:05:47.969+0000 7f47f389b700 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:04:59.889459+0000 front 2024-05-09T06:04:59.889691+0000 (oldest deadline 2024-05-09T06:05:22.789604+0000) 2024-05-09T06:05:48.416 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 06:05:47 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-8[53004]: 2024-05-09T06:05:47.969+0000 7f47f389b700 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-05-09T06:05:08.690621+0000 front 2024-05-09T06:05:08.690467+0000 (oldest deadline 2024-05-09T06:05:32.190537+0000) 2024-05-09T06:05:48.416 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 06:05:47 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-8[53004]: 2024-05-09T06:05:47.969+0000 7f47f389b700 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-09T06:05:17.392479+0000 front 2024-05-09T06:05:17.392391+0000 (oldest deadline 2024-05-09T06:05:39.692266+0000) 2024-05-09T06:05:48.416 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:48 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:48.098+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:40.939354+0000 front 2024-05-09T06:04:40.939391+0000 (oldest deadline 2024-05-09T06:05:06.239561+0000) 2024-05-09T06:05:48.416 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:48 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:48.098+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:49.140745+0000 front 2024-05-09T06:04:49.140702+0000 (oldest deadline 2024-05-09T06:05:15.040838+0000) 2024-05-09T06:05:48.416 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:48 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:48.098+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:04:58.542017+0000 front 2024-05-09T06:04:58.542182+0000 (oldest deadline 2024-05-09T06:05:22.042178+0000) 2024-05-09T06:05:48.416 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:48 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:48.098+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-09T06:05:13.045066+0000 front 2024-05-09T06:05:13.045200+0000 (oldest deadline 2024-05-09T06:05:38.345172+0000) 2024-05-09T06:05:49.038 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:48 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:48.554+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:44.474482+0000 front 2024-05-09T06:04:44.474540+0000 (oldest deadline 2024-05-09T06:05:10.875240+0000) 2024-05-09T06:05:49.038 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:48 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:48.554+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:50.875869+0000 front 2024-05-09T06:04:50.875902+0000 (oldest deadline 2024-05-09T06:05:14.376145+0000) 2024-05-09T06:05:49.039 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:48 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:48.554+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:05:01.278886+0000 front 2024-05-09T06:05:01.278763+0000 (oldest deadline 2024-05-09T06:05:22.279679+0000) 2024-05-09T06:05:49.039 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:48 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:48.554+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-05-09T06:05:08.180994+0000 front 2024-05-09T06:05:08.181056+0000 (oldest deadline 2024-05-09T06:05:31.081042+0000) 2024-05-09T06:05:49.039 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:48 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:48.554+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-09T06:05:16.882926+0000 front 2024-05-09T06:05:16.882948+0000 (oldest deadline 2024-05-09T06:05:42.183104+0000) 2024-05-09T06:05:49.039 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:48 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:48.554+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.100:6812 osd.5 since back 2024-05-09T06:05:22.183729+0000 front 2024-05-09T06:05:22.183822+0000 (oldest deadline 2024-05-09T06:05:46.283688+0000) 2024-05-09T06:05:49.102 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:48 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:48.716+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:43.538761+0000 front 2024-05-09T06:04:43.538885+0000 (oldest deadline 2024-05-09T06:05:08.239002+0000) 2024-05-09T06:05:49.102 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:48 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:48.716+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:48.239500+0000 front 2024-05-09T06:04:48.239770+0000 (oldest deadline 2024-05-09T06:05:15.840152+0000) 2024-05-09T06:05:49.102 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:48 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:48.716+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:05:01.041844+0000 front 2024-05-09T06:05:01.042028+0000 (oldest deadline 2024-05-09T06:05:26.941838+0000) 2024-05-09T06:05:49.102 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:48 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:48.716+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-05-09T06:05:06.942441+0000 front 2024-05-09T06:05:06.942467+0000 (oldest deadline 2024-05-09T06:05:34.543233+0000) 2024-05-09T06:05:49.102 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:48 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:48.716+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-09T06:05:16.844298+0000 front 2024-05-09T06:05:16.844561+0000 (oldest deadline 2024-05-09T06:05:39.744266+0000) 2024-05-09T06:05:49.416 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 06:05:49 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-8[53004]: 2024-05-09T06:05:49.002+0000 7f47f389b700 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:52.888379+0000 front 2024-05-09T06:04:52.888427+0000 (oldest deadline 2024-05-09T06:05:15.788423+0000) 2024-05-09T06:05:49.416 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 06:05:49 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-8[53004]: 2024-05-09T06:05:49.002+0000 7f47f389b700 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:04:59.889459+0000 front 2024-05-09T06:04:59.889691+0000 (oldest deadline 2024-05-09T06:05:22.789604+0000) 2024-05-09T06:05:49.416 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 06:05:49 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-8[53004]: 2024-05-09T06:05:49.002+0000 7f47f389b700 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-05-09T06:05:08.690621+0000 front 2024-05-09T06:05:08.690467+0000 (oldest deadline 2024-05-09T06:05:32.190537+0000) 2024-05-09T06:05:49.416 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 06:05:49 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-8[53004]: 2024-05-09T06:05:49.002+0000 7f47f389b700 -1 osd.8 86 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-09T06:05:17.392479+0000 front 2024-05-09T06:05:17.392391+0000 (oldest deadline 2024-05-09T06:05:39.692266+0000) 2024-05-09T06:05:49.416 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:49 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:49.132+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:40.939354+0000 front 2024-05-09T06:04:40.939391+0000 (oldest deadline 2024-05-09T06:05:06.239561+0000) 2024-05-09T06:05:49.416 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:49 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:49.132+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:49.140745+0000 front 2024-05-09T06:04:49.140702+0000 (oldest deadline 2024-05-09T06:05:15.040838+0000) 2024-05-09T06:05:49.416 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:49 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:49.132+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:04:58.542017+0000 front 2024-05-09T06:04:58.542182+0000 (oldest deadline 2024-05-09T06:05:22.042178+0000) 2024-05-09T06:05:49.416 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:49 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:49.132+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-09T06:05:13.045066+0000 front 2024-05-09T06:05:13.045200+0000 (oldest deadline 2024-05-09T06:05:38.345172+0000) 2024-05-09T06:05:50.038 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:49 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:49.583+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:44.474482+0000 front 2024-05-09T06:04:44.474540+0000 (oldest deadline 2024-05-09T06:05:10.875240+0000) 2024-05-09T06:05:50.039 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:49 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:49.583+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:50.875869+0000 front 2024-05-09T06:04:50.875902+0000 (oldest deadline 2024-05-09T06:05:14.376145+0000) 2024-05-09T06:05:50.039 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:49 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:49.583+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:05:01.278886+0000 front 2024-05-09T06:05:01.278763+0000 (oldest deadline 2024-05-09T06:05:22.279679+0000) 2024-05-09T06:05:50.039 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:49 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:49.583+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-05-09T06:05:08.180994+0000 front 2024-05-09T06:05:08.181056+0000 (oldest deadline 2024-05-09T06:05:31.081042+0000) 2024-05-09T06:05:50.039 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:49 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:49.583+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-09T06:05:16.882926+0000 front 2024-05-09T06:05:16.882948+0000 (oldest deadline 2024-05-09T06:05:42.183104+0000) 2024-05-09T06:05:50.039 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:49 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:49.583+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.100:6812 osd.5 since back 2024-05-09T06:05:22.183729+0000 front 2024-05-09T06:05:22.183822+0000 (oldest deadline 2024-05-09T06:05:46.283688+0000) 2024-05-09T06:05:50.102 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:49 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:49.728+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:43.538761+0000 front 2024-05-09T06:04:43.538885+0000 (oldest deadline 2024-05-09T06:05:08.239002+0000) 2024-05-09T06:05:50.102 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:49 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:49.728+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:48.239500+0000 front 2024-05-09T06:04:48.239770+0000 (oldest deadline 2024-05-09T06:05:15.840152+0000) 2024-05-09T06:05:50.102 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:49 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:49.728+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:05:01.041844+0000 front 2024-05-09T06:05:01.042028+0000 (oldest deadline 2024-05-09T06:05:26.941838+0000) 2024-05-09T06:05:50.102 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:49 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:49.728+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-05-09T06:05:06.942441+0000 front 2024-05-09T06:05:06.942467+0000 (oldest deadline 2024-05-09T06:05:34.543233+0000) 2024-05-09T06:05:50.102 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:49 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:49.728+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-09T06:05:16.844298+0000 front 2024-05-09T06:05:16.844561+0000 (oldest deadline 2024-05-09T06:05:39.744266+0000) 2024-05-09T06:05:50.306 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 06:05:50 smithi100 podman[77021]: 2024-05-09 06:05:50.026282762 +0000 UTC m=+5.630862945 container died b198cf54b5ca34f105e6f1c992a9539dab014c2c3edf72762a99e6da1345fcc3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-8, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-05-09T06:05:50.306 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:50 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:50.120+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:40.939354+0000 front 2024-05-09T06:04:40.939391+0000 (oldest deadline 2024-05-09T06:05:06.239561+0000) 2024-05-09T06:05:50.306 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:50 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:50.120+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:49.140745+0000 front 2024-05-09T06:04:49.140702+0000 (oldest deadline 2024-05-09T06:05:15.040838+0000) 2024-05-09T06:05:50.306 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:50 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:50.120+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:04:58.542017+0000 front 2024-05-09T06:04:58.542182+0000 (oldest deadline 2024-05-09T06:05:22.042178+0000) 2024-05-09T06:05:50.306 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:50 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:50.120+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-09T06:05:13.045066+0000 front 2024-05-09T06:05:13.045200+0000 (oldest deadline 2024-05-09T06:05:38.345172+0000) 2024-05-09T06:05:50.649 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 06:05:50 smithi100 podman[77021]: 2024-05-09 06:05:50.421257461 +0000 UTC m=+6.025837644 container cleanup b198cf54b5ca34f105e6f1c992a9539dab014c2c3edf72762a99e6da1345fcc3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-8, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2) 2024-05-09T06:05:50.649 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 06:05:50 smithi100 bash[77021]: ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-8 2024-05-09T06:05:50.915 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 06:05:50 smithi100 podman[77038]: 2024-05-09 06:05:50.664209186 +0000 UTC m=+0.636120193 container remove b198cf54b5ca34f105e6f1c992a9539dab014c2c3edf72762a99e6da1345fcc3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-8, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-09T06:05:51.038 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:50 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:50.609+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:44.474482+0000 front 2024-05-09T06:04:44.474540+0000 (oldest deadline 2024-05-09T06:05:10.875240+0000) 2024-05-09T06:05:51.038 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:50 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:50.609+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:50.875869+0000 front 2024-05-09T06:04:50.875902+0000 (oldest deadline 2024-05-09T06:05:14.376145+0000) 2024-05-09T06:05:51.038 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:50 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:50.609+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:05:01.278886+0000 front 2024-05-09T06:05:01.278763+0000 (oldest deadline 2024-05-09T06:05:22.279679+0000) 2024-05-09T06:05:51.039 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:50 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:50.609+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-05-09T06:05:08.180994+0000 front 2024-05-09T06:05:08.181056+0000 (oldest deadline 2024-05-09T06:05:31.081042+0000) 2024-05-09T06:05:51.039 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:50 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:50.609+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-09T06:05:16.882926+0000 front 2024-05-09T06:05:16.882948+0000 (oldest deadline 2024-05-09T06:05:42.183104+0000) 2024-05-09T06:05:51.039 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:50 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:50.609+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.100:6812 osd.5 since back 2024-05-09T06:05:22.183729+0000 front 2024-05-09T06:05:22.183822+0000 (oldest deadline 2024-05-09T06:05:46.283688+0000) 2024-05-09T06:05:51.102 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:50 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:50.710+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:43.538761+0000 front 2024-05-09T06:04:43.538885+0000 (oldest deadline 2024-05-09T06:05:08.239002+0000) 2024-05-09T06:05:51.102 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:50 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:50.710+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:48.239500+0000 front 2024-05-09T06:04:48.239770+0000 (oldest deadline 2024-05-09T06:05:15.840152+0000) 2024-05-09T06:05:51.102 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:50 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:50.710+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:05:01.041844+0000 front 2024-05-09T06:05:01.042028+0000 (oldest deadline 2024-05-09T06:05:26.941838+0000) 2024-05-09T06:05:51.102 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:50 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:50.710+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-05-09T06:05:06.942441+0000 front 2024-05-09T06:05:06.942467+0000 (oldest deadline 2024-05-09T06:05:34.543233+0000) 2024-05-09T06:05:51.102 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:50 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:50.710+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-09T06:05:16.844298+0000 front 2024-05-09T06:05:16.844561+0000 (oldest deadline 2024-05-09T06:05:39.744266+0000) 2024-05-09T06:05:51.219 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:51 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:51.166+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:40.939354+0000 front 2024-05-09T06:04:40.939391+0000 (oldest deadline 2024-05-09T06:05:06.239561+0000) 2024-05-09T06:05:51.219 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:51 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:51.166+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:49.140745+0000 front 2024-05-09T06:04:49.140702+0000 (oldest deadline 2024-05-09T06:05:15.040838+0000) 2024-05-09T06:05:51.219 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:51 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:51.166+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:04:58.542017+0000 front 2024-05-09T06:04:58.542182+0000 (oldest deadline 2024-05-09T06:05:22.042178+0000) 2024-05-09T06:05:51.219 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:51 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:51.166+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-09T06:05:13.045066+0000 front 2024-05-09T06:05:13.045200+0000 (oldest deadline 2024-05-09T06:05:38.345172+0000) 2024-05-09T06:05:51.219 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:51 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:51.166+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.100:6812 osd.5 since back 2024-05-09T06:05:20.546746+0000 front 2024-05-09T06:05:20.546809+0000 (oldest deadline 2024-05-09T06:05:51.147432+0000) 2024-05-09T06:05:51.220 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 06:05:50 smithi100 podman[77129]: 2024-05-09 06:05:50.885445204 +0000 UTC m=+0.017514327 image pull db794d706f492c144ccc8f2c5bbc1870e116f5c4f3309dfab4416b39d099f8d7 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584 2024-05-09T06:05:51.220 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 06:05:50 smithi100 podman[77129]: 2024-05-09 06:05:50.989996768 +0000 UTC m=+0.122065921 container create 2b4bc4cc9f18409db28fcbcc99ff6133a4b6c1e9d1b07911e909e9578aa78a19 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-8-deactivate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True) 2024-05-09T06:05:51.220 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 06:05:51 smithi100 podman[77129]: 2024-05-09 06:05:51.233837299 +0000 UTC m=+0.365906409 container init 2b4bc4cc9f18409db28fcbcc99ff6133a4b6c1e9d1b07911e909e9578aa78a19 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-8-deactivate, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-05-09T06:05:51.509 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 06:05:51 smithi100 podman[77129]: 2024-05-09 06:05:51.237208341 +0000 UTC m=+0.369277452 container start 2b4bc4cc9f18409db28fcbcc99ff6133a4b6c1e9d1b07911e909e9578aa78a19 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-8-deactivate, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404) 2024-05-09T06:05:51.509 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 06:05:51 smithi100 podman[77129]: 2024-05-09 06:05:51.342341856 +0000 UTC m=+0.474410967 container attach 2b4bc4cc9f18409db28fcbcc99ff6133a4b6c1e9d1b07911e909e9578aa78a19 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-8-deactivate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, ceph=True, org.label-schema.build-date=20240507, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-09T06:05:51.863 INFO:journalctl@ceph.osd.8.smithi100.stdout:May 09 06:05:51 smithi100 podman[77129]: 2024-05-09 06:05:51.524766745 +0000 UTC m=+0.656835849 container died 2b4bc4cc9f18409db28fcbcc99ff6133a4b6c1e9d1b07911e909e9578aa78a19 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-8-deactivate, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404) 2024-05-09T06:05:52.038 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:51 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:51.643+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:44.474482+0000 front 2024-05-09T06:04:44.474540+0000 (oldest deadline 2024-05-09T06:05:10.875240+0000) 2024-05-09T06:05:52.065 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:51 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:51.643+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:50.875869+0000 front 2024-05-09T06:04:50.875902+0000 (oldest deadline 2024-05-09T06:05:14.376145+0000) 2024-05-09T06:05:52.066 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:51 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:51.643+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:05:01.278886+0000 front 2024-05-09T06:05:01.278763+0000 (oldest deadline 2024-05-09T06:05:22.279679+0000) 2024-05-09T06:05:52.066 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:51 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:51.643+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-05-09T06:05:08.180994+0000 front 2024-05-09T06:05:08.181056+0000 (oldest deadline 2024-05-09T06:05:31.081042+0000) 2024-05-09T06:05:52.066 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:51 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:51.643+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-09T06:05:16.882926+0000 front 2024-05-09T06:05:16.882948+0000 (oldest deadline 2024-05-09T06:05:42.183104+0000) 2024-05-09T06:05:52.066 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:51 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:51.643+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.100:6812 osd.5 since back 2024-05-09T06:05:22.183729+0000 front 2024-05-09T06:05:22.183822+0000 (oldest deadline 2024-05-09T06:05:46.283688+0000) 2024-05-09T06:05:52.102 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:51 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:51.694+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:43.538761+0000 front 2024-05-09T06:04:43.538885+0000 (oldest deadline 2024-05-09T06:05:08.239002+0000) 2024-05-09T06:05:52.102 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:51 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:51.694+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:48.239500+0000 front 2024-05-09T06:04:48.239770+0000 (oldest deadline 2024-05-09T06:05:15.840152+0000) 2024-05-09T06:05:52.102 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:51 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:51.694+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:05:01.041844+0000 front 2024-05-09T06:05:01.042028+0000 (oldest deadline 2024-05-09T06:05:26.941838+0000) 2024-05-09T06:05:52.102 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:51 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:51.694+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-05-09T06:05:06.942441+0000 front 2024-05-09T06:05:06.942467+0000 (oldest deadline 2024-05-09T06:05:34.543233+0000) 2024-05-09T06:05:52.102 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:51 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:51.694+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-09T06:05:16.844298+0000 front 2024-05-09T06:05:16.844561+0000 (oldest deadline 2024-05-09T06:05:39.744266+0000) 2024-05-09T06:05:52.102 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:51 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:51.694+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.100:6812 osd.5 since back 2024-05-09T06:05:23.746389+0000 front 2024-05-09T06:05:23.746182+0000 (oldest deadline 2024-05-09T06:05:51.346426+0000) 2024-05-09T06:05:52.222 DEBUG:teuthology.orchestra.run.smithi100:> sudo pkill -f 'journalctl -f -n 0 -u ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@osd.8.service' 2024-05-09T06:05:52.306 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T06:05:52.307 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-05-09T06:05:52.307 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-05-09T06:05:52.307 DEBUG:teuthology.orchestra.run.smithi039:> sudo systemctl stop ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@osd.9 2024-05-09T06:05:52.415 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:52 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:52.150+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:40.939354+0000 front 2024-05-09T06:04:40.939391+0000 (oldest deadline 2024-05-09T06:05:06.239561+0000) 2024-05-09T06:05:52.416 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:52 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:52.150+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:49.140745+0000 front 2024-05-09T06:04:49.140702+0000 (oldest deadline 2024-05-09T06:05:15.040838+0000) 2024-05-09T06:05:52.416 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:52 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:52.150+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:04:58.542017+0000 front 2024-05-09T06:04:58.542182+0000 (oldest deadline 2024-05-09T06:05:22.042178+0000) 2024-05-09T06:05:52.416 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:52 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:52.150+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-09T06:05:13.045066+0000 front 2024-05-09T06:05:13.045200+0000 (oldest deadline 2024-05-09T06:05:38.345172+0000) 2024-05-09T06:05:52.416 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:52 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:52.150+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.100:6812 osd.5 since back 2024-05-09T06:05:20.546746+0000 front 2024-05-09T06:05:20.546809+0000 (oldest deadline 2024-05-09T06:05:51.147432+0000) 2024-05-09T06:05:52.602 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:52 smithi039 systemd[1]: Stopping Ceph osd.9 for 86d4cc60-0dc4-11ef-bc97-c7b262605968... 2024-05-09T06:05:53.038 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:52 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:52.645+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:44.474482+0000 front 2024-05-09T06:04:44.474540+0000 (oldest deadline 2024-05-09T06:05:10.875240+0000) 2024-05-09T06:05:53.038 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:52 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:52.645+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:50.875869+0000 front 2024-05-09T06:04:50.875902+0000 (oldest deadline 2024-05-09T06:05:14.376145+0000) 2024-05-09T06:05:53.038 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:52 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:52.645+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:05:01.278886+0000 front 2024-05-09T06:05:01.278763+0000 (oldest deadline 2024-05-09T06:05:22.279679+0000) 2024-05-09T06:05:53.039 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:52 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:52.645+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-05-09T06:05:08.180994+0000 front 2024-05-09T06:05:08.181056+0000 (oldest deadline 2024-05-09T06:05:31.081042+0000) 2024-05-09T06:05:53.039 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:52 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:52.645+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-09T06:05:16.882926+0000 front 2024-05-09T06:05:16.882948+0000 (oldest deadline 2024-05-09T06:05:42.183104+0000) 2024-05-09T06:05:53.039 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:52 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:52.645+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.100:6812 osd.5 since back 2024-05-09T06:05:22.183729+0000 front 2024-05-09T06:05:22.183822+0000 (oldest deadline 2024-05-09T06:05:46.283688+0000) 2024-05-09T06:05:53.102 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:52 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:52.637+0000 7fbb09f7b700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T06:05:53.102 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:52 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:52.637+0000 7fbb09f7b700 -1 osd.9 86 *** Got signal Terminated *** 2024-05-09T06:05:53.102 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:52 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:52.637+0000 7fbb09f7b700 -1 osd.9 86 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-09T06:05:53.102 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:52 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:52.738+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:43.538761+0000 front 2024-05-09T06:04:43.538885+0000 (oldest deadline 2024-05-09T06:05:08.239002+0000) 2024-05-09T06:05:53.102 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:52 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:52.738+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:48.239500+0000 front 2024-05-09T06:04:48.239770+0000 (oldest deadline 2024-05-09T06:05:15.840152+0000) 2024-05-09T06:05:53.103 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:52 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:52.739+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:05:01.041844+0000 front 2024-05-09T06:05:01.042028+0000 (oldest deadline 2024-05-09T06:05:26.941838+0000) 2024-05-09T06:05:53.103 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:52 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:52.739+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-05-09T06:05:06.942441+0000 front 2024-05-09T06:05:06.942467+0000 (oldest deadline 2024-05-09T06:05:34.543233+0000) 2024-05-09T06:05:53.103 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:52 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:52.739+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-09T06:05:16.844298+0000 front 2024-05-09T06:05:16.844561+0000 (oldest deadline 2024-05-09T06:05:39.744266+0000) 2024-05-09T06:05:53.103 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:52 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:52.739+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.100:6812 osd.5 since back 2024-05-09T06:05:23.746389+0000 front 2024-05-09T06:05:23.746182+0000 (oldest deadline 2024-05-09T06:05:51.346426+0000) 2024-05-09T06:05:53.665 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:53 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:53.194+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:40.939354+0000 front 2024-05-09T06:04:40.939391+0000 (oldest deadline 2024-05-09T06:05:06.239561+0000) 2024-05-09T06:05:53.665 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:53 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:53.194+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:49.140745+0000 front 2024-05-09T06:04:49.140702+0000 (oldest deadline 2024-05-09T06:05:15.040838+0000) 2024-05-09T06:05:53.665 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:53 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:53.194+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:04:58.542017+0000 front 2024-05-09T06:04:58.542182+0000 (oldest deadline 2024-05-09T06:05:22.042178+0000) 2024-05-09T06:05:53.665 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:53 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:53.194+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-09T06:05:13.045066+0000 front 2024-05-09T06:05:13.045200+0000 (oldest deadline 2024-05-09T06:05:38.345172+0000) 2024-05-09T06:05:53.666 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:53 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:53.194+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.100:6812 osd.5 since back 2024-05-09T06:05:20.546746+0000 front 2024-05-09T06:05:20.546809+0000 (oldest deadline 2024-05-09T06:05:51.147432+0000) 2024-05-09T06:05:54.039 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:53 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:53.603+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:44.474482+0000 front 2024-05-09T06:04:44.474540+0000 (oldest deadline 2024-05-09T06:05:10.875240+0000) 2024-05-09T06:05:54.039 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:53 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:53.603+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:50.875869+0000 front 2024-05-09T06:04:50.875902+0000 (oldest deadline 2024-05-09T06:05:14.376145+0000) 2024-05-09T06:05:54.039 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:53 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:53.603+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:05:01.278886+0000 front 2024-05-09T06:05:01.278763+0000 (oldest deadline 2024-05-09T06:05:22.279679+0000) 2024-05-09T06:05:54.039 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:53 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:53.603+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-05-09T06:05:08.180994+0000 front 2024-05-09T06:05:08.181056+0000 (oldest deadline 2024-05-09T06:05:31.081042+0000) 2024-05-09T06:05:54.039 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:53 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:53.603+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-09T06:05:16.882926+0000 front 2024-05-09T06:05:16.882948+0000 (oldest deadline 2024-05-09T06:05:42.183104+0000) 2024-05-09T06:05:54.039 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:53 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:53.603+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.100:6812 osd.5 since back 2024-05-09T06:05:22.183729+0000 front 2024-05-09T06:05:22.183822+0000 (oldest deadline 2024-05-09T06:05:46.283688+0000) 2024-05-09T06:05:54.102 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:53 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:53.764+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:43.538761+0000 front 2024-05-09T06:04:43.538885+0000 (oldest deadline 2024-05-09T06:05:08.239002+0000) 2024-05-09T06:05:54.102 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:53 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:53.764+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:48.239500+0000 front 2024-05-09T06:04:48.239770+0000 (oldest deadline 2024-05-09T06:05:15.840152+0000) 2024-05-09T06:05:54.102 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:53 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:53.764+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:05:01.041844+0000 front 2024-05-09T06:05:01.042028+0000 (oldest deadline 2024-05-09T06:05:26.941838+0000) 2024-05-09T06:05:54.102 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:53 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:53.764+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-05-09T06:05:06.942441+0000 front 2024-05-09T06:05:06.942467+0000 (oldest deadline 2024-05-09T06:05:34.543233+0000) 2024-05-09T06:05:54.102 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:53 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:53.764+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-09T06:05:16.844298+0000 front 2024-05-09T06:05:16.844561+0000 (oldest deadline 2024-05-09T06:05:39.744266+0000) 2024-05-09T06:05:54.102 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:53 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:53.764+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.100:6812 osd.5 since back 2024-05-09T06:05:23.746389+0000 front 2024-05-09T06:05:23.746182+0000 (oldest deadline 2024-05-09T06:05:51.346426+0000) 2024-05-09T06:05:54.665 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:54 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:54.229+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:40.939354+0000 front 2024-05-09T06:04:40.939391+0000 (oldest deadline 2024-05-09T06:05:06.239561+0000) 2024-05-09T06:05:54.665 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:54 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:54.229+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:49.140745+0000 front 2024-05-09T06:04:49.140702+0000 (oldest deadline 2024-05-09T06:05:15.040838+0000) 2024-05-09T06:05:54.666 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:54 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:54.229+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:04:58.542017+0000 front 2024-05-09T06:04:58.542182+0000 (oldest deadline 2024-05-09T06:05:22.042178+0000) 2024-05-09T06:05:54.666 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:54 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:54.229+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-09T06:05:13.045066+0000 front 2024-05-09T06:05:13.045200+0000 (oldest deadline 2024-05-09T06:05:38.345172+0000) 2024-05-09T06:05:54.666 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:54 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:54.229+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.100:6812 osd.5 since back 2024-05-09T06:05:20.546746+0000 front 2024-05-09T06:05:20.546809+0000 (oldest deadline 2024-05-09T06:05:51.147432+0000) 2024-05-09T06:05:55.038 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:54 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:54.571+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:44.474482+0000 front 2024-05-09T06:04:44.474540+0000 (oldest deadline 2024-05-09T06:05:10.875240+0000) 2024-05-09T06:05:55.039 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:54 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:54.571+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:50.875869+0000 front 2024-05-09T06:04:50.875902+0000 (oldest deadline 2024-05-09T06:05:14.376145+0000) 2024-05-09T06:05:55.039 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:54 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:54.571+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:05:01.278886+0000 front 2024-05-09T06:05:01.278763+0000 (oldest deadline 2024-05-09T06:05:22.279679+0000) 2024-05-09T06:05:55.039 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:54 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:54.571+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-05-09T06:05:08.180994+0000 front 2024-05-09T06:05:08.181056+0000 (oldest deadline 2024-05-09T06:05:31.081042+0000) 2024-05-09T06:05:55.039 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:54 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:54.571+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-09T06:05:16.882926+0000 front 2024-05-09T06:05:16.882948+0000 (oldest deadline 2024-05-09T06:05:42.183104+0000) 2024-05-09T06:05:55.039 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:54 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:54.571+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.100:6812 osd.5 since back 2024-05-09T06:05:22.183729+0000 front 2024-05-09T06:05:22.183822+0000 (oldest deadline 2024-05-09T06:05:46.283688+0000) 2024-05-09T06:05:55.039 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:54 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:54.571+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6822 osd.6 since back 2024-05-09T06:05:29.784792+0000 front 2024-05-09T06:05:29.784858+0000 (oldest deadline 2024-05-09T06:05:54.385244+0000) 2024-05-09T06:05:55.102 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:54 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:54.747+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:43.538761+0000 front 2024-05-09T06:04:43.538885+0000 (oldest deadline 2024-05-09T06:05:08.239002+0000) 2024-05-09T06:05:55.102 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:54 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:54.747+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:48.239500+0000 front 2024-05-09T06:04:48.239770+0000 (oldest deadline 2024-05-09T06:05:15.840152+0000) 2024-05-09T06:05:55.102 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:54 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:54.747+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:05:01.041844+0000 front 2024-05-09T06:05:01.042028+0000 (oldest deadline 2024-05-09T06:05:26.941838+0000) 2024-05-09T06:05:55.102 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:54 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:54.747+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-05-09T06:05:06.942441+0000 front 2024-05-09T06:05:06.942467+0000 (oldest deadline 2024-05-09T06:05:34.543233+0000) 2024-05-09T06:05:55.103 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:54 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:54.747+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-09T06:05:16.844298+0000 front 2024-05-09T06:05:16.844561+0000 (oldest deadline 2024-05-09T06:05:39.744266+0000) 2024-05-09T06:05:55.103 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:54 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:54.747+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.100:6812 osd.5 since back 2024-05-09T06:05:23.746389+0000 front 2024-05-09T06:05:23.746182+0000 (oldest deadline 2024-05-09T06:05:51.346426+0000) 2024-05-09T06:05:55.665 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:55 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:55.214+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:40.939354+0000 front 2024-05-09T06:04:40.939391+0000 (oldest deadline 2024-05-09T06:05:06.239561+0000) 2024-05-09T06:05:55.666 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:55 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:55.214+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:49.140745+0000 front 2024-05-09T06:04:49.140702+0000 (oldest deadline 2024-05-09T06:05:15.040838+0000) 2024-05-09T06:05:55.666 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:55 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:55.214+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:04:58.542017+0000 front 2024-05-09T06:04:58.542182+0000 (oldest deadline 2024-05-09T06:05:22.042178+0000) 2024-05-09T06:05:55.666 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:55 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:55.214+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-09T06:05:13.045066+0000 front 2024-05-09T06:05:13.045200+0000 (oldest deadline 2024-05-09T06:05:38.345172+0000) 2024-05-09T06:05:55.666 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:55 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:55.214+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.100:6812 osd.5 since back 2024-05-09T06:05:20.546746+0000 front 2024-05-09T06:05:20.546809+0000 (oldest deadline 2024-05-09T06:05:51.147432+0000) 2024-05-09T06:05:56.038 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:55 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:55.607+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:44.474482+0000 front 2024-05-09T06:04:44.474540+0000 (oldest deadline 2024-05-09T06:05:10.875240+0000) 2024-05-09T06:05:56.038 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:55 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:55.607+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:50.875869+0000 front 2024-05-09T06:04:50.875902+0000 (oldest deadline 2024-05-09T06:05:14.376145+0000) 2024-05-09T06:05:56.038 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:55 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:55.607+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:05:01.278886+0000 front 2024-05-09T06:05:01.278763+0000 (oldest deadline 2024-05-09T06:05:22.279679+0000) 2024-05-09T06:05:56.039 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:55 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:55.607+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-05-09T06:05:08.180994+0000 front 2024-05-09T06:05:08.181056+0000 (oldest deadline 2024-05-09T06:05:31.081042+0000) 2024-05-09T06:05:56.039 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:55 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:55.607+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-09T06:05:16.882926+0000 front 2024-05-09T06:05:16.882948+0000 (oldest deadline 2024-05-09T06:05:42.183104+0000) 2024-05-09T06:05:56.039 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:55 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:55.607+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.100:6812 osd.5 since back 2024-05-09T06:05:22.183729+0000 front 2024-05-09T06:05:22.183822+0000 (oldest deadline 2024-05-09T06:05:46.283688+0000) 2024-05-09T06:05:56.039 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:55 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:55.607+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6822 osd.6 since back 2024-05-09T06:05:29.784792+0000 front 2024-05-09T06:05:29.784858+0000 (oldest deadline 2024-05-09T06:05:54.385244+0000) 2024-05-09T06:05:56.102 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:55 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:55.772+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:43.538761+0000 front 2024-05-09T06:04:43.538885+0000 (oldest deadline 2024-05-09T06:05:08.239002+0000) 2024-05-09T06:05:56.102 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:55 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:55.772+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:48.239500+0000 front 2024-05-09T06:04:48.239770+0000 (oldest deadline 2024-05-09T06:05:15.840152+0000) 2024-05-09T06:05:56.102 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:55 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:55.772+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:05:01.041844+0000 front 2024-05-09T06:05:01.042028+0000 (oldest deadline 2024-05-09T06:05:26.941838+0000) 2024-05-09T06:05:56.102 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:55 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:55.772+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-05-09T06:05:06.942441+0000 front 2024-05-09T06:05:06.942467+0000 (oldest deadline 2024-05-09T06:05:34.543233+0000) 2024-05-09T06:05:56.102 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:55 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:55.772+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-09T06:05:16.844298+0000 front 2024-05-09T06:05:16.844561+0000 (oldest deadline 2024-05-09T06:05:39.744266+0000) 2024-05-09T06:05:56.102 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:55 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:55.772+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.100:6812 osd.5 since back 2024-05-09T06:05:23.746389+0000 front 2024-05-09T06:05:23.746182+0000 (oldest deadline 2024-05-09T06:05:51.346426+0000) 2024-05-09T06:05:56.416 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:56 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:56.169+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:40.939354+0000 front 2024-05-09T06:04:40.939391+0000 (oldest deadline 2024-05-09T06:05:06.239561+0000) 2024-05-09T06:05:56.416 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:56 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:56.169+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:49.140745+0000 front 2024-05-09T06:04:49.140702+0000 (oldest deadline 2024-05-09T06:05:15.040838+0000) 2024-05-09T06:05:56.416 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:56 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:56.169+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:04:58.542017+0000 front 2024-05-09T06:04:58.542182+0000 (oldest deadline 2024-05-09T06:05:22.042178+0000) 2024-05-09T06:05:56.416 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:56 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:56.169+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-09T06:05:13.045066+0000 front 2024-05-09T06:05:13.045200+0000 (oldest deadline 2024-05-09T06:05:38.345172+0000) 2024-05-09T06:05:56.416 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:56 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:56.169+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.100:6812 osd.5 since back 2024-05-09T06:05:20.546746+0000 front 2024-05-09T06:05:20.546809+0000 (oldest deadline 2024-05-09T06:05:51.147432+0000) 2024-05-09T06:05:57.038 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:56 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:56.572+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:44.474482+0000 front 2024-05-09T06:04:44.474540+0000 (oldest deadline 2024-05-09T06:05:10.875240+0000) 2024-05-09T06:05:57.038 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:56 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:56.572+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:50.875869+0000 front 2024-05-09T06:04:50.875902+0000 (oldest deadline 2024-05-09T06:05:14.376145+0000) 2024-05-09T06:05:57.038 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:56 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:56.572+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:05:01.278886+0000 front 2024-05-09T06:05:01.278763+0000 (oldest deadline 2024-05-09T06:05:22.279679+0000) 2024-05-09T06:05:57.039 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:56 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:56.572+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-05-09T06:05:08.180994+0000 front 2024-05-09T06:05:08.181056+0000 (oldest deadline 2024-05-09T06:05:31.081042+0000) 2024-05-09T06:05:57.039 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:56 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:56.572+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-09T06:05:16.882926+0000 front 2024-05-09T06:05:16.882948+0000 (oldest deadline 2024-05-09T06:05:42.183104+0000) 2024-05-09T06:05:57.039 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:56 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:56.572+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.100:6812 osd.5 since back 2024-05-09T06:05:22.183729+0000 front 2024-05-09T06:05:22.183822+0000 (oldest deadline 2024-05-09T06:05:46.283688+0000) 2024-05-09T06:05:57.039 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:56 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:56.572+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6822 osd.6 since back 2024-05-09T06:05:29.784792+0000 front 2024-05-09T06:05:29.784858+0000 (oldest deadline 2024-05-09T06:05:54.385244+0000) 2024-05-09T06:05:57.102 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:56 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:56.740+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:43.538761+0000 front 2024-05-09T06:04:43.538885+0000 (oldest deadline 2024-05-09T06:05:08.239002+0000) 2024-05-09T06:05:57.102 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:56 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:56.740+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:48.239500+0000 front 2024-05-09T06:04:48.239770+0000 (oldest deadline 2024-05-09T06:05:15.840152+0000) 2024-05-09T06:05:57.102 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:56 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:56.740+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:05:01.041844+0000 front 2024-05-09T06:05:01.042028+0000 (oldest deadline 2024-05-09T06:05:26.941838+0000) 2024-05-09T06:05:57.102 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:56 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:56.740+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-05-09T06:05:06.942441+0000 front 2024-05-09T06:05:06.942467+0000 (oldest deadline 2024-05-09T06:05:34.543233+0000) 2024-05-09T06:05:57.102 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:56 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:56.740+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-09T06:05:16.844298+0000 front 2024-05-09T06:05:16.844561+0000 (oldest deadline 2024-05-09T06:05:39.744266+0000) 2024-05-09T06:05:57.102 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:56 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9[63318]: 2024-05-09T06:05:56.740+0000 7fbb02529700 -1 osd.9 86 heartbeat_check: no reply from 172.21.15.100:6812 osd.5 since back 2024-05-09T06:05:23.746389+0000 front 2024-05-09T06:05:23.746182+0000 (oldest deadline 2024-05-09T06:05:51.346426+0000) 2024-05-09T06:05:57.665 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:57 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:57.207+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:40.939354+0000 front 2024-05-09T06:04:40.939391+0000 (oldest deadline 2024-05-09T06:05:06.239561+0000) 2024-05-09T06:05:57.666 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:57 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:57.207+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:49.140745+0000 front 2024-05-09T06:04:49.140702+0000 (oldest deadline 2024-05-09T06:05:15.040838+0000) 2024-05-09T06:05:57.666 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:57 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:57.207+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:04:58.542017+0000 front 2024-05-09T06:04:58.542182+0000 (oldest deadline 2024-05-09T06:05:22.042178+0000) 2024-05-09T06:05:57.666 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:57 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:57.207+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-09T06:05:13.045066+0000 front 2024-05-09T06:05:13.045200+0000 (oldest deadline 2024-05-09T06:05:38.345172+0000) 2024-05-09T06:05:57.666 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:57 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:57.207+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.100:6812 osd.5 since back 2024-05-09T06:05:20.546746+0000 front 2024-05-09T06:05:20.546809+0000 (oldest deadline 2024-05-09T06:05:51.147432+0000) 2024-05-09T06:05:57.666 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:57 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:57.207+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6822 osd.6 since back 2024-05-09T06:05:31.147887+0000 front 2024-05-09T06:05:31.147998+0000 (oldest deadline 2024-05-09T06:05:57.047898+0000) 2024-05-09T06:05:57.994 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:57 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:57.620+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:44.474482+0000 front 2024-05-09T06:04:44.474540+0000 (oldest deadline 2024-05-09T06:05:10.875240+0000) 2024-05-09T06:05:57.994 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:57 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:57.620+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:50.875869+0000 front 2024-05-09T06:04:50.875902+0000 (oldest deadline 2024-05-09T06:05:14.376145+0000) 2024-05-09T06:05:57.994 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:57 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:57.620+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:05:01.278886+0000 front 2024-05-09T06:05:01.278763+0000 (oldest deadline 2024-05-09T06:05:22.279679+0000) 2024-05-09T06:05:57.995 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:57 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:57.620+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-05-09T06:05:08.180994+0000 front 2024-05-09T06:05:08.181056+0000 (oldest deadline 2024-05-09T06:05:31.081042+0000) 2024-05-09T06:05:57.995 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:57 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:57.620+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-09T06:05:16.882926+0000 front 2024-05-09T06:05:16.882948+0000 (oldest deadline 2024-05-09T06:05:42.183104+0000) 2024-05-09T06:05:57.995 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:57 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:57.620+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.100:6812 osd.5 since back 2024-05-09T06:05:22.183729+0000 front 2024-05-09T06:05:22.183822+0000 (oldest deadline 2024-05-09T06:05:46.283688+0000) 2024-05-09T06:05:57.995 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:57 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:57.620+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6822 osd.6 since back 2024-05-09T06:05:29.784792+0000 front 2024-05-09T06:05:29.784858+0000 (oldest deadline 2024-05-09T06:05:54.385244+0000) 2024-05-09T06:05:58.456 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:58 smithi039 podman[95183]: 2024-05-09 06:05:58.187563115 +0000 UTC m=+5.659796173 container died a226042332ddf390cee543ad699a81ef276f968ad7ffb52f3dce2a9467ae068e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507) 2024-05-09T06:05:58.665 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:58 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:58.214+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:40.939354+0000 front 2024-05-09T06:04:40.939391+0000 (oldest deadline 2024-05-09T06:05:06.239561+0000) 2024-05-09T06:05:58.665 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:58 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:58.214+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:49.140745+0000 front 2024-05-09T06:04:49.140702+0000 (oldest deadline 2024-05-09T06:05:15.040838+0000) 2024-05-09T06:05:58.665 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:58 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:58.214+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:04:58.542017+0000 front 2024-05-09T06:04:58.542182+0000 (oldest deadline 2024-05-09T06:05:22.042178+0000) 2024-05-09T06:05:58.666 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:58 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:58.214+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-09T06:05:13.045066+0000 front 2024-05-09T06:05:13.045200+0000 (oldest deadline 2024-05-09T06:05:38.345172+0000) 2024-05-09T06:05:58.666 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:58 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:58.214+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.100:6812 osd.5 since back 2024-05-09T06:05:20.546746+0000 front 2024-05-09T06:05:20.546809+0000 (oldest deadline 2024-05-09T06:05:51.147432+0000) 2024-05-09T06:05:58.666 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:58 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:58.214+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6822 osd.6 since back 2024-05-09T06:05:31.147887+0000 front 2024-05-09T06:05:31.147998+0000 (oldest deadline 2024-05-09T06:05:57.047898+0000) 2024-05-09T06:05:58.790 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:58 smithi039 podman[95183]: 2024-05-09 06:05:58.57050378 +0000 UTC m=+6.042736840 container cleanup a226042332ddf390cee543ad699a81ef276f968ad7ffb52f3dce2a9467ae068e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, GIT_CLEAN=True) 2024-05-09T06:05:58.790 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:58 smithi039 bash[95183]: ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9 2024-05-09T06:05:59.038 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:58 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:58.643+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:44.474482+0000 front 2024-05-09T06:04:44.474540+0000 (oldest deadline 2024-05-09T06:05:10.875240+0000) 2024-05-09T06:05:59.039 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:58 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:58.643+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:50.875869+0000 front 2024-05-09T06:04:50.875902+0000 (oldest deadline 2024-05-09T06:05:14.376145+0000) 2024-05-09T06:05:59.039 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:58 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:58.643+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:05:01.278886+0000 front 2024-05-09T06:05:01.278763+0000 (oldest deadline 2024-05-09T06:05:22.279679+0000) 2024-05-09T06:05:59.039 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:58 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:58.643+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-05-09T06:05:08.180994+0000 front 2024-05-09T06:05:08.181056+0000 (oldest deadline 2024-05-09T06:05:31.081042+0000) 2024-05-09T06:05:59.039 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:58 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:58.643+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-09T06:05:16.882926+0000 front 2024-05-09T06:05:16.882948+0000 (oldest deadline 2024-05-09T06:05:42.183104+0000) 2024-05-09T06:05:59.039 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:58 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:58.643+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.100:6812 osd.5 since back 2024-05-09T06:05:22.183729+0000 front 2024-05-09T06:05:22.183822+0000 (oldest deadline 2024-05-09T06:05:46.283688+0000) 2024-05-09T06:05:59.039 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:58 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:58.643+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6822 osd.6 since back 2024-05-09T06:05:29.784792+0000 front 2024-05-09T06:05:29.784858+0000 (oldest deadline 2024-05-09T06:05:54.385244+0000) 2024-05-09T06:05:59.102 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:58 smithi039 podman[95203]: 2024-05-09 06:05:58.804938306 +0000 UTC m=+0.613143730 container remove a226042332ddf390cee543ad699a81ef276f968ad7ffb52f3dce2a9467ae068e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0) 2024-05-09T06:05:59.413 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:59 smithi039 podman[95291]: 2024-05-09 06:05:59.13081815 +0000 UTC m=+0.114619449 container create 42121b33eaf59e0cdef8df8b7bcb26ecb69f81c5da58d8596eadc17119335631 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux ) 2024-05-09T06:05:59.413 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:59 smithi039 podman[95291]: 2024-05-09 06:05:59.034768628 +0000 UTC m=+0.018569939 image pull db794d706f492c144ccc8f2c5bbc1870e116f5c4f3309dfab4416b39d099f8d7 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584 2024-05-09T06:05:59.665 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:59 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:59.257+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:40.939354+0000 front 2024-05-09T06:04:40.939391+0000 (oldest deadline 2024-05-09T06:05:06.239561+0000) 2024-05-09T06:05:59.665 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:59 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:59.257+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:49.140745+0000 front 2024-05-09T06:04:49.140702+0000 (oldest deadline 2024-05-09T06:05:15.040838+0000) 2024-05-09T06:05:59.665 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:59 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:59.257+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:04:58.542017+0000 front 2024-05-09T06:04:58.542182+0000 (oldest deadline 2024-05-09T06:05:22.042178+0000) 2024-05-09T06:05:59.666 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:59 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:59.257+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-09T06:05:13.045066+0000 front 2024-05-09T06:05:13.045200+0000 (oldest deadline 2024-05-09T06:05:38.345172+0000) 2024-05-09T06:05:59.666 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:59 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:59.257+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.100:6812 osd.5 since back 2024-05-09T06:05:20.546746+0000 front 2024-05-09T06:05:20.546809+0000 (oldest deadline 2024-05-09T06:05:51.147432+0000) 2024-05-09T06:05:59.666 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:05:59 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:05:59.257+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6822 osd.6 since back 2024-05-09T06:05:31.147887+0000 front 2024-05-09T06:05:31.147998+0000 (oldest deadline 2024-05-09T06:05:57.047898+0000) 2024-05-09T06:05:59.725 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:59 smithi039 podman[95291]: 2024-05-09 06:05:59.429219214 +0000 UTC m=+0.413020514 container init 42121b33eaf59e0cdef8df8b7bcb26ecb69f81c5da58d8596eadc17119335631 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9-deactivate, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-09T06:05:59.726 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:59 smithi039 podman[95291]: 2024-05-09 06:05:59.432774347 +0000 UTC m=+0.416575646 container start 42121b33eaf59e0cdef8df8b7bcb26ecb69f81c5da58d8596eadc17119335631 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9-deactivate, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0) 2024-05-09T06:05:59.726 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:59 smithi039 podman[95291]: 2024-05-09 06:05:59.533755824 +0000 UTC m=+0.517557126 container attach 42121b33eaf59e0cdef8df8b7bcb26ecb69f81c5da58d8596eadc17119335631 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9-deactivate, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.5, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, GIT_CLEAN=True) 2024-05-09T06:05:59.996 INFO:journalctl@ceph.osd.9.smithi039.stdout:May 09 06:05:59 smithi039 podman[95291]: 2024-05-09 06:05:59.741421879 +0000 UTC m=+0.725223187 container died 42121b33eaf59e0cdef8df8b7bcb26ecb69f81c5da58d8596eadc17119335631 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-9-deactivate, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.build-date=20240507, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, CEPH_POINT_RELEASE=) 2024-05-09T06:06:00.038 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:59 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:59.640+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:44.474482+0000 front 2024-05-09T06:04:44.474540+0000 (oldest deadline 2024-05-09T06:05:10.875240+0000) 2024-05-09T06:06:00.038 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:59 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:59.640+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:50.875869+0000 front 2024-05-09T06:04:50.875902+0000 (oldest deadline 2024-05-09T06:05:14.376145+0000) 2024-05-09T06:06:00.038 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:59 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:59.640+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:05:01.278886+0000 front 2024-05-09T06:05:01.278763+0000 (oldest deadline 2024-05-09T06:05:22.279679+0000) 2024-05-09T06:06:00.038 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:59 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:59.640+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-05-09T06:05:08.180994+0000 front 2024-05-09T06:05:08.181056+0000 (oldest deadline 2024-05-09T06:05:31.081042+0000) 2024-05-09T06:06:00.038 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:59 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:59.640+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-09T06:05:16.882926+0000 front 2024-05-09T06:05:16.882948+0000 (oldest deadline 2024-05-09T06:05:42.183104+0000) 2024-05-09T06:06:00.039 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:59 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:59.640+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.100:6812 osd.5 since back 2024-05-09T06:05:22.183729+0000 front 2024-05-09T06:05:22.183822+0000 (oldest deadline 2024-05-09T06:05:46.283688+0000) 2024-05-09T06:06:00.039 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:05:59 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:05:59.640+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6822 osd.6 since back 2024-05-09T06:05:29.784792+0000 front 2024-05-09T06:05:29.784858+0000 (oldest deadline 2024-05-09T06:05:54.385244+0000) 2024-05-09T06:06:00.211 DEBUG:teuthology.orchestra.run.smithi039:> sudo pkill -f 'journalctl -f -n 0 -u ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@osd.9.service' 2024-05-09T06:06:00.253 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T06:06:00.253 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-05-09T06:06:00.254 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-05-09T06:06:00.254 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@osd.10 2024-05-09T06:06:00.538 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:06:00 smithi060 systemd[1]: Stopping Ceph osd.10 for 86d4cc60-0dc4-11ef-bc97-c7b262605968... 2024-05-09T06:06:00.665 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:00 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:06:00.303+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:40.939354+0000 front 2024-05-09T06:04:40.939391+0000 (oldest deadline 2024-05-09T06:05:06.239561+0000) 2024-05-09T06:06:00.665 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:00 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:06:00.303+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:49.140745+0000 front 2024-05-09T06:04:49.140702+0000 (oldest deadline 2024-05-09T06:05:15.040838+0000) 2024-05-09T06:06:00.665 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:00 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:06:00.303+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:04:58.542017+0000 front 2024-05-09T06:04:58.542182+0000 (oldest deadline 2024-05-09T06:05:22.042178+0000) 2024-05-09T06:06:00.665 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:00 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:06:00.303+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-09T06:05:13.045066+0000 front 2024-05-09T06:05:13.045200+0000 (oldest deadline 2024-05-09T06:05:38.345172+0000) 2024-05-09T06:06:00.666 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:00 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:06:00.303+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.100:6812 osd.5 since back 2024-05-09T06:05:20.546746+0000 front 2024-05-09T06:05:20.546809+0000 (oldest deadline 2024-05-09T06:05:51.147432+0000) 2024-05-09T06:06:00.666 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:00 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:06:00.303+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6822 osd.6 since back 2024-05-09T06:05:31.147887+0000 front 2024-05-09T06:05:31.147998+0000 (oldest deadline 2024-05-09T06:05:57.047898+0000) 2024-05-09T06:06:01.038 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:06:00 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:06:00.584+0000 7f09c3d1c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T06:06:01.039 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:06:00 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:06:00.584+0000 7f09c3d1c700 -1 osd.10 86 *** Got signal Terminated *** 2024-05-09T06:06:01.039 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:06:00 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:06:00.584+0000 7f09c3d1c700 -1 osd.10 86 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-09T06:06:01.039 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:06:00 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:06:00.669+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:44.474482+0000 front 2024-05-09T06:04:44.474540+0000 (oldest deadline 2024-05-09T06:05:10.875240+0000) 2024-05-09T06:06:01.039 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:06:00 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:06:00.669+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:50.875869+0000 front 2024-05-09T06:04:50.875902+0000 (oldest deadline 2024-05-09T06:05:14.376145+0000) 2024-05-09T06:06:01.039 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:06:00 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:06:00.669+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:05:01.278886+0000 front 2024-05-09T06:05:01.278763+0000 (oldest deadline 2024-05-09T06:05:22.279679+0000) 2024-05-09T06:06:01.039 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:06:00 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:06:00.669+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-05-09T06:05:08.180994+0000 front 2024-05-09T06:05:08.181056+0000 (oldest deadline 2024-05-09T06:05:31.081042+0000) 2024-05-09T06:06:01.039 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:06:00 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:06:00.669+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-09T06:05:16.882926+0000 front 2024-05-09T06:05:16.882948+0000 (oldest deadline 2024-05-09T06:05:42.183104+0000) 2024-05-09T06:06:01.039 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:06:00 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:06:00.669+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.100:6812 osd.5 since back 2024-05-09T06:05:22.183729+0000 front 2024-05-09T06:05:22.183822+0000 (oldest deadline 2024-05-09T06:05:46.283688+0000) 2024-05-09T06:06:01.039 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:06:00 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:06:00.669+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6822 osd.6 since back 2024-05-09T06:05:29.784792+0000 front 2024-05-09T06:05:29.784858+0000 (oldest deadline 2024-05-09T06:05:54.385244+0000) 2024-05-09T06:06:01.665 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:01 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:06:01.349+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:40.939354+0000 front 2024-05-09T06:04:40.939391+0000 (oldest deadline 2024-05-09T06:05:06.239561+0000) 2024-05-09T06:06:01.665 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:01 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:06:01.349+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:49.140745+0000 front 2024-05-09T06:04:49.140702+0000 (oldest deadline 2024-05-09T06:05:15.040838+0000) 2024-05-09T06:06:01.666 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:01 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:06:01.349+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:04:58.542017+0000 front 2024-05-09T06:04:58.542182+0000 (oldest deadline 2024-05-09T06:05:22.042178+0000) 2024-05-09T06:06:01.666 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:01 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:06:01.349+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-09T06:05:13.045066+0000 front 2024-05-09T06:05:13.045200+0000 (oldest deadline 2024-05-09T06:05:38.345172+0000) 2024-05-09T06:06:01.666 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:01 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:06:01.349+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.100:6812 osd.5 since back 2024-05-09T06:05:20.546746+0000 front 2024-05-09T06:05:20.546809+0000 (oldest deadline 2024-05-09T06:05:51.147432+0000) 2024-05-09T06:06:01.666 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:01 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:06:01.349+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6822 osd.6 since back 2024-05-09T06:05:31.147887+0000 front 2024-05-09T06:05:31.147998+0000 (oldest deadline 2024-05-09T06:05:57.047898+0000) 2024-05-09T06:06:02.038 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:06:01 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:06:01.679+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:44.474482+0000 front 2024-05-09T06:04:44.474540+0000 (oldest deadline 2024-05-09T06:05:10.875240+0000) 2024-05-09T06:06:02.038 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:06:01 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:06:01.679+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:50.875869+0000 front 2024-05-09T06:04:50.875902+0000 (oldest deadline 2024-05-09T06:05:14.376145+0000) 2024-05-09T06:06:02.038 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:06:01 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:06:01.679+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:05:01.278886+0000 front 2024-05-09T06:05:01.278763+0000 (oldest deadline 2024-05-09T06:05:22.279679+0000) 2024-05-09T06:06:02.039 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:06:01 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:06:01.679+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-05-09T06:05:08.180994+0000 front 2024-05-09T06:05:08.181056+0000 (oldest deadline 2024-05-09T06:05:31.081042+0000) 2024-05-09T06:06:02.039 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:06:01 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:06:01.679+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-09T06:05:16.882926+0000 front 2024-05-09T06:05:16.882948+0000 (oldest deadline 2024-05-09T06:05:42.183104+0000) 2024-05-09T06:06:02.039 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:06:01 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:06:01.679+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.100:6812 osd.5 since back 2024-05-09T06:05:22.183729+0000 front 2024-05-09T06:05:22.183822+0000 (oldest deadline 2024-05-09T06:05:46.283688+0000) 2024-05-09T06:06:02.039 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:06:01 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:06:01.679+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6822 osd.6 since back 2024-05-09T06:05:29.784792+0000 front 2024-05-09T06:05:29.784858+0000 (oldest deadline 2024-05-09T06:05:54.385244+0000) 2024-05-09T06:06:02.665 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:02 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:06:02.318+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:40.939354+0000 front 2024-05-09T06:04:40.939391+0000 (oldest deadline 2024-05-09T06:05:06.239561+0000) 2024-05-09T06:06:02.704 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:02 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:06:02.318+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:49.140745+0000 front 2024-05-09T06:04:49.140702+0000 (oldest deadline 2024-05-09T06:05:15.040838+0000) 2024-05-09T06:06:02.705 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:02 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:06:02.318+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:04:58.542017+0000 front 2024-05-09T06:04:58.542182+0000 (oldest deadline 2024-05-09T06:05:22.042178+0000) 2024-05-09T06:06:02.705 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:02 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:06:02.318+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-09T06:05:13.045066+0000 front 2024-05-09T06:05:13.045200+0000 (oldest deadline 2024-05-09T06:05:38.345172+0000) 2024-05-09T06:06:02.705 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:02 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:06:02.318+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.100:6812 osd.5 since back 2024-05-09T06:05:20.546746+0000 front 2024-05-09T06:05:20.546809+0000 (oldest deadline 2024-05-09T06:05:51.147432+0000) 2024-05-09T06:06:02.705 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:02 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:06:02.318+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6822 osd.6 since back 2024-05-09T06:05:31.147887+0000 front 2024-05-09T06:05:31.147998+0000 (oldest deadline 2024-05-09T06:05:57.047898+0000) 2024-05-09T06:06:03.038 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:06:02 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:06:02.687+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:44.474482+0000 front 2024-05-09T06:04:44.474540+0000 (oldest deadline 2024-05-09T06:05:10.875240+0000) 2024-05-09T06:06:03.038 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:06:02 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:06:02.687+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:50.875869+0000 front 2024-05-09T06:04:50.875902+0000 (oldest deadline 2024-05-09T06:05:14.376145+0000) 2024-05-09T06:06:03.038 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:06:02 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:06:02.687+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:05:01.278886+0000 front 2024-05-09T06:05:01.278763+0000 (oldest deadline 2024-05-09T06:05:22.279679+0000) 2024-05-09T06:06:03.038 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:06:02 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:06:02.687+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-05-09T06:05:08.180994+0000 front 2024-05-09T06:05:08.181056+0000 (oldest deadline 2024-05-09T06:05:31.081042+0000) 2024-05-09T06:06:03.038 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:06:02 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:06:02.687+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-09T06:05:16.882926+0000 front 2024-05-09T06:05:16.882948+0000 (oldest deadline 2024-05-09T06:05:42.183104+0000) 2024-05-09T06:06:03.039 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:06:02 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:06:02.687+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.100:6812 osd.5 since back 2024-05-09T06:05:22.183729+0000 front 2024-05-09T06:05:22.183822+0000 (oldest deadline 2024-05-09T06:05:46.283688+0000) 2024-05-09T06:06:03.039 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:06:02 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:06:02.687+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6822 osd.6 since back 2024-05-09T06:05:29.784792+0000 front 2024-05-09T06:05:29.784858+0000 (oldest deadline 2024-05-09T06:05:54.385244+0000) 2024-05-09T06:06:03.665 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:03 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:06:03.310+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:40.939354+0000 front 2024-05-09T06:04:40.939391+0000 (oldest deadline 2024-05-09T06:05:06.239561+0000) 2024-05-09T06:06:03.665 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:03 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:06:03.310+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:49.140745+0000 front 2024-05-09T06:04:49.140702+0000 (oldest deadline 2024-05-09T06:05:15.040838+0000) 2024-05-09T06:06:03.665 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:03 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:06:03.310+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:04:58.542017+0000 front 2024-05-09T06:04:58.542182+0000 (oldest deadline 2024-05-09T06:05:22.042178+0000) 2024-05-09T06:06:03.665 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:03 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:06:03.310+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-09T06:05:13.045066+0000 front 2024-05-09T06:05:13.045200+0000 (oldest deadline 2024-05-09T06:05:38.345172+0000) 2024-05-09T06:06:03.666 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:03 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:06:03.310+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.100:6812 osd.5 since back 2024-05-09T06:05:20.546746+0000 front 2024-05-09T06:05:20.546809+0000 (oldest deadline 2024-05-09T06:05:51.147432+0000) 2024-05-09T06:06:03.666 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:03 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:06:03.310+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6822 osd.6 since back 2024-05-09T06:05:31.147887+0000 front 2024-05-09T06:05:31.147998+0000 (oldest deadline 2024-05-09T06:05:57.047898+0000) 2024-05-09T06:06:04.038 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:06:03 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:06:03.650+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:44.474482+0000 front 2024-05-09T06:04:44.474540+0000 (oldest deadline 2024-05-09T06:05:10.875240+0000) 2024-05-09T06:06:04.038 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:06:03 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:06:03.650+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:50.875869+0000 front 2024-05-09T06:04:50.875902+0000 (oldest deadline 2024-05-09T06:05:14.376145+0000) 2024-05-09T06:06:04.038 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:06:03 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:06:03.650+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:05:01.278886+0000 front 2024-05-09T06:05:01.278763+0000 (oldest deadline 2024-05-09T06:05:22.279679+0000) 2024-05-09T06:06:04.038 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:06:03 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:06:03.650+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-05-09T06:05:08.180994+0000 front 2024-05-09T06:05:08.181056+0000 (oldest deadline 2024-05-09T06:05:31.081042+0000) 2024-05-09T06:06:04.039 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:06:03 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:06:03.650+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-09T06:05:16.882926+0000 front 2024-05-09T06:05:16.882948+0000 (oldest deadline 2024-05-09T06:05:42.183104+0000) 2024-05-09T06:06:04.039 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:06:03 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:06:03.650+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.100:6812 osd.5 since back 2024-05-09T06:05:22.183729+0000 front 2024-05-09T06:05:22.183822+0000 (oldest deadline 2024-05-09T06:05:46.283688+0000) 2024-05-09T06:06:04.039 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:06:03 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:06:03.650+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6822 osd.6 since back 2024-05-09T06:05:29.784792+0000 front 2024-05-09T06:05:29.784858+0000 (oldest deadline 2024-05-09T06:05:54.385244+0000) 2024-05-09T06:06:04.665 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:04 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:06:04.342+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:40.939354+0000 front 2024-05-09T06:04:40.939391+0000 (oldest deadline 2024-05-09T06:05:06.239561+0000) 2024-05-09T06:06:04.665 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:04 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:06:04.342+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:49.140745+0000 front 2024-05-09T06:04:49.140702+0000 (oldest deadline 2024-05-09T06:05:15.040838+0000) 2024-05-09T06:06:04.665 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:04 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:06:04.342+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:04:58.542017+0000 front 2024-05-09T06:04:58.542182+0000 (oldest deadline 2024-05-09T06:05:22.042178+0000) 2024-05-09T06:06:04.666 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:04 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:06:04.342+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-09T06:05:13.045066+0000 front 2024-05-09T06:05:13.045200+0000 (oldest deadline 2024-05-09T06:05:38.345172+0000) 2024-05-09T06:06:04.666 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:04 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:06:04.342+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.100:6812 osd.5 since back 2024-05-09T06:05:20.546746+0000 front 2024-05-09T06:05:20.546809+0000 (oldest deadline 2024-05-09T06:05:51.147432+0000) 2024-05-09T06:06:04.666 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:04 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:06:04.343+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6822 osd.6 since back 2024-05-09T06:05:31.147887+0000 front 2024-05-09T06:05:31.147998+0000 (oldest deadline 2024-05-09T06:05:57.047898+0000) 2024-05-09T06:06:05.038 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:06:04 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:06:04.635+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:44.474482+0000 front 2024-05-09T06:04:44.474540+0000 (oldest deadline 2024-05-09T06:05:10.875240+0000) 2024-05-09T06:06:05.038 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:06:04 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:06:04.635+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:50.875869+0000 front 2024-05-09T06:04:50.875902+0000 (oldest deadline 2024-05-09T06:05:14.376145+0000) 2024-05-09T06:06:05.039 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:06:04 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:06:04.635+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:05:01.278886+0000 front 2024-05-09T06:05:01.278763+0000 (oldest deadline 2024-05-09T06:05:22.279679+0000) 2024-05-09T06:06:05.039 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:06:04 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:06:04.635+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6814 osd.3 since back 2024-05-09T06:05:08.180994+0000 front 2024-05-09T06:05:08.181056+0000 (oldest deadline 2024-05-09T06:05:31.081042+0000) 2024-05-09T06:06:05.039 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:06:04 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:06:04.635+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-09T06:05:16.882926+0000 front 2024-05-09T06:05:16.882948+0000 (oldest deadline 2024-05-09T06:05:42.183104+0000) 2024-05-09T06:06:05.039 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:06:04 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:06:04.635+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.100:6812 osd.5 since back 2024-05-09T06:05:22.183729+0000 front 2024-05-09T06:05:22.183822+0000 (oldest deadline 2024-05-09T06:05:46.283688+0000) 2024-05-09T06:06:05.039 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:06:04 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10[59581]: 2024-05-09T06:06:04.635+0000 7f09bc2ca700 -1 osd.10 86 heartbeat_check: no reply from 172.21.15.39:6822 osd.6 since back 2024-05-09T06:05:29.784792+0000 front 2024-05-09T06:05:29.784858+0000 (oldest deadline 2024-05-09T06:05:54.385244+0000) 2024-05-09T06:06:05.665 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:05 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:06:05.296+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:40.939354+0000 front 2024-05-09T06:04:40.939391+0000 (oldest deadline 2024-05-09T06:05:06.239561+0000) 2024-05-09T06:06:05.666 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:05 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:06:05.296+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:49.140745+0000 front 2024-05-09T06:04:49.140702+0000 (oldest deadline 2024-05-09T06:05:15.040838+0000) 2024-05-09T06:06:05.666 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:05 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:06:05.296+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:04:58.542017+0000 front 2024-05-09T06:04:58.542182+0000 (oldest deadline 2024-05-09T06:05:22.042178+0000) 2024-05-09T06:06:05.666 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:05 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:06:05.296+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-09T06:05:13.045066+0000 front 2024-05-09T06:05:13.045200+0000 (oldest deadline 2024-05-09T06:05:38.345172+0000) 2024-05-09T06:06:05.666 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:05 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:06:05.296+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.100:6812 osd.5 since back 2024-05-09T06:05:20.546746+0000 front 2024-05-09T06:05:20.546809+0000 (oldest deadline 2024-05-09T06:05:51.147432+0000) 2024-05-09T06:06:05.666 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:05 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:06:05.296+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6822 osd.6 since back 2024-05-09T06:05:31.147887+0000 front 2024-05-09T06:05:31.147998+0000 (oldest deadline 2024-05-09T06:05:57.047898+0000) 2024-05-09T06:06:06.238 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:06:05 smithi060 podman[77276]: 2024-05-09 06:06:05.976941421 +0000 UTC m=+5.502429848 container died 9a16852949380cbff47c85d26cac9ef516928b0deb47c689816e2d9ee73cc96c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-05-09T06:06:06.538 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:06:06 smithi060 podman[77276]: 2024-05-09 06:06:06.468344119 +0000 UTC m=+5.993832530 container cleanup 9a16852949380cbff47c85d26cac9ef516928b0deb47c689816e2d9ee73cc96c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.build-date=20240507) 2024-05-09T06:06:06.538 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:06:06 smithi060 bash[77276]: ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10 2024-05-09T06:06:06.665 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:06 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:06:06.327+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:40.939354+0000 front 2024-05-09T06:04:40.939391+0000 (oldest deadline 2024-05-09T06:05:06.239561+0000) 2024-05-09T06:06:06.665 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:06 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:06:06.327+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:49.140745+0000 front 2024-05-09T06:04:49.140702+0000 (oldest deadline 2024-05-09T06:05:15.040838+0000) 2024-05-09T06:06:06.666 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:06 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:06:06.327+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:04:58.542017+0000 front 2024-05-09T06:04:58.542182+0000 (oldest deadline 2024-05-09T06:05:22.042178+0000) 2024-05-09T06:06:06.666 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:06 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:06:06.327+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-09T06:05:13.045066+0000 front 2024-05-09T06:05:13.045200+0000 (oldest deadline 2024-05-09T06:05:38.345172+0000) 2024-05-09T06:06:06.666 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:06 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:06:06.327+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.100:6812 osd.5 since back 2024-05-09T06:05:20.546746+0000 front 2024-05-09T06:05:20.546809+0000 (oldest deadline 2024-05-09T06:05:51.147432+0000) 2024-05-09T06:06:06.666 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:06 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:06:06.327+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6822 osd.6 since back 2024-05-09T06:05:31.147887+0000 front 2024-05-09T06:05:31.147998+0000 (oldest deadline 2024-05-09T06:05:57.047898+0000) 2024-05-09T06:06:07.038 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:06:06 smithi060 podman[77291]: 2024-05-09 06:06:06.736264076 +0000 UTC m=+0.754488862 container remove 9a16852949380cbff47c85d26cac9ef516928b0deb47c689816e2d9ee73cc96c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-09T06:06:07.336 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:06:07 smithi060 podman[77380]: 2024-05-09 06:06:07.002030796 +0000 UTC m=+0.018685051 image pull db794d706f492c144ccc8f2c5bbc1870e116f5c4f3309dfab4416b39d099f8d7 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584 2024-05-09T06:06:07.336 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:06:07 smithi060 podman[77380]: 2024-05-09 06:06:07.245550537 +0000 UTC m=+0.262204766 container create c2a821e66389d5c9bc72d2099f229d2df33b34eaae0528f454b5ee33aa64ed6b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10-deactivate, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0) 2024-05-09T06:06:07.665 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:07 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:06:07.355+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:40.939354+0000 front 2024-05-09T06:04:40.939391+0000 (oldest deadline 2024-05-09T06:05:06.239561+0000) 2024-05-09T06:06:07.665 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:07 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:06:07.355+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:49.140745+0000 front 2024-05-09T06:04:49.140702+0000 (oldest deadline 2024-05-09T06:05:15.040838+0000) 2024-05-09T06:06:07.666 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:07 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:06:07.355+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:04:58.542017+0000 front 2024-05-09T06:04:58.542182+0000 (oldest deadline 2024-05-09T06:05:22.042178+0000) 2024-05-09T06:06:07.666 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:07 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:06:07.355+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-09T06:05:13.045066+0000 front 2024-05-09T06:05:13.045200+0000 (oldest deadline 2024-05-09T06:05:38.345172+0000) 2024-05-09T06:06:07.666 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:07 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:06:07.355+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.100:6812 osd.5 since back 2024-05-09T06:05:20.546746+0000 front 2024-05-09T06:05:20.546809+0000 (oldest deadline 2024-05-09T06:05:51.147432+0000) 2024-05-09T06:06:07.666 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:07 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:06:07.355+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6822 osd.6 since back 2024-05-09T06:05:31.147887+0000 front 2024-05-09T06:05:31.147998+0000 (oldest deadline 2024-05-09T06:05:57.047898+0000) 2024-05-09T06:06:07.666 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:07 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:06:07.355+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.60:6820 osd.7 since back 2024-05-09T06:05:41.049707+0000 front 2024-05-09T06:05:41.049721+0000 (oldest deadline 2024-05-09T06:06:06.349743+0000) 2024-05-09T06:06:07.756 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:06:07 smithi060 podman[77380]: 2024-05-09 06:06:07.464467972 +0000 UTC m=+0.481122203 container init c2a821e66389d5c9bc72d2099f229d2df33b34eaae0528f454b5ee33aa64ed6b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10-deactivate, io.buildah.version=1.33.5, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, ceph=True, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-09T06:06:07.756 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:06:07 smithi060 podman[77380]: 2024-05-09 06:06:07.467714387 +0000 UTC m=+0.484368623 container start c2a821e66389d5c9bc72d2099f229d2df33b34eaae0528f454b5ee33aa64ed6b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10-deactivate, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=) 2024-05-09T06:06:07.756 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:06:07 smithi060 podman[77380]: 2024-05-09 06:06:07.547731002 +0000 UTC m=+0.564385231 container attach c2a821e66389d5c9bc72d2099f229d2df33b34eaae0528f454b5ee33aa64ed6b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10-deactivate, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-09T06:06:07.757 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 09 06:06:07 smithi060 podman[77380]: 2024-05-09 06:06:07.771286377 +0000 UTC m=+0.787940607 container died c2a821e66389d5c9bc72d2099f229d2df33b34eaae0528f454b5ee33aa64ed6b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-10-deactivate, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404) 2024-05-09T06:06:08.304 DEBUG:teuthology.orchestra.run.smithi060:> sudo pkill -f 'journalctl -f -n 0 -u ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@osd.10.service' 2024-05-09T06:06:08.347 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T06:06:08.348 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-05-09T06:06:08.348 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-05-09T06:06:08.348 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@osd.11 2024-05-09T06:06:08.665 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:08 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:06:08.343+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:40.939354+0000 front 2024-05-09T06:04:40.939391+0000 (oldest deadline 2024-05-09T06:05:06.239561+0000) 2024-05-09T06:06:08.665 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:08 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:06:08.343+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:49.140745+0000 front 2024-05-09T06:04:49.140702+0000 (oldest deadline 2024-05-09T06:05:15.040838+0000) 2024-05-09T06:06:08.666 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:08 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:06:08.343+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:04:58.542017+0000 front 2024-05-09T06:04:58.542182+0000 (oldest deadline 2024-05-09T06:05:22.042178+0000) 2024-05-09T06:06:08.666 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:08 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:06:08.343+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-09T06:05:13.045066+0000 front 2024-05-09T06:05:13.045200+0000 (oldest deadline 2024-05-09T06:05:38.345172+0000) 2024-05-09T06:06:08.666 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:08 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:06:08.343+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.100:6812 osd.5 since back 2024-05-09T06:05:20.546746+0000 front 2024-05-09T06:05:20.546809+0000 (oldest deadline 2024-05-09T06:05:51.147432+0000) 2024-05-09T06:06:08.666 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:08 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:06:08.343+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6822 osd.6 since back 2024-05-09T06:05:31.147887+0000 front 2024-05-09T06:05:31.147998+0000 (oldest deadline 2024-05-09T06:05:57.047898+0000) 2024-05-09T06:06:08.666 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:08 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:06:08.343+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.60:6820 osd.7 since back 2024-05-09T06:05:41.049707+0000 front 2024-05-09T06:05:41.049721+0000 (oldest deadline 2024-05-09T06:06:06.349743+0000) 2024-05-09T06:06:08.666 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:08 smithi100 systemd[1]: Stopping Ceph osd.11 for 86d4cc60-0dc4-11ef-bc97-c7b262605968... 2024-05-09T06:06:09.165 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:08 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:06:08.681+0000 7fa46ab00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T06:06:09.165 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:08 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:06:08.681+0000 7fa46ab00700 -1 osd.11 86 *** Got signal Terminated *** 2024-05-09T06:06:09.165 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:08 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:06:08.681+0000 7fa46ab00700 -1 osd.11 86 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-09T06:06:09.665 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:09 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:06:09.360+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:40.939354+0000 front 2024-05-09T06:04:40.939391+0000 (oldest deadline 2024-05-09T06:05:06.239561+0000) 2024-05-09T06:06:09.665 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:09 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:06:09.360+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:49.140745+0000 front 2024-05-09T06:04:49.140702+0000 (oldest deadline 2024-05-09T06:05:15.040838+0000) 2024-05-09T06:06:09.665 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:09 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:06:09.360+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:04:58.542017+0000 front 2024-05-09T06:04:58.542182+0000 (oldest deadline 2024-05-09T06:05:22.042178+0000) 2024-05-09T06:06:09.665 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:09 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:06:09.360+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-09T06:05:13.045066+0000 front 2024-05-09T06:05:13.045200+0000 (oldest deadline 2024-05-09T06:05:38.345172+0000) 2024-05-09T06:06:09.666 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:09 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:06:09.360+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.100:6812 osd.5 since back 2024-05-09T06:05:20.546746+0000 front 2024-05-09T06:05:20.546809+0000 (oldest deadline 2024-05-09T06:05:51.147432+0000) 2024-05-09T06:06:09.666 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:09 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:06:09.360+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6822 osd.6 since back 2024-05-09T06:05:31.147887+0000 front 2024-05-09T06:05:31.147998+0000 (oldest deadline 2024-05-09T06:05:57.047898+0000) 2024-05-09T06:06:09.666 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:09 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:06:09.360+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.60:6820 osd.7 since back 2024-05-09T06:05:41.049707+0000 front 2024-05-09T06:05:41.049721+0000 (oldest deadline 2024-05-09T06:06:06.349743+0000) 2024-05-09T06:06:10.665 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:10 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:06:10.385+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:40.939354+0000 front 2024-05-09T06:04:40.939391+0000 (oldest deadline 2024-05-09T06:05:06.239561+0000) 2024-05-09T06:06:10.666 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:10 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:06:10.385+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:49.140745+0000 front 2024-05-09T06:04:49.140702+0000 (oldest deadline 2024-05-09T06:05:15.040838+0000) 2024-05-09T06:06:10.666 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:10 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:06:10.385+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:04:58.542017+0000 front 2024-05-09T06:04:58.542182+0000 (oldest deadline 2024-05-09T06:05:22.042178+0000) 2024-05-09T06:06:10.666 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:10 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:06:10.385+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-09T06:05:13.045066+0000 front 2024-05-09T06:05:13.045200+0000 (oldest deadline 2024-05-09T06:05:38.345172+0000) 2024-05-09T06:06:10.666 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:10 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:06:10.385+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.100:6812 osd.5 since back 2024-05-09T06:05:20.546746+0000 front 2024-05-09T06:05:20.546809+0000 (oldest deadline 2024-05-09T06:05:51.147432+0000) 2024-05-09T06:06:10.666 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:10 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:06:10.385+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6822 osd.6 since back 2024-05-09T06:05:31.147887+0000 front 2024-05-09T06:05:31.147998+0000 (oldest deadline 2024-05-09T06:05:57.047898+0000) 2024-05-09T06:06:10.666 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:10 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:06:10.385+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.60:6820 osd.7 since back 2024-05-09T06:05:41.049707+0000 front 2024-05-09T06:05:41.049721+0000 (oldest deadline 2024-05-09T06:06:06.349743+0000) 2024-05-09T06:06:11.665 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:11 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:06:11.388+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:40.939354+0000 front 2024-05-09T06:04:40.939391+0000 (oldest deadline 2024-05-09T06:05:06.239561+0000) 2024-05-09T06:06:11.665 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:11 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:06:11.389+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:49.140745+0000 front 2024-05-09T06:04:49.140702+0000 (oldest deadline 2024-05-09T06:05:15.040838+0000) 2024-05-09T06:06:11.666 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:11 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:06:11.389+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:04:58.542017+0000 front 2024-05-09T06:04:58.542182+0000 (oldest deadline 2024-05-09T06:05:22.042178+0000) 2024-05-09T06:06:11.666 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:11 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:06:11.389+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-09T06:05:13.045066+0000 front 2024-05-09T06:05:13.045200+0000 (oldest deadline 2024-05-09T06:05:38.345172+0000) 2024-05-09T06:06:11.666 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:11 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:06:11.389+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.100:6812 osd.5 since back 2024-05-09T06:05:20.546746+0000 front 2024-05-09T06:05:20.546809+0000 (oldest deadline 2024-05-09T06:05:51.147432+0000) 2024-05-09T06:06:11.666 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:11 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:06:11.389+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6822 osd.6 since back 2024-05-09T06:05:31.147887+0000 front 2024-05-09T06:05:31.147998+0000 (oldest deadline 2024-05-09T06:05:57.047898+0000) 2024-05-09T06:06:11.666 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:11 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:06:11.389+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.60:6820 osd.7 since back 2024-05-09T06:05:41.049707+0000 front 2024-05-09T06:05:41.049721+0000 (oldest deadline 2024-05-09T06:06:06.349743+0000) 2024-05-09T06:06:12.918 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:12 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:06:12.430+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:40.939354+0000 front 2024-05-09T06:04:40.939391+0000 (oldest deadline 2024-05-09T06:05:06.239561+0000) 2024-05-09T06:06:12.918 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:12 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:06:12.430+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:49.140745+0000 front 2024-05-09T06:04:49.140702+0000 (oldest deadline 2024-05-09T06:05:15.040838+0000) 2024-05-09T06:06:12.918 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:12 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:06:12.430+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:04:58.542017+0000 front 2024-05-09T06:04:58.542182+0000 (oldest deadline 2024-05-09T06:05:22.042178+0000) 2024-05-09T06:06:12.918 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:12 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:06:12.430+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-09T06:05:13.045066+0000 front 2024-05-09T06:05:13.045200+0000 (oldest deadline 2024-05-09T06:05:38.345172+0000) 2024-05-09T06:06:12.918 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:12 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:06:12.430+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.100:6812 osd.5 since back 2024-05-09T06:05:20.546746+0000 front 2024-05-09T06:05:20.546809+0000 (oldest deadline 2024-05-09T06:05:51.147432+0000) 2024-05-09T06:06:12.918 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:12 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:06:12.430+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6822 osd.6 since back 2024-05-09T06:05:31.147887+0000 front 2024-05-09T06:05:31.147998+0000 (oldest deadline 2024-05-09T06:05:57.047898+0000) 2024-05-09T06:06:12.918 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:12 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:06:12.430+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.60:6820 osd.7 since back 2024-05-09T06:05:41.049707+0000 front 2024-05-09T06:05:41.049721+0000 (oldest deadline 2024-05-09T06:06:06.349743+0000) 2024-05-09T06:06:13.665 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:13 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:06:13.419+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6806 osd.0 since back 2024-05-09T06:04:40.939354+0000 front 2024-05-09T06:04:40.939391+0000 (oldest deadline 2024-05-09T06:05:06.239561+0000) 2024-05-09T06:06:13.666 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:13 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:06:13.419+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-09T06:04:49.140745+0000 front 2024-05-09T06:04:49.140702+0000 (oldest deadline 2024-05-09T06:05:15.040838+0000) 2024-05-09T06:06:13.666 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:13 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:06:13.419+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.100:6804 osd.2 since back 2024-05-09T06:04:58.542017+0000 front 2024-05-09T06:04:58.542182+0000 (oldest deadline 2024-05-09T06:05:22.042178+0000) 2024-05-09T06:06:13.666 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:13 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:06:13.419+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-09T06:05:13.045066+0000 front 2024-05-09T06:05:13.045200+0000 (oldest deadline 2024-05-09T06:05:38.345172+0000) 2024-05-09T06:06:13.666 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:13 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:06:13.419+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.100:6812 osd.5 since back 2024-05-09T06:05:20.546746+0000 front 2024-05-09T06:05:20.546809+0000 (oldest deadline 2024-05-09T06:05:51.147432+0000) 2024-05-09T06:06:13.666 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:13 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:06:13.419+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.39:6822 osd.6 since back 2024-05-09T06:05:31.147887+0000 front 2024-05-09T06:05:31.147998+0000 (oldest deadline 2024-05-09T06:05:57.047898+0000) 2024-05-09T06:06:13.666 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:13 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:06:13.419+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.60:6820 osd.7 since back 2024-05-09T06:05:41.049707+0000 front 2024-05-09T06:05:41.049721+0000 (oldest deadline 2024-05-09T06:06:06.349743+0000) 2024-05-09T06:06:13.666 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:13 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11[60095]: 2024-05-09T06:06:13.419+0000 7fa4670b6700 -1 osd.11 86 heartbeat_check: no reply from 172.21.15.100:6820 osd.8 since back 2024-05-09T06:05:48.050610+0000 front 2024-05-09T06:05:48.050585+0000 (oldest deadline 2024-05-09T06:06:12.750621+0000) 2024-05-09T06:06:14.415 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:14 smithi100 podman[77234]: 2024-05-09 06:06:14.167877672 +0000 UTC m=+5.612583818 container died 7d69d998368ab62a8ba2a4b5539657a50563020130094eb5e6d55acfb0e31036 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD) 2024-05-09T06:06:14.784 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:14 smithi100 podman[77234]: 2024-05-09 06:06:14.531834179 +0000 UTC m=+5.976540336 container cleanup 7d69d998368ab62a8ba2a4b5539657a50563020130094eb5e6d55acfb0e31036 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-05-09T06:06:14.785 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:14 smithi100 bash[77234]: ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11 2024-05-09T06:06:15.135 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:14 smithi100 podman[77263]: 2024-05-09 06:06:14.799966704 +0000 UTC m=+0.629934422 container remove 7d69d998368ab62a8ba2a4b5539657a50563020130094eb5e6d55acfb0e31036 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-05-09T06:06:15.413 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:15 smithi100 podman[77354]: 2024-05-09 06:06:15.053807781 +0000 UTC m=+0.018013421 image pull db794d706f492c144ccc8f2c5bbc1870e116f5c4f3309dfab4416b39d099f8d7 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584 2024-05-09T06:06:15.413 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:15 smithi100 podman[77354]: 2024-05-09 06:06:15.158965318 +0000 UTC m=+0.123170958 container create 5191aff64f13def944c1b8b4107f3d3b17cf1690dead38a46f1054d3bd7a0430 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11-deactivate, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-05-09T06:06:15.413 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:15 smithi100 podman[77354]: 2024-05-09 06:06:15.352978529 +0000 UTC m=+0.317184169 container init 5191aff64f13def944c1b8b4107f3d3b17cf1690dead38a46f1054d3bd7a0430 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11-deactivate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507) 2024-05-09T06:06:15.413 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:15 smithi100 podman[77354]: 2024-05-09 06:06:15.356340316 +0000 UTC m=+0.320545957 container start 5191aff64f13def944c1b8b4107f3d3b17cf1690dead38a46f1054d3bd7a0430 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.build-date=20240507) 2024-05-09T06:06:15.413 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:15 smithi100 podman[77354]: 2024-05-09 06:06:15.428029354 +0000 UTC m=+0.392235014 container attach 5191aff64f13def944c1b8b4107f3d3b17cf1690dead38a46f1054d3bd7a0430 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11-deactivate, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-05-09T06:06:15.665 INFO:journalctl@ceph.osd.11.smithi100.stdout:May 09 06:06:15 smithi100 podman[77354]: 2024-05-09 06:06:15.6483379 +0000 UTC m=+0.612543541 container died 5191aff64f13def944c1b8b4107f3d3b17cf1690dead38a46f1054d3bd7a0430 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-osd-11-deactivate, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240507) 2024-05-09T06:06:16.204 DEBUG:teuthology.orchestra.run.smithi100:> sudo pkill -f 'journalctl -f -n 0 -u ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@osd.11.service' 2024-05-09T06:06:16.242 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T06:06:16.242 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-05-09T06:06:16.243 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-05-09T06:06:16.243 DEBUG:teuthology.orchestra.run.smithi039:> sudo systemctl stop ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@mds.a 2024-05-09T06:06:16.541 INFO:journalctl@ceph.mds.a.smithi039.stdout:May 09 06:06:16 smithi039 systemd[1]: Stopping Ceph mds.a for 86d4cc60-0dc4-11ef-bc97-c7b262605968... 2024-05-09T06:06:16.852 INFO:journalctl@ceph.mds.a.smithi039.stdout:May 09 06:06:16 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-a[70626]: 2024-05-09T06:06:16.555+0000 7f196a769700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T06:06:16.852 INFO:journalctl@ceph.mds.a.smithi039.stdout:May 09 06:06:16 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-a[70626]: 2024-05-09T06:06:16.555+0000 7f196a769700 -1 mds.a *** got signal Terminated *** 2024-05-09T06:06:20.824 INFO:journalctl@ceph.mds.a.smithi039.stdout:May 09 06:06:20 smithi039 podman[95407]: 2024-05-09 06:06:20.56938301 +0000 UTC m=+4.104597913 container died fe69fbfa83014e3196771bb493975a5f1d7ab8b702e96339a8390fdad2b71510 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-a, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, ceph=True, maintainer=Guillaume Abrioux ) 2024-05-09T06:06:21.102 INFO:journalctl@ceph.mds.a.smithi039.stdout:May 09 06:06:20 smithi039 podman[95407]: 2024-05-09 06:06:20.930392921 +0000 UTC m=+4.465607824 container cleanup fe69fbfa83014e3196771bb493975a5f1d7ab8b702e96339a8390fdad2b71510 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-a, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux ) 2024-05-09T06:06:21.102 INFO:journalctl@ceph.mds.a.smithi039.stdout:May 09 06:06:20 smithi039 bash[95407]: ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-a 2024-05-09T06:06:21.354 DEBUG:teuthology.orchestra.run.smithi039:> sudo pkill -f 'journalctl -f -n 0 -u ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@mds.a.service' 2024-05-09T06:06:21.390 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T06:06:21.391 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-05-09T06:06:21.391 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-05-09T06:06:21.391 DEBUG:teuthology.orchestra.run.smithi039:> sudo systemctl stop ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@mds.d 2024-05-09T06:06:21.728 INFO:journalctl@ceph.mds.d.smithi039.stdout:May 09 06:06:21 smithi039 systemd[1]: Stopping Ceph mds.d for 86d4cc60-0dc4-11ef-bc97-c7b262605968... 2024-05-09T06:06:22.102 INFO:journalctl@ceph.mds.d.smithi039.stdout:May 09 06:06:21 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-d[69318]: 2024-05-09T06:06:21.742+0000 7f78799ea700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T06:06:22.102 INFO:journalctl@ceph.mds.d.smithi039.stdout:May 09 06:06:21 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-d[69318]: 2024-05-09T06:06:21.742+0000 7f78799ea700 -1 mds.d *** got signal Terminated *** 2024-05-09T06:06:23.504 INFO:journalctl@ceph.mds.d.smithi039.stdout:May 09 06:06:23 smithi039 podman[95529]: 2024-05-09 06:06:23.231521624 +0000 UTC m=+1.598258190 container died 2410ecfd9100f0ce16f1754dd77b5889844dfa40af91fc879a5b5f5cf37521f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-d, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-05-09T06:06:23.837 INFO:journalctl@ceph.mds.d.smithi039.stdout:May 09 06:06:23 smithi039 podman[95529]: 2024-05-09 06:06:23.618120317 +0000 UTC m=+1.984856888 container cleanup 2410ecfd9100f0ce16f1754dd77b5889844dfa40af91fc879a5b5f5cf37521f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-d, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-05-09T06:06:23.837 INFO:journalctl@ceph.mds.d.smithi039.stdout:May 09 06:06:23 smithi039 bash[95529]: ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-d 2024-05-09T06:06:23.955 DEBUG:teuthology.orchestra.run.smithi039:> sudo pkill -f 'journalctl -f -n 0 -u ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@mds.d.service' 2024-05-09T06:06:23.989 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T06:06:23.989 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-05-09T06:06:23.990 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-05-09T06:06:23.990 DEBUG:teuthology.orchestra.run.smithi039:> sudo systemctl stop ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@mds.g 2024-05-09T06:06:24.101 INFO:journalctl@ceph.mds.g.smithi039.stdout:May 09 06:06:24 smithi039 systemd[1]: Stopping Ceph mds.g for 86d4cc60-0dc4-11ef-bc97-c7b262605968... 2024-05-09T06:06:24.602 INFO:journalctl@ceph.mds.g.smithi039.stdout:May 09 06:06:24 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-g[70158]: 2024-05-09T06:06:24.312+0000 7f3508e03700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T06:06:24.602 INFO:journalctl@ceph.mds.g.smithi039.stdout:May 09 06:06:24 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-g[70158]: 2024-05-09T06:06:24.312+0000 7f3508e03700 -1 mds.g *** got signal Terminated *** 2024-05-09T06:06:28.590 INFO:journalctl@ceph.mds.g.smithi039.stdout:May 09 06:06:28 smithi039 podman[95650]: 2024-05-09 06:06:28.326439515 +0000 UTC m=+4.100363755 container died e4dec390d7b56b1aae24dcde565b1a630f79b745615fdc855bcc01e179947425 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-g, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-09T06:06:28.851 INFO:journalctl@ceph.mds.g.smithi039.stdout:May 09 06:06:28 smithi039 podman[95650]: 2024-05-09 06:06:28.704982251 +0000 UTC m=+4.478906466 container cleanup e4dec390d7b56b1aae24dcde565b1a630f79b745615fdc855bcc01e179947425 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-g, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-09T06:06:28.852 INFO:journalctl@ceph.mds.g.smithi039.stdout:May 09 06:06:28 smithi039 bash[95650]: ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-g 2024-05-09T06:06:29.125 DEBUG:teuthology.orchestra.run.smithi039:> sudo pkill -f 'journalctl -f -n 0 -u ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@mds.g.service' 2024-05-09T06:06:29.158 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T06:06:29.159 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-05-09T06:06:29.159 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-05-09T06:06:29.159 DEBUG:teuthology.orchestra.run.smithi039:> sudo systemctl stop ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@mds.j 2024-05-09T06:06:29.502 INFO:journalctl@ceph.mds.j.smithi039.stdout:May 09 06:06:29 smithi039 systemd[1]: Stopping Ceph mds.j for 86d4cc60-0dc4-11ef-bc97-c7b262605968... 2024-05-09T06:06:29.851 INFO:journalctl@ceph.mds.j.smithi039.stdout:May 09 06:06:29 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-j[68891]: 2024-05-09T06:06:29.516+0000 7f96188be700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T06:06:29.852 INFO:journalctl@ceph.mds.j.smithi039.stdout:May 09 06:06:29 smithi039 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-j[68891]: 2024-05-09T06:06:29.516+0000 7f96188be700 -1 mds.j *** got signal Terminated *** 2024-05-09T06:06:31.803 INFO:journalctl@ceph.mds.j.smithi039.stdout:May 09 06:06:31 smithi039 podman[95770]: 2024-05-09 06:06:31.557030726 +0000 UTC m=+2.149005526 container died 52f6adc11bbf171ec735ea84f571960aeb386a4ae16abdc3bd0f24d328ea2cd8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-j, ceph=True, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-05-09T06:06:32.054 INFO:journalctl@ceph.mds.j.smithi039.stdout:May 09 06:06:31 smithi039 podman[95770]: 2024-05-09 06:06:31.884072387 +0000 UTC m=+2.476047185 container cleanup 52f6adc11bbf171ec735ea84f571960aeb386a4ae16abdc3bd0f24d328ea2cd8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-j, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-09T06:06:32.054 INFO:journalctl@ceph.mds.j.smithi039.stdout:May 09 06:06:31 smithi039 bash[95770]: ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-j 2024-05-09T06:06:32.054 INFO:journalctl@ceph.mds.j.smithi039.stdout:May 09 06:06:32 smithi039 podman[95796]: 2024-05-09 06:06:32.068358221 +0000 UTC m=+0.508015874 container remove 52f6adc11bbf171ec735ea84f571960aeb386a4ae16abdc3bd0f24d328ea2cd8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-j, ceph=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-09T06:06:32.297 DEBUG:teuthology.orchestra.run.smithi039:> sudo pkill -f 'journalctl -f -n 0 -u ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@mds.j.service' 2024-05-09T06:06:32.321 INFO:journalctl@ceph.mds.j.smithi039.stdout:May 09 06:06:32 smithi039 systemd[1]: ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@mds.j.service: Deactivated successfully. 2024-05-09T06:06:32.321 INFO:journalctl@ceph.mds.j.smithi039.stdout:May 09 06:06:32 smithi039 systemd[1]: Stopped Ceph mds.j for 86d4cc60-0dc4-11ef-bc97-c7b262605968. 2024-05-09T06:06:32.321 INFO:journalctl@ceph.mds.j.smithi039.stdout:May 09 06:06:32 smithi039 systemd[1]: ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@mds.j.service: Consumed 1.254s CPU time. 2024-05-09T06:06:32.334 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T06:06:32.334 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-05-09T06:06:32.334 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-05-09T06:06:32.334 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@mds.b 2024-05-09T06:06:32.645 INFO:journalctl@ceph.mds.b.smithi060.stdout:May 09 06:06:32 smithi060 systemd[1]: Stopping Ceph mds.b for 86d4cc60-0dc4-11ef-bc97-c7b262605968... 2024-05-09T06:06:33.038 INFO:journalctl@ceph.mds.b.smithi060.stdout:May 09 06:06:32 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-b[64794]: 2024-05-09T06:06:32.659+0000 7fe8b6c8d700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T06:06:33.038 INFO:journalctl@ceph.mds.b.smithi060.stdout:May 09 06:06:32 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-b[64794]: 2024-05-09T06:06:32.659+0000 7fe8b6c8d700 -1 mds.b *** got signal Terminated *** 2024-05-09T06:06:34.288 INFO:journalctl@ceph.mds.b.smithi060.stdout:May 09 06:06:34 smithi060 podman[77486]: 2024-05-09 06:06:34.012515925 +0000 UTC m=+1.459520734 container died 8d92a93d8766391fccd4c9ed69d65bac62caea21649cfd40081c62cfeb2e2182 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-b, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5) 2024-05-09T06:06:34.754 INFO:journalctl@ceph.mds.b.smithi060.stdout:May 09 06:06:34 smithi060 podman[77486]: 2024-05-09 06:06:34.526827402 +0000 UTC m=+1.973832211 container cleanup 8d92a93d8766391fccd4c9ed69d65bac62caea21649cfd40081c62cfeb2e2182 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-b, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-05-09T06:06:34.754 INFO:journalctl@ceph.mds.b.smithi060.stdout:May 09 06:06:34 smithi060 bash[77486]: ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-b 2024-05-09T06:06:34.924 DEBUG:teuthology.orchestra.run.smithi060:> sudo pkill -f 'journalctl -f -n 0 -u ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@mds.b.service' 2024-05-09T06:06:34.964 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T06:06:34.965 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-05-09T06:06:34.965 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-05-09T06:06:34.965 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@mds.e 2024-05-09T06:06:35.288 INFO:journalctl@ceph.mds.e.smithi060.stdout:May 09 06:06:35 smithi060 systemd[1]: Stopping Ceph mds.e for 86d4cc60-0dc4-11ef-bc97-c7b262605968... 2024-05-09T06:06:35.788 INFO:journalctl@ceph.mds.e.smithi060.stdout:May 09 06:06:35 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-e[64178]: 2024-05-09T06:06:35.421+0000 7ff6af29e700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T06:06:35.788 INFO:journalctl@ceph.mds.e.smithi060.stdout:May 09 06:06:35 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-e[64178]: 2024-05-09T06:06:35.421+0000 7ff6af29e700 -1 mds.e *** got signal Terminated *** 2024-05-09T06:06:38.288 INFO:journalctl@ceph.mds.e.smithi060.stdout:May 09 06:06:38 smithi060 podman[77618]: 2024-05-09 06:06:38.011510798 +0000 UTC m=+2.811081379 container died 9ab439eb840f02a51077d45daf6ee945409bec2a64a4724b1a079799c545b471 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-e, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-09T06:06:38.616 INFO:journalctl@ceph.mds.e.smithi060.stdout:May 09 06:06:38 smithi060 podman[77618]: 2024-05-09 06:06:38.422345097 +0000 UTC m=+3.221915670 container cleanup 9ab439eb840f02a51077d45daf6ee945409bec2a64a4724b1a079799c545b471 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-e, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404) 2024-05-09T06:06:38.616 INFO:journalctl@ceph.mds.e.smithi060.stdout:May 09 06:06:38 smithi060 bash[77618]: ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-e 2024-05-09T06:06:38.843 DEBUG:teuthology.orchestra.run.smithi060:> sudo pkill -f 'journalctl -f -n 0 -u ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@mds.e.service' 2024-05-09T06:06:38.867 INFO:journalctl@ceph.mds.e.smithi060.stdout:May 09 06:06:38 smithi060 podman[77632]: 2024-05-09 06:06:38.631745122 +0000 UTC m=+0.612725461 container remove 9ab439eb840f02a51077d45daf6ee945409bec2a64a4724b1a079799c545b471 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-e, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-05-09T06:06:38.867 INFO:journalctl@ceph.mds.e.smithi060.stdout:May 09 06:06:38 smithi060 systemd[1]: ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@mds.e.service: Deactivated successfully. 2024-05-09T06:06:38.867 INFO:journalctl@ceph.mds.e.smithi060.stdout:May 09 06:06:38 smithi060 systemd[1]: Stopped Ceph mds.e for 86d4cc60-0dc4-11ef-bc97-c7b262605968. 2024-05-09T06:06:38.867 INFO:journalctl@ceph.mds.e.smithi060.stdout:May 09 06:06:38 smithi060 systemd[1]: ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@mds.e.service: Consumed 11.619s CPU time. 2024-05-09T06:06:38.879 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T06:06:38.879 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-05-09T06:06:38.879 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-05-09T06:06:38.879 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@mds.h 2024-05-09T06:06:39.211 INFO:journalctl@ceph.mds.h.smithi060.stdout:May 09 06:06:38 smithi060 systemd[1]: Stopping Ceph mds.h for 86d4cc60-0dc4-11ef-bc97-c7b262605968... 2024-05-09T06:06:39.538 INFO:journalctl@ceph.mds.h.smithi060.stdout:May 09 06:06:39 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-h[64484]: 2024-05-09T06:06:39.225+0000 7ff54df7f700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T06:06:39.538 INFO:journalctl@ceph.mds.h.smithi060.stdout:May 09 06:06:39 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-h[64484]: 2024-05-09T06:06:39.225+0000 7ff54df7f700 -1 mds.h *** got signal Terminated *** 2024-05-09T06:06:42.288 INFO:journalctl@ceph.mds.h.smithi060.stdout:May 09 06:06:42 smithi060 podman[77741]: 2024-05-09 06:06:42.018579341 +0000 UTC m=+2.896964870 container died fa9e0675f81c3595d3368ec218aafbb9549d1a89125fc4087d99317bcf16399b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-h, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux ) 2024-05-09T06:06:42.620 INFO:journalctl@ceph.mds.h.smithi060.stdout:May 09 06:06:42 smithi060 podman[77741]: 2024-05-09 06:06:42.417558653 +0000 UTC m=+3.295944171 container cleanup fa9e0675f81c3595d3368ec218aafbb9549d1a89125fc4087d99317bcf16399b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-h, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2) 2024-05-09T06:06:42.620 INFO:journalctl@ceph.mds.h.smithi060.stdout:May 09 06:06:42 smithi060 bash[77741]: ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-h 2024-05-09T06:06:42.764 DEBUG:teuthology.orchestra.run.smithi060:> sudo pkill -f 'journalctl -f -n 0 -u ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@mds.h.service' 2024-05-09T06:06:42.798 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T06:06:42.798 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-05-09T06:06:42.798 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-05-09T06:06:42.798 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@mds.k 2024-05-09T06:06:43.131 INFO:journalctl@ceph.mds.k.smithi060.stdout:May 09 06:06:42 smithi060 systemd[1]: Stopping Ceph mds.k for 86d4cc60-0dc4-11ef-bc97-c7b262605968... 2024-05-09T06:06:43.538 INFO:journalctl@ceph.mds.k.smithi060.stdout:May 09 06:06:43 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-k[63858]: 2024-05-09T06:06:43.145+0000 7fbf59536700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T06:06:43.538 INFO:journalctl@ceph.mds.k.smithi060.stdout:May 09 06:06:43 smithi060 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-k[63858]: 2024-05-09T06:06:43.145+0000 7fbf59536700 -1 mds.k *** got signal Terminated *** 2024-05-09T06:06:47.538 INFO:journalctl@ceph.mds.k.smithi060.stdout:May 09 06:06:47 smithi060 podman[77864]: 2024-05-09 06:06:47.157939787 +0000 UTC m=+4.120871714 container died af347e184d3292cc764784ee97f3e39a51e637299d6ca2022801eed007549984 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-k, io.buildah.version=1.33.5, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-05-09T06:06:47.856 INFO:journalctl@ceph.mds.k.smithi060.stdout:May 09 06:06:47 smithi060 podman[77864]: 2024-05-09 06:06:47.620975595 +0000 UTC m=+4.583907524 container cleanup af347e184d3292cc764784ee97f3e39a51e637299d6ca2022801eed007549984 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-k, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-05-09T06:06:47.856 INFO:journalctl@ceph.mds.k.smithi060.stdout:May 09 06:06:47 smithi060 bash[77864]: ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-k 2024-05-09T06:06:47.980 DEBUG:teuthology.orchestra.run.smithi060:> sudo pkill -f 'journalctl -f -n 0 -u ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@mds.k.service' 2024-05-09T06:06:48.012 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T06:06:48.012 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-05-09T06:06:48.012 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-05-09T06:06:48.013 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@mds.c 2024-05-09T06:06:48.301 INFO:journalctl@ceph.mds.c.smithi100.stdout:May 09 06:06:48 smithi100 systemd[1]: Stopping Ceph mds.c for 86d4cc60-0dc4-11ef-bc97-c7b262605968... 2024-05-09T06:06:48.665 INFO:journalctl@ceph.mds.c.smithi100.stdout:May 09 06:06:48 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-c[65236]: 2024-05-09T06:06:48.315+0000 7f5eeca82700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T06:06:48.665 INFO:journalctl@ceph.mds.c.smithi100.stdout:May 09 06:06:48 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-c[65236]: 2024-05-09T06:06:48.315+0000 7f5eeca82700 -1 mds.c *** got signal Terminated *** 2024-05-09T06:06:50.210 INFO:journalctl@ceph.mds.c.smithi100.stdout:May 09 06:06:49 smithi100 podman[77459]: 2024-05-09 06:06:49.952863981 +0000 UTC m=+1.734812377 container died 3d9f81982fde83d301e2f1e9a3871af0de977636cc6e6860786bb2d3c73929e2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-c, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-05-09T06:06:50.601 INFO:journalctl@ceph.mds.c.smithi100.stdout:May 09 06:06:50 smithi100 podman[77459]: 2024-05-09 06:06:50.324411068 +0000 UTC m=+2.106359450 container cleanup 3d9f81982fde83d301e2f1e9a3871af0de977636cc6e6860786bb2d3c73929e2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-c, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0) 2024-05-09T06:06:50.602 INFO:journalctl@ceph.mds.c.smithi100.stdout:May 09 06:06:50 smithi100 bash[77459]: ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-c 2024-05-09T06:06:50.735 DEBUG:teuthology.orchestra.run.smithi100:> sudo pkill -f 'journalctl -f -n 0 -u ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@mds.c.service' 2024-05-09T06:06:50.769 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T06:06:50.770 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-05-09T06:06:50.770 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-05-09T06:06:50.770 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@mds.f 2024-05-09T06:06:51.165 INFO:journalctl@ceph.mds.f.smithi100.stdout:May 09 06:06:50 smithi100 systemd[1]: Stopping Ceph mds.f for 86d4cc60-0dc4-11ef-bc97-c7b262605968... 2024-05-09T06:06:51.165 INFO:journalctl@ceph.mds.f.smithi100.stdout:May 09 06:06:51 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-f[64933]: 2024-05-09T06:06:51.110+0000 7f4691f6d700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T06:06:51.165 INFO:journalctl@ceph.mds.f.smithi100.stdout:May 09 06:06:51 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-f[64933]: 2024-05-09T06:06:51.110+0000 7f4691f6d700 -1 mds.f *** got signal Terminated *** 2024-05-09T06:06:54.222 INFO:journalctl@ceph.mds.f.smithi100.stdout:May 09 06:06:53 smithi100 podman[77594]: 2024-05-09 06:06:53.957752941 +0000 UTC m=+2.951638691 container died 78de515fbc7a1d4c2248e38bec743485c41d83bf896a5d4ec26095977235e930 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-f, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True) 2024-05-09T06:06:54.658 INFO:journalctl@ceph.mds.f.smithi100.stdout:May 09 06:06:54 smithi100 podman[77594]: 2024-05-09 06:06:54.338466318 +0000 UTC m=+3.332352077 container cleanup 78de515fbc7a1d4c2248e38bec743485c41d83bf896a5d4ec26095977235e930 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-f, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-09T06:06:54.658 INFO:journalctl@ceph.mds.f.smithi100.stdout:May 09 06:06:54 smithi100 bash[77594]: ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-f 2024-05-09T06:06:54.796 DEBUG:teuthology.orchestra.run.smithi100:> sudo pkill -f 'journalctl -f -n 0 -u ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@mds.f.service' 2024-05-09T06:06:54.829 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T06:06:54.829 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-05-09T06:06:54.830 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-05-09T06:06:54.830 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@mds.i 2024-05-09T06:06:55.415 INFO:journalctl@ceph.mds.i.smithi100.stdout:May 09 06:06:54 smithi100 systemd[1]: Stopping Ceph mds.i for 86d4cc60-0dc4-11ef-bc97-c7b262605968... 2024-05-09T06:06:55.415 INFO:journalctl@ceph.mds.i.smithi100.stdout:May 09 06:06:55 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-i[65548]: 2024-05-09T06:06:55.175+0000 7f88d096f700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T06:06:55.415 INFO:journalctl@ceph.mds.i.smithi100.stdout:May 09 06:06:55 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-i[65548]: 2024-05-09T06:06:55.175+0000 7f88d096f700 -1 mds.i *** got signal Terminated *** 2024-05-09T06:06:58.219 INFO:journalctl@ceph.mds.i.smithi100.stdout:May 09 06:06:57 smithi100 podman[77715]: 2024-05-09 06:06:57.956786164 +0000 UTC m=+2.887537517 container died 8f96def255822fc7888e8830a1fbb4e70919f6ef8a1f4cd0a3273f766f68b806 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-i, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-09T06:06:58.569 INFO:journalctl@ceph.mds.i.smithi100.stdout:May 09 06:06:58 smithi100 podman[77715]: 2024-05-09 06:06:58.317345152 +0000 UTC m=+3.248096513 container cleanup 8f96def255822fc7888e8830a1fbb4e70919f6ef8a1f4cd0a3273f766f68b806 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-i, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240507, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404) 2024-05-09T06:06:58.569 INFO:journalctl@ceph.mds.i.smithi100.stdout:May 09 06:06:58 smithi100 bash[77715]: ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-i 2024-05-09T06:06:58.725 DEBUG:teuthology.orchestra.run.smithi100:> sudo pkill -f 'journalctl -f -n 0 -u ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@mds.i.service' 2024-05-09T06:06:58.756 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T06:06:58.756 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-05-09T06:06:58.756 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-05-09T06:06:58.757 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@mds.l 2024-05-09T06:06:59.165 INFO:journalctl@ceph.mds.l.smithi100.stdout:May 09 06:06:58 smithi100 systemd[1]: Stopping Ceph mds.l for 86d4cc60-0dc4-11ef-bc97-c7b262605968... 2024-05-09T06:06:59.165 INFO:journalctl@ceph.mds.l.smithi100.stdout:May 09 06:06:59 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-l[64627]: 2024-05-09T06:06:59.070+0000 7f605b9fa700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T06:06:59.166 INFO:journalctl@ceph.mds.l.smithi100.stdout:May 09 06:06:59 smithi100 ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-l[64627]: 2024-05-09T06:06:59.070+0000 7f605b9fa700 -1 mds.l *** got signal Terminated *** 2024-05-09T06:07:00.606 INFO:journalctl@ceph.mds.l.smithi100.stdout:May 09 06:07:00 smithi100 podman[77834]: 2024-05-09 06:07:00.350614971 +0000 UTC m=+1.360839576 container died 18ebd9304fb6e4f9170dcedca2818f997f71f9e43fe2cbada55b07a542b5753d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-l, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-05-09T06:07:00.863 INFO:journalctl@ceph.mds.l.smithi100.stdout:May 09 06:07:00 smithi100 podman[77834]: 2024-05-09 06:07:00.712984165 +0000 UTC m=+1.723208800 container cleanup 18ebd9304fb6e4f9170dcedca2818f997f71f9e43fe2cbada55b07a542b5753d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ef3f584d871dd6119fe1ccb29d0b8b624ec6e3462fcf3f49b8c928dd6ba67584, name=ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-l, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240508.183908-debug-c9da404, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True) 2024-05-09T06:07:00.863 INFO:journalctl@ceph.mds.l.smithi100.stdout:May 09 06:07:00 smithi100 bash[77834]: ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968-mds-l 2024-05-09T06:07:01.083 DEBUG:teuthology.orchestra.run.smithi100:> sudo pkill -f 'journalctl -f -n 0 -u ceph-86d4cc60-0dc4-11ef-bc97-c7b262605968@mds.l.service' 2024-05-09T06:07:01.113 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T06:07:01.113 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-05-09T06:07:01.114 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 --force --keep-logs 2024-05-09T06:07:01.316 INFO:teuthology.orchestra.run.smithi039.stdout:Deleting cluster with fsid: 86d4cc60-0dc4-11ef-bc97-c7b262605968 2024-05-09T06:07:03.971 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 --force --keep-logs 2024-05-09T06:07:04.170 INFO:teuthology.orchestra.run.smithi060.stdout:Deleting cluster with fsid: 86d4cc60-0dc4-11ef-bc97-c7b262605968 2024-05-09T06:07:06.843 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 --force --keep-logs 2024-05-09T06:07:07.030 INFO:teuthology.orchestra.run.smithi100.stdout:Deleting cluster with fsid: 86d4cc60-0dc4-11ef-bc97-c7b262605968 2024-05-09T06:07:09.387 DEBUG:teuthology.orchestra.run.smithi039:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-09T06:07:09.422 DEBUG:teuthology.orchestra.run.smithi060:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-09T06:07:09.455 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-09T06:07:09.481 INFO:tasks.cephadm:Archiving crash dumps... 2024-05-09T06:07:09.483 DEBUG:teuthology.misc:Transferring archived files from smithi039:/var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/crash to /home/teuthworker/archive/pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi/7699118/remote/smithi039/crash 2024-05-09T06:07:09.483 DEBUG:teuthology.orchestra.run.smithi039:> sudo tar c -f - -C /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/crash -- . 2024-05-09T06:07:09.523 INFO:teuthology.orchestra.run.smithi039.stderr:tar: /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/crash: Cannot open: No such file or directory 2024-05-09T06:07:09.524 INFO:teuthology.orchestra.run.smithi039.stderr:tar: Error is not recoverable: exiting now 2024-05-09T06:07:09.526 DEBUG:teuthology.misc:Transferring archived files from smithi060:/var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/crash to /home/teuthworker/archive/pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi/7699118/remote/smithi060/crash 2024-05-09T06:07:09.526 DEBUG:teuthology.orchestra.run.smithi060:> sudo tar c -f - -C /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/crash -- . 2024-05-09T06:07:09.566 INFO:teuthology.orchestra.run.smithi060.stderr:tar: /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/crash: Cannot open: No such file or directory 2024-05-09T06:07:09.566 INFO:teuthology.orchestra.run.smithi060.stderr:tar: Error is not recoverable: exiting now 2024-05-09T06:07:09.568 DEBUG:teuthology.misc:Transferring archived files from smithi100:/var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/crash to /home/teuthworker/archive/pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi/7699118/remote/smithi100/crash 2024-05-09T06:07:09.569 DEBUG:teuthology.orchestra.run.smithi100:> sudo tar c -f - -C /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/crash -- . 2024-05-09T06:07:09.600 INFO:teuthology.orchestra.run.smithi100.stderr:tar: /var/lib/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/crash: Cannot open: No such file or directory 2024-05-09T06:07:09.601 INFO:teuthology.orchestra.run.smithi100.stderr:tar: Error is not recoverable: exiting now 2024-05-09T06:07:09.602 INFO:tasks.cephadm:Checking cluster log for badness... 2024-05-09T06:07:09.602 DEBUG:teuthology.orchestra.run.smithi039:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-05-09T06:07:09.671 INFO:tasks.cephadm:Compressing logs... 2024-05-09T06:07:09.671 DEBUG:teuthology.orchestra.run.smithi039:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-09T06:07:09.674 DEBUG:teuthology.orchestra.run.smithi060:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-09T06:07:09.677 DEBUG:teuthology.orchestra.run.smithi100:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-09T06:07:09.700 INFO:teuthology.orchestra.run.smithi039.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph.log 2024-05-09T06:07:09.700 INFO:teuthology.orchestra.run.smithi039.stderr:: No such file or directory 2024-05-09T06:07:09.700 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph.audit.log 2024-05-09T06:07:09.700 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph-mds.g.log 2024-05-09T06:07:09.700 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph.log: /var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph-mds.j.log 2024-05-09T06:07:09.700 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph-osd.3.log 2024-05-09T06:07:09.703 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph-osd.0.log 2024-05-09T06:07:09.703 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph-mds.j.log: /var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph-mgr.x.log 2024-05-09T06:07:09.703 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph-mon.a.log 2024-05-09T06:07:09.703 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph-osd.6.log 2024-05-09T06:07:09.703 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph-mon.a.log: 90.5% -- replaced with /var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph.audit.log.gz 2024-05-09T06:07:09.704 INFO:teuthology.orchestra.run.smithi039.stderr: 87.3% -- replaced with /var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph.log.gz 2024-05-09T06:07:09.705 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph.cephadm.log 2024-05-09T06:07:09.706 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph-mds.a.log 2024-05-09T06:07:09.706 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph.cephadm.log: 83.3% -- replaced with /var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph.cephadm.log.gz 2024-05-09T06:07:09.708 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph-volume.log 2024-05-09T06:07:09.708 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph-mds.a.log: 94.7% -- replaced with /var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph-mds.g.log.gz 2024-05-09T06:07:09.708 INFO:teuthology.orchestra.run.smithi039.stderr: 94.7% -- replaced with /var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph-mds.j.log.gz 2024-05-09T06:07:09.708 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph-mds.d.log 2024-05-09T06:07:09.708 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph-osd.9.log 2024-05-09T06:07:09.715 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph-mds.d.log: 94.7% -- replaced with /var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph-mds.a.log.gz 2024-05-09T06:07:09.716 INFO:teuthology.orchestra.run.smithi039.stderr: 94.6% -- replaced with /var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph-mds.d.log.gz 2024-05-09T06:07:09.716 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-05-09T06:07:09.719 INFO:teuthology.orchestra.run.smithi100.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-05-09T06:07:09.719 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph.log 2024-05-09T06:07:09.719 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph-osd.2.log 2024-05-09T06:07:09.719 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph-mds.f.log 2024-05-09T06:07:09.719 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph.log: /var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph.audit.log 2024-05-09T06:07:09.726 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph-osd.9.log: /var/log/ceph/cephadm.log: 91.1% -- replaced with /var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph-volume.log.gz 2024-05-09T06:07:09.726 INFO:teuthology.orchestra.run.smithi039.stderr: 93.6% -- replaced with /var/log/ceph/cephadm.log.gz 2024-05-09T06:07:09.727 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph-osd.5.log 2024-05-09T06:07:09.727 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph-mds.c.log 2024-05-09T06:07:09.727 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph-mon.c.log 2024-05-09T06:07:09.727 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph-mgr.z.log 2024-05-09T06:07:09.727 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph-mds.i.log 2024-05-09T06:07:09.727 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph.cephadm.log 2024-05-09T06:07:09.727 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph-osd.11.log 2024-05-09T06:07:09.727 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph-osd.8.log 2024-05-09T06:07:09.728 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph-volume.log 2024-05-09T06:07:09.728 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph-mds.l.log 2024-05-09T06:07:09.728 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-05-09T06:07:09.729 INFO:teuthology.orchestra.run.smithi060.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-05-09T06:07:09.729 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph.log 2024-05-09T06:07:09.729 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph.audit.log 2024-05-09T06:07:09.729 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph-osd.7.log 2024-05-09T06:07:09.729 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph.log: /var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph-mds.b.log 2024-05-09T06:07:09.729 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph-osd.4.log 2024-05-09T06:07:09.729 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph-osd.1.log 2024-05-09T06:07:09.729 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph-mgr.y.log 2024-05-09T06:07:09.729 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph-mds.h.log 2024-05-09T06:07:09.729 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph-osd.10.log 2024-05-09T06:07:09.729 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph.cephadm.log 2024-05-09T06:07:09.729 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph-mds.e.log 2024-05-09T06:07:09.730 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph-volume.log 2024-05-09T06:07:09.730 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph-mds.e.log: gzip -5 --verbose -- /var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph-mon.b.log 2024-05-09T06:07:09.730 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph-mds.k.log 2024-05-09T06:07:09.730 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-05-09T06:07:09.813 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph-mds.k.log: /var/log/ceph/cephadm.log: 83.3% -- replaced with /var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph.cephadm.log.gz 2024-05-09T06:07:09.863 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph-mds.l.log: /var/log/ceph/cephadm.log: 92.4% -- replaced with /var/log/ceph/cephadm.log.gz 2024-05-09T06:07:09.864 INFO:teuthology.orchestra.run.smithi060.stderr: 93.5% -- replaced with /var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph-mgr.y.log.gz 2024-05-09T06:07:09.893 INFO:teuthology.orchestra.run.smithi060.stderr: 91.1% -- replaced with /var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph-volume.log.gz 2024-05-09T06:07:09.925 INFO:teuthology.orchestra.run.smithi060.stderr: 94.6% -- replaced with /var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph-mds.k.log.gz 2024-05-09T06:07:09.937 INFO:teuthology.orchestra.run.smithi100.stderr: 93.6% -- replaced with /var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph-mgr.z.log.gz 2024-05-09T06:07:09.981 INFO:teuthology.orchestra.run.smithi060.stderr: 92.0% -- replaced with /var/log/ceph/cephadm.log.gz 2024-05-09T06:07:09.984 INFO:teuthology.orchestra.run.smithi060.stderr: 87.4% -- replaced with /var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph.log.gz 2024-05-09T06:07:09.993 INFO:teuthology.orchestra.run.smithi060.stderr: 90.7% -- replaced with /var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph.audit.log.gz 2024-05-09T06:07:10.128 INFO:teuthology.orchestra.run.smithi039.stderr: 90.7% -- replaced with /var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph-mgr.x.log.gz 2024-05-09T06:07:10.139 INFO:teuthology.orchestra.run.smithi100.stderr: 91.1% -- replaced with /var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph-volume.log.gz 2024-05-09T06:07:10.270 INFO:teuthology.orchestra.run.smithi100.stderr: 83.3% -- replaced with /var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph.cephadm.log.gz 2024-05-09T06:07:10.274 INFO:teuthology.orchestra.run.smithi100.stderr: 90.7% -- replaced with /var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph.audit.log.gz 2024-05-09T06:07:10.299 INFO:teuthology.orchestra.run.smithi100.stderr: 94.6% -- replaced with /var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph-mds.l.log.gz 2024-05-09T06:07:10.349 INFO:teuthology.orchestra.run.smithi100.stderr: 87.4% -- replaced with /var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph.log.gz 2024-05-09T06:07:11.643 INFO:teuthology.orchestra.run.smithi039.stderr: 90.2% -- replaced with /var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph-mon.a.log.gz 2024-05-09T06:07:16.966 INFO:teuthology.orchestra.run.smithi100.stderr: 92.1% -- replaced with /var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph-mon.c.log.gz 2024-05-09T06:07:22.645 INFO:teuthology.orchestra.run.smithi039.stderr: 94.0% -- replaced with /var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph-osd.9.log.gz 2024-05-09T06:07:24.266 INFO:teuthology.orchestra.run.smithi039.stderr: 93.8% -- replaced with /var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph-osd.0.log.gz 2024-05-09T06:07:25.473 INFO:teuthology.orchestra.run.smithi039.stderr: 94.1% -- replaced with /var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph-osd.6.log.gz 2024-05-09T06:07:27.277 INFO:teuthology.orchestra.run.smithi039.stderr: 93.9% -- replaced with /var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph-osd.3.log.gz 2024-05-09T06:07:27.279 INFO:teuthology.orchestra.run.smithi039.stderr: 2024-05-09T06:07:27.279 INFO:teuthology.orchestra.run.smithi039.stderr:real 0m17.591s 2024-05-09T06:07:27.279 INFO:teuthology.orchestra.run.smithi039.stderr:user 1m1.104s 2024-05-09T06:07:27.279 INFO:teuthology.orchestra.run.smithi039.stderr:sys 0m2.079s 2024-05-09T06:08:04.355 INFO:teuthology.orchestra.run.smithi100.stderr: 94.2% -- replaced with /var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph-osd.5.log.gz 2024-05-09T06:08:05.417 INFO:teuthology.orchestra.run.smithi060.stderr: 95.2% -- replaced with /var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph-mds.e.log.gz 2024-05-09T06:08:05.464 INFO:teuthology.orchestra.run.smithi060.stderr: 93.5% -- replaced with /var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph-mon.b.log.gz 2024-05-09T06:08:28.349 INFO:teuthology.orchestra.run.smithi100.stderr: 94.6% -- replaced with /var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph-mds.f.log.gz 2024-05-09T06:08:41.173 INFO:teuthology.orchestra.run.smithi100.stderr: 93.9% -- replaced with /var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph-osd.11.log.gz 2024-05-09T06:08:54.085 INFO:teuthology.orchestra.run.smithi100.stderr: 94.2% -- replaced with /var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph-osd.8.log.gz 2024-05-09T06:09:01.113 INFO:teuthology.orchestra.run.smithi100.stderr: 94.2% -- replaced with /var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph-osd.2.log.gz 2024-05-09T06:09:09.879 INFO:teuthology.orchestra.run.smithi100.stderr: 93.6% -- replaced with /var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph-mds.i.log.gz 2024-05-09T06:09:14.856 INFO:teuthology.orchestra.run.smithi060.stderr: 95.5% -- replaced with /var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph-mds.h.log.gz 2024-05-09T06:09:39.177 INFO:teuthology.orchestra.run.smithi100.stderr: 94.1% -- replaced with /var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph-mds.c.log.gz 2024-05-09T06:09:39.179 INFO:teuthology.orchestra.run.smithi100.stderr: 2024-05-09T06:09:39.179 INFO:teuthology.orchestra.run.smithi100.stderr:real 2m29.488s 2024-05-09T06:09:39.179 INFO:teuthology.orchestra.run.smithi100.stderr:user 3m55.729s 2024-05-09T06:09:39.179 INFO:teuthology.orchestra.run.smithi100.stderr:sys 0m9.231s 2024-05-09T06:10:39.490 INFO:teuthology.orchestra.run.smithi060.stderr: 94.1% -- replaced with /var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph-osd.4.log.gz 2024-05-09T06:10:51.789 INFO:teuthology.orchestra.run.smithi060.stderr: 93.9% -- replaced with /var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph-osd.1.log.gz 2024-05-09T06:11:54.147 INFO:teuthology.orchestra.run.smithi060.stderr: 94.1% -- replaced with /var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph-osd.10.log.gz 2024-05-09T06:12:09.251 INFO:teuthology.orchestra.run.smithi060.stderr: 94.1% -- replaced with /var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph-osd.7.log.gz 2024-05-09T06:22:35.236 INFO:teuthology.orchestra.run.smithi060.stderr: 93.2% -- replaced with /var/log/ceph/86d4cc60-0dc4-11ef-bc97-c7b262605968/ceph-mds.b.log.gz 2024-05-09T06:22:35.262 INFO:teuthology.orchestra.run.smithi060.stderr: 2024-05-09T06:22:35.262 INFO:teuthology.orchestra.run.smithi060.stderr:real 15m25.573s 2024-05-09T06:22:35.262 INFO:teuthology.orchestra.run.smithi060.stderr:user 10m56.934s 2024-05-09T06:22:35.262 INFO:teuthology.orchestra.run.smithi060.stderr:sys 0m24.181s 2024-05-09T06:22:35.262 INFO:tasks.cephadm:Archiving logs... 2024-05-09T06:22:35.263 DEBUG:teuthology.misc:Transferring archived files from smithi039:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi/7699118/remote/smithi039/log 2024-05-09T06:22:35.264 DEBUG:teuthology.orchestra.run.smithi039:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-09T06:22:43.927 DEBUG:teuthology.misc:Transferring archived files from smithi060:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi/7699118/remote/smithi060/log 2024-05-09T06:22:43.928 DEBUG:teuthology.orchestra.run.smithi060:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-09T06:24:21.305 DEBUG:teuthology.misc:Transferring archived files from smithi100:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi/7699118/remote/smithi100/log 2024-05-09T06:24:21.324 DEBUG:teuthology.orchestra.run.smithi100:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-09T06:24:56.752 INFO:tasks.cephadm:Removing cluster... 2024-05-09T06:24:56.752 DEBUG:teuthology.orchestra.run.smithi039:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 --force 2024-05-09T06:24:56.957 INFO:teuthology.orchestra.run.smithi039.stdout:Deleting cluster with fsid: 86d4cc60-0dc4-11ef-bc97-c7b262605968 2024-05-09T06:24:57.304 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 --force 2024-05-09T06:24:57.995 INFO:teuthology.orchestra.run.smithi060.stdout:Deleting cluster with fsid: 86d4cc60-0dc4-11ef-bc97-c7b262605968 2024-05-09T06:24:58.767 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 86d4cc60-0dc4-11ef-bc97-c7b262605968 --force 2024-05-09T06:24:58.960 INFO:teuthology.orchestra.run.smithi100.stdout:Deleting cluster with fsid: 86d4cc60-0dc4-11ef-bc97-c7b262605968 2024-05-09T06:24:59.564 INFO:tasks.cephadm:Removing cephadm ... 2024-05-09T06:24:59.564 DEBUG:teuthology.orchestra.run.smithi039:> rm -rf /home/ubuntu/cephtest/cephadm 2024-05-09T06:24:59.589 DEBUG:teuthology.orchestra.run.smithi060:> rm -rf /home/ubuntu/cephtest/cephadm 2024-05-09T06:24:59.608 DEBUG:teuthology.orchestra.run.smithi100:> rm -rf /home/ubuntu/cephtest/cephadm 2024-05-09T06:24:59.625 INFO:tasks.cephadm:Teardown complete 2024-05-09T06:24:59.625 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-05-09T06:24:59.867 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-05-09T06:24:59.868 DEBUG:teuthology.orchestra.run.smithi039:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-09T06:24:59.872 DEBUG:teuthology.orchestra.run.smithi060:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-09T06:24:59.874 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-09T06:24:59.992 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-05-09T06:25:00.748 INFO:teuthology.task.clock:Checking final clock skew... 2024-05-09T06:25:00.748 DEBUG:teuthology.orchestra.run.smithi039:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-09T06:25:00.751 DEBUG:teuthology.orchestra.run.smithi060:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-09T06:25:00.754 DEBUG:teuthology.orchestra.run.smithi100:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-09T06:25:00.767 INFO:teuthology.orchestra.run.smithi039.stderr:bash: line 1: ntpq: command not found 2024-05-09T06:25:00.769 INFO:teuthology.orchestra.run.smithi060.stderr:bash: line 1: ntpq: command not found 2024-05-09T06:25:00.771 INFO:teuthology.orchestra.run.smithi100.stderr:bash: line 1: ntpq: command not found 2024-05-09T06:25:00.772 INFO:teuthology.orchestra.run.smithi039.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-09T06:25:00.772 INFO:teuthology.orchestra.run.smithi039.stdout:=============================================================================== 2024-05-09T06:25:00.772 INFO:teuthology.orchestra.run.smithi039.stdout:^* hv01.front.sepia.ceph.com 3 6 377 0 +1657us[+1524us] +/- 52ms 2024-05-09T06:25:00.772 INFO:teuthology.orchestra.run.smithi039.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 63 -1197us[-1329us] +/- 74ms 2024-05-09T06:25:00.773 INFO:teuthology.orchestra.run.smithi039.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 62 -1332us[-1464us] +/- 61ms 2024-05-09T06:25:00.773 INFO:teuthology.orchestra.run.smithi039.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T06:25:00.776 INFO:teuthology.orchestra.run.smithi100.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-09T06:25:00.776 INFO:teuthology.orchestra.run.smithi100.stdout:=============================================================================== 2024-05-09T06:25:00.776 INFO:teuthology.orchestra.run.smithi100.stdout:^* hv01.front.sepia.ceph.com 3 6 377 64 +1564us[+1577us] +/- 51ms 2024-05-09T06:25:00.776 INFO:teuthology.orchestra.run.smithi100.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 3 -1268us[-1268us] +/- 75ms 2024-05-09T06:25:00.776 INFO:teuthology.orchestra.run.smithi100.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 61 -1436us[-1436us] +/- 61ms 2024-05-09T06:25:00.776 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T06:25:00.855 INFO:teuthology.orchestra.run.smithi060.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-09T06:25:00.855 INFO:teuthology.orchestra.run.smithi060.stdout:=============================================================================== 2024-05-09T06:25:00.855 INFO:teuthology.orchestra.run.smithi060.stdout:^* hv01.front.sepia.ceph.com 3 6 377 0 +1701us[+1572us] +/- 52ms 2024-05-09T06:25:00.855 INFO:teuthology.orchestra.run.smithi060.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 63 -1166us[-1297us] +/- 74ms 2024-05-09T06:25:00.855 INFO:teuthology.orchestra.run.smithi060.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 63 -1289us[-1420us] +/- 61ms 2024-05-09T06:25:00.855 INFO:teuthology.orchestra.run.smithi060.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T06:25:00.857 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-05-09T06:25:01.119 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-05-09T06:25:01.120 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-05-09T06:25:01.275 DEBUG:teuthology.orchestra.run.smithi039:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-09T06:25:01.361 DEBUG:teuthology.orchestra.run.smithi060:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-09T06:25:01.493 DEBUG:teuthology.orchestra.run.smithi100:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-09T06:25:01.701 DEBUG:teuthology.orchestra.run.smithi039:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-09T06:25:01.737 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T06:25:01.738 DEBUG:teuthology.orchestra.run.smithi060:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-09T06:25:01.770 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T06:25:01.771 DEBUG:teuthology.orchestra.run.smithi100:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-09T06:25:01.799 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T06:25:01.800 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-05-09T06:25:01.812 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-05-09T06:25:01.822 INFO:teuthology.task.internal:Duration was 3957.471724 seconds 2024-05-09T06:25:01.823 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-05-09T06:25:01.833 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-05-09T06:25:01.833 DEBUG:teuthology.orchestra.run.smithi039:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-09T06:25:01.836 DEBUG:teuthology.orchestra.run.smithi060:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-09T06:25:01.839 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-09T06:25:01.882 INFO:teuthology.orchestra.run.smithi039.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-09T06:25:01.903 INFO:teuthology.orchestra.run.smithi100.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-09T06:25:01.924 INFO:teuthology.orchestra.run.smithi060.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-09T06:25:02.211 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-05-09T06:25:02.211 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi039.front.sepia.ceph.com 2024-05-09T06:25:02.211 DEBUG:teuthology.orchestra.run.smithi039:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-09T06:25:02.237 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi060.front.sepia.ceph.com 2024-05-09T06:25:02.238 DEBUG:teuthology.orchestra.run.smithi060:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-09T06:25:02.271 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi100.front.sepia.ceph.com 2024-05-09T06:25:02.271 DEBUG:teuthology.orchestra.run.smithi100:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-09T06:25:02.310 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-05-09T06:25:02.310 DEBUG:teuthology.orchestra.run.smithi039:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-09T06:25:02.313 DEBUG:teuthology.orchestra.run.smithi060:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-09T06:25:02.316 DEBUG:teuthology.orchestra.run.smithi100:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-09T06:25:02.377 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-05-09T06:25:02.377 DEBUG:teuthology.orchestra.run.smithi039:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-09T06:25:02.386 DEBUG:teuthology.orchestra.run.smithi060:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-09T06:25:02.393 DEBUG:teuthology.orchestra.run.smithi100:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-09T06:25:02.912 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-05-09T06:25:02.924 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-05-09T06:25:02.924 DEBUG:teuthology.orchestra.run.smithi039:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-09T06:25:02.950 DEBUG:teuthology.orchestra.run.smithi060:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-09T06:25:02.999 DEBUG:teuthology.orchestra.run.smithi100:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-09T06:25:03.039 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-05-09T06:25:03.050 DEBUG:teuthology.orchestra.run.smithi039:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-09T06:25:03.053 DEBUG:teuthology.orchestra.run.smithi060:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-09T06:25:03.055 DEBUG:teuthology.orchestra.run.smithi100:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-09T06:25:03.075 INFO:teuthology.orchestra.run.smithi039.stdout:kernel.core_pattern = core 2024-05-09T06:25:03.096 INFO:teuthology.orchestra.run.smithi060.stdout:kernel.core_pattern = core 2024-05-09T06:25:03.110 INFO:teuthology.orchestra.run.smithi100.stdout:kernel.core_pattern = core 2024-05-09T06:25:03.139 DEBUG:teuthology.orchestra.run.smithi039:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-09T06:25:03.155 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T06:25:03.156 DEBUG:teuthology.orchestra.run.smithi060:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-09T06:25:03.194 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T06:25:03.195 DEBUG:teuthology.orchestra.run.smithi100:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-09T06:25:03.209 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T06:25:03.209 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-05-09T06:25:03.222 INFO:teuthology.task.internal:Transferring archived files... 2024-05-09T06:25:03.223 DEBUG:teuthology.misc:Transferring archived files from smithi039:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi/7699118/remote/smithi039 2024-05-09T06:25:03.223 DEBUG:teuthology.orchestra.run.smithi039:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-09T06:25:03.275 DEBUG:teuthology.misc:Transferring archived files from smithi060:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi/7699118/remote/smithi060 2024-05-09T06:25:03.275 DEBUG:teuthology.orchestra.run.smithi060:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-09T06:25:03.314 DEBUG:teuthology.misc:Transferring archived files from smithi100:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-05-08_22:06:20-fs-wip-pdonnell-testing-20240508.183908-debug-distro-default-smithi/7699118/remote/smithi100 2024-05-09T06:25:03.315 DEBUG:teuthology.orchestra.run.smithi100:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-09T06:25:03.352 INFO:teuthology.task.internal:Removing archive directory... 2024-05-09T06:25:03.352 DEBUG:teuthology.orchestra.run.smithi039:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-09T06:25:03.354 DEBUG:teuthology.orchestra.run.smithi060:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-09T06:25:03.357 DEBUG:teuthology.orchestra.run.smithi100:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-09T06:25:03.400 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-05-09T06:25:03.412 INFO:teuthology.task.internal:Not uploading archives. 2024-05-09T06:25:03.412 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-05-09T06:25:03.423 INFO:teuthology.task.internal:Tidying up after the test... 2024-05-09T06:25:03.423 DEBUG:teuthology.orchestra.run.smithi039:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-09T06:25:03.426 DEBUG:teuthology.orchestra.run.smithi060:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-09T06:25:03.428 DEBUG:teuthology.orchestra.run.smithi100:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-09T06:25:03.439 INFO:teuthology.orchestra.run.smithi039.stdout: 265305 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 9 06:25 /home/ubuntu/cephtest 2024-05-09T06:25:03.440 INFO:teuthology.orchestra.run.smithi060.stdout: 262161 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 9 06:25 /home/ubuntu/cephtest 2024-05-09T06:25:03.454 INFO:teuthology.orchestra.run.smithi100.stdout: 262161 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 9 06:25 /home/ubuntu/cephtest 2024-05-09T06:25:03.455 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-05-09T06:25:03.468 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-05-09T06:25:03.498 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/no 5-quiesce/no 6-workunit/suites/dbench}} duration: 3957.4717240333557 flavor: default owner: scheduled_pdonnell@teuthology success: true 2024-05-09T06:25:03.498 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-09T06:25:03.584 INFO:teuthology.run:pass